Interaction method and electronic equipment

Abstract

The invention provides an interaction method and electronic equipment, the method is applied to the electronic equipment, the electronic equipment comprises a virtual key, the virtual key is used for detecting a pressing operation of a user, the electronic equipment displays a first interface, and the method comprises the following steps: detecting a first pressing operation of the user for the virtual key, and determining a first pressing force and a first pressing duration; determining a first function according to the first interface, the first pressing force and the first pressing duration; and in response to the first pressing operation, executing a first function. The electronic equipment is provided with the virtual key, and the corresponding function can be executed according to the displayed interface, the force of pressing the virtual key by the user and the duration of pressing the virtual key, so that the operation efficiency of the user is improved, the interactivity is enhanced, and the improvement of the user experience is facilitated.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of electronic devices, and more specifically, to an interaction method and an electronic device. Background Art

[0002] With the continuous advancement of technology, users have higher and higher requirements for electronic devices. In order to obtain a thinner and lighter body and better enclosure, electronic devices tend to reduce internal structural parts and develop in the direction of an integrated body. For example, the 3.5mm headphone jack originally configured on electronic devices can be replaced by Bluetooth headphones, or share the interface with the charging port. At present, some electronic devices use virtual buttons instead of physical buttons (also called physical buttons), which improves the degree of body integration. However, the current interaction method of virtual buttons is single, the application scenario is single, and the role of virtual buttons is not fully utilized. Summary of the invention

[0003] The present application provides an interactive method and an electronic device, wherein the electronic device has virtual buttons, and can execute corresponding functions according to the displayed interface, the force with which the user presses the virtual buttons, and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0004] In a first aspect, an interaction method is provided, which is applied to an electronic device, wherein the electronic device includes a virtual key, which is used to detect a user's pressing operation, and the electronic device displays a first interface. The method includes: detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing duration; determining a first function based on the first interface, the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0005] In an embodiment of the present application, the electronic device has virtual buttons and can execute corresponding functions according to the displayed interface, the force with which the user presses the virtual buttons, and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0006] In combination with the first aspect, in certain implementations of the first aspect, the first interface is a main screen interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a system volume adjustment function.

[0007] In the embodiment of the present application, the electronic device can display a parameter adjustment bar according to the strength and time of the user pressing the virtual key, so that the user can operate conveniently.

[0008] In combination with the first aspect, in certain implementations of the first aspect, the virtual key is also used to detect a sliding gesture of the user, and the method further includes: in response to a first sliding gesture of the user on the virtual key, switching from the first function to a second function, wherein the direction of the first sliding gesture is the thickness direction of the electronic device, and the second function is one of a brightness adjustment function, a microphone volume adjustment function, a speaker volume adjustment function, a message alert tone volume adjustment function, a screen display mode adjustment function, and an incoming call ring volume adjustment function.

[0009] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time the user presses the virtual button, so that the user can operate conveniently, and the gesture for switching the parameter bar is simple, which conforms to daily usage habits and can enhance the user experience.

[0010] In combination with the first aspect, in certain implementations of the first aspect, the virtual key is also used to detect a sliding gesture of the user, and the method further includes: adjusting the system volume in response to a second sliding gesture of the user on the virtual key, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0011] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time the user presses the virtual button, so that the user can operate conveniently, and the gesture for switching the parameter bar is simple, which conforms to daily usage habits and can enhance the user experience.

[0012] In combination with the first aspect, in certain implementations of the first aspect, the first interface is a main screen interface, and when the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

[0013] In an embodiment of the present application, the electronic device can activate the voice assistant according to the force and time when the user presses the virtual button, so that the user can operate conveniently and improve the user experience.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the first interface is a photo taking interface, and when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

[0015] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: detecting a second press operation of the user on the virtual key, determining a second press strength and a second press duration; when the second press strength is less than the first threshold and the second press duration is greater than or equal to the second threshold, in response to the second press operation, displaying a focus frame, which is used to identify the first object.

[0016] In combination with the first aspect, in certain implementations of the first aspect, the virtual key is also used to detect a sliding gesture of the user, and the method further includes: in response to a second sliding gesture of the user on the virtual key, switching the first object in the focus frame to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0017] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: in response to the user's continuous pressing operation on the virtual key, locking the focus frame and the first object, wherein the pressing force of the continuous pressing operation is less than the first threshold.

[0018] In combination with the first aspect, in some implementations of the first aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0019] In combination with the first aspect, in certain implementations of the first aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

[0020] In combination with the first aspect, in some implementations of the first aspect, when the first pressing force is less than the first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0021] In combination with the first aspect, in certain implementations of the first aspect, the virtual button is also used to detect a sliding gesture of the user, and the method further includes: in response to the user's operation of adjusting the parameter, displaying an adjustment bar for a first parameter; in response to the user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, switching the adjustment bar for the first parameter to an adjustment bar for the second parameter, and if the direction of the sliding gesture is the length direction of the electronic device, adjusting the first parameter.

[0022] In an embodiment of the present application, when the electronic device is running a camera application, it can adjust the shooting parameters and switch the parameter adjustment bar according to the sliding direction of the user on the virtual button, so that the user can operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, which conforms to daily usage habits and can enhance the user experience.

[0023] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: detecting that at least two of the four edge areas of the screen are touched, and also detecting the user's third press operation on the virtual key, determining a third press strength and a third press duration of the third press operation; when the third press strength is greater than or equal to the first threshold and less than or equal to the third threshold, starting the camera and performing autofocus; when the third press strength is first greater than the third threshold and then less than the first threshold, starting the camera and taking a photo; when the third press strength is greater than the third threshold and the third press duration is greater than the second threshold, starting the camera and recording a video.

[0024] In the implementation of this application, the electronic device can respond to the user's operation on the virtual button when displaying the interface of the non-camera application, enter the camera application, and execute the corresponding function according to the pressing force and pressing duration of the virtual button, so that the functions of taking pictures and recording videos can be performed quickly, which helps to improve the user experience.

[0025] In a second aspect, an interaction method is provided, which is applied to an electronic device, wherein the electronic device includes a virtual key, which is used to detect a user's pressing operation, and the electronic device displays a first interface, which is a photo taking interface. The method includes: detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing duration; determining a first function based on the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0026] In combination with the second aspect, in some implementations of the second aspect, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0027] In combination with the second aspect, in certain implementations of the second aspect, the method also includes: detecting a second press operation of the user on the virtual key, determining a second press strength and a second press duration; when the second press strength is less than the first threshold and the second press duration is greater than or equal to the second threshold, in response to the second press operation, displaying a focus frame, wherein the focus frame is used to identify the first object.

[0028] In combination with the second aspect, in certain implementations of the second aspect, the virtual key is also used to detect a sliding gesture of the user, and the method further includes: in response to a second sliding gesture of the user on the virtual key, switching the first object in the focus frame to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0029] In combination with the second aspect, in certain implementations of the second aspect, the method further includes: in response to the user's continuous pressing operation on the virtual key, locking the focus frame and the first object, wherein the pressing force of the continuous pressing operation is less than the first threshold.

[0030] In combination with the second aspect, in some implementations of the second aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0031] In combination with the second aspect, in certain implementations of the second aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

[0032] In combination with the second aspect, in some implementations of the second aspect, when the first pressing force is less than the first threshold and the first pressing duration is greater than the second threshold, the first function is to display a viewfinder.

[0033] In combination with the second aspect, in certain implementations of the second aspect, the virtual button is also used to detect a sliding gesture of the user, and the method further includes: in response to the user's operation of adjusting the parameter, displaying an adjustment bar for a first parameter; in response to the user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, switching the adjustment bar for the first parameter to an adjustment bar for the second parameter, and if the direction of the sliding gesture is the length direction of the electronic device, adjusting the first parameter.

[0034] In a third aspect, an interaction method is provided, which is applied to an electronic device, the electronic device including a virtual key, the virtual key being used to detect a user's pressing operation, the electronic device displaying a first interface, the first interface being an interface of a non-camera application, the method comprising: detecting that at least two of four edge areas of the screen are touched, and also detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing duration; starting a camera application, and determining a first function based on the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0035] In combination with the third aspect, in certain implementations of the third aspect, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0036] In combination with the third aspect, in certain implementations of the third aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0037] In combination with the third aspect, in certain implementations of the third aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

[0038] In a fourth aspect, a computer-readable storage medium is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0039] In a fifth aspect, a computer program product is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0040] In a sixth aspect, a computer program is provided, which, when executed on a computer, enables the method in the first aspect and any possible implementation thereof to be executed.

[0041] The seventh aspect is an electronic device of an embodiment of the present application, which includes modules / units for executing the above aspects or any possible design method of the above aspects; these modules / units can be implemented by hardware, or the corresponding software can be implemented by hardware.

[0042] The eighth aspect is a chip of an embodiment of the present application, which is coupled to a memory in an electronic device and is used to call a computer program stored in the memory and execute the above-mentioned aspects of the embodiment of the present application and any possible design of the above-mentioned aspects of the embodiment of the present application; "coupling" in the embodiment of the present application refers to the direct or indirect combination of two components with each other.

[0043] The ninth aspect is a graphical user interface on an electronic device of an embodiment of the present application, the electronic device having a display screen, one or more memories, and one or more processors, the one or more processors being used to execute one or more computer programs stored in the one or more memories, the graphical user interface including a graphical user interface displayed when the electronic device executes the above aspect and any possible design technical solution of the above aspect.

[0044] The tenth aspect is an electronic device of an embodiment of the present application, which includes one or more processors; one or more memories; the one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the above aspects or any possible implementation method of the above aspects is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1It is a schematic diagram of the configuration of virtual keys provided in an embodiment of the present application.

[0046] Figure 2 This is a schematic diagram of another form of setting virtual keys provided in an embodiment of the present application.

[0047] Figure 3 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0048] Figure 4 It is a software structure block diagram of the electronic device according to an embodiment of the present application.

[0049] Figure 5 It is a set of GUIs provided by the embodiments of the present application.

[0050] Figure 6 This is another set of GUIs provided by an embodiment of the present application.

[0051] Figure 7 This is another set of GUIs provided by an embodiment of the present application.

[0052] Figure 8 This is another set of GUIs provided by an embodiment of the present application.

[0053] Fig. 9 This is another set of GUIs provided by an embodiment of the present application.

[0054] Fig.10 This is another set of GUIs provided by an embodiment of the present application.

[0055] Fig.11 This is another set of GUIs provided by an embodiment of the present application.

[0056] Fig.12 It is a schematic flow chart of the interaction method provided in the embodiment of the present application.

[0057] Fig.13 It is a schematic flow chart of the interaction method provided in the embodiment of the present application.

[0058] Fig.14 It is a schematic flow chart of the interaction method provided in the embodiment of the present application.

[0059] Fig.15 It is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0061] The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0062] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0063] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication function (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer, etc. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer.

[0064] The electronic device is provided with virtual buttons, which specifically means that the electronic device is provided with touch sensors and pressure sensors. For example, the touch sensors and pressure sensors can be set at the positions where physical buttons need to be set on the electronic device. The electronic device can use the touch effect of the touch sensor and the piezoelectric effect of the pressure sensor to detect the pressing operation input by the user, so as to realize the related functions of physical buttons such as locking the screen and adjusting the volume. In this way, the physical buttons set on the surface of the electronic device can be reduced, making the appearance of the electronic device more beautiful. In other embodiments, such buttons can also be called touch buttons and the like, which is not limited in the embodiments of the present application.

[0065] For example, if the electronic device is a mobile phone, the virtual button can be set on the side frame (such as the left frame or the right frame) of the mobile phone. Among them, one or more touch sensors and one or more pressure sensors can be set on the side frame of the mobile phone.

[0066] For example, with the virtual key set Figure 1 Take the right side frame of the mobile phone 10 shown in (a) as an example. Figure 1 (b) in FIG. 1 shows the distribution of touch sensors and pressure sensors used to implement virtual keys. Figure 1 As shown in (b), a touch sensor and a pressure sensor 110 are provided in a preset area 101 of the right side frame of the mobile phone 10, and a touch sensor and a pressure sensor 120 are provided in a preset area 102. The pressure sensor 110 is provided at a lower layer of the touch sensor in the preset area 101, and the pressure sensor 120 is provided at a lower layer of the touch sensor in the preset area 102.

[0067] In some embodiments, the touch sensor provided in the preset area 101 and the preset area 102 may be the same touch sensor. That is, a touch sensor (referred to as touch sensor 1) may be provided on the right side frame of the mobile phone 10, and the touch sensor 1 is provided in the preset area 101 and the preset area 102 of the right side frame. Of course, the touch sensor 1 may also be provided on the entire right side frame of the mobile phone 10, and the embodiment of the present application is not limited to this.

[0068] In some embodiments, the touch sensor and the pressure sensor can be integrated into one sensor. The sensor can be set in the preset area 101 and the preset area 102 of the right side frame. Of course, the sensor can also be set in the entire right side frame of the mobile phone 10, and the embodiment of the present application is not limited to this.

[0069] In some embodiments, if the mobile phone 10 is a curved screen mobile phone, the touch sensor corresponding to the virtual key and the touch sensor in the touch screen of the mobile phone 10 may be integrated, that is, the touch sensor of the virtual key is the touch sensor in the touch screen of the mobile phone 10. If the touch screen of the mobile phone 10 is a flat screen mobile phone, the touch sensor of the virtual key is a touch sensor independent of the touch screen of the mobile phone 10, that is, the touch sensor of the virtual key is different from the touch sensor in the touch screen of the mobile phone 10.

[0070] In other embodiments, the touch sensors provided in the preset area 101 and the preset area 102 may be at least two touch sensors. For example, if the mobile phone 10 is a flat screen mobile phone, the preset area 101 and the preset area 102 of the right frame of the mobile phone 10 may each be provided with a touch sensor.

[0071] For example, the touch button is set to Figure 2 Take the right side frame of the mobile phone 20 shown in (a) as an example. Figure 2 (b) in FIG. 1 shows the distribution of touch sensors and pressure sensors used to implement touch-press keys. Figure 2 As shown in (b), a touch sensor is provided in the preset area 201 of the right frame of the mobile phone 20, a touch sensor is provided in the preset area 202, and a pressure sensor 210 is provided at the junction of the preset area 201 and the preset area 202. The pressure sensor 210 is provided at the lower layer of the touch sensors of the preset area 201 and the preset area 202.

[0072] Exemplarily, the position of the pressure sensor 210 on the right side frame of the mobile phone 20 can be set with reference to the position of physical buttons (such as the "volume +" key and the "volume -" key) on the side frame of the mobile phone. For example, the pressure sensor 210 can be set in the middle of the position of the "volume +" key on the side frame of the mobile phone and the position of the "volume -" key on the side frame of the mobile phone. The preset area 201 is on the right side frame of the mobile phone 20, above the position of the pressure sensor 210. The preset area 202 is on the right side frame of the mobile phone 20, below the position of the pressure sensor 210. Among them, the sizes of the preset area 201 and the preset area 202 are pre-configured in the mobile phone 20.

[0073] In some embodiments, the touch sensor provided on the preset area 201 and the touch sensor provided on the preset area 202 may be the same touch sensor.

[0074] In some other embodiments, the touch sensors provided on the preset area 201 and the preset area 202 may be at least two touch sensors.

[0075] Exemplarily, the pressure sensors (such as pressure sensor 110, pressure sensor 120 and pressure sensor 210) in the embodiments of the present application may be piezoelectric pressure sensors. For example, the piezoelectric pressure sensor may be a piezoelectric ceramic sensor. Compared with other pressure sensors, the piezoelectric ceramic sensor has higher sensitivity.

[0076] Of course, touch buttons can be set on both side frames (such as the left frame and the right frame) of the mobile phone. That is, one or more pressure sensors and one or more touch sensors (not shown in the drawings) can be set on the left frame and the right frame of the mobile phone to realize the function of the touch button.

[0077] The above describes the structure of the electronic device for implementing the corresponding virtual keys. The following describes the internal structure of the electronic device.

[0078] Figure 3 The structure diagram of the electronic device 300 is shown. The electronic device 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, a button 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395. The sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0079] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0080] The processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0081] The controller may be the nerve center and command center of the electronic device 300. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0082] The processor 310 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory may store instructions or data that the processor 310 has just used or cyclically used. If the processor 310 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0083] In some embodiments, the processor 310 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0084] The wireless communication function of the electronic device 300 can be implemented through the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor and the baseband processor.

[0085] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0086] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 300. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves from the antenna 3, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 3. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the same device as at least some of the modules of the processor 310.

[0087] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 370A, a receiver 370B, etc.), or displays an image or video through a display screen 394. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 310 and be set in the same device as the mobile communication module 350 or other functional modules.

[0088] The wireless communication module 360 ​​can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 300. The wireless communication module 360 ​​can be one or more devices integrating at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 310. The wireless communication module 360 ​​can also receive the signal to be sent from the processor 310, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0089] In some embodiments, the antenna 3 of the electronic device 300 is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the electronic device 300 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0090] The electronic device 300 implements the display function through a GPU, a display screen 394, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 310 may include one or more GPUs, which execute program instructions to generate or change display information.

[0091] The display screen 394 is used to display images, videos, etc. The display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 300 may include 1 or N display screens 394, where N is a positive integer greater than 1.

[0092] The electronic device 300 can realize the shooting function through ISP, camera 393, video codec, GPU, display screen 394 and application processor.

[0093] The ISP is used to process the data fed back by the camera 393. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 393.

[0094] The camera 393 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 300 may include 1 or N cameras 393, where N is a positive integer greater than 1.

[0095] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 300 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0096] Video codecs are used to compress or decompress digital videos. The electronic device 300 may support one or more video codecs. Thus, the electronic device 300 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0097] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 300 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0098] The external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 300. The external memory card communicates with the processor 310 through the external memory interface 320 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0099] The internal memory 321 can be used to store computer executable program codes, which include instructions. The processor 310 executes various functional applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 321. The internal memory 321 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 300 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0100] The electronic device 300 can implement audio functions such as music playing and recording through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the headphone jack 370D, and the application processor.

[0101] The audio module 370 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 370 can also be used to encode and decode audio signals. In some embodiments, the audio module 370 can be arranged in the processor 310, or some functional modules of the audio module 370 can be arranged in the processor 310.

[0102] The speaker 370A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 300 can listen to music or listen to a hands-free call through the speaker 170A.

[0103] The receiver 370B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 300 receives a call or voice message, the voice can be received by placing the receiver 370B close to the human ear.

[0104] Microphone 370C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 370C to input the sound signal into the microphone 370C. The electronic device 300 can be provided with at least one microphone 370C. In other embodiments, the electronic device 300 can be provided with two microphones 370C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 300 can also be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0105] The pressure sensor 380A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 380A can be set on the display screen 394. There are many types of pressure sensors 380A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 380A, the capacitance between the electrodes changes. The electronic device 300 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 394, the electronic device 300 detects the touch operation intensity according to the pressure sensor 380A. The electronic device 300 can also calculate the touch position based on the detection signal of the pressure sensor 380A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the alarm application icon, the instruction to create a new alarm is executed.

[0106] The fingerprint sensor 380H is used to collect fingerprints. The electronic device 300 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc. For example, when the mobile phone detects a user's touch operation on the lock screen interface, the mobile phone can collect the user's fingerprint information through the fingerprint sensor 380H, and match the collected fingerprint information with the fingerprint information preset in the mobile phone. If the match is successful, the mobile phone can enter the non-lock screen interface from the lock screen interface.

[0107] The touch sensor 380K is also called a "touch panel". The touch sensor 380K can be set on the display screen 394, and the touch sensor 380K and the display screen 394 form a touch screen, also called a "touch screen". The touch sensor 380K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 394. In other embodiments, the touch sensor 380K can also be set on the surface of the electronic device 300, which is different from the position of the display screen 394.

[0108] Figure 4 3 is a software structure diagram of the electronic device 300 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, respectively, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.

[0109] like Figure 4 As shown, the application layer may include camera, settings, and third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0110] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions.

[0111] like Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0112] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0113] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc., such as the indication information for prompting a virtual shutter key in the embodiment of the present application. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures.

[0114] The phone manager is used to provide communication functions of the electronic device 300, such as management of call status (including connecting, hanging up, etc.).

[0115] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0116] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0117] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0118] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0119] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0120] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0121] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0122] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0123] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0124] A 2D graphics engine is a drawing engine for 2D drawings.

[0125] In addition, the system library may also include status monitoring service modules, such as a physical status recognition module for analyzing and identifying user gestures; a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0126] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0127] The hardware layer can include various types of sensors, such as Figure 1-Figure 3 The various types of sensors introduced in the present application include acceleration sensors, gyroscope sensors, touch sensors, etc.

[0128] With the continuous advancement of technology, users have higher and higher requirements for electronic devices. In order to obtain a thinner and lighter body and better enclosure, electronic devices tend to reduce internal structural parts and develop in the direction of an integrated body. For example, the 3.5mm headphone jack originally configured on electronic devices can be replaced by Bluetooth headphones, or share the interface with the charging port. At present, some electronic devices use virtual buttons instead of physical buttons (also called physical buttons), which improves the degree of body integration. However, the current interaction method of virtual buttons is single, the application scenario is single, and the role of virtual buttons is not fully utilized.

[0129] Before introducing the embodiments of the present application, several possible application scenarios associated with virtual keys involved in the embodiments of the present application are first introduced.

[0130] 1. Adjust system parameters on the main screen.

[0131] When displaying the main screen interface, the electronic device can respond to the user's operation on the virtual buttons and adjust the system parameters.

[0132] Exemplarily, the system parameters may include volume and brightness.

[0133] Exemplarily, the main screen interface may be a desktop, a negative one screen, or the like.

[0134] 2. Adjust system parameters through the application interface.

[0135] When displaying some application program interfaces, the electronic device can adjust system parameters in response to user operations on virtual keys.

[0136] For example, when the electronic device displays the interface of a music application, it detects the user's operation on a virtual key and can adjust the volume in response to the operation.

[0137] For another example, when the electronic device displays the interface of a call application and detects a user's operation on a virtual key, the electronic device can adjust the volume in response to the operation.

[0138] 3. Adjust application parameters in the application interface.

[0139] When displaying the interface of some application programs, the electronic device can adjust the application program parameters corresponding to the application program in response to the user's operation on the virtual key. The application program parameters can be understood as the parameters corresponding to the application program when executing a certain function.

[0140] Exemplarily, taking a camera application as an example, the camera application parameters may include focal length, sensitivity (ISO), and the like.

[0141] 4. Launch the application.

[0142] The electronic device can start application #1 in response to the user's operation on the virtual key. In this application scenario, before starting application #1, the electronic device can be in a locked screen state, or can be in a state where application #2 is running in the foreground, or can be in a state where the main screen interface is displayed.

[0143] For example, when the electronic device is in a locked screen state, an operation of a user on a virtual key is detected, and a camera application can be started in response to the operation.

[0144] For another example, when the electronic device displays the desktop, it detects the user's operation on a virtual key, and in response to the operation, it can start a camera application.

[0145] For another example, when the electronic device displays the interface of a gallery application, it detects a user operation on a virtual key and, in response to the operation, may start a camera application.

[0146] The above introduces several possible scenarios involved in the embodiments of the present application. The following will introduce the interaction method provided in the embodiments of the present application in conjunction with a graphical user interface (GUI).

[0147] Figure 5 A set of GUIs provided by an embodiment of the present application is shown.

[0148] like Figure 5 As shown in (a) of FIG. 5 , the electronic device displays an interface 501, which is a desktop. When the electronic device displays the interface 501, it detects that the user presses a virtual key, and can determine the user's pressing force and pressing duration. When it is determined that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, the electronic device displays the following: Figure 5 GUI shown in (b) in .

[0149] It should be noted that the virtual keys in the figure protrude relative to the frame of the electronic device only to facilitate identification of the virtual keys. In actual electronic devices, the sensing area of ​​the virtual keys is part of the frame and does not protrude from the frame.

[0150] It should be noted that, in the embodiment of the present application, only the interface 501 is the desktop as an example, and the specific limitation of the embodiment of the present application should not be understood. For example, the interface 501 can also be a negative one screen interface, a setting interface, a lock screen interface, etc.

[0151] In the embodiment of the present application, the desktop, negative one screen interface, and lock screen interface may be collectively referred to as the main screen interface.

[0152] like Figure 5 As shown in (b) of FIG. 5 , when the electronic device determines that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, in response to the user pressing the virtual key, the system volume adjustment bar 502 is displayed. Since the virtual key can detect the user's sliding gesture, the electronic device can perform different functions according to the direction of the user's sliding gesture. When the electronic device detects that the direction of the user's sliding gesture is the thickness direction of the electronic device, the system volume adjustment bar can be switched to an adjustment bar for other parameters, see Figure 5 When the electronic device detects that the direction of the user's sliding gesture is the length direction of the electronic device, the parameters can be adjusted, see Figure 5 (d) in.

[0153] It should be noted that the embodiment of the present application only takes the case where the pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold, and the electronic device displays a system volume adjustment bar as an example, but this should not be understood as a limitation on the embodiment of the present application. In other embodiments of the present application, when the pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold, the electronic device may also display adjustment bars for other parameters, such as a speaker volume adjustment bar, a message alert tone volume adjustment bar, etc.

[0154] like Figure 5 As shown in (c) in FIG. 1 , when the electronic device determines that the sliding direction of the user is the thickness direction, the system volume adjustment bar 502 can be switched to the brightness adjustment bar 503 .

[0155] It is understandable that when the user continues to slide in the direction of the thickness of the electronic device, the electronic device can also switch the brightness adjustment bar 503 to adjustment bars for other parameters, such as a speaker volume adjustment bar, a message alert tone volume adjustment bar, etc.

[0156] It can also be understood that after the electronic device switches the system volume adjustment bar 502 to the brightness adjustment bar 503 , and then detects a user sliding gesture in the opposite direction, the brightness adjustment bar 503 can be switched to the system volume adjustment bar 502 again.

[0157] It should be noted that the embodiment of the present application only takes the example that when the electronic device determines that the user's sliding direction is the direction of its thickness, the system volume adjustment bar 502 can be switched to the brightness adjustment bar 503, but this should not be understood as a limitation on the embodiment of the present application. In other embodiments of the present application, when the electronic device determines that the user's sliding direction is the direction of its thickness, the electronic device can switch the system volume adjustment bar 502 to the message alert tone volume adjustment bar.

[0158] like Figure 5 As shown in (d) in FIG. 1 , when the electronic device determines that the sliding direction of the user is the length direction of the electronic device, the system volume can be adjusted. For example, if the sliding direction of the user is upward, the electronic device can increase the system volume, and if the sliding direction of the user is downward, the electronic device can decrease the system volume.

[0159] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the force and time the user presses the virtual button, so that the user can operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, which conforms to daily usage habits and can enhance the user experience.

[0160] Figure 6 Another set of GUIs provided by an embodiment of the present application is shown.

[0161] like Figure 6As shown in (a) of FIG. 6 , the electronic device displays an interface 601, which is an interface of a music application. When the electronic device displays the interface 601, it detects that the user presses a virtual key, and can determine the user's pressing force and pressing duration. When it is determined that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, the electronic device displays the following information: Figure 6 GUI shown in (b) in .

[0162] like Figure 6 As shown in (b) of FIG. 1 , when the electronic device determines that the user's pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold, in response to the user pressing the virtual key, Figure 5 The difference from (b) is that, since the electronic device displays the interface of the music application, the electronic device can display the volume adjustment bar 602 of the music application.

[0163] It should be understood that if interface 601 is an interface of a video application, the electronic device may display a volume adjustment bar of the video application.

[0164] It should also be understood that the electronic device can also switch the volume adjustment bar 602 of the music application or adjust the volume of the music application in response to the user's sliding gesture. For a specific description, see Figure 5 For the sake of brevity, the description is not repeated here.

[0165] contrast Figure 5 and Figure 6 It can be seen that when the electronic device displays the parameter adjustment bar, different parameter adjustment bars can be displayed according to different interfaces.

[0166] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the force and time the user presses the virtual button, so that the user can operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, which conforms to daily usage habits and can enhance the user experience.

[0167] Figure 7 Another set of GUIs provided by an embodiment of the present application is shown.

[0168] like Figure 7 As shown in (a) of FIG. 7 , the electronic device displays an interface 701, which is a desktop. When the electronic device displays the interface 701, it detects that the user presses a virtual key, and can determine the user's pressing force and pressing duration. When it is determined that the user's pressing force is greater than or equal to a second threshold and the pressing duration is greater than or equal to the second threshold, the electronic device displays the following: Figure 7 GUI shown in (b) in .

[0169] like Figure 7As shown in (b), when the electronic device determines that the user's pressing force is greater than or equal to the first threshold and the pressing duration is greater than or equal to the second threshold, in response to the user pressing the virtual key, the voice assistant is started and the voice assistant bar 702 is displayed.

[0170] It should be noted that, in some other embodiments, interface 701 may also be a negative one screen or a lock screen interface.

[0171] In the process of starting the voice assistant, since the electronic device can detect the user's pressing force and pressing time, it can gradually display the voice assistant's awakening animation effect according to the gradual increase in the user's pressing force and / or the increase in the pressing time, which can enhance the user experience.

[0172] In an embodiment of the present application, the electronic device can activate the voice assistant according to the force and time when the user presses the virtual button, so that the user can operate conveniently and improve the user experience.

[0173] Figure 8 Another set of GUIs provided by an embodiment of the present application is shown.

[0174] like Figure 8 As shown in (a) of FIG. 8 , the electronic device displays an interface 801, which is a lock screen interface. When the electronic device displays the interface 801, it detects that at least two of the four edge areas of the screen are touched and also simultaneously detects a user's pressing operation on a virtual key, and can determine the pressing force and pressing duration, and execute different functions according to the user's pressing force and pressing duration.

[0175] like Figure 8 As shown in (b), when the electronic device determines that the pressing force is equal to or greater than the first threshold and less than or equal to the third threshold, it can start the camera application and execute the autofocus function, that is, it can jump from interface 801 to interface 802 and then perform autofocus.

[0176] It should be understood that when the electronic device performs the autofocus function, it may display the focus frame or not, or it may first display the focus frame to mark the focused object and then no longer display the focus frame. The embodiments of the present application are not limited to this.

[0177] like Figure 8 As shown in (c), when the electronic device determines that the pressing force is first greater than the third threshold and then less than the first threshold, the camera application can be started and the photo-taking function can be executed, that is, the interface 801 can be jumped to the interface 802, and then the photo can be taken.

[0178] like Figure 8As shown in (d), when the electronic device determines that the pressing force is greater than the third threshold and the pressing duration is greater than or equal to the second threshold, it can start the camera application and execute the recording function, that is, it can jump from interface 801 to interface 803 and then record the video.

[0179] It should be noted that Figure 8 The example of the electronic device entering the camera application from the lock screen interface is used here, but it should not be understood as a specific limitation on the embodiments of the present application. In other embodiments of the present application, the electronic device can also respond to the user's operation to launch the camera application and perform corresponding functions when displaying other interfaces. For example, the interface displayed by the electronic device can also be the negative screen, the desktop, the interface of the application, etc.

[0180] In the implementation of this application, the electronic device can respond to the user's operation on the virtual button when displaying the interface of the non-camera application, enter the camera application, and execute the corresponding function according to the pressing force and pressing duration of the virtual button, so that the functions of taking pictures and recording videos can be performed quickly, which helps to improve the user experience.

[0181] Fig. 9 Another set of GUIs provided by an embodiment of the present application is shown.

[0182] like Fig. 9 As shown in (a) of FIG. 1 , the electronic device displays an interface 901, which is a photo taking interface. When the electronic device displays the interface 901, it detects the user pressing a virtual key, can determine the user's pressing force and pressing duration, and can execute different functions according to the user's pressing force and pressing duration.

[0183] like Fig. 9 As shown in (b), when the electronic device determines that the pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the electronic device can perform the auto focus function.

[0184] It should be understood that when the electronic device performs the autofocus function, it may display the focus frame or not, or it may first display the focus frame to mark the focused object and then no longer display the focus frame. The embodiments of the present application are not limited to this.

[0185] Optionally, in some embodiments, when the electronic device does not display the focus frame when executing the auto-focus function, the electronic device may display the focus frame in response to a user's operation of activating the focus frame.

[0186] Exemplarily, the user's operation of activating the focus frame may be pressing a virtual key, where the pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold.

[0187] like Fig. 9As shown in (c), when the electronic device determines that the pressing force is first greater than the second threshold and then less than the third threshold, the electronic device can execute the photo taking function.

[0188] like Fig. 9 As shown in (d) in FIG. 8 , when the electronic device determines that the pressing force is greater than the third threshold and the pressing duration is greater than the second threshold, it switches to interface 902 , which is a video recording interface.

[0189] When the electronic device switches to the recording interface 902 , the electronic device may directly record the video, or may also record the video in response to a user's recording operation.

[0190] Exemplarily, the user's recording operation may be that the user clicks on control 903 .

[0191] like Fig. 9 As shown in (e) in FIG. 1 , when the electronic device determines that the pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, the viewfinder may be displayed.

[0192] It can be understood that when the electronic device enters the autofocus function, if the user's pressing force is less than the first threshold and the pressing time is greater than or equal to the second threshold, the electronic device can display the focus frame; when the electronic device does not enter the autofocus function but only displays the photo taking interface, if the pressing force is less than the first threshold and the pressing time is greater than or equal to the second threshold, the electronic device can display the viewfinder frame.

[0193] In the implementation of this application, when the electronic device runs a camera application, it can execute corresponding functions according to the pressure and pressing duration of the virtual button by the user, so that functions such as taking pictures and recording videos can be quickly executed, which helps to improve the user experience.

[0194] Fig.10 Another set of GUIs provided by an embodiment of the present application is shown.

[0195] like Fig.10 As shown in (a) of FIG. 1 , the electronic device displays an interface 1001, which is an auto-focus interface. The electronic device can identify the focus object in the interface 1001. Since the virtual button can detect the user's sliding gesture, when the electronic device detects that the direction of the user's sliding gesture is the length direction of the electronic device, the focus object can be switched. Fig.10 (b) in the figure. The electronic device may also lock the focus object in response to a user's operation of locking the focus object.

[0196] like Fig.10 As shown in (b), the electronic device can switch the focus object from the elephant to the tree in response to the user sliding on the virtual key, and when the sliding direction is the length direction of the electronic device.

[0197] Optionally, in some embodiments, the user's operation of switching the focus object may also be the user sliding on a virtual key, and the sliding direction is the thickness direction of the electronic device.

[0198] When the electronic device is automatically focusing, in addition to switching the focus object, it can also lock the focus object in response to a user's operation of locking the focus object.

[0199] Exemplarily, the user's operation of locking the focus object may be to continuously press a virtual key, and the pressing force is less than a first threshold. Fig.10 For example, in response to the user pressing the virtual key twice in succession and the pressing force is less than the first threshold, the electronic device can lock the focus object as the elephant.

[0200] It should be understood that continuously pressing the virtual key can be understood as pressing the virtual key multiple times within a shorter time interval. The shorter time interval can be set by the user and is also preset in the electronic device before leaving the factory. The embodiments of the present application do not limit this.

[0201] Fig.11 Another set of GUIs provided by an embodiment of the present application is shown.

[0202] like Fig.11 As shown in (a) of FIG. 1 , the electronic device displays an interface 1101 , which is a parameter adjustment interface of a camera application. The electronic device can display a focus adjustment bar 1102 on the interface 1101 .

[0203] It should be noted that the embodiment of the present application does not limit the manner in which the electronic device displays the parameter adjustment interface. Fig.11 As shown in (a) of FIG. 1 , the electronic device can enter the professional mode, in which the electronic device can display a parameter adjustment bar, such as a focus adjustment bar 1102. Since the virtual button can detect the user's sliding gesture, the electronic device can perform different functions according to the direction of the user's sliding gesture. When the electronic device detects that the direction of the user's sliding gesture is the thickness direction of the electronic device, the focus adjustment bar can be switched to an adjustment bar for other parameters, see Fig.11 When the electronic device detects that the direction of the user's sliding gesture is the length direction of the electronic device, the focal length parameter can be adjusted, see Fig.11 (c) in .

[0204] like Fig.11 As shown in (b) in FIG. 1 , when the electronic device determines that the sliding direction of the user is the thickness direction, the focus adjustment bar 1102 can be switched to the ISO adjustment bar 1103 .

[0205] It should be noted that the embodiments of the present application only take the focus adjustment bar and the ISO adjustment bar as examples, which should not be understood as specific limitations on the embodiments of the present application.

[0206] In an embodiment of the present application, when the electronic device is running a camera application, it can adjust the shooting parameters and switch the parameter adjustment bar according to the sliding direction of the user on the virtual button, so that the user can operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, which conforms to daily usage habits and can enhance the user experience.

[0207] The above introduces the interaction method provided in the embodiment of the present application in conjunction with the GUI, and the following will introduce the interaction method provided in the embodiment of the present application in conjunction with the flowchart.

[0208] Fig.12 A schematic flow chart of the interaction method provided in the embodiment of the present application is shown, as Fig.12 As shown, the method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, and the method includes:

[0209] S1201: Detect a first pressing operation of a user on a virtual key, and determine a first pressing force and a first pressing duration.

[0210] S1202: Determine a first function according to the first interface, a first pressing force, and a first pressing duration.

[0211] S1203, in response to the first pressing operation, executing a first function.

[0212] Specifically, the electronic device can detect a user's first pressing operation on a virtual key, determine a first pressing force and a first pressing duration, then determine a first function based on the displayed first interface, the first pressing force and the first pressing duration, and then execute the first function in response to the first pressing operation.

[0213] For example, Figure 5 As shown, when the electronic device displays the main screen interface, when the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device displays the system volume adjustment bar 502.

[0214] For example, Figure 6 As shown, when the electronic device displays the interface of the music application, when the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device displays the volume adjustment bar 602 of the music application.

[0215] For example, Figure 7As shown, when the electronic device displays the main screen interface, when the first pressing force is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device activates the voice assistant function.

[0216] For example, Fig. 9 As shown, when the electronic device displays the photo taking interface, the electronic device can perform different functions according to the first pressing force and the first pressing duration. Please refer to the above for details and will not be repeated here.

[0217] In an embodiment of the present application, the electronic device has virtual buttons and can execute corresponding functions according to the displayed interface, the force with which the user presses the virtual buttons, and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0218] Optionally, in some embodiments, the first interface is a main screen interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a system music adjustment function.

[0219] Optionally, in some embodiments, the virtual key is also used to detect a sliding gesture of the user, and the method further includes:

[0220] In response to a first sliding gesture of the user on the virtual key, the first function is switched to the second function, wherein the direction of the first sliding gesture is the thickness direction of the electronic device.

[0221] For example, Figure 5 As shown in (b) and (c) in FIG. 8 , the electronic device switches the system volume adjustment bar 502 to the brightness adjustment bar 503 .

[0222] Optionally, in some embodiments, the second function is one of a brightness adjustment function, a microphone volume adjustment function, a speaker volume adjustment function, a message alert tone volume adjustment function, a screen display mode adjustment function, and an incoming call ring volume adjustment function.

[0223] Optionally, in some embodiments, the virtual key is also used to detect a sliding gesture of the user, and the method further includes:

[0224] In response to a second sliding gesture of the user on the virtual key, the system volume is adjusted, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0225] For example, Figure 5 As shown in (b) and (d) in the figure, the electronic device can adjust the volume of the system.

[0226] Optionally, in some embodiments, the first interface is a main screen interface, and when the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

[0227] For example, Figure 7 As shown, when the electronic device displays the main screen interface, when the first pressing force is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device activates the voice assistant function.

[0228] Optionally, in some embodiments, the first interface is a photo taking interface, and when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

[0229] For example, Fig. 9 As shown in (a) and (b) in FIG. 1 , the electronic device determines that the first pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, and the elephant can be focused.

[0230] Optionally, in some embodiments, the electronic device does not display a focus frame when focusing, and the method further includes:

[0231] In response to a second pressing operation of the user on the virtual key, determining a second pressing intensity and a second pressing duration;

[0232] When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, a focus frame is displayed, where the focus frame is used to identify the first object.

[0233] For example, Fig. 9 For example, the electronic device has automatically focused on the elephant when executing the autofocus function, but has not used the focus frame to identify it. The electronic device detects a second pressing operation of the user, and when the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, the focus frame can be displayed in response to the second pressing operation, so that the displayed focus frame identifies the elephant.

[0234] Optionally, in some embodiments, the method further comprises:

[0235] In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to the second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0236] like Fig.10 As shown in (a)-(b) in the figure, when the electronic device responds to the user sliding on the virtual key and the sliding direction is the length direction of the electronic device, the focus object can be switched from the elephant to the tree.

[0237] Optionally, in some other embodiments, the user's operation of switching the focus object may also be the user sliding on a virtual key, and the sliding direction is the thickness direction of the electronic device.

[0238] Optionally, in some embodiments, the method further comprises:

[0239] In response to a user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than a first threshold.

[0240] Optionally, in some embodiments, the first interface is a photo taking interface, and when the first pressing force is first greater than a third threshold and then less than the first threshold, the first function is a photo taking function.

[0241] For example, Fig. 9 As shown in (a) and (c), when the electronic device determines that the first pressing force is first greater than the third threshold and then less than the first threshold, the photo taking function is executed.

[0242] Optionally, in some embodiments, the first interface is a photo taking interface, and when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0243] For example, Fig. 9 As shown in (a) and (d), when the electronic device determines that the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the video recording function is executed.

[0244] Optionally, in some embodiments, the first interface is a photo taking interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0245] For example, Fig. 9 As shown in (a) and (e) in the figure, when the electronic device determines that the first pressing force is less than the first threshold and the first pressing duration is greater than the second threshold, the viewfinder is displayed.

[0246] Optionally, in some embodiments, the first interface is a photo taking interface, the virtual button is further used to detect a sliding gesture of the user, and the method further includes:

[0247] In response to a user's operation of adjusting a parameter, displaying an adjustment bar of a first parameter;

[0248] In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

[0249] For example, Fig.11As shown in (a) and (b), the electronic device switches the focus adjustment bar to the ISO adjustment bar in response to the user sliding in the direction of its thickness.

[0250] For example, Fig.11 As shown in (a) and (c), the electronic device adjusts the focal length in response to the user's sliding direction being in its length direction.

[0251] Optionally, in some embodiments, the first interface is an interface of a non-camera application, and the method further includes:

[0252] detecting that at least two edge regions of the four edge regions of the screen are touched and also detecting a third pressing operation of the user on the virtual key, and determining a third pressing force and a third pressing duration of the third pressing operation;

[0253] When the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, starting the camera and focusing;

[0254] When the third pressing force is first greater than the third threshold and then less than the first threshold, starting the camera and taking a photo;

[0255] When the third pressing force is greater than the third threshold and the third pressing duration is greater than the second threshold, the camera is started and video is recorded.

[0256] For example, Figure 8 As shown in (a) and (b), when the electronic device determines that the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the camera application can be started and the autofocus function can be executed.

[0257] For example, Figure 8 As shown in (a) and (c), when the electronic device determines that the pressing force is first greater than the third threshold and then less than the first threshold, the camera application can be started and the photo taking function can be executed.

[0258] For example, Figure 8 As shown in (a) and (d), when the electronic device determines that the pressing force is greater than the third threshold and the pressing duration is greater than or equal to the second threshold, the camera application can be started and the video recording function can be executed.

[0259] Fig.13 A schematic flow chart of another interactive method provided in an embodiment of the present application is shown, such as Fig.13 As shown, the method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, the first interface is a photo taking interface, and the method includes:

[0260] S1301, detecting a first pressing operation of a user on a virtual key, and determining a first pressing force and a first pressing duration.

[0261] S1302: Determine a first function according to a first pressing force and a first pressing duration.

[0262] S1303, in response to the first pressing operation, executing the first function.

[0263] Specifically, when the electronic device displays the photo-taking interface, it detects the user's first pressing operation on the virtual key, can determine the first pressing force and the first pressing duration, determine the first function based on the first pressing force and the first pressing duration, and then execute the first function.

[0264] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0265] For example, Fig. 9 As shown in (a) and (d), when the electronic device determines that the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the video recording function is executed.

[0266] Optionally, in some embodiments, when the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0267] For example, Fig. 9 As shown in (a) and (e) in the figure, when the electronic device determines that the first pressing force is less than the first threshold and the first pressing duration is greater than the second threshold, the viewfinder is displayed.

[0268] Optionally, in some embodiments, the virtual key is further used to detect a sliding gesture of the user, and the method further includes:

[0269] In response to a user's operation of adjusting a parameter, displaying an adjustment bar of a first parameter;

[0270] In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

[0271] For example, Fig.11 As shown in (a) and (b), the electronic device switches the focus adjustment bar to the ISO adjustment bar in response to the user sliding in the direction of its thickness.

[0272] For example, Fig.11 As shown in (a) and (c), the electronic device adjusts the focal length in response to the user's sliding direction being in its length direction.

[0273] Optionally, in some embodiments, when the electronic device performs an auto-focus function, the method further includes:

[0274] Detecting a second pressing operation of the user on the virtual key, and determining a second pressing force and a second pressing duration;

[0275] When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, a focus frame is displayed in response to the second pressing operation, and the focus frame is used to identify the first object. In other words, the electronic device may not display the focus frame when performing the autofocus function, and may display the focus frame when the second pressing operation is detected and the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, or the electronic device may first display the focus frame when performing the autofocus function, and the focus frame disappears or fades after a period of time, and the electronic device may display the focus frame when the second pressing operation is detected and the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold.

[0276] Optionally, in some embodiments, when the electronic device performs an auto-focus function, the method further includes:

[0277] In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to the second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0278] Optionally, in some embodiments, when the electronic device performs an auto-focus function, the method further includes:

[0279] In response to a user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than a first threshold.

[0280] In an embodiment of the present application, the electronic device has virtual buttons, and when running a camera application, it can execute corresponding functions based on the force with which the user presses the virtual buttons and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0281] Fig.14 A schematic flow chart of another interactive method provided in an embodiment of the present application is shown, such as Fig.14 As shown, the method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, the first interface is an interface of a non-camera application, and the method includes:

[0282] S1401: Detect that at least two edge areas of the four edge areas of the screen are touched, and also detect a first pressing operation of a user on a virtual key, and determine a first pressing intensity and a first pressing duration.

[0283] S1402, start a camera application, and determine a first function according to a first pressing force and a first pressing duration.

[0284] S1403, in response to the first pressing operation, executing the first function.

[0285] Optionally, in some embodiments, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0286] Optionally, in some embodiments, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0287] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0288] In an embodiment of the present application, the electronic device is provided with virtual buttons. When displaying an interface of a non-camera application, the function in the camera application can be quickly executed according to the force with which the user presses the virtual buttons and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0289] The above mainly introduces an interactive method provided by an embodiment of the present application from the perspective of an electronic device. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0290] The embodiment of the present application can divide the functional modules of the processor of the electronic device according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0291] In the case of dividing each functional module into corresponding functional modules, Fig.15 FIG. 1 shows a schematic diagram of the composition of an electronic device 1500 provided in an embodiment of the present application. Fig.15 As shown, the electronic device 1500 includes a display module 1510 , a detection module 1520 and a processing module 1530 .

[0292] In some embodiments:

[0293] The display module 1510 is used to display the first interface.

[0294] The detection module 1520 is used to determine a first pressing force and a first pressing duration when detecting a first pressing operation of a user on a virtual key.

[0295] The processing module 1530 is used to determine the first function according to the first interface, the first pressing force and the first pressing duration.

[0296] The processing module 1530 is further configured to execute the first function.

[0297] In some embodiments:

[0298] The display module 1510 is used to display a first interface, which is a photo taking interface.

[0299] The detection module 1520 is used to determine a first pressing force and a first pressing duration when detecting a first pressing operation of a user on a virtual key.

[0300] The processing module 1530 is configured to determine a first function according to a first pressing force and a first pressing duration.

[0301] The processing module 1530 is further configured to execute the first function.

[0302] In some embodiments:

[0303] The display module 1510 is used to display a first interface, where the first interface is an interface of a non-camera application.

[0304] The detection module 1520 is used to determine a first pressing force and a first pressing duration when at least two edge areas of the four edge areas of the screen are detected to be touched and a first pressing operation of the user on the virtual key is also detected.

[0305] The processing module 1530 is used to start a camera application and determine a first function according to a first pressing force and a first pressing duration.

[0306] The processing module 1530 is further configured to execute the first function.

[0307] The embodiment of the present application provides a computer program product, when the computer program product is run on an electronic device, the electronic device executes the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above method-related embodiments, and will not be repeated here.

[0308] The embodiment of the present application provides a readable storage medium, the readable storage medium contains instructions, when the instructions are executed in an electronic device, the electronic device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar, and will not be repeated here.

[0309] The embodiment of the present application provides a chip, the chip is used to execute instructions, when the chip is running, the technical solution in the above embodiment is executed. The implementation principle and technical effect are similar, and will not be repeated here.

[0310] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0311] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0312] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0313] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0314] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0315] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0316] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the embodiment of the present application, which should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. An interactive method, characterized in that: The method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, and the method includes: Detecting a first pressing operation of the user on the virtual key, and determining a first pressing force and a first pressing duration; Determine a first function according to the first interface, the first pressing force, and the first pressing duration; In response to the first pressing operation, the first function is executed.

2. The method according to claim 1, characterized in that The first interface is a main screen interface. When the first pressing force is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a system volume adjustment function.

3. The method according to claim 2, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to the user's first sliding gesture on the virtual button, the first function is switched to the second function, wherein the direction of the first sliding gesture is the thickness direction of the electronic device, and the second function is one of a brightness adjustment function, a microphone volume adjustment function, a speaker volume adjustment function, a message alert sound volume adjustment function, a screen display mode adjustment function, and an incoming call ring volume adjustment function.

4. The method according to claim 2, characterized in that: The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to a second sliding gesture of the user on the virtual key, the system volume is adjusted, wherein the direction of the second sliding gesture is the length direction of the electronic device.

5. The method according to claim 1, characterized in that The first interface is a main screen interface. When the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

6. The method according to claim 1, characterized in that The first interface is a photo taking interface, and when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

7. The method according to claim 6, characterized in that The method further comprises: Detecting a second pressing operation of the user on the virtual key, and determining a second pressing force and a second pressing duration; When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, in response to the second pressing operation, a focus frame is displayed, where the focus frame is used to identify the first object.

8. The method according to claim 7, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

9. The method according to claim 7, characterized in that: The method further comprises: In response to the user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than the first threshold.

10. The method according to any one of claims 6 to 9, characterized in that When the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

11. The method according to any one of claims 6 to 10, characterized in that When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

12. The method according to any one of claims 6 to 11, characterized in that When the first pressing force is less than the first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

13. The method according to any one of claims 6 to 12, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to the user's operation of adjusting the parameter, displaying an adjustment bar of the first parameter; In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

14. The method according to any one of claims 2 to 5, characterized in that The method further comprises: detecting that at least two edge regions of the four edge regions of the screen are touched, and also detecting a third pressing operation of the user on the virtual key, and determining a third pressing force and a third pressing duration of the third pressing operation; When the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, starting the camera and performing auto-focusing; When the third pressing force is first greater than the third threshold and then less than the first threshold, starting the camera and taking a photo; When the third pressing force is greater than the third threshold and the third pressing duration is greater than the second threshold, the camera is started and video is recorded.

15. An interactive method, characterized in that: The method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, the first interface is a photo taking interface, and the method includes: Detecting a first pressing operation of a user on a virtual key, and determining a first pressing force and a first pressing duration; determining a first function according to the first pressing force and the first pressing duration; In response to the first pressing operation, the first function is executed.

16. The method according to claim 15, characterized in that When the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

17. The method according to claim 16, characterized in that The method further comprises: Detecting a second pressing operation of the user on the virtual key, and determining a second pressing force and a second pressing duration; When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, in response to the second pressing operation, a focus frame is displayed, where the focus frame is used to identify the first object.

18. The method according to claim 17, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

19. The method according to claim 17, characterized in that The method further comprises: In response to the user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than the first threshold.

20. The method according to any one of claims 15 to 19, characterized in that When the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

21. The method according to any one of claims 15 to 20, characterized in that When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

22. The method according to any one of claims 15 to 21, characterized in that When the first pressing force is less than the first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

23. The method according to any one of claims 15 to 22, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to the user's operation of adjusting the parameter, displaying an adjustment bar of the first parameter; In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

24. An interactive method, characterized in that: The method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, the first interface is an interface of a non-camera application, and the method includes: Detecting that at least two edge regions of the four edge regions of the screen are touched, and also detecting a first pressing operation of the user on the virtual key, and determining a first pressing force and a first pressing duration; Starting a camera application and determining a first function according to the first pressing force and the first pressing duration; In response to the first pressing operation, a first function is executed.

25. The method according to claim 24, characterized in that When the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

26. The method according to claim 24 or 25, characterized in that When the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

27. The method according to claim 24, characterized in that When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

28. An electronic device, characterized in that: The method comprises one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, cause the method as described in any one of claims 1 to 14 or 15 to 23 or 24 to 27 to be executed.

29. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the method as described in any one of claims 1 to 14 or 15 to 23 or 24 to 27 is executed.

30. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the method according to any one of claims 1 to 14, 15 to 23, or 24 to 27 is executed.

Images