Method of interaction and electronic device

Abstract

The application provides an interaction method and an electronic device. The method is applied to the electronic device, the electronic device comprises a virtual key, the virtual key is used for detecting a pressing operation of a user, the electronic device displays a first interface, and the method comprises the following steps: detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing time; determining a first function according to the first interface, the first pressing force and the first pressing time; and executing the first function in response to the first pressing operation. The electronic device in the application has a virtual key, and can execute a corresponding function according to the displayed interface, the pressing force of the user on the virtual key and the pressing time of the user on the virtual key, thereby improving the operation efficiency of the user, enhancing the interaction, and helping to improve the experience of the user.

Description

Technical Field

[0001] This application relates to the field of electronic devices, and more specifically, to an interactive method and an electronic device. Background Technology

[0002] As technology continues to advance, users have increasingly higher demands for electronic devices. To achieve thinner and lighter designs and better enclosure, electronic devices tend to reduce internal structural components, moving towards a unibody design. For example, the 3.5mm headphone jack previously found on electronic devices can be replaced by Bluetooth headphones or shared with the charging port. Currently, some electronic devices use virtual buttons instead of physical buttons, improving the overall unibody design. However, the interaction methods and application scenarios of virtual buttons are currently limited, failing to fully realize their potential. Summary of the Invention

[0003] This application provides an interactive method and an electronic device. The electronic device has virtual buttons, which can execute corresponding functions according to the displayed interface, the force of the user pressing the virtual buttons, and the duration of the press, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0004] In a first aspect, an interaction method is provided, applied to an electronic device including a virtual button for detecting a user's pressing operation, the electronic device displaying a first interface, the method comprising: detecting a first pressing operation by a user on the virtual button, determining a first pressing force and a first pressing duration; determining a first function based on the first interface, the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0005] In this embodiment, the electronic device has virtual buttons, and can perform corresponding functions according to the displayed interface, the force of the user pressing the virtual buttons, and the duration of the press, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0006] In conjunction with the first aspect, in some implementations of the first aspect, the first interface is the main screen interface, and when the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the first function is the system volume adjustment function.

[0007] In this embodiment, the electronic device can display a parameter adjustment bar based on the force and duration of the user pressing the virtual button, allowing for convenient operation by the user.

[0008] In conjunction with the first aspect, in some implementations of the first aspect, the virtual button is also used to detect the user's swiping gesture. The method further includes: in response to the user's first swiping gesture on the virtual button, switching from the first function to a second function, wherein the direction of the first swiping gesture is the thickness direction of the electronic device, and the second function is one of the following: brightness adjustment function, microphone volume adjustment function, speaker volume adjustment function, message notification tone volume adjustment function, screen display mode adjustment function, and incoming call ringtone volume adjustment function.

[0009] In this embodiment, the electronic device can display a parameter adjustment bar based on the force and duration of the user pressing the virtual button, allowing for convenient operation. The gesture for switching the parameter bar is simple, conforms to daily usage habits, and enhances the user experience.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, the virtual button is also used to detect the user's swiping gesture, and the method further includes: adjusting the system volume in response to the user's second swiping gesture on the virtual button, wherein the direction of the second swiping gesture is the length direction of the electronic device.

[0011] In this embodiment, the electronic device can display a parameter adjustment bar based on the force and duration of the user pressing the virtual button, allowing for convenient operation. The gesture for switching the parameter bar is simple, conforms to daily usage habits, and enhances the user experience.

[0012] In conjunction with the first aspect, in some implementations of the first aspect, the first interface is the main screen interface, and when the first pressing pressure is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold, the first function is a voice assistant function.

[0013] In this embodiment, the electronic device can activate the voice assistant based on the force and duration of the user pressing the virtual button, enabling convenient operation and improving the user experience.

[0014] In conjunction with the first aspect, in some implementations of the first aspect, the first interface is a photo-taking interface, and when the first pressure is greater than or equal to the first threshold and less than or equal to the third threshold, the first function is an autofocus function.

[0015] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: detecting a second press operation by a user on a virtual button, determining a second press intensity and a second press duration; when the second press intensity is less than the first threshold and the second press duration is greater than or equal to the second threshold, displaying a focus box in response to the second press operation, the focus box being used to identify a first object.

[0016] In conjunction with the first aspect, in some implementations of the first aspect, the virtual button is also used to detect the user's swipe gesture, and the method further includes: in response to the user's second swipe gesture on the virtual button, switching the first object in the focus box to a second object, wherein the direction of the second swipe gesture is the length direction of the electronic device.

[0017] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: locking the focus box and the first object in response to a continuous pressing operation by the user on the virtual button, wherein the pressing force of the continuous pressing operation is less than the first threshold.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is the photo-taking function.

[0019] In conjunction with the first aspect, in some implementations of the first aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a recording function.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, when the first pressing force is less than the first threshold and the first pressing duration is greater than the second threshold, the first function is to display the viewfinder.

[0021] In conjunction with the first aspect, in some implementations of the first aspect, the virtual button is also used to detect the user's sliding gesture, and the method further includes: displaying an adjustment bar for a first parameter in response to the user's operation of adjusting parameters; and, in response to the user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, switching the adjustment bar for the first parameter to an adjustment bar for a second parameter, and if the direction of the sliding gesture is the length direction of the electronic device, adjusting the first parameter.

[0022] In this embodiment, when the electronic device is running a camera application, it can adjust the shooting parameters and switch the parameter adjustment bar according to the user's sliding direction on the virtual button, which makes the user's operation convenient. The gestures for switching the parameter bar and adjusting the parameters are simple, conform to daily usage habits, and can improve the user experience.

[0023] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: detecting that at least two of the four edge regions of the screen are touched, and also detecting a third press operation by the user on the virtual button, determining the third press intensity and the third press duration; when the third press intensity is greater than or equal to the first threshold and less than or equal to the third threshold, activating the camera and performing autofocus; when the third press intensity is first greater than the third threshold and then less than the first threshold, activating the camera and taking a picture; when the third press intensity is greater than the third threshold and the third press duration is greater than the second threshold, activating the camera and recording video.

[0024] In this application, the electronic device can respond to the user's operation on the virtual button when displaying an interface other than the camera application, enter the camera application, and execute the corresponding function according to the pressure and duration of pressing the virtual button, thereby quickly performing functions such as taking pictures and recording videos, which helps to improve the user experience.

[0025] Secondly, an interaction method is provided, which is applied to an electronic device including a virtual button for detecting a user's pressing operation. The electronic device displays a first interface, which is a camera interface. The method includes: detecting a user's first pressing operation on the virtual button; determining a first pressing force and a first pressing duration; determining a first function based on the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0026] In conjunction with the second aspect, in some implementations of the second aspect, when the first pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the first function is an autofocus function.

[0027] In conjunction with the second aspect, in some implementations of the second aspect, the method further includes: detecting a second press operation by a user on a virtual button, determining a second press intensity and a second press duration; when the second press intensity is less than the first threshold and the second press duration is greater than or equal to the second threshold, displaying a focus box in response to the second press operation, the focus box being used to identify a first object.

[0028] In conjunction with the second aspect, in some implementations of the second aspect, the virtual button is also used to detect the user's swipe gesture, and the method further includes: in response to the user's second swipe gesture on the virtual button, switching the first object in the focus box to a second object, wherein the direction of the second swipe gesture is the length direction of the electronic device.

[0029] In conjunction with the second aspect, in some implementations of the second aspect, the method further includes: locking the focus box and the first object in response to the user's continuous pressing operation on the virtual button, wherein the pressing force of the continuous pressing operation is less than the first threshold.

[0030] In conjunction with the second aspect, in some implementations of the second aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is the photo-taking function.

[0031] In conjunction with the second aspect, in some implementations of the second aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a recording function.

[0032] In conjunction with the second aspect, in some implementations of the second aspect, when the first pressing force is less than the first threshold and the first pressing duration is greater than the second threshold, the first function is to display the viewfinder.

[0033] In conjunction with the second aspect, in some implementations of the second aspect, the virtual button is also used to detect the user's sliding gesture. The method further includes: displaying an adjustment bar for a first parameter in response to the user's operation of adjusting parameters; and, in response to the user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, switching the adjustment bar for the first parameter to an adjustment bar for a second parameter, and if the direction of the sliding gesture is the length direction of the electronic device, adjusting the first parameter.

[0034] Thirdly, an interaction method is provided, applied to an electronic device including a virtual button for detecting a user's pressing operation, the electronic device displaying a first interface, the first interface being a non-camera application interface, the method comprising: detecting that at least two of the four edge regions of the screen are touched, and further detecting a first pressing operation by the user on the virtual button, determining a first pressing force and a first pressing duration; launching a camera application, and determining a first function based on the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0035] In conjunction with the third aspect, in some implementations of the third aspect, when the first pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the first function is an autofocus function.

[0036] In conjunction with the third aspect, in some implementations of the third aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is the photo-taking function.

[0037] In conjunction with the third aspect, in some implementations of the third aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a recording function.

[0038] Fourthly, a computer-readable storage medium is provided, comprising a computer program or instructions that, when executed on a computer, cause the first aspect and any possible implementation of the method of the first aspect to be performed.

[0039] Fifthly, a computer program product is provided, comprising a computer program or instructions that, when executed on a computer, cause the first aspect and any possible implementation of the method of the first aspect to be performed.

[0040] In a sixth aspect, a computer program is provided that, when run on a computer, causes the methods described in the first aspect and any possible implementation thereof to be executed.

[0041] A seventh aspect is an electronic device according to an embodiment of this application, the electronic device including modules / units for performing the above aspects or any possible design of the above aspects; these modules / units can be implemented in hardware or implemented by hardware executing corresponding software.

[0042] Eighthly, a chip according to an embodiment of this application is coupled to a memory in an electronic device and is used to call a computer program stored in the memory and execute the above-mentioned aspects of the embodiments of this application and any possible design of the above-mentioned aspects; in the embodiments of this application, "coupling" means that two components are directly or indirectly combined with each other.

[0043] A ninth aspect is a graphical user interface on an electronic device according to an embodiment of this application. The electronic device has a display screen, one or more memories, and one or more processors, the one or more processors being used to execute one or more computer programs stored in the one or more memories. The graphical user interface includes a graphical user interface displayed when the electronic device performs the above aspects and any possible design of the above aspects.

[0044] A tenth aspect is an electronic device according to an embodiment of this application, the electronic device including one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the above aspects or any possible implementation of the above aspects to be performed. Attached Figure Description

[0045] Figure 1This is a schematic diagram of the virtual button configuration provided in an embodiment of this application.

[0046] Figure 2 This is a schematic diagram of another form of setting virtual buttons provided in the embodiments of this application.

[0047] Figure 3 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application.

[0048] Figure 4 This is a software structure block diagram of an electronic device according to an embodiment of this application.

[0049] Figure 5 This is a set of GUIs provided in the embodiments of this application.

[0050] Figure 6 This is another set of GUIs provided in the embodiments of this application.

[0051] Figure 7 This is another set of GUIs provided in the embodiments of this application.

[0052] Figure 8 This is another set of GUIs provided in the embodiments of this application.

[0053] Figure 9 This is another set of GUIs provided in the embodiments of this application.

[0054] Figure 10 This is another set of GUIs provided in the embodiments of this application.

[0055] Figure 11 This is another set of GUIs provided in the embodiments of this application.

[0056] Figure 12 This is a schematic flowchart of the interaction method provided in the embodiments of this application.

[0057] Figure 13 This is a schematic flowchart of the interaction method provided in the embodiments of this application.

[0058] Figure 14 This is a schematic flowchart of the interaction method provided in the embodiments of this application.

[0059] Figure 15 This is a schematic diagram of the composition of the electronic device provided in the embodiments of this application. Detailed Implementation

[0060] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0061] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one, two, or more than two. The term “and / or” is used to describe the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can indicate: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character “ / ” generally indicates that the preceding and following related objects are in an “or” relationship.

[0062] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0063] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or music player, such as a mobile phone, tablet computer, wearable electronic device with wireless communication capabilities (such as a smartwatch), etc. Exemplary embodiments of the portable electronic device include, but are not limited to, carrying... Alternatively, it could be a portable electronic device with another operating system. The aforementioned portable electronic device could also be other portable electronic devices, such as laptops. It should also be understood that in some other embodiments, the aforementioned electronic device may not be a portable electronic device, but rather a desktop computer.

[0064] The electronic device is equipped with virtual buttons, specifically referring to the presence of touch sensors and pressure sensors. For example, the touch sensors and pressure sensors can be placed at locations on the electronic device where physical buttons would normally be required. The electronic device can utilize the tactile effect of the touch sensor and the piezoelectric effect of the pressure sensor to detect user input presses, thereby enabling functions similar to those of physical buttons, such as screen locking and volume adjustment. This reduces the number of physical buttons on the surface of the electronic device, making it more aesthetically pleasing. In other embodiments, these buttons may also be referred to as touch-sensitive buttons, etc., and this application does not impose such limitations.

[0065] For example, taking a mobile phone as an example, virtual buttons can be set on the side frame of the phone (such as the left or right side frame). One or more touch sensors and one or more pressure sensors can be set on the side frame of the phone.

[0066] For example, using virtual buttons to set Figure 1 Take the right side of the mobile phone 10 shown in (a) as an example. Figure 1 (b) shows the distribution of the touch and pressure sensors used to implement the virtual buttons. Figure 1 As shown in (b), a touch sensor and a pressure sensor 110 are provided in a preset area 101 on the right side frame of the mobile phone 10, and a touch sensor and a pressure sensor 120 are provided in a preset area 102. The pressure sensor 110 is located below the touch sensor in the preset area 101, and the pressure sensor 120 is located below the touch sensor in the preset area 102.

[0067] In some embodiments, the touch sensors disposed on the preset area 101 and the preset area 102 may be the same touch sensor. That is, a touch sensor (referred to as touch sensor 1) may be disposed on the right side frame of the mobile phone 10, and the touch sensor 1 is disposed on the preset area 101 and the preset area 102 of the right side frame. Of course, the touch sensor 1 may also be disposed on the entire right side frame of the mobile phone 10, and this embodiment of the application does not limit this.

[0068] In some embodiments, the touch sensor and the pressure sensor can be integrated into a single sensor. This sensor can be disposed in preset areas 101 and 102 on the right side bezel. Of course, the sensor can also be disposed across the entire right side bezel of the phone 10; this embodiment does not limit this application.

[0069] In some embodiments, if the mobile phone 10 is a curved screen phone, the touch sensor corresponding to the virtual button can be integrated with the touch sensor in the touch screen of the mobile phone 10; that is, the touch sensor of the virtual button is the touch sensor in the touch screen of the mobile phone 10. If the touch screen of the mobile phone 10 is a flat screen phone, the touch sensor of the virtual button is independent of the touch sensor in the touch screen of the mobile phone 10; that is, the touch sensor of the virtual button is different from the touch sensor in the touch screen of the mobile phone 10.

[0070] In other embodiments, the touch sensors disposed on the preset areas 101 and 102 may be at least two touch sensors. For example, if the mobile phone 10 is a flat-screen mobile phone, a touch sensor may be disposed on the preset areas 101 and 102 on the right side frame of the mobile phone 10.

[0071] For example, using touch-sensitive buttons... Figure 2 Take the right side of the mobile phone 20 shown in (a) as an example. Figure 2 (b) shows the distribution of the touch sensor and pressure sensor used to implement the touch-sensitive button. Figure 2 As shown in (b), a touch sensor is provided in a preset area 201 on the right side frame of the mobile phone 20, a touch sensor is provided in a preset area 202, and a pressure sensor 210 is provided at the junction of the preset areas 201 and 202. The pressure sensor 210 is located below the touch sensors in the preset areas 201 and 202.

[0072] For example, the position of the pressure sensor 210 on the right side frame of the phone 20 can be similar to the position of physical buttons (such as the "volume +" and "volume -" buttons) on the side frame of the phone. For instance, the pressure sensor 210 could be positioned midway between the positions of the "volume +" and "volume -" buttons on the side frame of the phone. A preset area 201 is located on the right side frame of the phone 20, above the position of the pressure sensor 210. A preset area 202 is located on the right side frame of the phone 20, below the position of the pressure sensor 210. The sizes of the preset areas 201 and 202 are pre-configured within the phone 20.

[0073] In some embodiments, the touch sensors provided on the preset area 201 and the preset area 202 may be the same touch sensor.

[0074] In other embodiments, the touch sensors disposed on the preset area 201 and the preset area 202 may be at least two touch sensors.

[0075] For example, the pressure sensors (such as pressure sensor 110, pressure sensor 120, and pressure sensor 210) in the embodiments of this application can be piezoelectric pressure sensors. For instance, the piezoelectric pressure sensor can be a piezoelectric ceramic sensor. Compared to other pressure sensors, the piezoelectric ceramic sensor has higher sensitivity.

[0076] Of course, touch-sensitive buttons can be installed on both side bezels of the phone (such as the left and right bezels). That is, one or more pressure sensors and one or more touch sensors (not shown in the attached diagram) can be installed on the left and right bezels of the phone to realize the function of touch-sensitive buttons.

[0077] The above describes the structure of electronic devices used to implement virtual buttons. The following section will describe the internal structure of electronic devices.

[0078] Figure 3 A schematic diagram of the electronic device 300 is shown. The electronic device 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, antenna 1, antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headphone jack 370D, a sensor module 380, buttons 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc. The sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an accelerometer sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0079] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 300. In other embodiments of this application, the electronic device 300 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0080] Processor 310 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0081] The controller can be the nerve center and command center of the electronic device 300. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.

[0082] The processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. This memory can store instructions or data that the processor 310 has just used or that are used repeatedly. If the processor 310 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0083] In some embodiments, the processor 310 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0084] The wireless communication function of electronic device 300 can be realized through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor, etc.

[0085] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 300 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0086] The mobile communication module 350 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 300. The mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves via the antenna 3, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 3. In some embodiments, at least some functional modules of the mobile communication module 350 may be housed in the processor 310. In some embodiments, at least some functional modules of the mobile communication module 350 and at least some modules of the processor 310 may be housed in the same device.

[0087] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 370A, receiver 370B, etc.) or displays images or videos through a display screen 394. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 310 and may be housed in the same device as the mobile communication module 350 or other functional modules.

[0088] The wireless communication module 360 ​​can provide solutions for wireless communication applications on the electronic device 300, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 360 ​​can be one or more devices integrating at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to processor 310. The wireless communication module 360 ​​can also receive signals to be transmitted from processor 310, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0089] In some embodiments, antenna 3 of electronic device 300 is coupled to mobile communication module 350, and antenna 2 is coupled to wireless communication module 360, enabling electronic device 300 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-CDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0090] Electronic device 300 implements display functions through a GPU, a display screen 394, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 310 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0091] Display screen 394 is used to display images, videos, etc. Display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 300 may include one or N displays 394, where N is a positive integer greater than 1.

[0092] Electronic device 300 can achieve shooting function through ISP, camera 393, video codec, GPU, display 394 and application processor.

[0093] The ISP (Image Signal Processor) is used to process data fed back from the camera 393. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 393.

[0094] Camera 393 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 300 may include one or N cameras 393, where N is a positive integer greater than 1.

[0095] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when the electronic device 300 is selecting a frequency, the DSP is used to perform Fourier transforms on the frequency energy.

[0096] Video codecs are used to compress or decompress digital video. Electronic device 300 may support one or more video codecs. Thus, electronic device 300 can play or record video in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0097] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs can enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0098] The external storage interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 300. The external memory card communicates with the processor 310 through the external storage interface 320 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0099] Internal memory 321 can be used to store computer executable program code, which includes instructions. Processor 310 executes various functional applications and data processing of electronic device 300 by running the instructions stored in internal memory 321. Internal memory 321 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 300 (such as audio data, phonebook, etc.). Furthermore, internal memory 321 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0100] Electronic device 300 can implement audio functions such as music playback and recording through audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone jack 370D, and application processor.

[0101] The audio module 370 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. The audio module 370 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 370 may be located in the processor 310, or some functional modules of the audio module 370 may be located in the processor 310.

[0102] The speaker 370A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic device 300 can listen to music or make hands-free calls through the speaker 170A.

[0103] The receiver 370B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 300 answers a telephone call or voice message, the receiver 370B can be brought close to the listener's ear to hear the voice.

[0104] Microphone 370C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 370C, inputting the sound signal into microphone 370C. Electronic device 300 may have at least one microphone 370C. In some embodiments, electronic device 300 may have two microphones 370C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 300 may have three, four, or more microphones 370C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0105] Pressure sensor 380A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 380A can be disposed on display screen 394. There are many types of pressure sensors 380A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 380A, the capacitance between the electrodes changes. Electronic device 300 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 394, electronic device 300 detects the intensity of the touch operation based on pressure sensor 380A. Electronic device 300 can also calculate the touch position based on the detection signal from pressure sensor 380A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with a touch operation intensity greater than or equal to a first pressure threshold is applied to the alarm clock application icon, a command to create a new alarm is executed.

[0106] The fingerprint sensor 380H is used to collect fingerprints. The electronic device 300 can utilize the collected fingerprint characteristics to achieve fingerprint unlocking, app access lock, fingerprint photography, fingerprint call answering, etc. For example, when the phone detects a user's touch operation on the lock screen, the phone can collect the user's fingerprint information through the fingerprint sensor 380H and match it with preset fingerprint information in the phone. If the match is successful, the phone can transition from the lock screen to the unlock screen.

[0107] Touch sensor 380K, also known as a "touch panel," can be located on display screen 394. The touch sensor 380K and display screen 394 together form a touchscreen, also known as a "touch screen." Touch sensor 380K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 394. In other embodiments, touch sensor 380K may also be located on the surface of electronic device 300, in a different position than display screen 394.

[0108] Figure 4 This is a software structure block diagram of an electronic device 300 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0109] like Figure 4 As shown, the application layer can include camera, settings, and third-party applications. These third-party applications can include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0110] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer may include some predefined functions.

[0111] like Figure 4 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0112] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making this data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0113] The view system includes visual controls, such as controls for displaying text, controls for displaying images, and such as the indicator information for displaying the virtual shutter button in the embodiments of this application. The view system can be used to build applications. The display interface can consist of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying images.

[0114] The phone manager is used to provide communication functions for electronic devices 300. For example, it manages call status (including connection and disconnection).

[0115] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0116] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0117] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0118] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0119] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0120] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0121] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0122] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0123] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0124] A 2D graphics engine is a graphics engine for 2D drawing.

[0125] In addition, the system library may also include status monitoring service modules, such as a physical status recognition module for analyzing and recognizing user gestures; and a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0126] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0127] The hardware layer can include various types of sensors, such as Figures 1-3 The various sensors described in the document include accelerometers, gyroscopes, touch sensors, etc., which are involved in the embodiments of this application.

[0128] As technology continues to advance, users have increasingly higher demands for electronic devices. To achieve thinner and lighter designs and better enclosure, electronic devices tend to reduce internal structural components, moving towards a unibody design. For example, the 3.5mm headphone jack previously found on electronic devices can be replaced by Bluetooth headphones or shared with the charging port. Currently, some electronic devices use virtual buttons instead of physical buttons, improving the overall unibody design. However, the interaction methods and application scenarios of virtual buttons are currently limited, failing to fully realize their potential.

[0129] Before introducing the embodiments of this application, we will first introduce several possible application scenarios associated with virtual buttons involved in the embodiments of this application.

[0130] 1. Adjust system parameters on the main screen interface.

[0131] When an electronic device displays its main screen, it can respond to user input on virtual buttons and adjust system parameters.

[0132] For example, system parameters may include volume and brightness.

[0133] For example, the main screen interface can be the desktop, the negative one screen, etc.

[0134] 2. Adjust system parameters through the application interface.

[0135] When displaying application interfaces, electronic devices can adjust system parameters in response to user actions on virtual buttons.

[0136] For example, when an electronic device displays the interface of a music application, it can detect the user's operation on virtual buttons and adjust the volume in response to that operation.

[0137] For example, when an electronic device displays the interface of a calling application, it can detect the user's operation on the virtual buttons and adjust the volume in response to that operation.

[0138] 3. Adjust application parameters through the application interface.

[0139] When an electronic device displays the interface of an application, it can adjust the application parameters in response to user input on virtual buttons. Application parameters can be understood as the parameters that an application uses to perform a specific function.

[0140] For example, a camera application may include parameters such as focal length and ISO sensitivity.

[0141] 4. Launch the application.

[0142] The electronic device can launch application #1 in response to a user's operation on the virtual buttons. In this application scenario, before launching application #1, the electronic device may be in a locked screen state, or in a state where application #2 is running in the foreground, or in a state where the main screen interface is displayed.

[0143] For example, when an electronic device is locked, if it detects a user's action on a virtual button, it can launch the camera application in response to that action.

[0144] For example, when an electronic device displays its desktop, it detects the user's action on a virtual button and, in response to that action, can launch a camera application.

[0145] For example, when an electronic device displays the interface of a gallery application, it detects the user's operation on virtual buttons and, in response to that operation, can launch the camera application.

[0146] The foregoing has introduced several possible scenarios involved in the embodiments of this application. The following will introduce the interaction method provided by the embodiments of this application in conjunction with the graphical user interface (GUI).

[0147] Figure 5 A set of GUIs provided in embodiments of this application is shown.

[0148] like Figure 5 As shown in (a), the electronic device displays interface 501, which is the desktop. When the electronic device displays interface 501, it detects the user pressing a virtual button, determines the user's pressing force and duration, and displays the following when the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold: Figure 5 The GUI shown in (b) is shown in the image.

[0149] It should be noted that the virtual buttons in the picture protrude from the edge of the electronic device only for easy identification. In actual electronic devices, the sensing area of ​​the virtual buttons is part of the edge and does not protrude from it.

[0150] It should be noted that this embodiment only uses the desktop as an example, and should not be interpreted as a specific limitation on the embodiment. For example, the interface 501 can also be the negative one screen, the settings interface, the lock screen, etc.

[0151] In this embodiment of the application, the desktop, the negative one screen interface, and the lock screen interface can be collectively referred to as the main screen interface.

[0152] like Figure 5 As shown in (b), when the electronic device determines that the user's pressing pressure is less than a first threshold and the pressing duration is greater than or equal to a second threshold, it displays the system volume control bar 502 in response to the user's pressing of the virtual button. Since the virtual button can detect the user's swipe gesture, the electronic device can perform different functions depending on the direction of the user's swipe gesture. When the electronic device detects that the direction of the user's swipe gesture is the thickness direction of the electronic device, it can switch the system volume control bar to a bar for other parameters, see [reference needed]. Figure 5 (c) In this context, when the electronic device detects that the user's swipe gesture is in the direction of the electronic device's length, parameters can be adjusted; see [link to relevant documentation]. Figure 5 (d) in the middle.

[0153] It should be noted that the embodiments of this application only take the example of an electronic device displaying a system volume adjustment bar when the pressing pressure is less than the first threshold and the pressing duration is greater than or equal to the second threshold. However, this should not be construed as a limitation on the embodiments of this application. In some other embodiments of this application, when the pressing pressure is less than the first threshold and the pressing duration is greater than or equal to the second threshold, the electronic device may also display adjustment bars for other parameters, such as speaker volume adjustment bars, message notification tone volume adjustment bars, etc.

[0154] like Figure 5 As shown in (c), when the electronic device determines that the user's sliding direction is its thickness direction, it can switch the system volume control bar 502 to the brightness control bar 503.

[0155] Understandably, as the user continues to slide along the thickness of the electronic device, the electronic device can also switch the brightness adjustment bar 503 to an adjustment bar for other parameters, such as a speaker volume adjustment bar or a message notification sound volume adjustment bar.

[0156] It is also understandable that when the electronic device switches the system volume control bar 502 to the brightness control bar 503, and then detects the user's gesture of swiping in the opposite direction, it can switch the brightness control bar 503 back to the system volume control bar 502.

[0157] It should be noted that the embodiments of this application only take the example of the electronic device determining that the user's sliding direction is its thickness direction, and the system volume adjustment bar 502 can be switched to the brightness adjustment bar 503. However, it should not be construed as a limitation on the embodiments of this application. In some other embodiments of this application, when the electronic device determines that the user's sliding direction is its thickness direction, the electronic device can switch the system volume adjustment bar 502 to the message prompt tone volume adjustment bar.

[0158] like Figure 5 As shown in (d), when the electronic device determines that the user's sliding direction is along its length, it can adjust the system volume. For example, if the user slides upwards, the electronic device can increase the system volume; if the user slides downwards, the electronic device can decrease the system volume.

[0159] In this embodiment, the electronic device can display a parameter adjustment bar based on the force and duration of the user pressing the virtual button, enabling convenient operation. The gestures for switching parameter bars and adjusting parameters are simple, conform to daily usage habits, and can improve the user experience.

[0160] Figure 6 Another set of GUIs provided in the embodiments of this application is shown.

[0161] like Figure 6As shown in (a), the electronic device displays interface 601, which is the interface of a music application. When the electronic device displays interface 601, it detects a user pressing a virtual button, determines the user's pressing force and duration, and when it determines that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, it displays as shown in (a). Figure 6 The GUI shown in (b) is shown in the image.

[0162] like Figure 6 As shown in (b), when the electronic device determines that the user's pressure intensity is less than a first threshold and the pressure duration is greater than or equal to a second threshold, it responds to the user's operation of pressing the virtual button, and... Figure 5 The difference between (b) and (c) is that since the electronic device displays the interface of a music application, the electronic device can display the volume control bar 602 of the music application at this time.

[0163] It should be understood that if interface 601 is the interface of a video application, the electronic device may display the volume control bar of the video application.

[0164] It should also be understood that the electronic device can also respond to the user's swipe gestures to toggle the volume control bar 602 of the music application or adjust the volume of the music application, as detailed in the description provided for... Figure 5 For the sake of brevity, the description will not be repeated here.

[0165] contrast Figure 5 and Figure 6 It can be seen that when displaying parameter adjustment bars, electronic devices can display different parameter adjustment bars depending on the interface.

[0166] In this embodiment, the electronic device can display a parameter adjustment bar based on the force and duration of the user pressing the virtual button, enabling convenient operation. The gestures for switching parameter bars and adjusting parameters are simple, conform to daily usage habits, and can improve the user experience.

[0167] Figure 7 Another set of GUIs provided in the embodiments of this application is shown.

[0168] like Figure 7 As shown in (a), the electronic device displays interface 701, which is the desktop. When the electronic device displays interface 701, it detects a user pressing a virtual button, determines the user's pressing force and duration, and displays the following when the user's pressing force is greater than or equal to a second threshold and the pressing duration is greater than or equal to the second threshold: Figure 7 The GUI shown in (b) is shown in the image.

[0169] like Figure 7As shown in (b), when the electronic device determines that the user's pressing pressure is greater than or equal to a first threshold and the pressing duration is greater than or equal to a second threshold, it activates the voice assistant and displays the voice assistant bar 702 in response to the user's pressing of the virtual button.

[0170] It should be noted that in some other embodiments, interface 701 can also be a negative one screen or a lock screen interface.

[0171] During the activation of the voice assistant, the electronic device can detect the user's pressure and duration of pressure, and thus gradually display the voice assistant's activation animation based on the gradual increase in the user's pressure and / or the increase in the duration of pressure, which can enhance the user experience.

[0172] In this embodiment, the electronic device can activate the voice assistant based on the force and duration of the user pressing the virtual button, enabling convenient operation and improving the user experience.

[0173] Figure 8 Another set of GUIs provided in the embodiments of this application is shown.

[0174] like Figure 8 As shown in (a), the electronic device displays interface 801, which is a lock screen interface. When the electronic device displays interface 801, it detects that at least two of the four edge areas of the screen have been touched and also detects that the user has pressed the virtual buttons. It can determine the pressure and duration of the press and execute different functions according to the pressure and duration of the press.

[0175] like Figure 8 As shown in (b), when the electronic device determines that the pressure applied is equal to or greater than the first threshold and less than or equal to the third threshold, it can start the camera application and perform the autofocus function, that is, it can jump from interface 801 to interface 802 and then perform autofocus.

[0176] It should be understood that when an electronic device performs autofocus, it may display the focus frame or not, or it may first display the focus frame to mark the object being focused and then no longer display the focus frame. This application does not limit this.

[0177] like Figure 8 As shown in (c), when the electronic device determines that the pressure applied is first greater than the third threshold and then less than the first threshold, it can start the camera application and perform the photo-taking function, that is, it can jump from interface 801 to interface 802 and then take a photo.

[0178] like Figure 8As shown in (d), when the electronic device determines that the pressing pressure is greater than the third threshold and the pressing duration is greater than or equal to the second threshold, it can start the camera application and execute the recording function, that is, it can jump from interface 801 to interface 803 and then record.

[0179] It should be noted that, Figure 8 This example only illustrates how an electronic device accesses the camera application from the lock screen, and should not be construed as a specific limitation on the embodiments of this application. In other embodiments of this application, the electronic device may also access the camera application and perform corresponding functions in response to user operations while displaying other interfaces. For example, the interface displayed by the electronic device may also be the negative one screen, the desktop, the application interface, etc.

[0180] In this application, the electronic device can respond to the user's operation on the virtual button when displaying an interface other than the camera application, enter the camera application, and execute the corresponding function according to the pressure and duration of pressing the virtual button, thereby quickly performing functions such as taking pictures and recording videos, which helps to improve the user experience.

[0181] Figure 9 Another set of GUIs provided in the embodiments of this application is shown.

[0182] like Figure 9 As shown in (a), the electronic device displays interface 901, which is also a camera interface. When the electronic device displays interface 901, it detects the user pressing a virtual button, determines the pressure and duration of the press, and can execute different functions based on the pressure and duration.

[0183] like Figure 9 As shown in (b), when the electronic device determines that the pressure applied is greater than or equal to the first threshold and less than or equal to the third threshold, the electronic device can perform the autofocus function.

[0184] It should be understood that when an electronic device performs autofocus, it may display the focus frame or not, or it may first display the focus frame to mark the object being focused and then no longer display the focus frame. This application does not limit this.

[0185] Optionally, in some embodiments, when the electronic device does not display the focus frame while performing autofocus, the electronic device may display the focus frame in response to a user's activation of the focus frame.

[0186] For example, the user can activate the focus box by pressing a virtual button, where the pressure is less than a first threshold and the press duration is greater than or equal to a second threshold.

[0187] like Figure 9As shown in (c), when the electronic device determines that the pressure applied is first greater than the second threshold and then less than the third threshold, the electronic device can perform the photo-taking function.

[0188] like Figure 9 As shown in (d), when the electronic device determines that the pressing pressure is greater than the third threshold and the pressing duration is greater than the second threshold, it switches to interface 902, which is a recording interface.

[0189] When the electronic device switches to the recording interface 902, the electronic device can record directly, or it can record in response to the user's recording operation.

[0190] For example, a user recording operation could be achieved by the user clicking control 903.

[0191] like Figure 9 As shown in (e), when the electronic device determines that the pressing pressure is less than a first threshold and the pressing duration is greater than or equal to a second threshold, it can display a viewfinder.

[0192] Understandably, when an electronic device enters the autofocus function, if the user's pressing pressure is less than the first threshold and the pressing duration is greater than or equal to the second threshold, the electronic device can display the focus frame. When the electronic device does not enter the autofocus function but only displays the shooting interface, if the pressing pressure is less than the first threshold and the pressing duration is greater than or equal to the second threshold, the electronic device can display the viewfinder.

[0193] In this application, when the electronic device is running a camera application, it can execute the corresponding function according to the pressure and duration of the user pressing the virtual button, thereby quickly performing functions such as taking photos and recording videos, which helps to improve the user experience.

[0194] Figure 10 Another set of GUIs provided in the embodiments of this application is shown.

[0195] like Figure 10 As shown in (a), the electronic device displays interface 1001, which is an autofocus interface. The electronic device can identify the focus object on this interface 1001. Since the virtual buttons can detect the user's swipe gestures, when the electronic device detects that the direction of the user's swipe gesture is the length direction of the electronic device, it can switch the focus object. See [reference needed]. Figure 10 (b) In this context, electronic devices can also lock the focus object in response to a user's action of locking the focus object.

[0196] like Figure 10 As shown in (b), when the electronic device responds to the user's swipe on the virtual button and the swipe direction is the length direction of the electronic device, the focus object can be switched from the elephant to the tree.

[0197] Optionally, in some embodiments, the user's operation of switching the focus object can also be the user sliding on the virtual button, and the sliding direction is the thickness direction of the electronic device.

[0198] When an electronic device is autofocusing, in addition to switching the focus object, it can also lock the focus object in response to the user's operation of locking the focus object.

[0199] For example, a user's action to lock focus on an object could be by repeatedly pressing a virtual button, with the pressure less than a first threshold. For instance, using... Figure 10 For example, when an electronic device responds to a user pressing a virtual button twice consecutively with a pressure less than a first threshold, it can lock the focus object as an elephant.

[0200] It should be understood that continuous pressing of a virtual button can be understood as pressing the virtual button multiple times within a short time interval. This short time interval can be set by the user or is preset by the electronic device at the factory. This application embodiment does not limit this.

[0201] Figure 11 Another set of GUIs provided in the embodiments of this application is shown.

[0202] like Figure 11 As shown in (a), the electronic device displays interface 1101, which is the parameter adjustment interface for the camera application. The electronic device can display a focus adjustment bar 1102 on interface 1101.

[0203] It should be noted that the embodiments of this application do not limit the way the electronic device displays the parameter adjustment interface. For example, such as Figure 11 As shown in (a), the electronic device can enter a professional mode, in which it can display parameter adjustment bars, such as focus adjustment bar 1102. Since the virtual buttons can detect the user's swipe gestures, the electronic device can perform different functions depending on the direction of the user's swipe gesture. When the electronic device detects that the direction of the user's swipe gesture is the thickness direction of the electronic device, it can switch the focus adjustment bar to an adjustment bar for other parameters, see [reference]. Figure 11 (b) In this context, when the electronic device detects that the user's swipe gesture is in the direction of the electronic device's length, the focal length parameter can be adjusted. See [reference needed]. Figure 11 (c) in the middle.

[0204] like Figure 11 As shown in (b), when the electronic device determines that the user's sliding direction is its thickness direction, it can switch the focus adjustment bar 1102 to the ISO adjustment bar 1103.

[0205] It should be noted that the embodiments in this application only use the focus adjustment bar and ISO adjustment bar as examples, and should not be construed as specific limitations on the embodiments of this application.

[0206] In this embodiment, when the electronic device is running a camera application, it can adjust the shooting parameters and switch the parameter adjustment bar according to the user's sliding direction on the virtual button, which makes the user's operation convenient. The gestures for switching the parameter bar and adjusting the parameters are simple, conform to daily usage habits, and can improve the user experience.

[0207] The interactive method provided by the embodiments of this application has been introduced above with reference to the GUI. The interactive method provided by the embodiments of this application will be introduced below with reference to the flowchart.

[0208] Figure 12 A schematic flowchart of the interaction method provided in an embodiment of this application is shown, such as... Figure 12 As shown, the method is applied to an electronic device that includes virtual buttons for detecting user press operations. The electronic device displays a first interface, and the method includes:

[0209] S1201, The user's first press operation on the virtual button is detected, and the first press force and first press duration are determined.

[0210] S1202, determine the first function based on the first interface, the first pressing force, and the first pressing duration.

[0211] S1203, in response to the first press operation, executes the first function.

[0212] Specifically, the electronic device can detect the user's first press operation on the virtual button, determine the first press pressure and the first press duration, then determine the first function based on the first displayed interface, the first press pressure and the first press duration, and then execute the first function in response to the first press operation.

[0213] For example, such as Figure 5 As shown, when the electronic device displays the main screen interface, if the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device displays the system volume adjustment bar 502.

[0214] For example, such as Figure 6 As shown, when the electronic device displays the interface of a music application, if the first pressing pressure is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the electronic device displays the volume adjustment bar 602 of the music application.

[0215] For example, such as Figure 7As shown, when the electronic device displays the main screen interface, the electronic device activates the voice assistant function when the first pressing force is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold.

[0216] For example, such as Figure 9 As shown, when the electronic device displays the camera interface, it can perform different functions depending on the first pressing pressure and the first pressing duration. Please refer to the above for details, which will not be repeated here.

[0217] In this embodiment, the electronic device has virtual buttons, and can perform corresponding functions according to the displayed interface, the force of the user pressing the virtual buttons, and the duration of the press, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0218] Optionally, in some embodiments, the first interface is the main screen interface, and when the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the first function is the system music adjustment function.

[0219] Optionally, in some embodiments, the virtual button is also used to detect the user's swipe gesture, and the method further includes:

[0220] In response to the user's first swipe gesture on the virtual button, the function switches from the first function to the second function, wherein the direction of the first swipe gesture is the thickness direction of the electronic device.

[0221] For example, such as Figure 5 As shown in (b) and (c), the electronic device switches the system volume control bar 502 to the brightness control bar 503.

[0222] Optionally, in some embodiments, the second function is one of the following: brightness adjustment function, microphone volume adjustment function, speaker volume adjustment function, message notification tone volume adjustment function, screen display mode adjustment function, and incoming call ringtone volume adjustment function.

[0223] Optionally, in some embodiments, the virtual button is also used to detect the user's swipe gesture, and the method further includes:

[0224] The system volume is adjusted in response to a second swipe gesture by the user on a virtual button, wherein the direction of the second swipe gesture is the length of the electronic device.

[0225] For example, such as Figure 5 As shown in (b) and (d) in the diagram, the electronic device can adjust the system volume.

[0226] Optionally, in some embodiments, the first interface is the main screen interface, and when the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

[0227] For example, such as Figure 7 As shown, when the electronic device displays the main screen interface, the electronic device activates the voice assistant function when the first pressing force is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold.

[0228] Optionally, in some embodiments, the first interface is a camera interface, and when the first pressure is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0229] For example, such as Figure 9 As shown in (a) and (b), the electronic device determines that the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, and can focus on the elephant.

[0230] Optionally, in some embodiments, the electronic device does not display a focus box when focusing, and the method further includes:

[0231] In response to a user's second press operation on a virtual button, determine the second press force and the second press duration;

[0232] When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, a focus box is displayed to identify the first object.

[0233] For example, with Figure 9 For example, when the electronic device performs autofocus, it has automatically focused on the elephant but has not used a focus frame identifier. The electronic device detects a second press operation from the user. When the intensity of the second press is less than a first threshold and the duration of the second press is greater than or equal to the second threshold, the electronic device can respond to the second press operation by displaying a focus frame to identify the elephant.

[0234] Optionally, in some embodiments, the method further includes:

[0235] In response to a second swipe gesture by the user on a virtual button, the first object in the focus box is switched to the second object, wherein the direction of the second swipe gesture is the length direction of the electronic device.

[0236] like Figure 10 As shown in (a)-(b), when the electronic device responds to the user's swipe on the virtual button and the swipe direction is the length direction of the electronic device, the focus object can be switched from the elephant to the tree.

[0237] Alternatively, in other embodiments, the user's operation of switching the focus object can also be the user sliding on the virtual button, and the sliding direction is the thickness direction of the electronic device.

[0238] Optionally, in some embodiments, the method further includes:

[0239] In response to a user's continuous pressing of a virtual button, the focus box and a first object are locked, wherein the pressure of the continuous pressing is less than a first threshold.

[0240] Optionally, in some embodiments, the first interface is a camera interface, and when the first pressure is greater than a third threshold and then less than the first threshold, the first function is the camera function.

[0241] For example, such as Figure 9 As shown in (a) and (c), the electronic device executes the photo-taking function when it determines that the first pressing force is greater than the third threshold and then less than the first threshold.

[0242] Optionally, in some embodiments, the first interface is a photo-taking interface, and when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0243] For example, such as Figure 9 As shown in (a) and (d) in the figure, the electronic device executes the recording function when it determines that the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold.

[0244] Optionally, in some embodiments, the first interface is a camera interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the first function is to display the viewfinder.

[0245] For example, such as Figure 9 As shown in (a) and (e), the electronic device displays a viewfinder when it determines that the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold.

[0246] Optionally, in some embodiments, the first interface is a camera interface, and the virtual buttons are also used to detect the user's swipe gestures. The method further includes:

[0247] In response to the user's adjustment of parameters, the adjustment bar for the first parameter is displayed;

[0248] In response to a user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

[0249] For example, such as Figure 11As shown in (a) and (b), the electronic device switches the focus adjustment bar to the ISO adjustment bar in response to the user's sliding direction being its thickness direction.

[0250] For example, such as Figure 11 As shown in (a) and (c), the electronic device adjusts the focal length in response to the user's sliding direction being its length direction.

[0251] Optionally, in some embodiments, the first interface is a non-camera application interface, and the method further includes:

[0252] While detecting that at least two of the four edge areas of the screen are touched, the system also detects a third press operation by the user on the virtual button, and determines the third press force and the third press duration.

[0253] When the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the camera is activated and focused.

[0254] When the third pressing force is first greater than the third threshold and then less than the first threshold, the camera is activated and a picture is taken.

[0255] When the intensity of the third press is greater than the third threshold and the duration of the third press is greater than the second threshold, the camera is activated and recording begins.

[0256] For example, such as Figure 8 As shown in (a) and (b), when the electronic device determines that the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, it can launch the camera application and perform the autofocus function.

[0257] For example, such as Figure 8 As shown in (a) and (c), when the electronic device determines that the pressure applied is first greater than the third threshold and then less than the first threshold, it can launch the camera application and perform the photo-taking function.

[0258] For example, such as Figure 8 As shown in (a) and (d), when the electronic device determines that the pressure applied is greater than the third threshold and the duration of the pressure is greater than or equal to the second threshold, it can launch the camera application and perform the recording function.

[0259] Figure 13 A schematic flowchart of another interaction method provided in an embodiment of this application is shown, such as... Figure 13 As shown, the method is applied to an electronic device, which includes virtual buttons for detecting user press operations. The electronic device displays a first interface, which is a camera interface. The method includes:

[0260] S1301, The user's first press operation on the virtual button is detected, and the first press force and first press duration are determined.

[0261] S1302, determine the first function based on the first pressing force and the first pressing duration.

[0262] S1303, in response to the first press operation, executes the first function.

[0263] Specifically, when the electronic device displays the camera interface, it detects the user's first press operation on the virtual button, determines the first press pressure and the first press duration, determines the first function based on the first press pressure and the first press duration, and then executes the first function.

[0264] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0265] For example, such as Figure 9 As shown in (a) and (d) in the figure, the electronic device executes the recording function when it determines that the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold.

[0266] Optionally, in some embodiments, when the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0267] For example, such as Figure 9 As shown in (a) and (e), the electronic device displays a viewfinder when it determines that the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold.

[0268] Optionally, in some embodiments, the virtual buttons are also used to detect the user's swipe gestures, and the method further includes:

[0269] In response to the user's adjustment of parameters, the adjustment bar for the first parameter is displayed;

[0270] In response to a user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

[0271] For example, such as Figure 11 As shown in (a) and (b), the electronic device switches the focus adjustment bar to the ISO adjustment bar in response to the user's sliding direction being its thickness direction.

[0272] For example, such as Figure 11 As shown in (a) and (c), the electronic device adjusts the focal length in response to the user's sliding direction being its length direction.

[0273] Optionally, in some embodiments, when the electronic device performs the autofocus function, the method further includes:

[0274] The user's second press operation on the virtual button is detected, and the second press force and second press duration are determined.

[0275] When the second pressing pressure is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, a focus frame is displayed in response to the second pressing operation. The focus frame is used to identify the first object. In other words, when the electronic device performs autofocus, it may not display the focus frame initially, but may display it when a second pressing operation is detected and the second pressing pressure is less than the first threshold and the second pressing duration is greater than or equal to the second threshold. Alternatively, when the electronic device performs autofocus, it may display the focus frame initially, and after a period of time, the focus frame may disappear or fade. The electronic device may then display the focus frame again when a second pressing operation is detected and the second pressing pressure is less than the first threshold and the second pressing duration is greater than or equal to the second threshold.

[0276] Optionally, in some embodiments, when the electronic device performs the autofocus function, the method further includes:

[0277] In response to a second swipe gesture by the user on a virtual button, the first object in the focus box is switched to the second object, wherein the direction of the second swipe gesture is the length direction of the electronic device.

[0278] Optionally, in some embodiments, when the electronic device performs the autofocus function, the method further includes:

[0279] In response to a user's continuous pressing of a virtual button, the focus box and a first object are locked, wherein the pressure of the continuous pressing is less than a first threshold.

[0280] In this embodiment, the electronic device has virtual buttons, and when running the camera application, it can execute corresponding functions according to the pressure and duration of the user pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0281] Figure 14 A schematic flowchart of another interaction method provided in an embodiment of this application is shown, such as... Figure 14 As shown, the method is applied to an electronic device including virtual buttons for detecting user press operations. The electronic device displays a first interface, which is a non-camera application interface. The method includes:

[0282] S1401, at least two of the four edge areas of the screen are detected to be touched, and the user's first press operation on the virtual button is also detected, and the first press intensity and first press duration are determined.

[0283] S1402, launch the camera application and determine the first function based on the first pressing pressure and the first pressing duration.

[0284] S1403, in response to the first press operation, executes the first function.

[0285] Optionally, in some embodiments, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0286] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and then less than a first threshold, the first function is the photo-taking function.

[0287] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0288] In this embodiment, the electronic device has virtual buttons. When displaying an interface other than the camera application, the functions in the camera application can be executed quickly based on the force and duration of the user's press of the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to improve the user experience.

[0289] The foregoing primarily describes an interaction method provided by the embodiments of this application from the perspective of an electronic device. It is understood that, in order to achieve the above functions, the electronic device includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, in conjunction with the algorithm steps of the various examples described in the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0290] This application embodiment can divide the processor of an electronic device into functional modules according to the above method example. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0291] With the adoption of dividing each function into different modules, corresponding to each function, Figure 15 A schematic diagram of the composition of the electronic device 1500 provided in an embodiment of this application is shown, as follows: Figure 15 As shown, the electronic device 1500 includes a display module 1510, a detection module 1520, and a processing module 1530.

[0292] In some embodiments:

[0293] Display module 1510 is used to display the first interface.

[0294] The detection module 1520 is used to detect the user's first press operation on the virtual button and determine the first press force and the first press duration.

[0295] The processing module 1530 is used to determine the first function based on the first interface, the first pressing force, and the first pressing duration.

[0296] The processing module 1530 is also used to perform the first function.

[0297] In some embodiments:

[0298] Display module 1510 is used to display the first interface, which is the camera interface.

[0299] The detection module 1520 is used to detect the user's first press operation on the virtual button and determine the first press force and the first press duration.

[0300] The processing module 1530 is used to determine the first function based on the first pressing force and the first pressing duration.

[0301] The processing module 1530 is also used to perform the first function.

[0302] In some embodiments:

[0303] Display module 1510 is used to display a first interface, which is a non-camera application interface.

[0304] The detection module 1520 is used to detect that at least two of the four edge areas of the screen have been touched, and also detects the user's first press operation on the virtual button, and determines the first press intensity and the first press duration.

[0305] The processing module 1530 is used to launch the camera application and determine the first function based on the first pressing pressure and the first pressing duration.

[0306] The processing module 1530 is also used to perform the first function.

[0307] This application provides a computer program product that, when run on an electronic device, causes the electronic device to execute the technical solutions described in the above embodiments. Its implementation principle and technical effects are similar to those of the related embodiments described above, and will not be repeated here.

[0308] This application provides a readable storage medium containing instructions that, when executed by an electronic device, cause the electronic device to perform the technical solution described in the above embodiments. The implementation principle and technical effects are similar and will not be repeated here.

[0309] This application provides a chip for executing instructions. When the chip is running, it executes the technical solutions described in the above embodiments. Its implementation principle and technical effects are similar and will not be repeated here.

[0310] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this application.

[0311] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0312] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0313] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0314] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0315] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or parts of the technical solutions, can be embodied in the form of software products. These computer software products are stored in a storage medium and include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0316] The above description is merely a specific implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the embodiments of this application should be included within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.

Claims

1. An interaction method, characterized in that, The method is applied to an electronic device, which includes virtual buttons for detecting user press operations. The electronic device displays a first interface, which is not an interface of a camera application. The method includes: Touching is detected in at least two of the four edge areas of the screen, and the user's first press operation on the virtual button is also detected, determining the first press force and the first press duration; Launch the camera application and determine the first function based on the first pressure intensity and the first pressure duration; In response to the first press operation, the first function is executed.

2. The method according to claim 1, characterized in that, When the first pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the first function is the autofocus function.

3. The method according to claim 1, characterized in that, When the first pressing force is greater than the third threshold and then less than the first threshold, the first function is the photo taking function.

4. The method according to claim 1, characterized in that, When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is the recording function.

5. The method according to any one of claims 1 to 4, characterized in that, The virtual button is a touch-sensitive button.

6. An electronic device, characterized in that, It includes one or more processors; one or more memories; said one or more memories storing one or more computer programs, said one or more computer programs including instructions that, when executed by said one or more processors, cause the method as described in any one of claims 1 to 5 to be performed.

7. A chip, characterized in that, The chip includes a processor and a communication interface, the communication interface being used to receive signals and transmit the signals to the processor, the processor processing the signals such that the method as described in any one of claims 1 to 5 is executed.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed on a computer, cause the method as described in any one of claims 1 to 5 to be performed.

Images