An interactive interface display method, an electronic device, and a storage medium
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2024-10-22
- Publication Date
- 2026-07-10
Smart Images

Figure CN120255771B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to an interactive interface display method, electronic device and storage medium. Background Technology
[0002] With the increasing prevalence of terminal devices, smart devices have become indispensable in people's lives. Users' demand for drag-and-drop functionality across multiple devices is also growing, allowing them to share data between two applications on different devices. How to improve the user's drag-and-drop experience requires further research. Summary of the Invention
[0003] This application provides an interactive interface display method, an electronic device, and a storage medium. When the user moves the first control out of the first response hot zone, or when the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 can shrink the display of the first response hot zone. This prevents the display size of the first response hot zone from being too large and obscuring other areas of the first user interface, making it easier for the user to share the first content to other applications or other devices through other means, thus improving the user's interactive experience.
[0004] In a first aspect, this application provides an interactive interface display method. The method includes: an electronic device displaying a first user interface, the first user interface including first content and a first navigation bar; the electronic device receiving a first operation on the first content; in response to the first operation, the electronic device displaying a first control and a first response hotspot, the display size of the first response hotspot being larger than the display size of the first navigation bar; when the first control is located within the first response hotspot, the display size of the first response hotspot is a first size; the electronic device continuing to receive the first operation on the first control, when the first control moves out of the first response hotspot, the electronic device switching the display size of the first response hotspot from the first size to a second size; or, when the first control is located at a first position, or when the movement position of the first control meets a preset condition, the display size of the first response hotspot is a third size; the electronic device continuing to receive the first operation on the first control, when the position of the first control remains unchanged for a first duration, the electronic device switching the display size of the first response hotspot from the third size to the second size.
[0005] For example, the first user interface can be any one of the following: chat interface, gallery interface, reading interface, memo interface, web page interface, editing software interface, music interface, file management interface, etc.
[0006] For example, the first content may include, but is not limited to, any of the following: text, documents, tables, images, web pages, etc.
[0007] For example, you can refer toFigures 9A-9B or Figures 11A-11B or Figures 10B-10C Description in the embodiments.
[0008] Using this method, when the user moves the first control out of the first response hotspot, or when the user presses and holds the first control for a continuous first duration without changing its position, or when the movement of the first control meets preset conditions, the electronic device 100 can shrink the display of the first response hotspot. This prevents the display size of the first response hotspot from being too large and obscuring other areas of the first user interface. After the electronic device 100 shrinks the display of the first response hotspot, it can receive user actions on the first control and share the first content to other applications or other devices through other means, thus improving the user's interactive experience.
[0009] Optionally, the third dimension and the first dimension can be the same or different.
[0010] For example, the first response thermal area of the first dimension can be response thermal area 3005. The first response thermal area of the second dimension can be response thermal area 3009. The first response thermal area of the third dimension can be response thermal area 3004 or response thermal area 3005.
[0011] In conjunction with the first aspect, in one possible implementation, the preset conditions include: the first control has moved a first distance along a first direction, or the position of the first control is within a preset position. The first position may be located within or outside the first response hotspot; this application does not limit this.
[0012] Optionally, the first direction can be the opposite direction of the first response thermal zone, such as the direction from the first response thermal zone to the top of the display screen. The first direction can be perpendicular to the horizontal line, or it can be at an angle to the vertical line.
[0013] Optionally, the preset condition may refer to the position of the first control meeting the preset condition, such as the first control being located within a preset position, or the movement distance of the first control meeting the preset condition, such as the movement distance of the first control being greater than a threshold.
[0014] In conjunction with the first aspect, in one possible implementation, after the electronic device switches the display size of the first response hotspot to the second size, the method further includes: the electronic device continuing to receive a first operation on the first control, wherein when the first control is outside the first response hotspot, the display size of the first response hotspot continues to be displayed as the second size.
[0015] Thus, when the user moves the first control out of the first response hot zone, or when the user presses and holds the first control for a continuous first duration without changing its position, or when the movement of the first control meets the preset conditions, the electronic device 100 can shrink the display of the first response hot zone. If the user continues to press and hold and move the first control, the display size of the first response hot zone can remain unchanged when the first control is outside the first response hot zone.
[0016] For example, you can refer to Figures 9B-9F , Figures 10D-10E Description in the embodiments.
[0017] In one possible implementation, after the electronic device switches the display size of the first response hotspot to the second size, the method further includes: the electronic device continuing to receive a first operation on the first control, wherein when the first control is located within the first response hotspot, the electronic device switches the display size of the first response hotspot from the second size to the first size.
[0018] Thus, if the user moves the first control out of the first response hot zone, or if the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 can shrink the display of the first response hot zone. If the user continues to press and hold and move the first control, the electronic device can further expand the display size of the first response hot zone when the first control is within the first response hot zone.
[0019] For example, you can refer to Figures 9I-9J , Figures 10F-10G Description in the embodiments.
[0020] In conjunction with the first aspect, in one possible implementation, the electronic device continues to receive a first operation on the first control. When the position of the first control remains unchanged for a first duration, the electronic device switches the area of the display region of the first response hot zone from a third size to a second size. Specifically, when the first control is located outside the first response hot zone, the electronic device continues to receive a first operation on the first control. When the position of the first control remains unchanged for a first duration, the electronic device switches the display size of the first response hot zone from a third size to a second size.
[0021] In one possible implementation, the method further includes: when the first control is located within the first response hot zone, the electronic device continues to receive a first operation on the first control; and when the position of the first control remains unchanged for a first duration, the display size of the first response hot zone continues to be displayed as a third size.
[0022] For example, you can refer to Figures 11A-11B Description in the embodiments.
[0023] Thus, when the first control is outside the first response hot zone, if the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 will then shrink the display of the first response hot zone. When the first control is within the first response hot zone, if the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 will not shrink the display of the first response hot zone, thus preventing accidental touches.
[0024] Optionally, it is not necessary to distinguish whether the first control is located outside or inside the first response hot zone. As long as the user presses and holds the first control and the position of the first control does not change for a continuous first duration, the electronic device 100 can shrink and display the first response hot zone.
[0025] In conjunction with the first aspect, in one possible implementation, the electronic device stops displaying the first navigation bar when the electronic device displays the first response hot zone.
[0026] In conjunction with the first aspect, in one possible implementation, before the display size of the first response hotspot is a first size, or before the display size of the first response hotspot is a third size, in response to a first operation on the first content, the display size of the first response hotspot changes according to the first operation.
[0027] In conjunction with the first aspect, in one possible implementation, the display size of the first response hotspot is determined based on the position of the first control.
[0028] Optionally, the display size of the first response hotspot can be determined based on the position of the first control. Different positions of the first control will result in different display sizes of the first response hotspot.
[0029] Optionally, the display size of the first response hotspot can be determined based on the distance between the first control and the first navigation bar. Different distances between the first control and the first navigation bar result in different display sizes of the first response hotspot.
[0030] Optionally, the distance between the first control and the first navigation bar can refer to the distance between the center point of the first control and the center point of the first navigation bar, or the distance between the top edge of the first control and the top edge of the first navigation bar, or the distance between the bottom edge of the first control and the bottom edge of the first navigation bar. This application does not limit the implementation of the distance between the first control and the first navigation bar.
[0031] For example, the first control can be control 3003, control 4002, or control 5002.
[0032] For example, the display size of the first response hotspot changes according to the first operation, as can be seen from... Figures 3C-3F ,or, Figures 4A-4D,or, Figures 5B-5F Description in the embodiments.
[0033] In conjunction with the first aspect, in one possible implementation, in response to the first operation, the electronic device displays the first control and the first response hotspot, specifically including: in response to the first operation, if the position of the first control meets a preset condition, the electronic device displays the first control and the first response hotspot.
[0034] Optionally, in response to the first operation, if the position of the first control does not meet the preset conditions, the electronic device displays the first navigation bar.
[0035] The location of the first control meets the preset conditions. This can mean that the first control is located within a preset position, or that the distance between the first control and the first navigation bar meets the preset conditions. For example, the preset conditions can mean that the distance between the first control and the first navigation bar is less than a first threshold.
[0036] In conjunction with the first aspect, in one possible implementation, the second dimension is a preset dimension, the first dimension is larger than the second dimension, or the third dimension is larger than the second dimension.
[0037] In conjunction with the first aspect, in one possible implementation, after the electronic device switches the display size of the first response hotspot from the second size to the first size, the method further includes: the electronic device stopping receiving the first operation on the first control; in response to stopping receiving the first operation on the first control, the electronic device displaying a first window, the first window including first content and one or more operation options, the one or more operation options being used to perform a corresponding operation on the first content.
[0038] For example, when the first content is a file, one or more options can be Figure 3H The options shown are 3006, 3007, and 3008.
[0039] For example, when the primary content is text, one or more options can be Figure 4F The options shown are 4004, 4005, and 4006.
[0040] For example, when the first content is an image, one or more options can be Figure 5G The options shown are 5004, 5005, and 5006.
[0041] In conjunction with the first aspect, in one possible implementation, after the electronic device stops receiving the first operation on the first control, the method further includes: the electronic device sending the first content to the server; the electronic device receiving one or more operation intentions sent by the server, the one or more operation intentions being derived based on the first content and user behavior characteristics, and one or more operation options being associated with one or more operation intentions.
[0042] After obtaining the initial content, the server can determine one or more operational intentions based on this content. These intentions are related to a user profile, which reflects the user's behavioral habits and can be obtained by the server based on user data.
[0043] Optionally, different users have different user profiles, and the server may obtain one or more different operational intentions for different users based on the first content.
[0044] In conjunction with the first aspect, in one possible implementation, the first operation is to long-press the first content and drag the first content towards the display area where the first navigation bar is located.
[0045] In conjunction with the first aspect, in one possible implementation, the first content includes any of the following: text, file, table, image, or webpage.
[0046] Secondly, this application provides an electronic device, including a memory and a processor; wherein the memory and the processor are coupled, the memory is used to store a computer program, and when the processor executes and calls the computer program, the first electronic device executes an application window management method provided in any possible implementation of the first aspect.
[0047] Thirdly, this application provides a computer-readable storage medium including instructions that, when executed on a first electronic device, cause the first electronic device to perform an interactive interface display method provided in any possible implementation of the first aspect described above.
[0048] Fourthly, this application provides a chip system including one or more processors, which are used to invoke computer instructions to cause a first electronic device to execute an interactive interface display method provided in any possible implementation of any of the above aspects.
[0049] Fifthly, this application provides a computer program product containing instructions, which, when run on a first electronic device, causes the first electronic device to execute an interactive interface display method provided in any possible implementation of any of the above aspects.
[0050] For a description of the beneficial effects in aspects two through five, please refer to the description of the beneficial effects in aspect one; this application will not repeat them here. Attached Figure Description
[0051] Figure 1 A schematic diagram of the hardware structure of an electronic device 100 is shown;
[0052] Figure 2 This is a software structure block diagram of the electronic device 100 according to an embodiment of this application;
[0053] Figures 3A-3H A schematic diagram is shown of a user dragging first content and releasing the first content within the target response hot zone;
[0054] Figures 4A-4F This diagram illustrates another scenario where a user drags the first content and releases it within the target response hotspot.
[0055] Figures 5A-5G This diagram illustrates yet another scenario where a user drags the first content and releases it within the target response hotspot;
[0056] Figure 6 A flowchart illustrating a method for a user to drag and release first content within a target response hot zone, as provided in this application;
[0057] Figures 7A-7F A schematic diagram is shown showing how the size of the display area containing the response hotspot changes as the position of the first control changes;
[0058] Figure 8 A flowchart illustrating a method for changing the size of the display area containing the response hotspot as the position of the first control changes;
[0059] Figures 9A-9J This diagram illustrates how the size of the display area containing another response hotspot changes with the position of the first control;
[0060] Figure 10A This diagram illustrates how the size of the display area containing another response hotspot changes with the position of the first control;
[0061] Figures 10B-10G This diagram illustrates how the size of the display area containing another type of response hotspot changes with the position of the first control;
[0062] Figures 11A-11B This diagram illustrates the shrinking display response area of the electronic device 100 when the user presses and holds the first control for a continuous first duration.
[0063] Figure 12 This diagram illustrates a method for shrinking the display response hotspot of an electronic device 100 when a user presses and holds a first control for a continuous first duration.
[0064] Figure 13 This is a flowchart illustrating an interactive interface display method provided in this application. Detailed Implementation
[0065] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0066] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, features defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.
[0067] The term "user interface (UI)" used in the following embodiments of this application refers to the medium interface through which an application or operating system interacts and exchanges information with a user. It realizes the conversion between the internal form of information and the form that the user can accept. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be visual interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of a wearable device.
[0068] To facilitate user operation, electronic devices can share content from a first application to a second application by dragging and dropping content. The display area of the second application is fixed. If the display area is too small, it's inconvenient for the user to drag and drop content into it; if the display area is too large, it may obstruct other areas, preventing the user from sharing the dragged content to other applications and negatively impacting the user experience.
[0069] Based on the above analysis, this application provides an interactive interface display method. The method includes: an electronic device 100 displaying a first user interface with a first application, the first user interface displaying first content and a first navigation bar. The electronic device 100 can receive a first operation from a user on the first content; in response to the first operation, the electronic device 100 can display a first control, which moves as the user's finger moves towards the display area of the first navigation bar. As the first control moves towards the display area of the first navigation bar, the first navigation bar can switch to display as a response hotspot. As the first control gets closer to the display area of the first navigation bar, the display area of the response hotspot gradually increases, prompting the user to drag the first control into the display area of the response hotspot and release their finger within the display area of the response hotspot.
[0070] In response to the release of a finger within the display area of the first control's response hotspot, the voice assistant application can confirm one or more operation intentions based on the first content and display the first content and one or more options within the first capsule, the one or more options being related to one or more operation intentions.
[0071] Optionally, when the first control moves into the response hot zone, the electronic device 100 may display special effects, such as gradient colors and flowing light effects on the border of the response hot zone, vibration effects, etc.
[0072] Optionally, the user's selected content will affect the user's intended action, and the operation options displayed by the electronic device 100 for the selected content will also differ.
[0073] Optionally, when the electronic device 100 displays the first user interface, the electronic device 100 can receive user input operations on the first navigation bar, such as a click operation. In response to the user's input operation, the electronic device 100 can display a first window, which may be a window provided by a voice assistant application. The electronic device 100 can input text or audio in the first window based on the user's operation. In response to the text or audio input by the user in the first window, the voice assistant application can display the response result of the text or audio in the first window.
[0074] For example, the first user interface can be a chat interface, a gallery interface, a reading interface, a memo interface, a web page interface, an editing software interface, a music interface, a file management interface, etc.
[0075] For example, the first content may include, but is not limited to, any of the following: text, documents, tables, images, web pages, etc.
[0076] Using this method, when the user drags the first content, the electronic device 100 can change the display style of the first navigation bar to prompt the user to drag the selected first content to the display area where the first navigation bar is located, thereby improving the user's interactive experience.
[0077] Figure 1 A schematic diagram of the hardware structure of an electronic device 100 is shown.
[0078] Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a display screen 194, a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include one or more sensors, such as a gyroscope sensor 180B, a magnetic sensor 180D, an accelerometer sensor 180E, a proximity sensor 180F, a touch sensor 180K, etc. In some embodiments, the sensor module 180 may also include one or more of the following sensors: a pressure sensor, a barometric pressure sensor, a proximity sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.
[0079] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0080] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0081] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0082] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system. In some embodiments, the processor 110 may include one or more interfaces, such as a universal serial bus (USB) interface.
[0083] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, or USB Type-C port. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0084] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0085] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0086] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0087] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0088] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0089] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, frequency modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.
[0090] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0091] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0092] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0093] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).
[0094] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.
[0095] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.
[0096] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.
[0097] Electronic device 100 can implement audio functions, such as making calls and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, and application processor.
[0098] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0099] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0100] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0101] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.
[0102] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.
[0103] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover.
[0104] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.
[0105] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0106] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0107] In some embodiments, the electronic device 100 may further include one or more of buttons, a motor, and an indicator. Buttons may include a power button, volume buttons, etc. Buttons may be mechanical buttons or touch buttons. The electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of the electronic device 100. The motor may generate vibration cues. The indicator may be an indicator light, which can be used to indicate charging status, battery level changes, and can also be used to indicate messages, missed calls, notifications, etc.
[0108] The SIM card interface 195 is used to connect the SIM card.
[0109] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.
[0110] Figure 2 This is a software structure block diagram of the electronic device 100 according to an embodiment of this application.
[0111] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the system libraries, and the kernel layer.
[0112] The application layer can include a series of application packages.
[0113] like Figure 2As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0114] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0115] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0116] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0117] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0118] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0119] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).
[0120] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0121] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0122] The core library consists of two parts: one part is the functionalities that the Java language needs to call, and the other part is the core library of the operating system.
[0123] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0124] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0125] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0126] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0127] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0128] A 2D graphics engine is a graphics engine for 2D drawing.
[0129] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0130] The following section will provide a detailed description of one of the display methods provided in this application, taking into account different scenarios.
[0131] 1. The user drags the first content and releases it within the target response hot zone.
[0132] Figures 3A-3H This diagram illustrates a user dragging first content and releasing it within the target response hotspot.
[0133] For example, the first content could be a file.
[0134] For example, such as Figure 3AAs shown, the electronic device 100 displays a desktop with a page containing application icons. This page includes multiple application icons (e.g., settings app icon, app store app icon, gallery app icon, instant messaging app icon, etc.). Below these application icons, a page indicator is displayed to indicate the positional relationship between the currently displayed page and other pages. Below the page indicator is a tray area. This tray area includes multiple tray icons, such as a camera app icon, contacts app icon, phone app icon, and messaging app icon. The tray area remains displayed during page switching. In some embodiments, the page may also include multiple application icons and a page indicator. The page indicator may not be part of the page and may exist independently. The tray icons are also optional, and this embodiment does not impose any limitations on this.
[0135] Figure 3A The desktop also displays a navigation bar 3001, which is used to activate the voice assistant application. For example, the electronic device 100 can receive user input on the navigation bar 3001, such as a click. In response to the user's input, the electronic device 100 can display a first window, which may be a window provided by the voice assistant application. The electronic device 100 can input text or audio within the first window based on the user's action. In response to the text or audio input by the user in the first window, the voice assistant application can display the response result of the text or audio within the first window. Thus, the electronic device 100 can quickly launch the voice assistant application via the navigation bar 3001, allowing the user to interact with the voice assistant application.
[0136] like Figure 3A As shown, the electronic device 100 can receive user input operations on an instant messaging application icon, such as a click operation. In response to the user's input operation, the electronic device 100 can display... Figure 3B The instant messaging application's main interface and navigation bar 3001 are shown. The main interface displays dialog boxes for multiple contacts, including a "group chat" dialog box. Figure 3B As shown, the electronic device 100 can receive user input operations on the dialog box of the "group chat," such as a click operation. In response to the user's input operation, the electronic device 100 can display... Figure 3C The chat interface shown. Figure 3C The chat interface shown includes multiple chat records and a navigation bar 3001. For example, the multiple chat records include a file 3002 sent by the contact "Lily".
[0137] In some embodiments, a user can long-press on file 3002 and drag file 3002 to the display area where navigation bar 3001 is located, so that the voice assistant application can return one or more operation intentions based on file 3002.
[0138] like Figure 3C and Figure 3D As shown, the electronic device 100 can receive a user's first operation on the file 3002, such as a long press and drag operation on the file 3002. In response to the first operation, the electronic device 100 can display a control 3003, which can also be located in... Figure 3D The location of the user's finger is shown.
[0139] like Figure 3C and Figure 3D As shown, in response to the distance between the control 3003 and the navigation bar 3001 being less than a first threshold, the electronic device 100 can change the display form of the navigation bar 3001. For example, the electronic device 100 can display... Figure 3D The response hotspot 3009 shown has a larger display area than the navigation bar 3001, prompting the user to drag the control 3003 into the response hotspot 3009.
[0140] Optionally, if the distance between control 3003 and navigation bar 3001 is greater than the first threshold, electronic device 100 will continue to display navigation bar 3001.
[0141] Optionally, the distance between the control 3003 and the navigation bar 3001 can refer to the distance between the center point of the control 3003 and the center point of the navigation bar 3001, the distance between the upper edge of the control 3003 and the upper edge of the navigation bar 3001, or the distance between the lower edge of the control 3003 and the lower edge of the navigation bar 3001. This application does not limit the implementation of the distance between the control 3003 and the navigation bar 3001.
[0142] like Figure 3D and Figure 3E As shown, the electronic device 100 can continue to receive the user's first operation on the control 3003. For example, the first operation can be a long press and drag operation on the control 3003. In response to the first operation, the control 3003 can move with the movement of the user's finger. For example, the control 3003 can be located at... Figure 3E The location of the user's finger is shown.
[0143] like Figure 3D and Figure 3E As shown, Figure 3E The distance between the central control 3003 and the navigation bar 3001 is less than the first threshold, and Figure 3EThe distance between the central control 3003 and the navigation bar 3001 is less than Figure 3D The distance between the central control 3003 and the navigation bar 3001 allows the electronic device 100 to change the display format of the responsive hotspot 3009. For example, the electronic device 100 can display... Figure 3E The response hotspot 3004 shown has a larger display area than the navigation bar 3001, prompting the user to drag the control 3003 into the response hotspot 3004.
[0144] Optionally, the area of the display area containing the response hotspot can vary with the distance between the control 3003 and the navigation bar 3001. If the distance between the control 3003 and the navigation bar 3001 gradually decreases, the area of the display area containing the response hotspot also gradually increases until the area of the display area containing the response hotspot expands to a second threshold, at which point the area of the display area containing the response hotspot no longer changes. If the distance between the control 3003 and the navigation bar 3001 gradually increases, the area of the display area containing the response hotspot also gradually decreases until the distance between the control 3003 and the navigation bar 3001 exceeds a first threshold, at which point the electronic device 100 switches to displaying the navigation bar 3001.
[0145] like Figure 3E and Figure 3F As shown, the electronic device 100 can continue to receive the user's first operation on the control 3003. For example, the first operation can be a long press and drag operation on the control 3003. In response to the first operation, the control 3003 can move with the movement of the user's finger. For example, the control 3003 can be located at... Figure 3F The location of the user's finger is shown.
[0146] like Figure 3E and Figure 3F As shown, Figure 3F The distance between the central control 3003 and the navigation bar 3001 is less than the first threshold, and Figure 3E The distance between the central control 3003 and the navigation bar 3001 is less than Figure 3E The distance between the control 3003 and the response hotspot 3004 allows the electronic device 100 to change the display format of the response hotspot 3004; for example, the electronic device 100 can display... Figure 3F The response hotspot 3005 shown has a larger area than the display area of the response hotspot 3004, prompting the user to drag the control 3003 into the response hotspot 3005.
[0147] Optional, if Figure 3FThe area of the display area where the response hotspot 3005 is located is the second threshold. If the user continues to drag the control 3003 downwards, the electronic device 100 will no longer expand the area of the display area where the response hotspot 3005 is located, and will continue to display the response hotspot 3005.
[0148] like Figure 3F and Figure 3G As shown, the electronic device 100 can continue to receive the user's first operation on the control 3003. For example, the first operation can be a long press and drag operation on the control 3003. In response to the first operation, the control 3003 can move with the movement of the user's finger. For example, the control 3003 can be located at... Figure 3G The location of the user's finger is shown.
[0149] like Figure 3F and Figure 3G As shown, the area of the display region where the response hotspot 3005 is located is the second threshold, even if Figure 3G The distance between the central control 3003 and the navigation bar 3001 is less than Figure 3F The distance between the control 3003 and the response hotspot 3004 is such that the electronic device 1000 no longer expands the display area where the response hotspot 3005 is located, and continues to display the response hotspot 3005.
[0150] like Figure 3G and Figure 3H As shown, when the control 3003 is within the response hot zone 3005, the user releases their finger. In response to the user releasing their finger, the voice assistant application in the electronic device 100 can determine one or more operation intentions based on the document 3002, and display one or more operation options based on the one or more operation intentions. The one or more operation options are related to one or more operation intentions.
[0151] For example, electronic device 100 can display Figure 3H The window 3010 shown includes controls 3003, options 3006, 3007, and 3008. The user can save file 3002 to the favorites folder of electronic device 100 via option 3006. The user can send file 3002 to a printer and print it via option 3007. The user can use option 3006 to translate the text in the first language of file 3002 into a second language, which is different from the first language.
[0152] Optionally, different users may have different intentions regarding the operation of file 3002, and the operation options displayed in window 3010 will also be different.
[0153] Optionally, as the user drags file 3002 into the response hotspot 3005, the electronic device 100 may change the display format of file 3002, such as by darkening the color, to indicate to the user that the currently dragged content is file 3002.
[0154] Optionally, the operation options displayed on the electronic device 100 can also be different depending on the content dragged by the user.
[0155] Figures 4A-4F This diagram illustrates another scenario where a user drags the first content and releases it within the target response hotspot.
[0156] For example, the first content can be text.
[0157] like Figure 4A As shown, the electronic device 100 can display a dialog box with the contact "Henry", which displays multiple chat records and a navigation bar 3001. For example, among the multiple chat records is text 4001 sent by the contact "Lily", which includes "Japanese restaurant in Kexing Science Park".
[0158] In some embodiments, a user can long press and drag the text 4001 to move it into the display area where the navigation bar 3001 is located, so that the voice assistant application can return one or more operation intentions based on the text 4001.
[0159] like Figure 4A and Figure 4B As shown, the electronic device 100 can receive a user's first operation on the text 4001, such as a long press and drag operation on the text 4001. In response to the first operation, the electronic device 100 can display a control 4002, which can also be located in... Figure 4B The location of the user's finger is shown.
[0160] like Figure 4A and Figure 4B As shown, in response to the distance between the control 4002 and the navigation bar 3001 being less than a first threshold, the electronic device 100 can change the display form of the navigation bar 3001. For example, the electronic device 100 can display... Figure 4B The response hotspot 3009 shown has a larger display area than the navigation bar 3001, prompting the user to drag the control 4002 into the response hotspot 3009.
[0161] Optionally, if the distance between control 4002 and navigation bar 3001 is greater than the first threshold, electronic device 100 will continue to display navigation bar 3001.
[0162] Optionally, the distance between control 4002 and navigation bar 3001 can be the distance between the center point of control 4002 and the center point of navigation bar 3001, the distance between the upper edge of control 4002 and the upper edge of navigation bar 3001, or the distance between the lower edge of control 4002 and the lower edge of navigation bar 3001. This application does not limit the implementation of the distance between control 4002 and navigation bar 3001.
[0163] like Figure 4B and Figure 4C As shown, the electronic device 100 can continue to receive the user's first operation on the control 4002. For example, the first operation can be a long press and drag operation on the control 4002. In response to the first operation, the control 4002 can move with the movement of the user's finger. For example, the control 4002 can be located at... Figure 4C The location of the user's finger is shown.
[0164] like Figure 4B and Figure 4C As shown, Figure 4C The distance between the central control 4002 and the navigation bar 3001 is less than the first threshold, and Figure 4C The distance between the middle control 4002 and the navigation bar 3001 is less than Figure 4B The distance between the central control 4002 and the navigation bar 3001 allows the electronic device 100 to change the display format of the responsive hotspot 3009. For example, the electronic device 100 can display... Figure 4C The response hotspot 3004 shown has a larger display area than the navigation bar 3001, prompting the user to drag the control 4002 into the response hotspot 3004.
[0165] Optionally, the area of the display area containing the response hotspot can vary with the distance between the control 4002 and the navigation bar 3001. If the distance between the control 4002 and the navigation bar 3001 gradually decreases, the area of the display area containing the response hotspot also gradually increases until the area of the display area containing the response hotspot expands to a second threshold, at which point the area of the display area containing the response hotspot no longer changes. If the distance between the control 4002 and the navigation bar 3001 gradually increases, the area of the display area containing the response hotspot also gradually decreases until the distance between the control 4002 and the navigation bar 3001 exceeds a first threshold, at which point the electronic device 100 switches to displaying the navigation bar 3001.
[0166] like Figure 4C and Figure 4DAs shown, the electronic device 100 can continue to receive the user's first operation on the control 4002. For example, the first operation can be a long press and drag operation on the control 4002. In response to the first operation, the control 4002 can move with the movement of the user's finger. For example, the control 4002 can be located at... Figure 4D The location of the user's finger is shown.
[0167] like Figure 4C and Figure 4D As shown, Figure 4D The distance between the central control 4002 and the navigation bar 3001 is less than the first threshold, and Figure 4D The distance between the middle control 4002 and the navigation bar 3001 is less than Figure 4C The distance between the control 4002 and the response hotspot 3004 allows the electronic device 100 to change the display format of the response hotspot 3004; for example, the electronic device 100 can display... Figure 4D The response hotspot 3005 shown has a larger area than the display area of the response hotspot 3004, prompting the user to drag the control 4002 into the response hotspot 3005.
[0168] Optional, if Figure 4D The area of the display area where the response hotspot 3005 is located is the second threshold. If the user continues to drag the control 4002 downwards, the electronic device 100 will no longer expand the area of the display area where the response hotspot 3005 is located, and will continue to display the response hotspot 3005.
[0169] like Figure 4D and Figure 4E As shown, the electronic device 100 can continue to receive the user's first operation on the control 4002. For example, the first operation can be a long press and drag operation on the control 4002. In response to the first operation, the control 4002 can move with the movement of the user's finger. For example, the control 4002 can be located at... Figure 4E The location of the user's finger is shown.
[0170] like Figure 4D and Figure 4E As shown, the area of the display region where the response hotspot 3005 is located is the second threshold, even if Figure 4E The distance between the middle control 4002 and the navigation bar 3001 is less than Figure 4D The distance between the control 4002 and the response hotspot 3004 is such that the electronic device 1000 no longer expands the display area where the response hotspot 3005 is located, and continues to display the response hotspot 3005.
[0171] like Figure 4E and Figure 4FAs shown, when the control 4002 is within the response hot zone 3005, the user releases their finger. In response to the user releasing their finger, the voice assistant application in the electronic device 100 can determine one or more operation intentions based on the text 4001, and display one or more operation options based on the one or more operation intentions. The one or more operation options are related to one or more operation intentions.
[0172] For example, electronic device 100 can display Figure 4F The window 4003 shown includes controls 4002, options 4004, 4005, and 4006. Users can use option 4004 to obtain and display navigation routes with the location in text 4001 as the destination and the location of electronic device 100 as the starting point. Users can use option 4005 to translate text in the first language of text 4001 into text in a second language, which is different from the first language. Users can use option 4006 to save text 4001 to the clipboard, enabling them to paste text 4001 into other applications and send text 4001 to other applications.
[0173] Optionally, different users may have different intentions regarding the operation of text 4001, and the operation options displayed in window 4003 will also be different.
[0174] Optionally, while the user is dragging text 4001 into the response hotspot 3005, the electronic device 100 may change the display format of text 4001, such as by darkening the color, to indicate to the user that the currently dragged content is text 4001.
[0175] Figures 5A-5G This diagram illustrates yet another scenario where a user drags the first content and releases it within the target response hotspot.
[0176] For example, the first content could be an image.
[0177] like Figure 5A As shown, the electronic device 100 displays a desktop with an icon for the gallery application. The electronic device 100 can receive user input actions on the gallery application icon, such as a click. In response to the user's input actions, the electronic device 100 can display... Figure 5B The image gallery interface shown includes multiple images and a navigation bar 3001, among which image 5001 is included.
[0178] In some embodiments, a user can long-press text 4001 and drag image 5001 to the display area where navigation bar 3001 is located, so that the voice assistant application can return one or more operation intentions based on image 5001.
[0179] like Figure 5B and Figure 5C As shown, the electronic device 100 can receive a first operation from the user on the image 5001, such as a long press and drag operation on the image 5001. In response to the first operation, the electronic device 100 can display a control 5002, which can also be located in... Figure 5C The location of the user's finger is shown.
[0180] like Figure 5B and Figure 5C As shown, in response to the distance between control 5002 and navigation bar 3001 being less than a first threshold, electronic device 100 can change the display form of navigation bar 3001. For example, electronic device 100 can display... Figure 5C The response hotspot 3009 shown has a larger display area than the navigation bar 3001, prompting the user to drag the control 5002 into the response hotspot 3009.
[0181] Optionally, if the distance between control 5002 and navigation bar 3001 is greater than the first threshold, electronic device 100 will continue to display navigation bar 3001.
[0182] Optionally, the distance between control 5002 and navigation bar 3001 can refer to the distance between the center point of control 5002 and the center point of navigation bar 3001, the distance between the upper edge of control 5002 and the upper edge of navigation bar 3001, or the distance between the lower edge of control 5002 and the lower edge of navigation bar 3001. This application does not limit the implementation of the distance between control 5002 and navigation bar 3001.
[0183] like Figure 5C and Figure 5D As shown, the electronic device 100 can continue to receive the user's first operation on the control 5002. For example, the first operation can be a long press and drag operation on the control 5002. In response to the first operation, the control 5002 can move with the movement of the user's finger. For example, the control 5002 can be located at... Figure 5D The location of the user's finger is shown.
[0184] like Figure 5C and Figure 5D As shown, Figure 5D The distance between the central control 5002 and the navigation bar 3001 is less than the first threshold, and Figure 5D The distance between control 5002 and navigation bar 3001 is less than Figure 5C The distance between the central control 5002 and the navigation bar 3001 allows the electronic device 100 to change the display format of the responsive hotspot 3009. For example, the electronic device 100 can display... Figure 5D The response hotspot 3004 shown has a larger display area than the navigation bar 3001, prompting the user to drag the control 5002 into the response hotspot 3004.
[0185] Optionally, the area of the display area containing the response hotspot can vary with the distance between the control 5002 and the navigation bar 3001. If the distance between the control 5002 and the navigation bar 3001 gradually decreases, the area of the display area containing the response hotspot also gradually increases until the area of the display area containing the response hotspot expands to a second threshold, at which point the area of the display area containing the response hotspot no longer changes. If the distance between the control 5002 and the navigation bar 3001 gradually increases, the area of the display area containing the response hotspot also gradually decreases until the distance between the control 5002 and the navigation bar 3001 exceeds a first threshold, at which point the electronic device 100 switches to displaying the navigation bar 3001.
[0186] like Figure 5D and Figure 5E As shown, the electronic device 100 can continue to receive the user's first operation on the control 5002. For example, the first operation can be a long press and drag operation on the control 5002. In response to the first operation, the control 4002 can move with the movement of the user's finger. For example, the control 5002 can be located at... Figure 5E The location of the user's finger is shown.
[0187] like Figure 5D and Figure 5E As shown, Figure 5E The distance between the central control 5002 and the navigation bar 3001 is less than the first threshold, and Figure 5E The distance between control 5002 and navigation bar 3001 is less than Figure 5D The distance between the control 5002 and the response hotspot 3004 allows the electronic device 100 to change the display format of the response hotspot 3004; for example, the electronic device 100 can display... Figure 5E The response hotspot 3005 shown has a larger area than the display area of the response hotspot 3004, prompting the user to drag the control 5002 into the response hotspot 3005.
[0188] Optional, if Figure 5E The area of the display area where the response hotspot 3005 is located is the second threshold. If the user continues to drag the control 4002 downwards, the electronic device 100 will no longer expand the area of the display area where the response hotspot 3005 is located, and will continue to display the response hotspot 3005.
[0189] like Figure 5E and Figure 5FAs shown, the electronic device 100 can continue to receive the user's first operation on the control 5002. For example, the first operation can be a long press and drag operation on the control 5002. In response to the first operation, the control 4002 can move with the movement of the user's finger. For example, the control 5002 can be located at... Figure 5F The location of the user's finger is shown.
[0190] like Figure 5E and Figure 5F As shown, the area of the display region where the response hotspot 3005 is located is the second threshold, even if Figure 5F The distance between control 5002 and navigation bar 3001 is less than Figure 5E The distance between the control 5002 and the response hotspot 3004 is such that the electronic device 1000 no longer expands the display area where the response hotspot 3005 is located, and continues to display the response hotspot 3005.
[0191] like Figure 5F and Figure 5G As shown, when the control 5002 is within the response hot zone 3005, the user releases their finger. In response to the user releasing their finger, the voice assistant application in the electronic device 100 can determine one or more operation intentions based on the text 4001, and display one or more operation options based on the one or more operation intentions. The one or more operation options are related to one or more operation intentions.
[0192] For example, electronic device 100 can display Figure 5G The window 4003 shown includes controls 5002, options 5004, 5005, and 5006. Users can edit image 5001 using option 5004, such as adding filters. Users can share image 5001 to other applications or devices using option 5005. Users can obtain an image of the target object in image 5001 using option 5006.
[0193] Optionally, different users may have different intentions regarding the operation of image 5001, and the operation options displayed in window 4003 will also be different.
[0194] Optionally, while the user is dragging the image 5001 into the response hotspot 3005, the electronic device 100 may change the display format of the image 5001, for example, by darkening the color, to indicate to the user that the currently dragged content is the image 5001.
[0195] Optional, Figures 3A-5G The response hotspots 3009, 3004, and 3005 shown in the embodiment are essentially the same response hotspot, only with different display sizes.
[0196] Figure 6 This application provides a flowchart illustrating a method for a user to drag and drop first content and release it within a target response hotspot.
[0197] The method by which a user drags and releases the first content within the target response hot zone includes, but is not limited to, the following steps:
[0198] S601, Electronic device 100 displays a first user interface of a first application, the first user interface including first content and a first navigation bar.
[0199] For example, the first user interface could be Figure 3C The chat interface shown can have the following content as the first message: Figure 3C The first navigation bar in the document 3002 shown can be... Figure 3C The navigation bar shown is 3001.
[0200] For example, the first user interface could be Figure 4A The dialog box shown can have the following content as its first element: Figure 4A The text 4001 shown can be the first navigation bar. Figure 4A The navigation bar shown is 3001.
[0201] For example, the first user interface could be Figure 5B The gallery interface shown can have the following content as the first item: Figure 5B The first navigation bar in the image 5001 shown can be... Figure 5B The navigation bar shown is 3001.
[0202] S602, the electronic device 100 receives and performs a first operation on the first content, and displays a first control. The first operation is to long press the first content and drag the first control to the display area where the first navigation bar is located.
[0203] In response to a first operation on the first content, the electronic device 100 may display a first control, which indicates that the content dragged by the user is the first content.
[0204] For example, the first operation could be Figure 3C The first user action shown for file 3002 can be represented by the first control. Figure 3D The control shown is 3003.
[0205] For example, the first operation could be Figure 4A The first user action shown is on text 4001; the first control could be... Figure 4B The control shown is 4002.
[0206] For example, the first operation could be Figure 5BThe first user action shown for image 5001 can be represented by the first control. Figure 5C The control shown is 5002.
[0207] S603, Electronic device 100 needs to confirm whether the distance between the first control and the first navigation bar is less than or equal to the first threshold.
[0208] After the electronic device 100 displays the first control, the electronic device 100 can continue to receive the user's first operation on the first control. The electronic device 100 needs to confirm whether the distance between the first control and the first navigation bar is less than or equal to a first threshold.
[0209] When the distance between the first control and the first navigation bar is less than or equal to the first threshold, the electronic device 100 can change the display form of the first navigation bar, that is, execute S606-S616.
[0210] If the distance between the first control and the first navigation bar is greater than a first threshold, the electronic device 100 can continue to display the first navigation bar, i.e., execute S604-S605.
[0211] Optionally, S603 can also be replaced by the following steps: S603, electronic device 100 needs to confirm whether the position of the first control meets the preset conditions.
[0212] After the electronic device 100 displays the first control, the electronic device 100 can continue to receive the user's first operation on the first control. The electronic device 100 needs to confirm whether the position of the first control meets the preset conditions.
[0213] When the position of the first control meets the preset conditions, the electronic device 100 can change the display form of the first navigation bar, that is, execute S606-S616.
[0214] If the position of the first control does not meet the preset conditions, the electronic device 100 can continue to display the first navigation bar, that is, execute S604-S605.
[0215] Optionally, the preset condition can refer to the position of the first control being in a preset position.
[0216] S604, Electronic device 100 continues to display the first control and the first navigation bar.
[0217] If the distance between the first control and the first navigation bar is greater than a first threshold, the electronic device 100 may continue to display the first control and the first navigation bar.
[0218] After displaying the first control and the first navigation bar, the electronic device 100 can receive a first operation from the user on the first control, and based on the first operation, confirm whether the distance between the first control and the first navigation bar is less than a first threshold, so as to determine whether to continue displaying the first navigation bar or stop displaying the first navigation bar and start displaying the first response hotspot.
[0219] Optionally, if the first operation is to long press the first control and drag the first control to move it in the opposite direction to the display area where the first navigation bar is located, the electronic device 100 can continue to display the first control and the first navigation bar.
[0220] Optionally, if the first operation is a long press and drag operation of the first control towards the display area where the first navigation bar is located, the electronic device 100 needs to confirm whether the distance between the first control and the first navigation bar is less than a first threshold. If the distance between the first control and the first navigation bar is less than the first threshold, the electronic device 100 stops displaying the first navigation bar and starts displaying the first response hotspot. If the distance between the first control and the first navigation bar is greater than the first threshold, the electronic device 100 continues to display the first navigation bar.
[0221] Optionally, if the user releases their finger, the electronic device 100 may stop displaying the first control and continue displaying the first user interface of the first application.
[0222] Optionally, electronic device 100 may not execute S603-S604.
[0223] S605, the electronic device 100 displays a first response hot zone of size A, the display size of the first response hot zone is larger than the display size of the first navigation bar.
[0224] Optionally, the display size of the first response hotspot can be determined based on the distance between the position of the first control and the display area where the first navigation bar is located. The display size of the first response hotspot can also vary depending on the distance between the position of the first control and the display area where the first navigation bar is located.
[0225] S606, the electronic device 100 continues to receive the first operation on the first control and changes the display size of the first response hot zone according to the drag distance.
[0226] When the distance between the first control and the first navigation bar is less than a first threshold, the electronic device 100 can change the display form of the first navigation bar. For example, the electronic device 100 can display a first response hotspot of size A, the display size of which is larger than the display size of the first navigation bar, to prompt the user to drag the first control to the display area where the first response hotspot is located.
[0227] After the electronic device 100 displays the first response hotspot, the electronic device 100 can continue to receive the user's first operation on the first control.
[0228] Optionally, if the first operation is to long press the first control and move it in the direction of the display area where the first navigation bar is located, the electronic device 100 can enlarge the display size of the first response hot zone until the display size of the first response hot zone is equal to the second threshold, and the display size of the first response hot zone no longer changes.
[0229] Optionally, if the first operation is a long press on the first control and a movement in the opposite direction to the display area where the first navigation bar is located, the electronic device 100 may reduce the display size of the first response hotspot. Optionally, the electronic device 100 stops displaying the first response hotspot until the distance between the position of the first control and the display area where the first navigation bar is located is greater than a first threshold. The first navigation bar is then displayed.
[0230] Optionally, after the electronic device 100 displays the first response hotspot, if the user releases their finger and the first control is within the first response hotspot, the electronic device 100 can execute steps S 609-S 612. If the first control is not within the first response hotspot, the electronic device 100 continues to display the first user interface of the first application, i.e., executes step S608.
[0231] For example, the first response thermal zone of size A can be Figure 3D The response hotspot 3009 shown can be used for the first operation on the first control. Figure 3D The operation of long-pressing and dragging control 3003 is shown. Alternatively, the first response hotspot of size A can be... Figure 3E The response hotspot 3004 shown can be used for the first operation of the first control. Figure 3E The operation of long-pressing and dragging control 3003 is shown. Alternatively, the first response hotspot of size A can be... Figure 3F The response hotspot 3005 shown can be used for the first operation of the first control. Figure 3F The operation of long-pressing and dragging control 3003 is shown.
[0232] For example, the first response thermal zone of size A can be Figure 4B The response hotspot 3009 shown can be used for the first operation of the first control. Figure 4B The operation of long-pressing and dragging control 4002 is shown. Alternatively, the first response hotspot of size A can be... Figure 4C The response hotspot 3004 shown can be used for the first operation of the first control. Figure 4C The operation of long-pressing and dragging control 4002 is shown. Alternatively, the first response hotspot of size A can be... Figure 4DThe response hotspot 3005 shown can be used for the first operation of the first control. Figure 4D The operation of long-pressing and dragging control 4002 is shown.
[0233] For example, the first response thermal zone of size A can be Figure 5C The response hotspot 3009 shown can be used for the first operation of the first control. Figure 5C The operation of long-pressing and dragging control 5002 is shown. Alternatively, the first response hotspot of size A can be... Figure 5D The response hotspot 3004 shown can be used for the first operation of the first control. Figure 5D The operation of long-pressing and dragging control 5002 is shown. Alternatively, the first response hotspot of size A can be... Figure 5E The response hotspot 3005 shown can be used for the first operation of the first control. Figure 5E The operation of long-pressing and dragging control 5002 is shown.
[0234] S607, Electronic device 100 detects whether the user releases the first control when it is within the first response hot zone.
[0235] If the user releases the control while it is within the first response hot zone, the electronic device 100 can execute S609-S612.
[0236] If the user does not release the control when it is within the first response hot zone, the electronic device 100 can execute S608.
[0237] Optionally, the first control being located within the first response hot zone can mean that the entire content of the first control is located within the first response hot zone, or it can mean that part of the content of the first control is located within the first response hot zone. This application does not limit this.
[0238] S608, electronic device 100 continues to display the first user interface of the first application.
[0239] If the user does not release the control when it is within the first response hot zone, the conditions for the user to interact with the voice assistant application are not met, and the electronic device 100 can continue to display the first user interface of the first application.
[0240] S609, Electronic device 100 sends the first content to server 200.
[0241] S610 and Server 200 confirm one or more operational intentions based on the first content.
[0242] S611, Server 200 sends one or more operational intentions to Electronic Device 100.
[0243] S612, Electronic device 100 displays first content and one or more options, which are related to one or more operational intentions.
[0244] If the user releases the control when it is within the first response hot zone, the conditions for the user to interact with the voice assistant application are met. The electronic device 100 can send the first content to the server 200 through the voice assistant application. The server 200 can be the server of the voice assistant application.
[0245] After obtaining the first piece of content, server 200 can determine one or more operational intentions based on the first piece of content. These one or more operational intentions are related to user profiles, which can reflect the behavioral habits and characteristics of users. These user profiles can be obtained by server 200 based on user data.
[0246] Optionally, different users have different user profiles, and the server 200 may obtain one or more different operational intentions for different users based on the first content.
[0247] After confirming one or more operation intentions, server 200 can send one or more operation intentions to electronic device 100. Upon receiving one or more operation intentions sent by server 200, electronic device 100 can display first content and one or more options, which are related to one or more operation intentions. The user can perform corresponding operations on the first content based on one or more options.
[0248] For example, when the first content is a file, one or more options can be Figure 3H The options shown are 3006, 3007, and 3008.
[0249] For example, when the primary content is text, one or more options can be Figure 4F The options shown are 4004, 4005, and 4006.
[0250] For example, when the first content is an image, one or more options can be Figure 5G The options shown are 5004, 5005, and 5006.
[0251] Optionally, S609-S611 can also be executed by electronic device 100.
[0252] It should be noted that, Figure 6 The steps described herein are for illustrative purposes only and are not intended to explain this application. Figure 6 The order in which the steps are executed is not a limitation.
[0253] 2. Before the user drags the first control into the target response hotspot, the size of the display area where the response hotspot is located changes with the position of the first control.
[0254] Figures 7A-7F A schematic diagram is shown showing how the size of the display area containing the response hotspot changes as the position of the first control changes.
[0255] For example, refer to Figures 3A-3E As described in the embodiments, in response to a user's first operation on file 3002, such as a long press and drag operation on file 3002, electronic device 100 can display control 3003. If the distance between control 3003 and navigation bar 3001 is less than a first threshold, electronic device 100 can display... Figure 7A The response hot zone 3004 is shown.
[0256] Users can long press and move control 3003, and the size of the display area where the response hotspot 3004 is located changes with the position of control 3003.
[0257] For example, in Figure 3E Following the examples, as Figure 7A As shown, the electronic device 100 can receive user operations on the control 3003, such as a long press and a movement in the opposite direction to the response hotspot 3004. In response to this user operation, the distance between the control 3003 and the navigation bar 3001 gradually increases. For example, the control 3003 may be located at... Figure 7B The location shown.
[0258] like Figure 7B The distance between the position of the control 3003 and the navigation bar 3001 shown is less than a first threshold, so the electronic device 100 can display... Figure 7B The area of the display area where the response hot zone 7001 is located is smaller than the area of the display area where the response hot zone 3004 is located.
[0259] For example, such as Figure 7C As shown, the electronic device 100 can receive user operations on the control 3003, such as a long press and a movement in the opposite direction to the response hotspot 7001. In response to this user operation, the distance between the control 3003 and the navigation bar 3001 gradually increases. For example, the control 3003 may be located at... Figure 7D The location shown.
[0260] like Figure 7D When the distance between the position of the control 3003 and the navigation bar 3001 is greater than a first threshold, the electronic device 100 can display... Figure 7D The navigation bar shown is 3001.
[0261] For example, such as Figure 7E As shown, the electronic device 100 can receive user operations on the control 3003, such as long-pressing and moving it towards the response hotspot 3004. In response to this user operation, the distance between the control 3003 and the navigation bar 3001 gradually decreases. For example, the control 3003 may be located at... Figure 7F The location shown.
[0262] like Figure 7F The distance between the position of the control 3003 and the navigation bar 3001 shown is less than a first threshold, so the electronic device 100 can display... Figure 7F The area of the display area where the response hotspot 7002 is located is larger than the area of the display area where the response hotspot 7001 is located.
[0263] In other words, before the control 3003 is located within the target response hot zone, when the distance between the control 3003 and the navigation bar 3001 is less than the first threshold, the size of the display area where the response hot zone is located changes with the distance between the control 3003 and the navigation bar 3001. Until the area of the display area where the response hot zone is located is greater than the second threshold, if the distance between the control 3003 and the navigation bar 3001 continues to decrease, the area of the display area where the response hot zone is located will no longer change.
[0264] Optional, Figures 7A-7F The response hotspots 3009, 3004, 7001, and 7002 shown in the embodiments are essentially the same response hotspot, only with different display sizes.
[0265] Figure 8 A flowchart illustrating a method for changing the size of the display area containing the response hotspot as the position of the first control changes.
[0266] S801, Display the first control and the first response hotspot, wherein the display size of the first response hotspot is larger than the display size of the first navigation bar.
[0267] For example, the first control could be Figure 7A The control 3003 shown can have a first response hotspot that is Figure 7A The response hot zone 3004 is shown.
[0268] For example, the first control could also be Figure 7C The control 3003 shown can have a first response hotspot that is Figure 7C The response hot zone 7001 is shown.
[0269] S802, Electronic device 100 receives a first operation on the first control.
[0270] S803, Electronic device 100 needs to confirm whether the distance between the first control and the first navigation bar is less than or equal to the first threshold.
[0271] After the electronic device 100 displays the first control and the first response hotspot, the electronic device 100 can receive the user's first operation on the first control and change the display position of the first control.
[0272] Optionally, the first operation could be a long press on the first control and a movement in the opposite direction to the first response hotspot. For example, the first operation could be... Figure 7A The operation shown is a long press on control 3003 and a movement in the opposite direction to the response hotspot 3004. For example, the first operation could be... Figure 7C The operation shown is to press and hold control 3003 and move it in the opposite direction to the response hotspot 7001.
[0273] Optionally, the first action can also be a long press on the first control and a movement towards the first responsive hotspot. For example, the first action could be... Figure 7E The operation shown is to long press the control 3003 and move it to the response hotspot 3004.
[0274] In response to the first operation, the electronic device 100 needs to confirm whether the distance between the first control and the first navigation bar is less than the first threshold.
[0275] If the distance between the first control and the first navigation bar is less than the first threshold, the electronic device 100 can continue to display the first response hot zone, i.e., execute S805.
[0276] If the distance between the first control and the first navigation bar is greater than a first threshold, the electronic device 100 stops displaying the first response hot zone, that is, executes S804.
[0277] For a description of S803, please refer to S603; this application will not repeat it here.
[0278] S804, Electronic device 100 continues to display the first control and the first navigation bar.
[0279] When the distance between the first control and the first navigation bar exceeds a first threshold, the electronic device 100 stops displaying the first response hotspot and displays the first control and the first navigation bar. For example, the first navigation bar could be... Figure 7D The navigation bar shown is 3001.
[0280] Optionally, S803-S804 can be omitted.
[0281] S805, electronic device 100 changes the display size of the first response hot zone based on the first operation.
[0282] If the distance between the first control and the first navigation bar is less than a first threshold, the electronic device 100 may continue to display the response hotspot.
[0283] In some embodiments, if the first operation is a long press on the first control and a movement towards the first response hotspot, that is, the closer the distance between the first control and the first navigation bar, the larger the display of the first response hotspot can be based on the first operation. For example, the first response hotspot after the display size change can be... Figure 7F The response hot zone 7002 is shown.
[0284] In some embodiments, if the first operation is a long press on the first control and a movement in the opposite direction to the first response hotspot, that is, the greater the distance between the first control and the first navigation bar, the smaller the display area of the first response hotspot can be based on the first operation. For example, the first response hotspot after the display size change can be... Figure 7B The response hot zone 7001 is shown.
[0285] pass Figure 8 The method shown in the embodiment, before the first control is located within the target response hot zone, when the distance between the first control and the first navigation bar is less than a first threshold, the size of the display area where the response hot zone is located changes with the distance between the first control and the first navigation bar, until the area of the display area where the response hot zone is located is greater than a second threshold. If the distance between the first control and the first navigation bar continues to decrease, the area of the display area where the response hot zone is located will no longer change.
[0286] It should be noted that, Figure 8 The steps described herein are for illustrative purposes only and are not intended to explain this application. Figure 6 The order in which the steps are executed is not a limitation.
[0287] 3. After the user drags the first control into the target response hotspot, the size of the display area where the response hotspot is located changes as the position of the first control changes.
[0288] Figures 9A-9J This diagram illustrates how the size of the display area containing another response hotspot changes as the position of the first control changes.
[0289] For example, refer to Figures 3A-3FAs described in the embodiments, in response to a user's first operation on file 3002, such as a long press and drag operation on file 3002, electronic device 100 can display control 3003. If the distance between control 3003 and navigation bar 3001 is less than a first threshold, electronic device 100 can display... Figure 9A The response hot zone 3005 is shown.
[0290] For example, in Figure 3F After the implementation, as Figure 9A and Figure 9B As shown, the user can press and hold the control 3003 in the opposite direction of the response hotspot 3005, and move the control 3003 to... Figure 9B The position shown. Responding to control 3003 being located at... Figure 9B As shown, when the distance between control 3003 and navigation bar 3001 is less than a first threshold, and control 3003 is located outside the display area of response hotspot 3005, electronic device 100 can display... Figure 9B The response hot zone shown is 3009.
[0291] For example, such as Figure 9C and Figure 9D As shown, the user can press and hold the control 3003 and move it in the opposite direction of the response hotspot 3009, and move the control 3003 to... Figure 9D The position shown. Responding to control 3003 being located at... Figure 9D At the position shown, when the distance between control 3003 and navigation bar 3001 is greater than a first threshold, electronic device 100 can display... Figure 9D The navigation bar shown is 3001.
[0292] Optionally, in response to control 3003 located in Figure 9D As shown, the electronic device 100 can also display the information when the distance between control 3003 and navigation bar 3001 is greater than the first threshold. Figure 9B The response hot zone shown is 3009.
[0293] For example, such as Figure 9E and Figure 9F As shown, the user can long press and move control 3003 towards the response hotspot 3009, and move control 3003 to... Figure 9F The position shown. Responding to control 3003 being located at... Figure 9F At the position shown, when the distance between control 3003 and navigation bar 3001 is less than a first threshold, electronic device 100 can display... Figure 9F The response hot zone shown is 3009.
[0294] For example, such as Figure 9Gand Figure 9H As shown, the user can long press and move control 3003 towards the response hotspot 3009, and move control 3003 to... Figure 9G Within the dialog box 9001 shown. Move control 3003 to... Figure 9H After the user releases their finger in the dialog box 9001 shown, the electronic device 100 can share the file 3002 to the "group chat" and display it. Figure 9H The dialog box shown. Figure 9H As shown, the dialog box includes file 3002 shared by the local user "Leo" with other contacts in the "group chat".
[0295] After the user releases their finger, the electronic device 100 stops displaying the control 3003 and the response hotspot 3009, and displays... Figure 9H The navigation bar shown is 3001.
[0296] For example, such as Figure 9I and Figure 9J As shown, the user can long press and move control 3003 towards the response hotspot 3009, and move control 3003 to... Figure 9J The position shown. Responding to control 3003 being located at... Figure 9J As shown, when the distance between control 3003 and navigation bar 3001 is less than a first threshold, and control 3003 is located within the response hot zone 3009, the electronic device 100 can display... Figure 9J The response hot zone 3005 is shown.
[0297] Optional, in Figure 9B , Figure 9D , Figure 9F If the electronic device 100 stops receiving the user's first operation, such as when the user releases their finger, the electronic device 100 can stop displaying the control 3003 and the response hotspot, and display the navigation bar 3001.
[0298] Optional, in Figure 9A , Figure 9I If the electronic device 100 stops receiving the user's first operation, such as when the user releases their finger, the electronic device 100 can display... Figure 3H The window shown is 3010.
[0299] Figure 10A This diagram illustrates how the size of the display area containing another response hotspot changes as the position of the first control changes.
[0300] S1001, Electronic device 100 displays a first control and a first response hot zone of size B, the first control being located within the first response hot zone.
[0301] Optionally, the first response hot zone of size B can also be referred to as the target response hot zone. Size B can also be referred to as the second threshold.
[0302] For example, the first control could be Figure 9A The control 3003 shown, the first response hotspot of size B can be Figure 9A The response hot zone 3005 is shown.
[0303] S1002, Electronic device 100 receives a first operation on the first control.
[0304] S1003, Electronic device 100 needs to confirm whether the first control has moved out of the first response hot zone.
[0305] Optionally, the first operation can also be a long press on the first control and a movement towards the first response hotspot.
[0306] Optionally, the first operation could be a long press on the first control and a movement in the opposite direction to the first response hotspot. For example, the first operation could be... Figure 9A The operation shown is to press and hold control 3003 and move it in the opposite direction to the response hotspot 3005.
[0307] In response to the first operation, the electronic device 100 needs to confirm whether the first control has moved out of the response hot zone 3005.
[0308] If the first control moves out of the first response hot zone, the electronic device 100 needs to shrink the display of the first response hot zone, that is, execute S1005.
[0309] If the first control is not moved out of the first response hot zone, the electronic device 100 can keep the display size of the first response hot zone unchanged, that is, execute S1004.
[0310] S1004, Electronic device 100 continues to display the first control and the first response hot zone of size B.
[0311] S1005, Electronic device 100 displays a first control and a first response hot zone of size C, where size C is smaller than size B.
[0312] If the first control is not moved out of the first response hot zone, the electronic device 100 can maintain the display size of the first response hot zone unchanged; for example, the electronic device 100 can continue to display. Figure 9A The response hot zone 3005 is shown.
[0313] When the first control moves out of the first response hotspot, the electronic device 100 needs to shrink the display of the first response hotspot, for example, displaying... Figure 9B The response hot zone shown is 3009.
[0314] S1006, Electronic device 100 receives a first operation on the first control.
[0315] S1007. Electronic device 100 needs to confirm whether the first control is located within the first response hot zone.
[0316] After the first control is moved out of the first response hotspot and the display of the first response hotspot is reduced, the electronic device 100 can receive the first operation for the first control.
[0317] Optionally, the first operation could be a long press on the first control and a movement operation in the opposite direction to the first responsive hotspot of size C. For example, the first operation could be... Figure 9C The operation shown is to press and hold control 3003 and move it in the opposite direction to the response hotspot 3009.
[0318] Optionally, the first operation can also be a long press on the first control and a movement operation towards the first responsive hotspot of size C. For example, the first operation could be... Figure 9E The operation shown is a long press on the control 3003 and a movement towards the response hotspot 3009. For example, the first operation could be... Figure 9I The operation shown is to long press the control 3003 and move it to the response hotspot 3009.
[0319] In response to the first operation, the electronic device 100 needs to confirm whether the first control is located within the first response hot zone.
[0320] When the first control is located within the first response hot zone, the electronic device 100 can expand the display of the first response hot zone again, i.e., execute S1009.
[0321] If the first control is still not located within the first response hot zone, the electronic device 100 may continue to display the first response hot zone of size C, i.e., execute S1008.
[0322] S1008, Electronic device 100 continues to display the first control and the first response hot zone of size C.
[0323] S1009, Electronic device 100 displays the first control and the first response hot zone of size B.
[0324] When the user moves the first control and places it within the first response hotspot, the electronic device 100 can further expand the display of the first response hotspot; for example, the first response hotspot of size B can be... Figure 9J The response hot zone 3005 is shown.
[0325] Even if the user moves the first control but does not place it within the first response hotspot, the electronic device 100 can continue to display the first response hotspot of size C. For example, the first response hotspot of size C could be... Figure 9D or Figure 9F The response hot zone shown is 3009.
[0326] Optionally, after the electronic device 100 shrinks the display of the first response hotspot, the user can send the first content to other applications or other devices through other means. For example, the user can save the first content in the relay station of the electronic device 100, and then send the first content to other applications or other devices through the relay station of the electronic device 100.
[0327] Optionally, S1006-S1009 can be omitted.
[0328] pass Figure 10A The method shown in the embodiment allows the electronic device 100 to reduce the display area of the response hotspot after the first control is located within the target response hotspot. If the user moves the first control out of the target response hotspot, the electronic device 100 can reduce the size of the display area to prevent the target response hotspot from becoming too large and obscuring other display areas of the first user interface. After the user moves the first control back into the reduced display area of the response hotspot, the electronic device 100 can re-display the target response hotspot. If the user releases the control within the target response hotspot, the first content can be shared to the voice assistant application.
[0329] Optionally, the second application is not limited to a voice assistant application, but can also be other applications. This application does not limit this application, but only uses a voice assistant application as an example for illustration.
[0330] It should be noted that, Figure 10A The steps described herein are for illustrative purposes only and are not intended to explain this application. Figure 6 The order in which the steps are executed is not a limitation.
[0331] In some embodiments, when the first control is not moved onto the first response hotspot, if the user moves the first control in a first direction and the movement of the first control meets a preset condition, the electronic device 100 can shrink the display of the first response hotspot. After the electronic device 100 shrinks the display of the first response hotspot, if the electronic device 100 receives a first operation from the user on the first control, and the first control is not moved onto the first response hotspot, the electronic device 100 still shrinks the display of the first response hotspot. If the electronic device 100 receives a first operation from the user on the first control, and the first control moves onto the first response hotspot, the electronic device 100 can enlarge the display of the first response hotspot.
[0332] Optionally, the first direction can be the opposite direction of the first response thermal zone, such as the direction from the first response thermal zone to the top of the display screen. The first direction can be perpendicular to the horizontal line, or it can be at an angle to the vertical line.
[0333] Figures 10B-10G This diagram illustrates how the size of the display area containing another type of response hotspot changes as the position of the first control changes.
[0334] For example, refer to Figures 3A-3F As described in the embodiments, in response to a user's first operation on file 3002, such as a long press and drag operation on file 3002, electronic device 100 can display control 3003. If the distance between control 3003 and navigation bar 3001 is less than a first threshold, electronic device 100 can display... Figure 9A The response hot zone 3005 is shown.
[0335] For example, in Figure 3F After the implementation, as Figure 10B and Figure 10C As shown, the user can press and hold the control 3003 in the opposite direction of the response hotspot 3005, and move the control 3003 to... Figure 10C The position shown. Responding to control 3003 being located at... Figure 10C The electronic device 100 can display the position shown, provided that the movement of control 3003 meets preset conditions. Figure 10C The response hot zone shown is 3009.
[0336] Optionally, the preset conditions can be that the position of the control 3003 meets the preset conditions, such as the control 3003 being located within a preset position, or the movement distance of the control 3003 meets the preset conditions, such as the movement distance of the control 3003 being greater than a threshold.
[0337] When the movement position of control 3003 meets preset conditions, electronic device 100 displays... Figure 10C After the first response hotspot 3009 is shown, if the electronic device 100 receives the user's first operation on the first control, and the first control is not moved to the first response hotspot, the electronic device 100 will still shrink the display of the first response hotspot.
[0338] For example, such as Figure 10D and Figure 10E As shown, the user can long press and move control 3003 towards the response hotspot 3009, and move control 3003 to... Figure 10E The position shown. Responding to control 3003 being located at... Figure 10E The electronic device 100 can display the indicated position when the control 3003 is not moved to the response hotspot 3009. Figure 9F The response hot zone shown is 3009.
[0339] When the movement position of control 3003 meets preset conditions, electronic device 100 displays...Figure 10C After the response hotspot 3009 is shown, if the electronic device 100 receives the user's first operation on the first control and the first control moves onto the first response hotspot, the electronic device 100 can enlarge and display the first response hotspot.
[0340] For example, such as Figure 10F and Figure 10G As shown, the user can long press and move control 3003 towards the response hotspot 3009, and move control 3003 to... Figure 10G The position shown. Responding to control 3003 being located at... Figure 10G As shown, when control 3003 is moved to the response hotspot 3009, electronic device 100 can display... Figure 10G The response hot zone 3005 is shown.
[0341] IV. When the user presses and holds the first control for a continuous period of time without changing the position of the first control, the electronic device shrinks the display response hotspot by 100%.
[0342] Figures 11A-11B This diagram illustrates the shrinking display response hotspot of the electronic device 100 when the user presses and holds the first control for a continuous first duration without changing the position of the first control.
[0343] For example, refer to Figures 3A-3E As described in the embodiments, in response to a user's first operation on file 3002, such as a long press and drag operation on file 3002, electronic device 100 can display control 3003. If the distance between control 3003 and navigation bar 3001 is less than a first threshold, electronic device 100 can display... Figure 11A The response hot zone 3004 is shown.
[0344] exist Figure 3E After the implementation, as Figure 11A As shown, control 3003 is located outside the response hotspot 3004. The user can press and hold control 3003 while maintaining its position. If the user presses and holds control 3003 and its position remains unchanged for a continuous first duration, the electronic device 100 can reduce the display area of the response hotspot 3004. For example, the electronic device 100 can display... Figure 11B The area of the display area where the response hot zone 3009 is located is smaller than the area of the display area where the response hot zone 3004 is located.
[0345] In some embodiments, if the control 3003 is located within the response hot zone, the user can press and hold the control 3003 for a long time and keep the position of the control 3003 unchanged. If the user presses and holds the control 3003 for a long time and the position of the control 3003 does not change for a continuous first time period, the electronic device 100 can continue to display the current response hot zone without changing the display size of the response hot zone.
[0346] Figure 12 A flowchart illustrating a method for shrinking the display response hotspot of an electronic device 100 when a user presses and holds a first control for a continuous first duration without changing the position of the first control.
[0347] S1201, Electronic device 100 displays a first control and a first response hot zone of size E.
[0348] For example, the first control could be Figure 11A The control 3003 shown can have a first response hotspot of size E. Figure 11A The response hot zone 3004 is shown.
[0349] S1202, Receive the operation of long-pressing the first control and stopping the movement of the first control.
[0350] S1203, Electronic device 100 needs to confirm whether the position of the first control has not changed for more than a first time period.
[0351] After the user presses and holds the first control and stops moving it, the electronic device 100 needs to confirm whether the position of the first control has remained unchanged for a first time period.
[0352] If the position of the first control remains unchanged for a first duration, the electronic device 100 may shrink the display of the first response hot zone, i.e., execute S1204.
[0353] If the position of the first control has not changed for more than the first time period, the electronic device 100 can keep the display storage of the first response hot zone unchanged, that is, execute S1205.
[0354] S1204, Electronic device 100 displays a first control and a first response hot zone of size F, where size F is smaller than size E.
[0355] S1205, Electronic device 100 continues to display the first control and the first response hot zone of size E.
[0356] If the position of the first control remains unchanged for a first duration, the electronic device 100 can shrink the display of the first response hotspot, that is, display the first control and the first response hotspot of size F, where size F is smaller than size E. For example, the first response hotspot of size F could be... Figure 11B The response hot zone shown is 3009.
[0357] If the position of the first control remains unchanged for no more than a first duration, the electronic device 100 can maintain the display storage of the first response hotspot unchanged, that is, continue to display the first control and the first response hotspot of size E. For example, the first response hotspot of size E can be... Figure 11A The response hot zone 3004 is shown.
[0358] Optionally, the electronic device 100 also needs to confirm whether the first control is located within the first response hot zone.
[0359] If the position of the first control remains unchanged for more than a first duration and the first control is located outside the first response hot zone, the electronic device 100 can shrink the display of the first response hot zone, that is, execute S1204.
[0360] If the position of the first control does not change for more than the first time period, but the first control is located in the first response hot zone, the electronic device 100 can keep the display storage of the first response hot zone unchanged, that is, execute S1205.
[0361] If the position of the first control has not changed for more than the first time period, regardless of whether the first control is located in the first response hot zone or outside the first response hot zone, the electronic device 100 will maintain the display and storage of the first response hot zone unchanged, that is, execute S1205.
[0362] Optionally, after S1204, electronic device 100 may continue to perform. Figure 10A For details regarding S1006-S1009 in the embodiment, please refer to [link / reference]. Figure 10A The descriptions of S1006-S1009 in the embodiments will not be repeated here.
[0363] Figure 13 This is a flowchart illustrating an interactive interface display method provided in this application.
[0364] S1301, The electronic device displays a first user interface, which includes first content and a first navigation bar.
[0365] S1302, The electronic device receives a first operation for the first content.
[0366] S1303, In response to the first operation, the electronic device displays a first control and a first response hotspot, the display size of the first response hotspot being larger than the display size of the first navigation bar.
[0367] S1304. When the first control is located within the first response hot zone, the display size of the first response hot zone is the first size. The electronic device continues to receive the first operation for the first control. When the first control moves out of the first response hot zone, the electronic device switches the display size of the first response hot zone from the first size to the second size.
[0368] S1305. When the first control is located in the first position, or when the movement position of the first control meets the preset conditions, the display size of the first response hot zone is the third size; the electronic device continues to receive the first operation for the first control, and when the position of the first control does not change for more than a first time period, the electronic device switches the display size of the first response hot zone from the third size to the second size.
[0369] For example, the first user interface can be any one of the following: chat interface, gallery interface, reading interface, memo interface, web page interface, editing software interface, music interface, file management interface, etc.
[0370] For example, the first content may include, but is not limited to, any of the following: text, documents, tables, images, web pages, etc.
[0371] For example, you can refer to Figures 9A-9B or Figures 11A-11B or Figures 10B-10C Description in the embodiments.
[0372] Using this method, when the user moves the first control out of the first response hotspot, or when the user presses and holds the first control for a continuous first duration without changing its position, or when the movement of the first control meets preset conditions, the electronic device 100 can shrink the display of the first response hotspot. This prevents the display size of the first response hotspot from being too large and obscuring other areas of the first user interface. After the electronic device 100 shrinks the display of the first response hotspot, it can receive user actions on the first control and share the first content to other applications or other devices through other means, thus improving the user's interactive experience.
[0373] Optionally, the third dimension and the first dimension can be the same or different.
[0374] For example, the first response thermal area of the first dimension can be response thermal area 3005. The first response thermal area of the second dimension can be response thermal area 3009. The first response thermal area of the third dimension can be response thermal area 3004 or response thermal area 3005.
[0375] In one possible implementation, the preset conditions include: the first control has moved a first distance along a first direction, or the position of the first control is within a preset position. The first position may be located within or outside the first response hot zone, and this application does not limit this.
[0376] Optionally, the first direction can be the opposite direction of the first response thermal zone, such as the direction from the first response thermal zone to the top of the display screen. The first direction can be perpendicular to the horizontal line, or it can be at an angle to the vertical line.
[0377] Optionally, the preset condition may refer to the position of the first control meeting the preset condition, such as the first control being located within a preset position, or the movement distance of the first control meeting the preset condition, such as the movement distance of the first control being greater than a threshold.
[0378] In one possible implementation, after the electronic device switches the display size of the first response hotspot to the second size, the method further includes: the electronic device continuing to receive a first operation on the first control, wherein when the first control is outside the first response hotspot, the display size of the first response hotspot continues to be displayed as the second size.
[0379] Thus, when the user moves the first control out of the first response hot zone, or when the user presses and holds the first control for a continuous first duration without changing its position, or when the movement of the first control meets the preset conditions, the electronic device 100 can shrink the display of the first response hot zone. If the user continues to press and hold and move the first control, the display size of the first response hot zone can remain unchanged when the first control is outside the first response hot zone.
[0380] For example, you can refer to Figures 9B-9F , Figures 10D-10E Description in the embodiments.
[0381] In one possible implementation, after the electronic device switches the display size of the first response hotspot to the second size, the method further includes: the electronic device continuing to receive a first operation on the first control, wherein when the first control is located within the first response hotspot, the electronic device switches the display size of the first response hotspot from the second size to the first size.
[0382] Thus, if the user moves the first control out of the first response hot zone, or if the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 can shrink the display of the first response hot zone. If the user continues to press and hold and move the first control, the electronic device can further expand the display size of the first response hot zone when the first control is within the first response hot zone.
[0383] For example, you can refer to Figures 9I-9J , Figures 10F-10G Description in the embodiments.
[0384] When the duration remains unchanged, the electronic device switches the display area of the first response hot zone from the third size to the second size. Specifically, when the first control is outside the first response hot zone, the electronic device continues to receive the first operation for the first control. When the position of the first control remains unchanged for more than a first duration, the electronic device switches the display size of the first response hot zone from the third size to the second size.
[0385] In one possible implementation, the method further includes: when the first control is located within the first response hot zone, the electronic device continues to receive a first operation on the first control; and when the position of the first control remains unchanged for a first duration, the display size of the first response hot zone continues to be displayed as a third size.
[0386] For example, you can refer to Figures 11A-11B Description in the embodiments.
[0387] Thus, when the first control is outside the first response hot zone, if the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 will then shrink the display of the first response hot zone. When the first control is within the first response hot zone, if the user presses and holds the first control for a continuous first duration without changing its position, the electronic device 100 will not shrink the display of the first response hot zone, thus preventing accidental touches.
[0388] Optionally, it is not necessary to distinguish whether the first control is located outside or inside the first response hot zone. As long as the user presses and holds the first control and the position of the first control does not change for a continuous first duration, the electronic device 100 can shrink and display the first response hot zone.
[0389] In one possible implementation, the electronic device stops displaying the first navigation bar when the first response hotspot is displayed.
[0390] In one possible implementation, before the display size of the first response hotspot is a first size, or before the display size of the first response hotspot is a third size, the display size of the first response hotspot changes according to the first operation in response to the first content.
[0391] In one possible implementation, the display size of the first response hotspot is determined based on the position of the first control.
[0392] Optionally, the display size of the first response hotspot can be determined based on the position of the first control. Different positions of the first control will result in different display sizes of the first response hotspot.
[0393] Optionally, the display size of the first response hotspot can be determined based on the distance between the first control and the first navigation bar. Different distances between the first control and the first navigation bar result in different display sizes of the first response hotspot.
[0394] Optionally, the distance between the first control and the first navigation bar can refer to the distance between the center point of the first control and the center point of the first navigation bar, or the distance between the top edge of the first control and the top edge of the first navigation bar, or the distance between the bottom edge of the first control and the bottom edge of the first navigation bar. This application does not limit the implementation of the distance between the first control and the first navigation bar.
[0395] For example, the first control can be control 3003, control 4002, or control 5002.
[0396] For example, the display size of the first response hotspot changes according to the first operation, as can be seen from... Figures 3C-3F ,or, Figures 4A-4D ,or, Figures 5B-5F Description in the embodiments.
[0397] In one possible implementation, in response to a first operation, the electronic device displays a first control and a first response hotspot, specifically including: in response to the first operation, if the position of the first control meets a preset condition, the electronic device displays the first control and the first response hotspot.
[0398] Optionally, in response to the first operation, if the position of the first control does not meet the preset conditions, the electronic device displays the first navigation bar.
[0399] The location of the first control meets the preset conditions. This can mean that the first control is located within a preset position, or that the distance between the first control and the first navigation bar meets the preset conditions. For example, the preset conditions can mean that the distance between the first control and the first navigation bar is less than a first threshold.
[0400] In one possible implementation, the second dimension is a preset dimension, the first dimension is larger than the second dimension, or the third dimension is larger than the second dimension.
[0401] In one possible implementation, after the electronic device switches the display size of the first response hotspot from the second size to the first size, the method further includes: the electronic device stopping receiving a first operation on the first control; in response to stopping receiving the first operation on the first control, the electronic device displaying a first window, the first window including first content and one or more operation options, the one or more operation options being used to perform a corresponding operation on the first content.
[0402] For example, when the first content is a file, one or more options can be Figure 3H The options shown are 3006, 3007, and 3008.
[0403] For example, when the primary content is text, one or more options can be Figure 4F The options shown are 4004, 4005, and 4006.
[0404] For example, when the first content is an image, one or more options can be Figure 5G The options shown are 5004, 5005, and 5006.
[0405] In one possible implementation, after the electronic device stops receiving the first operation on the first control, the method further includes: the electronic device sending first content to a server; the electronic device receiving one or more operation intentions sent by the server, the one or more operation intentions being derived based on the first content and user behavior characteristics, and one or more operation options being associated with one or more operation intentions.
[0406] After obtaining the initial content, the server can determine one or more operational intentions based on this content. These intentions are related to a user profile, which reflects the user's behavioral habits and can be obtained by the server based on user data.
[0407] Optionally, different users have different user profiles, and the server may obtain one or more different operational intentions for different users based on the first content.
[0408] In one possible implementation, the first operation is to long press the first content and drag the first content to the display area where the first navigation bar is located.
[0409] In one possible implementation, the first content includes any of the following: text, document, table, image, or webpage.
[0410] This application provides an electronic device, including a memory and a processor; wherein the memory and the processor are coupled, the memory is used to store a computer program, and when the processor executes and calls the computer program, the first electronic device executes an application window management method provided in any possible implementation of the first aspect.
[0411] This application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform an interactive interface display method provided in any possible implementation of the first aspect described above.
[0412] This application provides a chip system, which includes one or more processors. The processors are used to invoke computer instructions to cause an electronic device to execute an interactive interface display method provided in any possible implementation of any of the above aspects.
[0413] This application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, causes the electronic device to execute an interactive interface display method provided in any possible implementation of any of the above aspects.
[0414] The above are merely some embodiments and implementation methods of this application. The scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0415] It is understood that the user interfaces described in the embodiments of this application are merely example interfaces and do not constitute a limitation on the solution of this application. In other embodiments, the user interface may adopt different interface layouts, may include more or fewer controls, and may add or remove other functional options, as long as they are based on the same inventive concept provided in this application, they are all within the protection scope of this application.
[0416] It should be noted that, without causing contradictions or conflicts, any feature in any embodiment of this application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of this application.
[0417] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A method for displaying an interactive interface, characterized in that, The method includes: The electronic device displays a first user interface, which includes first content and a first navigation bar; The electronic device receives a first operation in response to the first content; In response to the first operation, the electronic device displays a first control and a first response hotspot, wherein the display size of the first response hotspot is larger than the display size of the first navigation bar; When the first control is located in the first position, the display size of the first response hotspot is the third size, wherein the first position is located outside the first response hotspot; The electronic device continues to receive the first operation for the first control. When the position of the first control remains unchanged for a first time period, or when the movement position of the first control meets a preset condition, the electronic device switches the display size of the first response hotspot from the third size to the second size, where the third size is larger than the second size. After the electronic device switches the display size of the first response hotspot to the second size, the electronic device continues to receive the first operation from the user on the first control; After the electronic device continues to receive the first operation from the user on the first control, when the first control is within the first response hot zone, the electronic device stops receiving the first operation on the first control. In response to ceasing to receive the first operation on the first control, the electronic device displays a first window, the first window including the first content and one or more operation options, the one or more operation options being used to perform a corresponding operation on the first content, the one or more operation options being associated with one or more operation intentions, the one or more operation intentions being derived based on the first content.
2. The method according to claim 1, characterized in that, The preset conditions include: the first control has moved a first distance along a first direction, or the position of the first control is within a preset position.
3. The method according to claim 1 or 2, characterized in that, After the electronic device continues to receive the first operation from the user on the first control, the method further includes: When the first control moves outside the first response hotspot, the display size of the first response hotspot continues to be the second size; or, When the first control moves into the first response hot zone, the electronic device switches the display size of the first response hot zone from the second size to the first size.
4. The method according to claim 1 or 2, characterized in that, When the electronic device displays the first response hotspot, the electronic device stops displaying the first navigation bar.
5. The method according to claim 1 or 2, characterized in that, Before the display size of the first response hotspot is a first size, or before the display size of the first response hotspot is a third size, in response to the first operation on the first content, the display size of the first response hotspot changes according to the first operation.
6. The method according to claim 5, characterized in that, The display size of the first response hotspot is determined based on the position of the first control.
7. The method according to claim 1 or 2, characterized in that, In response to the first operation, the electronic device displays a first control and a first response hotspot, specifically including: In response to the first operation, if the location of the first control meets a preset condition, the electronic device displays the first control and the first response hotspot.
8. The method according to claim 1 or 2, characterized in that, The second dimension is a preset dimension.
9. The method according to claim 1, characterized in that, Before the electronic device displays the first window, the method further includes: The electronic device sends the first content to the server; The electronic device receives one or more operational intentions sent by the server.
10. The method according to claim 1 or 2, characterized in that, The first operation is to long press the first content and drag the first content to the display area where the first navigation bar is located.
11. The method according to claim 1 or 2, characterized in that, The first content includes any of the following: text, documents, tables, images, and web pages.
12. An electronic device, characterized in that, The electronic device includes a memory and a processor; wherein the memory and the processor are coupled, the memory is used to store a computer program, and when the processor executes the computer program, the electronic device performs the method of any one of claims 1-11.
13. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device performs the method of any one of claims 1-11.
14. A computer program product, comprising a computer program, characterized in that, When the computer program is run on an electronic device, the electronic device performs the method of any one of claims 1-11.