Display method and electronic equipment

Abstract

The invention provides a display method and electronic equipment. The method comprises the following steps: displaying a first interface; in response to the detected first gesture operation across the air, displaying a second interface; wherein the second interface comprises a plurality of options, and a first option in the plurality of options is displayed as a currently selected option; each option in the plurality of options is a content included in the first interface, or at least one option in the plurality of options is an associated content of a first content included in the first interface. According to the method, the efficiency, the flexibility and the practicability of the electronic equipment for air interaction can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and in particular to a display method and electronic device. Background Art

[0002] Currently, in addition to supporting traditional touch screen and keyboard and mouse operations, electronic devices also support the recognition and response of gestures, thereby enabling users to experience airborne interaction without touching the display screen and input tools. For example, an electronic device can recognize a specific gesture made by a user and, in response to the specific gesture, select a specific content corresponding to the specific gesture or perform a specific operation corresponding to the specific gesture. In this method, the response of the electronic device based on a specific gesture is fixed, with low flexibility and interaction efficiency, and can only meet the interaction needs in simple scenarios. Therefore, the airborne interaction experience provided is poor and its practicality is poor. Summary of the Invention

[0003] The present application provides a display method and an electronic device for improving the efficiency, flexibility and practicality of air-to-air interaction of electronic devices.

[0004] In a first aspect, an embodiment of the present application provides a display method, applied to an electronic device, the method comprising: displaying a first interface; displaying a second interface in response to a detected first air gesture operation; wherein the second interface includes multiple options, and the first option of the multiple options is displayed as the currently selected option; each option of the multiple options is an item of content included in the first interface, or at least one option of the multiple options is associated content of the first content included in the first interface.

[0005] Optionally, the second interface may be an interface that has undergone significant changes relative to the first interface. For example, the first interface may contain one or more contents, and the second interface may display contents related to the contents in the first interface by shrinking or stacking as options. The number of options may be the same as the number of contents in the first interface, or it may be less or more, and this is not limited in this application.

[0006] Optionally, the second interface may be an interface that has undergone minor changes based on the first interface. For example, the first interface may originally have multiple contents as options, and the second interface may be an interface that adds a selection effect for an option in the first interface.

[0007] In this method, the electronic device can display multiple options for selection and the selected option among the multiple options in response to the received air gesture operation, so that the user can view multiple selectable options and the currently selected option at the same time. On the one hand, it can improve the efficiency of viewing and selection, and on the other hand, it is convenient for the user to switch the currently selected option. Therefore, this method has high flexibility and efficiency in content selection, helps to provide a better air interaction experience in complex scenarios, and has high practicality. In one possible design, the method further includes: in response to a detected second air gesture operation, switching the second interface to a third interface; wherein the third interface includes the multiple options, and the second option among the multiple options is displayed as the currently selected option. Optionally, the second gesture operation and the first gesture operation are continuous gesture operations.

[0008] Based on this method, electronic devices can achieve the effect of switching the user's selected content based on the user's air gesture operation, with high interaction efficiency. Combined with the above method, electronic devices can support users to select content and switch selected content through continuous air gesture operations, thereby realizing air interaction easily and quickly, with high practicality.

[0009] In one possible design, the method further includes: in response to a detected third air gesture operation, switching the third interface to a fourth interface; wherein the fourth interface includes the second option.

[0010] Based on this method, the electronic device can present the content finally selected by the user to the user separately, making it easier for the user to perform subsequent operations on the content, thereby improving the user experience.

[0011] Optionally, the third gesture operation and the second gesture operation are continuous gesture operations. Based on this method, the electronic device can support the user to select content quickly and easily through continuous air gesture operations, which is highly practical.

[0012] In one possible design, the multiple options in the second interface are displayed in a stacked manner; the first option among the multiple options is displayed as the currently selected option, including: the first option is displayed at the top layer among the multiple options.

[0013] Based on this method, the electronic device can display multiple selectable options to the user while also displaying the currently selected option to the user in a simple, fast and intuitive manner, thereby improving viewing efficiency and user experience.

[0014] In one possible design, when the multiple options in the second interface support up and down page turning, the second gesture operation is a waving operation toward or away from the second interface using the first gesture; or, when the multiple options in the second interface support left and right page turning, the second gesture operation is a rotating operation clockwise or counterclockwise toward the second interface using the first gesture. Optionally, the first gesture is a fist gesture.

[0015] In this method, the electronic device can flexibly set the type of gesture operation used to switch selected content based on the interface layout of the second interface and the switching method of different options in the second interface. Therefore, the most appropriate gesture operation can be used to switch selected content in different interface layout scenarios, which helps improve efficiency and user experience.

[0016] In one possible design, the display areas occupied by the multiple options in the second interface do not overlap with each other; the first option among the multiple options is displayed as the currently selected option, including: the first option is marked as the currently selected option.

[0017] Based on this method, the electronic device can fully display multiple optional options to the user while also displaying the currently selected option to the user in a simple, fast and intuitive manner, thereby improving viewing efficiency and user experience.

[0018] In a possible design, the second gesture operation is an operation of translating with a second gesture. Optionally, the second gesture is a palm gesture.

[0019] In this method, the interface layout of the second interface is a layout in which different options are arranged based on relative positions. In this scenario, switching the selected content based on a translation operation can improve processing efficiency and display effects.

[0020] In one possible design, the associated content is one of multiple formats of the first content, or one of multiple representations of the first content. For example, the associated content can be any of the following: a link to the first content; a screenshot of the first content; or plain text of the first content.

[0021] Based on the above method, the electronic device can provide users with more options in the content selection scenario, allowing users to make more choices through air gesture operations, thereby providing users with a richer user experience.

[0022] In one possible design, when the electronic device is a first type of electronic device, the second gesture operation is an operation of waving toward or away from the second interface with the first gesture; or, when the electronic device is a second type of electronic device, the second gesture operation is an operation of rotating clockwise or counterclockwise toward the second interface with the first gesture; or, when the electronic device is a third type of electronic device, the second gesture operation is an operation of translating with the second gesture.

[0023] In this method, the electronic device can flexibly set the type of gesture operation for switching selected content based on the device type of the device. Therefore, the most appropriate gesture operation can be used to switch selected content on different devices, which helps improve efficiency and user experience.

[0024] In a possible design, the first gesture operation is an operation of opening the palm.

[0025] In one possible design, when each of the multiple options is an item of content included in the first interface, the first gesture operation is used to select the first option; or, when at least one of the multiple options is an associated content of the first content included in the first interface, the first gesture operation is used to select the first content.

[0026] Based on this method, the electronic device can provide the user with more relevant options based on the different content selected by the user, facilitating the user to make further selections, thereby improving interaction efficiency and interaction experience.

[0027] In a second aspect, the present application provides an electronic device, comprising a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code comprises computer instructions; when the computer instructions are executed by the one or more processors, the electronic device executes the method described in the above-mentioned first aspect or any possible design of the first aspect.

[0028] In a third aspect, the present application provides a computer-readable storage medium storing a computer program. When the computer program runs on an electronic device, the electronic device executes the method described in the first aspect or any possible design of the first aspect.

[0029] In a fourth aspect, the present application provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on an electronic device, the electronic device executes the method described in the first aspect or any possible design of the first aspect.

[0030] In a fifth aspect, the present application provides a chip system comprising a processor and a memory, wherein the memory stores instructions; when the instructions are executed by the processor, the method described in the first aspect or any possible design of the first aspect is implemented. The chip system may be composed of a chip alone, or may include a chip and other discrete components.

[0031] The beneficial effects of the second to fifth aspects mentioned above can be referred to the beneficial effects of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of the hardware architecture of an electronic device provided in an embodiment of the present application;

[0033] Figure 2 A schematic diagram of the software architecture of an electronic device provided in an embodiment of the present application;

[0034] Figure 3 A schematic diagram of a display method provided in an embodiment of the present application;

[0035] Figure 4 A schematic diagram of a display interface related to a display method provided in an embodiment of the present application;

[0036] Figure 5 A schematic diagram of a display method provided in an embodiment of the present application;

[0037] Figure 6 A schematic diagram of a voice receiving interface provided in an embodiment of the present application;

[0038] Figure 7 A schematic diagram of a display interface related to a display method provided in an embodiment of the present application;

[0039] Figure 8 A schematic diagram of a gesture application scenario provided in an embodiment of the present application;

[0040] Figure 9 A schematic diagram of a content selection-related display interface provided in an embodiment of the present application;

[0041] Figure 10 A schematic diagram of a content selection-related display interface provided in an embodiment of the present application;

[0042] Figure 11 A schematic diagram of a display method provided in an embodiment of the present application;

[0043] Figure 12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0045] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Therefore, features specified as "first" or "second" may explicitly or implicitly include one or more of the features.

[0046] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0047] In order to improve the efficiency, flexibility and practicality of electronic devices for airborne interaction, an embodiment of the present application provides a display method and an electronic device. In this method, the electronic device can select target content from multiple contents displayed by the electronic device in response to continuous gestures made by the user, and / or select the target format or target presentation form of a certain content displayed by the electronic device. Based on this method, the electronic device can support flexible and efficient content selection in different task scenarios through continuous gestures, so that the user can accurately select the desired content through continuous gestures without having to change to other operation methods such as touch screen or keyboard and mouse operation in the middle, which is highly practical.

[0048] In some embodiments of the present application, the electronic device may be a portable device, such as a mobile phone, a tablet computer, a wearable device with wireless communication capabilities (e.g., a smart watch, smart glasses, etc.), an in-vehicle terminal device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a smart home device (e.g., a smart TV, a smart speaker, etc.), an intelligent robot, workshop equipment, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, an aircraft device (e.g., an intelligent robot, a drone, an airplane), etc. A wearable device is a portable device that a user can wear directly on the body or integrate into the user's clothing or accessories.

[0049] In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions. Example embodiments of the portable terminal device include but are not limited to: Or a portable terminal device with other operating systems. The portable terminal device may also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present application, the electronic device may not be a portable terminal device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0050] For an introduction to the performance of electronic equipment, please refer to the relevant description below.

[0051] See below Figure 1 , the structure of the electronic device to which the method provided in the embodiments of the present application is applicable is introduced.

[0052] like Figure 1As shown in , the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.

[0053] The sensor module 180 may include a gyroscope sensor, an acceleration sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, and the like.

[0054] It is understandable that Figure 1 The electronic device 100 shown is merely an example and does not constitute a limitation to the electronic device, and the electronic device may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. Figure 1 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0055] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated into one or more processors. Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate an operation control signal based on the instruction opcode and timing signal to complete the control of instruction fetching and execution.

[0056] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0057] The execution of the display method provided in the embodiment of the present application can be controlled by the processor 110 or completed by calling other components, such as calling the processing program of the embodiment of the present application stored in the internal memory 121, or calling the processing program of the embodiment of the present application stored in a third-party device through the external memory interface 120, to control the wireless communication module 160 to communicate data with other devices, thereby improving the intelligence and convenience of the electronic device 100 and enhancing the user experience. The processor 110 can include different devices. For example, when a CPU and a GPU are integrated, the CPU and the GPU can cooperate to execute the display method provided in the embodiment of the present application. For example, part of the algorithm in the display method is executed by the CPU, and another part of the algorithm is executed by the GPU to obtain faster processing efficiency.

[0058] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. The display screen 194 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, the display screen 194 can display various interfaces such as the recommendation interface described in the embodiments of the present application.

[0059] In the embodiment of the present application, the display screen 194 can be an integrated flexible display screen, or a spliced display screen consisting of two rigid screens and a flexible screen located between the two rigid screens.

[0060] Camera 193 (either a front-facing camera or a rear-facing camera, or one camera serving as both) is used to capture still images or videos. Typically, camera 193 includes a photosensitive element, such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave) that capture light signals reflected from the object to be photographed and transmit the captured light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signals.

[0061] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the code of the operating system, application program (such as the function corresponding to the solution of the present application, etc.). The data storage area can store data created during the use of the electronic device 100, etc.

[0062] The internal memory 121 may also store one or more computer programs corresponding to the algorithms of the present application. The one or more computer programs are stored in the internal memory 121 and configured to be executed by the one or more processors 110. The one or more computer programs include instructions that can be used to perform the various steps in the following embodiments.

[0063] In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0064] Of course, the code of the algorithm of the embodiment of the present application can also be stored in an external memory. In this case, the processor 110 can run the code of the algorithm of the embodiment of the present application stored in the external memory through the external memory interface 120.

[0065] A touch sensor, also known as a "touch panel," can be provided on the display screen 194. The touch sensor and the display screen 194 form a touch display screen, also known as a "touch screen." The touch sensor is used to detect touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor can also be provided on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0066] For example, the display screen 194 of the electronic device 100 may display a main interface, which includes icons of multiple applications (such as a camera application, a sports and health application, etc.). For example, a user may click the icon of the camera application in the main interface via the touch sensor to trigger the processor 110 to start the camera application and turn on the camera 193. The display screen 194 displays the interface of the camera application, such as the viewfinder interface.

[0067] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0068] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0069] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110. In an embodiment of the present application, the mobile communication module 150 can also be used to exchange information with other devices.

[0070] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0071] The wireless communication module 160 can provide wireless communication solutions applied to the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (WiFi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2. In the embodiment of the present application, the wireless communication module 160 can be used to establish a connection with other electronic devices and exchange data. Or the wireless communication module 160 can be used to access an access point device, send control instructions to other electronic devices, or receive data sent from other electronic devices.

[0072] In addition, the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor. For example, music playback, recording, etc. The electronic device 100 can receive input from the key 190 and generate key signal input related to the user settings and function control of the electronic device 100. The electronic device 100 can use the motor 191 to generate a vibration prompt (such as an incoming call vibration prompt). The indicator 192 in the electronic device 100 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 in the electronic device 100 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.

[0073] It should be understood that in actual applications, the electronic device 100 may include Figure 1 The embodiments of the present application are not limited to more or fewer components shown. The illustrated electronic device 100 is merely an example, and the electronic device 100 may have more or fewer components than shown, may combine two or more components, or may have a different component configuration. The various components shown in the figures may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0074] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. For example, Figure 2 As shown in the figure, the software architecture can be divided into four layers, from top to bottom: application layer, application framework layer (framework, FWK), runtime and system library, and (Linux) kernel layer.

[0075] The application layer is the top layer of the operating system, including native applications of the operating system, such as camera, gallery, calendar, Bluetooth, music, video, information, etc., and may also include third-party applications. The application involved in the embodiment of the present application is referred to as application (APP), which is a software program that can realize one or more specific functions. Typically, multiple applications can be installed in an electronic device, such as a camera application, a mailbox application, etc. The applications mentioned below can be system applications that are installed on the electronic device when it leaves the factory, or they can be third-party applications that the user downloads from the Internet or obtains from other electronic devices while using the electronic device.

[0076] Of course, developers can write applications and install them into this layer. In one possible implementation, applications can be developed using the Java language by calling the application programming interface (API) provided by the application framework layer. Developers can use the application framework to interact with the underlying layer of the operating system (such as the kernel layer) and develop their own applications.

[0077] The application framework layer provides the application API and programming framework. It includes predefined functions and can include a window manager, content provider, view system, telephony manager, resource manager, and notification manager.

[0078] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the display (or screen), capture the display, etc.

[0079] Content providers are used to store and retrieve data and make it accessible to applications. The data may include files (such as documents, videos, images, audio), text, and other information.

[0080] The view system includes visual controls, such as those that display text, images, and documents. The view system is used to build applications. The interface within a display window can be composed of one or more views. For example, the interface for a text notification icon might include a view that displays text and a view that displays an image.

[0081] The phone manager provides communication functionality for electronic devices. The notification manager enables applications to display notifications in the status bar, which can be used to convey informational messages and automatically disappear after a short period of time without user interaction.

[0082] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the system.

[0083] The system's core library consists of two parts: one containing the Java language's callable functions and the other the system's core library. The application layer and application framework layer run within a virtual machine. For example, in Java, the virtual machine executes Java files from the application and framework layers as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0084] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), image processing library, etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.564, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0085] The kernel layer provides the operating system's core system services, such as security, memory management, process management, the network protocol stack, and the driver model. These services are all implemented at the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including the display driver, the keyboard driver for input devices, the Flash driver for memory-based devices, the camera driver, the audio driver, the Bluetooth driver, and the Wi-Fi driver.

[0086] It should be understood that the functional services described above are only examples. In actual applications, electronic devices can also be divided into more or fewer functional services according to other factors, or the functions of each service can be divided in other ways, or the functional services can be not divided but work as a whole.

[0087] The solution provided by this application is described in detail below with reference to specific embodiments and accompanying drawings. It should be noted that the user operations described in the following embodiments may be air operations and / or gesture operations, and the detection of air operations described in the following embodiments may also be understood as the receipt of air operations.

[0088] Example 1: Selecting target content

[0089] In the solution provided by this embodiment, the electronic device can select target content from multiple contents displayed by the electronic device based on the detected continuous user operations. Figure 3 , the program may include the following processes:

[0090] S301: The electronic device displays a first interface including multiple contents.

[0091] Optionally, the electronic device may display the first interface on the display screen.

[0092] Each of the multiple contents may be in any format or form, for example, each of the contents may be media content in the form of text, image, video, audio, etc.

[0093] Optionally, different contents among the multiple contents may occupy different areas in the first interface.

[0094] Example 1: In one example, taking the electronic device as a mobile phone, the first interface displayed by the electronic device may be Figure 4 The interface shown in the diagram (a) in Figure 4 As shown in the schematic diagram (a) in FIG. 1 , the first interface may include six items of content, 1 to 6 .

[0095] S302: The electronic device marks a first content among the multiple contents as selected or chosen in response to a detected first user operation.

[0096] The first user operation may be used to select or choose a first content from a plurality of contents. Alternatively, the first user operation may be an operation in which the user performs a first setting gesture.

[0097] The first content may be content located at a position in the first interface corresponding to the part of the user performing the first user operation (e.g., the user's hand). The electronic device may identify the position of the part of the user performing the first user operation relative to the display screen used to display the first interface and determine the position of the first content based on the position.

[0098] Optionally, after detecting the first user operation, the electronic device may further display an icon indicating a gesture corresponding to the first user operation, so that the user can confirm that the electronic device has successfully detected the first user operation. Optionally, after marking the first content as selected, the electronic device may further display a first prompt message, which may be used to prompt the user that they can switch the selected or selected content by performing a second user operation.

[0099] Example 2: In one example, based on the above example 1, the electronic device displays Figure 4 After the interface shown in the schematic diagram (a) in FIG. 1 is displayed, the user can respond to the detected first user operation (eg Figure 4 (a) in the figure shows the palm of the hand gesture), select the memo content 1 (equivalent to the first content), and can display Figure 4 The first mark shown in the schematic diagram (b) in FIG. 1 can be used to indicate that the memo content 1 is currently selected or selected. Figure 4 As shown in the schematic diagram (b) in FIG. , the electronic device may further display a first prompt message to prompt the user to switch the selected or chosen content.

[0100] In the first possible case, the following step S303 may be performed after step S302:

[0101] S303: In response to the detected second user operation, the electronic device cancels marking the first content as selected or chosen, and marks the second content among the multiple contents as selected or chosen.

[0102] The second user operation is used to switch the selected or chosen content from the first content to the second content. The second user operation and the first user operation can be continuous user operations. Continuous user operations refer to multiple user operations that can be performed continuously or successively.

[0103] Optionally, the second user operation may be a gesture of the user moving in a first target direction according to a first set gesture, where the first target direction is a direction from a location of the first content to a location of the second content.

[0104] Optionally, the electronic device may switch multiple times between content that has been selected or chosen by the user based on user operations. For example, after marking the second content as selected or chosen, the electronic device may, in response to a detected user operation indicating that the selected content should be switched from the second content to a third content, cancel the marking of the second content as selected or chosen, and mark the third content among the multiple content items as selected or chosen, thereby switching the selected or chosen content.

[0105] Optionally, after detecting the second user operation, the electronic device may further display an icon indicating a gesture corresponding to the second user operation, to confirm to the user that the electronic device has successfully detected the second user operation. Optionally, after marking the second content as selected or chosen, the electronic device may further display a second prompt message, which may be used to prompt the user that they can switch the selected or chosen content by performing the second user operation.

[0106] Example 3: In one example, based on the above example 2, the electronic device displays Figure 4 After the interface shown in the schematic diagram (b) in FIG. 1 is displayed, the interface may be switched to displaying the second user operation (eg, the operation of moving the palm downward) in response to the detection. Figure 4 Specifically, the electronic device can convert the original Figure 4 The first mark added to the memo content 1 shown in the schematic diagram (b) is updated to Figure 4 The second mark added to the memo content 3 (equivalent to the second content) shown in the schematic diagram (c) in FIG. 1 prompts the user to change the currently selected or selected content to the memo content 3. Figure 4 As shown in the schematic diagram (c) in FIG. , the electronic device may continue to display the first prompt information.

[0107] Optionally, in the above method, the electronic device may determine the position of the content selected by the user, i.e., the second content, based on the movement direction, movement speed, and / or movement distance during the second user operation, thereby determining the second content. Alternatively, the electronic device may map the position of the user's hand at the end of the second user operation to a position on the display screen as the position of the second content, thereby determining the second content.

[0108] Optionally, after step S303, the following step S304 may be further included:

[0109] S304: The electronic device displays a second interface including second content in response to the received third user operation.

[0110] In this scenario, the second user operation can be used to select the second content, and the third user operation can be used to confirm the selection of the currently selected content, namely the second content. The third user operation and the second user operation can be consecutive user operations.

[0111] Optionally, the third user operation may be an operation in which the user performs a second setting gesture.

[0112] Optionally, after receiving the third user operation, the electronic device may further display third prompt information, where the third prompt information may be used to indicate that the second content has been selected.

[0113] In the above scenario, the second content is the target content.

[0114] After displaying the second interface including the second content, the electronic device may further perform subsequent processing (such as sharing, etc.) on the second content in response to other received operations, which is not specifically limited in the embodiments of the present application.

[0115] Example 4: In one example, based on the above example 3, the electronic device displays Figure 4 After the interface shown in the schematic diagram (c) in FIG. 1 is displayed, the user can switch to displaying the following in response to a detected third user operation (such as an operation of changing from an open palm to a fist gesture). Figure 4 The interface shown in the schematic diagram (d) in FIG. Figure 4 As shown in the schematic diagram (d) in FIG, the interface includes the memo content 3 finally selected by the user.

[0116] In the second possible scenario, the first user operation described above can be used to select the first content. After step S302, the following steps can be performed: the electronic device displays a third interface including the first content in response to receiving a third user operation. In this scenario, the third user operation can be used to confirm the selection of the currently selected content, namely, the first content. The third user operation and the second user operation can be consecutive user operations. This step can be implemented with reference to step S304 and will not be described in detail here.

[0117] Based on the above method, the electronic device can flexibly select different content from multiple contents in the same interface based on the user's continuous operations, thereby realizing content selection simply and quickly, and having high practicality.

[0118] Example 2: Selecting a target format or target presentation form for target content

[0119] In the solution provided by this embodiment, the electronic device can select the target content displayed by the electronic device based on the detected continuous user operations and select the target format or target presentation form from multiple formats and / or presentation forms of the target content. Figure 5 , the program may include the following processes:

[0120] S501: The electronic device displays a fourth interface including third content.

[0121] The third content may be part of or all of the content in the fourth interface, and it can also be understood that the third content may occupy part of or all of the area in the fourth interface.

[0122] The third content may be content in any format or form. For example, the third content may be media content in the format of text, image, video, audio, etc.

[0123] Example 5: In one example, taking the electronic device as a mobile phone, the fourth interface displayed by the electronic device may be Figure 6 The interface shown in the diagram (a) in Figure 6 As shown in the schematic diagram (a) in FIG. 1 , the interface may be a video playback interface, and the third content may include all the content in the interface.

[0124] S502: In response to a detected fourth user operation, the electronic device displays multiple associated contents of the third content and selects a first associated content from the multiple associated contents; wherein the fourth user operation is used to select the third content.

[0125] The plurality of associated contents may include different formats and / or presentation forms of the third content. For example, the plurality of associated contents may include a link to the third content, a screenshot of the third content, or a plain text format of the third content.

[0126] Optionally, the first related content may be a related content automatically selected by the electronic device from multiple related contents and recommended to the user, or may be a related content selected by the electronic device from multiple related contents according to a set rule.

[0127] Optionally, multiple related contents may be displayed on different cards in the stack of cards. In this scenario, the first related content may be displayed in the topmost card in the stack of cards.

[0128] Optionally, the fourth user operation can be an operation in which the user performs a third set gesture. Alternatively, when the third content is part of the content in the fourth interface, the electronic device can also refer to the method for selecting the first content or the second content described in Example 1 to select the third content in the fourth interface. In this scenario, the fourth user operation can include the electronic device selecting the first content or the second content by referring to the method described in Example 1.

[0129] Optionally, after detecting the fourth user operation, the electronic device may further display an icon indicating a gesture corresponding to the fourth user operation, to confirm to the user that the electronic device has successfully detected the fourth user operation. Optionally, after displaying multiple associated contents, the electronic device may further display a fourth prompt message, which may be used to prompt the user that they can switch the selected associated content by performing a fifth user operation.

[0130] Example 6: In one example, based on the above example 5, the electronic device displays Figure 6 After the interface shown in the schematic diagram (a) in FIG. 1 is displayed, in response to the fourth user operation detected (for example, the user opens the palm and then makes a fist), Figure 6 The interface shown in the diagram (b) in Figure 1 is shown in the figure. Figure 6 As shown in the diagram (b) in FIG, the interface may include a first card and a second card displayed in a stacked manner, wherein the first card may include a link to a third content, and the second card may include a screenshot of the third content. In this scenario, the link to the third content in the first card is the first associated content mentioned above. Figure 6 As shown in the schematic diagram (b) in FIG, the interface may further include fourth prompt information to prompt the user to switch the selected associated content.

[0131] In an optional solution, after selecting the first associated content, the electronic device may perform subsequent processing (such as sharing, etc.) on the first associated content in response to other received operations, which is not specifically limited in the embodiments of the present application.

[0132] In another optional solution, the following step S503 may be further included after step S502:

[0133] S503: In response to the detected fifth user operation, the electronic device switches to selecting a second related content from the multiple related contents.

[0134] The fifth user operation may be used to indicate a switch from selecting the first associated content to selecting the second associated content. The fifth user operation and the fourth user operation may be consecutive user operations. Optionally, the fifth user operation may be an operation in which the user performs a fourth setting gesture.

[0135] Optionally, the electronic device may switch the user-selected associated content multiple times based on user operations. For example, after selecting the second associated content, the electronic device may select the third associated content in response to a detected user operation indicating that the selected content should be switched from the second associated content to the third associated content, thereby switching the selected associated content.

[0136] Optionally, after detecting the fifth user operation, the electronic device may further display an icon indicating a gesture corresponding to the fifth user operation, to confirm to the user that the electronic device has successfully detected the fifth user operation. Optionally, after selecting the second associated content, the electronic device may further display a fifth prompt message, which may be used to prompt the user that they can switch the selected content by performing the fifth user operation.

[0137] After selecting the second associated content, the electronic device may perform subsequent processing (eg, sharing, etc.) on the second associated content in response to other received operations, which is not specifically limited in the embodiments of the present application.

[0138] Example 7: In one example, based on the above example 6, the electronic device displays Figure 6 After the interface shown in the schematic diagram (b) in FIG. 1 is displayed, the user can respond to the detected fifth user operation (eg, toward Figure 6 (b) The interface swipe operation shown in the diagram) switches to display Figure 6 Specifically, the electronic device can convert the original Figure 6 The first associated content displayed on the top layer (i.e., selected) shown in the schematic diagram (b) is updated to Figure 6 The second associated content shown in the schematic diagram (c) in FIG. 1 is displayed, thereby switching the selected associated content. Figure 6 As shown in the schematic diagram (c) in FIG. , the electronic device may further display a fifth prompt message.

[0139] Based on the above method, the electronic device can flexibly select related content from multiple related contents of the same content based on the user's continuous operations. For example, it can select the required format or form of expression from different formats and / or different forms of expression of the same content, thereby realizing content selection simply and quickly, and is highly practical.

[0140] Example 3: Combined application

[0141] In some embodiments of the present application, the method provided in the above-mentioned embodiment 1 and the method provided in the above-mentioned embodiment 2 can be applied in combination.

[0142] Taking the scenario in which the user triggers the selection of content in the interface through the gesture of spreading the palm (similar to the first user operation), switches to select different content in the same interface through the gesture of moving the palm horizontally (i.e., the second user operation), triggers the selection of related content of the content in the interface through the fist gesture (i.e., the above-mentioned fourth user operation), and triggers the switch to select different related content of the same content through the fist waving gesture as an example, the solution of combining the method provided in the above-mentioned embodiment one and the method provided in the above-mentioned embodiment two is explained in detail.

[0143] Reference Figure 7 Based on the above scenario, a possible display method provided by an embodiment of the present application may include:

[0144] S701: The electronic device displays a first interface on a display screen; wherein the first interface includes at least one item of content.

[0145] Step S701 can be implemented with reference to the aforementioned step S301 or S501 and will not be described in detail here.

[0146] S702: When the electronic device detects the user's hand, it detects whether the user's gesture is a palm; if so, execute step S703; otherwise, execute step S713.

[0147] S703: The electronic device selects the first content in the at least one content, and executes step S704.

[0148] Steps S702 to S703 may be implemented with reference to the aforementioned step S302 and will not be described in detail here.

[0149] S704: The electronic device detects whether the user pans with a palm gesture; if so, execute step S705; otherwise, execute step S707.

[0150] S705: The electronic device selects a second content in the at least one content in response to the user's palm panning operation, and executes step S706.

[0151] Steps S704 to S705 may be implemented with reference to the aforementioned step S303 and will not be described in detail here.

[0152] S706: When the electronic device determines that the user switches to the setting gesture, the second interface is displayed; wherein the second interface includes second content.

[0153] Optionally, the set gesture may be a fist gesture.

[0154] Step S706 can be implemented with reference to the aforementioned step S304 and will not be described in detail here.

[0155] S707: The electronic device detects whether the user's gesture changes to a fist gesture; if so, execute step S708; otherwise, execute step S712.

[0156] S708: The electronic device displays multiple related contents of the currently selected first content, wherein the first related content among the multiple related contents is the currently selected content, and then executes step S709.

[0157] Steps S707 to S708 may be implemented with reference to the aforementioned step S502 and will not be described in detail here.

[0158] S709: The electronic device detects whether the user waves a fist toward or away from the display screen; if so, execute step S710; otherwise, execute step S711.

[0159] S710: In response to the user waving a fist toward or away from the display screen, the electronic device switches to selecting a second related content from the multiple contents.

[0160] Steps S709 to S710 may be implemented with reference to the aforementioned step S503 and will not be described in detail here.

[0161] S711: The electronic device selects the first related content.

[0162] Step S711 can be implemented with reference to the aforementioned step S502 and will not be described in detail here.

[0163] S712: When the electronic device determines that the user switches to the setting gesture, the electronic device displays a third interface, wherein the third interface includes the first content.

[0164] Step S712 can be implemented by referring to the method described in the second possible scenario in the first embodiment, and will not be described in detail here.

[0165] S713: The electronic device continues to detect user gestures.

[0166] Based on the above method, the electronic device can select different types of content simply and efficiently based on the user's air gesture operation, with high flexibility and practicality.

[0167] Example 4: Using different gestures in different scenarios

[0168] In some embodiments of the present application, Figure 8As shown in , when the user operation described in the methods provided in the above-mentioned embodiments 1 and 2 is a gesture operation, the user operation for switching the selected content may specifically include three types of operations: moving (or translating), waving, and rotating. Among them, the moving operation can be an operation in which the user translates with a gesture, such as translating the palm or moving with a fist. The waving operation can be a gesture in which the user moves toward or away from the display interface, such as waving toward or away from the display interface after clenching a fist. The rotating operation can be an operation in which the user rotates with a gesture, such as rotating the fist after clenching a fist.

[0169] In different application scenarios, electronic devices can use different types of gesture operations. The application scenarios may include the device form factor of the electronic device, the size of the electronic device display, the interface layout of the display interface, etc. Optionally, the types of gesture operations used in different scenarios can be pre-set.

[0170] In the first possible approach, as Figure 8 As shown in , in scenarios where the electronic device is a screen-holding device such as a mobile phone, a waving gesture operation can be used. In scenarios where the electronic device is a tablet, computer, smart screen, smart TV, or other device with a large display screen (for example, the display screen size is larger than the set size, etc.), a moving gesture operation can be used. In scenarios where the electronic device is a wearable device such as a smart watch, a rotating gesture operation can be used. The following examples 8 to 10 are used to illustrate this method.

[0171] Example 8: In one example, in the scenario where the electronic device described in Examples 5 to 7 is a mobile phone, Figure 6 (a) Schematic diagram to Figure 6 As shown in the schematic diagram (b) in FIG, the fourth user operation may be a gesture operation in which the user changes from palm to fist. Since the electronic device is a screen-holding device, Figure 6 As shown in the schematic diagram (b) in FIG, the fifth user operation for switching the selected associated content may be a waving operation in which the user makes a fist and waves it toward the display interface (or display screen) of the electronic device.

[0172] Example 9: In one example, taking the scenario where the electronic device is a tablet as an example, Figure 9 As shown in the schematic diagram (a) in FIG, the content displayed by the electronic device may include content 1 to 6. In this scenario, based on the method described in the first embodiment, the first user operation may be an operation in which the user makes a palm gesture. The electronic device may switch to displaying the first user operation in response to the detection of the first user operation. Figure 9The interface shown in the diagram (b) in FIG. 1 includes a mark 1 for indicating the selected content 1. In this scenario, the gesture operation for switching the selected content can be a palm translation operation. For example, Figure 9 As shown in the schematic diagram (b) in FIG. 1 , the second user operation for switching the selected content may be a mobile operation in which the user moves the palm of his hand to the lower right. The electronic device may display the second user operation in response to the detection of the second user operation. Figure 9 The interface shown in the diagram (c) in FIG. 1 includes a mark 2 for indicating the selected content 5, but does not include a mark 1. Based on this method, the content selected by the user can be switched from content 1 to content 5. For another example, the electronic device can also respond to Figure 9 The user shown in the diagram (c) moves his palm to the upper right to switch to the display Figure 9 The interface shown in the schematic diagram (d) in FIG. 3 includes a mark 3 for indicating that content 3 is selected, and does not include a mark 2. Based on this method, the content selected by the user can be switched from content 5 to content 3.

[0173] Example 10: In one example, taking the scenario where the electronic device is a smartwatch as an example, the electronic device selects a certain content based on the method of the aforementioned embodiment 2 and displays multiple related contents of the content, which may include: Figure 10 The first associated content, the second associated content, and the third associated content are shown in the schematic diagram (a) of FIG. The first associated content is the currently selected content. In this scenario, the gesture operation for switching the selected content can be a rotation operation of rotating a fist. For example, the electronic device can respond to the following Figure 10 The operation of rotating the display clockwise as shown in the diagram (a) in the figure switches to display Figure 10 The interface shown in the diagram (b) in FIG. 1 is used to switch the currently selected content from the first content to the third content. For another example, the electronic device may respond to the following Figure 10 The operation of rotating the display clockwise as shown in the diagram (b) in the figure switches to display Figure 10 The interface shown in the diagram (c) in FIG. 1 is used to switch the currently selected content from the third content to the second content. For another example, the electronic device may respond to the following Figure 10 The operation of rotating the display counterclockwise as shown in the diagram (c) in the figure switches to display Figure 10 The interface shown in the schematic diagram (d) in FIG. 1 is used to switch the currently selected content from the second content to the first content.

[0174] In the second possible approach, as Figure 8As shown in , in the scenario where the interface layout of the display interface is a top-down page-turning layout, a waving gesture operation can be used. In the scenario where the interface layout of the display interface is a left-right page-turning layout, a rotating gesture operation can be used. In the scenario where the interface layout of the display interface is arranged according to relative positions, a moving gesture operation can be used. The following examples 11 to 13 are used to illustrate this method.

[0175] Example 11: In one example, in the scenarios described in Examples 5 to 7 above, Figure 6 When the stacked cards in the interface shown in the diagram (b) can be switched by flipping pages up and down, the operation for switching the selected content can be a waving operation of clenching a fist. For example, the electronic device can respond to Figure 6 The waving operation shown in the schematic diagram (b) of FIG. 1 is a user waving his fist toward the display interface (or display screen) of the electronic device, switching to display Figure 6 The interface shown in the diagram (c) in FIG. 1 is used to switch the content currently selected by the user from the first associated content to the second associated content. For another example, the electronic device may also respond to Figure 6 In the diagram (b) of FIG. 1 , the user clenched his fist and waved away from the display interface (or display screen) of the electronic device, switching to display Figure 6 The interface shown in the schematic diagram (b) in FIG. 1 is used to switch the content currently selected by the user from the second associated content (ie, the content of the second card) to the first associated content (ie, the content of the first card).

[0176] Example 12: In one example, in the scenario described in Example 10, Figure 10 The first, second, and third associated contents shown in the diagram (a) can be switched by flipping pages left or right. In this scenario, the gesture operation for switching the selected content can be a rotation operation such as making a fist. For details, please refer to the operation instructions in Example 10 and will not be repeated here.

[0177] Example 13: In one example, in the scenarios described in Examples 1 to 4 above, if Figure 4 As shown in the diagram (a) in FIG, the first user operation may be an operation in which the user makes a palm gesture. Since the multiple contents in the first interface are arranged according to relative positions, as shown in FIG. Figure 4 As shown in the schematic diagram (b) in FIG. 1 , the second user operation for switching the selected content may be a moving operation of moving the palm downward. Alternatively, in the scenario described in the aforementioned example 9, as Figure 9 The contents in the interface shown in the schematic diagram (a) are arranged in relative positions, so as described in Example 9, the gesture operation for switching the selected content can be a moving operation.

[0178] It should be noted that the application scenarios provided in the above embodiments are merely examples of applicable scenarios of the embodiments of this application and do not limit the scenarios to which the solutions of this application are applicable. Part of the methods or the same technical concepts provided in any of the above embodiments may also be applied in other embodiments or other scenarios, or may be combined with the methods provided in other embodiments. Specifically, they can be applied in conjunction with specific embodiments or specific scenarios, and will not be listed one by one in this application.

[0179] Based on the above embodiments and the same technical concept, the present application also provides a display method, such as Figure 11 As shown in , the method may include:

[0180] S1101: The electronic device displays a first interface.

[0181] The first interface may include at least one item of content.

[0182] Optionally, the first interface may refer to the first interface described in the first embodiment or the fourth interface described in the fourth embodiment, and will not be described in detail here.

[0183] For example, the first interface can be referred to Figure 4 The interface shown in the diagram (a) or Figure 6 The interface shown in the schematic diagram (a).

[0184] S1102: The electronic device displays a second interface in response to a detected first air gesture operation; wherein the second interface includes multiple options, and the first option among the multiple options is displayed as the currently selected option; each of the multiple options is an item of content included in the first interface, or at least one of the multiple options is associated content of the first content included in the first interface.

[0185] In some embodiments of the present application, as an optional implementation, the second interface can be an interface that has undergone significant changes relative to the first interface. For example, the first interface can contain one or more contents, and the second interface can display contents related to the contents in the first interface by shrinking or stacking as options. The number of options can be the same as the number of contents in the first interface, or it can be less or more, which is not limited in this application. For example, the first interface can refer to Figure 6 In the interface shown in the diagram (a), in this scenario, the second interface can Figure 6 (b) The schematic diagram shows the stacked Figure 6 The contents related to the contents in the interface shown in the diagram (a) are provided as options.

[0186] Optionally, the second interface can be an interface that has undergone minor changes based on the first interface. For example, the first interface can originally have multiple contents as options, and the second interface can be an interface that adds a selection effect for an option in the first interface. Figure 4 In the interface shown in the diagram (a), in this scenario, the second interface can be Figure 4 The pair shown in the diagram (b) Figure 4 An interface for adding a selection effect to an item (i.e., memo content 1) in the interface shown in the diagram (a).

[0187] Optionally, the multiple options may correspond one-to-one to multiple items of content in the first interface, or the multiple options may correspond one-to-one to multiple items of associated content of the first content, or the multiple options may include at least one item of associated content of the first content (where each item of associated content may serve as an option) and other options, which are not specifically limited in the embodiments of the present application. The first content may include part or all of the content in the first interface.

[0188] In some embodiments of the present application, the associated content of the first content may be in one of the first content's multiple formats, or in one of the first content's multiple presentation forms. For example, the associated content of the first content may be any of the following: a link to the first content; a screenshot of the first content; or the plain text of the first content. Of course, other formats or presentation forms of the first content are also possible, and these are not listed here.

[0189] For example, the second interface can be referred to Figure 4 The interface shown in the diagram (b) or Figure 6 The interface shown in the diagram (b) or Figure 9 The interface shown in the diagram (b) or Figure 10 The interface shown in the schematic diagram (a).

[0190] In one example, when the second interface is Figure 4 In the interface shown in the diagram (b) in FIG, the multiple options can be memo contents 1 to 6 in the interface, and the first option can be the selected memo content 1 in the interface. In one example, when the second interface is Figure 6 In the interface shown in the schematic diagram (b), the multiple options can be the contents of the first card and the second card displayed in stacked form in the interface, and the first option can be the content of the first card displayed on the top layer in the interface.

[0191] In some embodiments of the present application, the first gesture operation may be an operation of opening the palm.

[0192] In the above method, when each of the multiple options is a content included in the first interface, the first gesture operation can be used to select the first option. When at least one of the multiple options is an associated content of the first content included in the first interface, the first gesture operation can be used to select the first content.

[0193] In some embodiments of the present application, the following step S1103 may be further included after step S1102:

[0194] S1103: The electronic device switches the second interface to a third interface in response to the detected second air gesture operation; wherein the third interface includes multiple options, and the second option among the multiple options is displayed as the currently selected option.

[0195] In this method, the electronic device switches the second interface to the third interface, that is, the electronic device switches the currently selected option from the first option to the second option. The display method of the second option can refer to the display method of the first option, and will not be repeated here.

[0196] For example, the third interface can be referred to Figure 4 The interface shown in the diagram (c) or Figure 6 The interface shown in the diagram (c) or Figure 9 The interface shown in the diagram (c) or Figure 10 The interface shown in the schematic diagram (b).

[0197] In one example, when the second interface is Figure 4 In the interface shown in the diagram (c) in FIG, the multiple options can be the memo contents 1 to 6 in the interface, and the second option can be the selected memo content 3 in the interface. In one example, when the second interface is Figure 6 In the interface shown in the schematic diagram (c), the multiple options can be the contents of the first card and the second card displayed in stacked form in the interface, and the second option can be the content of the second card displayed on the top layer in the interface.

[0198] In some embodiments of the present application, the second tidying operation and the first gesture operation may be continuous gesture operations.

[0199] In one possible approach, multiple options in the second interface can be displayed in a stacked format. For example, each of the multiple options can be displayed in a card, or the multiple options can be displayed in a stacked card format. In this scenario, the first option among the multiple options is displayed as the currently selected option. Specifically, the first option can be displayed at the top of the multiple options. That is, the option at the top of the stacked options can be the user's currently selected option.

[0200] As an optional implementation, in the above scenario, when multiple options in the second interface support up and down page turning, the second gesture operation is an operation of waving toward or away from the second interface with the first gesture. Alternatively, when multiple options in the second interface support left and right page turning, the second gesture operation is an operation of rotating clockwise or counterclockwise toward the second interface with the first gesture. Optionally, the first gesture can be a fist gesture. Regarding this method, please refer to the second possible method in the aforementioned embodiment four, which will not be described in detail here.

[0201] Optionally, the specific implementation process of the above method can refer to the method described in the above embodiment 2, and will not be described in detail here.

[0202] In another possible method, the display areas occupied by multiple options in the second interface may not overlap. In this scenario, the first option among the multiple options is displayed as the currently selected option. Specifically, the first option may be marked as the currently selected option. For example, the first option may have a setting mark that can be used to indicate that the first option has been selected or selected. As an optional embodiment, the second gesture operation may be an operation of panning with the second gesture. Optionally, the second gesture may be a palm gesture.

[0203] Optionally, the specific implementation process of the above method can refer to the method described in the above embodiment 1, and will not be described in detail here.

[0204] In the above two possible methods, as another optional implementation, when the electronic device is an electronic device of the first type, the second gesture operation is an operation of waving toward or away from the second interface with the first gesture. Optionally, the first type may be a screen-holding type. Or, when the electronic device is an electronic device of the second type, the second gesture operation is an operation of rotating clockwise or counterclockwise toward the second interface with the first gesture. Optionally, the second type may be a type with a display screen size greater than or equal to a set size. Or, when the electronic device is an electronic device of the third type, the second gesture operation is an operation of translating with the second gesture. Optionally, the third type may be a wearable type. Optionally, the description of the above method can be referred to for bending over the desk and the first gesture or the second gesture, which will not be described in detail here. Regarding this method, reference may be made to the first possible method in the aforementioned embodiment four, which will not be described in detail here.

[0205] In some embodiments of the present application, the following step may be included after step S1102: in response to detecting a third air gesture operation, switching the third interface to a fourth interface; wherein the fourth interface includes the second option. Based on this method, the electronic device can separately display the content ultimately selected by the user. Optionally, the third gesture operation and the second gesture operation can be continuous gesture operations.

[0206] Optional, for the fourth interface, please refer to Figure 4 The interface shown in the schematic diagram in (c).

[0207] In the above method, the specific steps executed by the electronic device can be found in the relevant introduction of the above embodiments, and will not be described in detail here.

[0208] Based on the above embodiments and the same technical concept, the embodiment of the present application further provides an electronic device, which is used to implement the display method provided in the embodiment of the present application. Figure 12 As shown in FIG, electronic device 1200 may include: a memory 1201, one or more processors 1202, and one or more computer programs (not shown). The above components may be coupled via one or more communication buses 1203. Electronic device 1200 may also include a display screen 1204.

[0209] Among them, one or more computer programs (codes) are stored in the memory 1201, and one or more computer programs include computer instructions; one or more processors 1202 call the computer instructions stored in the memory 1201, so that the electronic device 1200 executes the display method provided by the above-mentioned embodiment of the present application.

[0210] In a specific implementation, the memory 1201 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The memory 1201 can store an operating system (hereinafter referred to as the system), such as an embedded operating system such as ANDROID, IOS, WINDOWS, or LINUX. The memory 1201 can be used to store the implementation program of the embodiment of the present application. The memory 1201 can also store a network communication program, which can be used to communicate with one or more additional devices, one or more user devices, and one or more network devices.

[0211] The one or more processors 1202 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0212] The display screen 1204 is used to display application interfaces and other related user interfaces.

[0213] It should be noted that Figure 12 This is only one implementation of the electronic device 1200 provided in the embodiment of the present application. In actual applications, the electronic device 1200 may also include more or fewer components. Figure 1 The specific structure and description shown here are not limiting.

[0214] Based on the above embodiments and the same technical concept, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer executes the method provided in the above embodiments.

[0215] Based on the above embodiments and the same technical concept, an embodiment of the present application further provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer executes the method provided in the above embodiments.

[0216] Based on the above embodiments and the same technical concept, an embodiment of the present application further provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer executes the method provided in the above embodiments.

[0217] The methods provided in the embodiments of the present application may be implemented in whole or in part through software, hardware, firmware, or any combination thereof. When implemented using software, they may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. A computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. Available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs), or semiconductor media (e.g., SSDs), etc.

[0218] Obviously, those skilled in the art may make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include these modifications and variations.

Claims

1. A display method, applied to an electronic device, characterized in that: The method comprises: Display the first interface; In response to a detected first air gesture operation, a second interface is displayed; wherein, the second interface includes multiple options, and the first option among the multiple options is displayed as the currently selected option; each of the multiple options is an item of content included in the first interface, or at least one of the multiple options is associated content of the first content included in the first interface.

2. The method according to claim 1, wherein The method further comprises: In response to the detected second air gesture operation, the second interface is switched to a third interface; wherein the third interface includes the multiple options, and the second option among the multiple options is displayed as the currently selected option.

3. The method according to claim 2, wherein The second gesture operation and the first gesture operation are continuous gesture operations.

4. The method according to claim 2 or 3, wherein: The method further comprises: In response to the detected third air gesture operation, the third interface is switched to a fourth interface; wherein the fourth interface includes the second option.

5. The method according to claim 4, wherein The third gesture operation and the second gesture operation are continuous gesture operations.

6. The method according to any one of claims 1 to 5, wherein: The multiple options in the second interface are displayed in a stacked manner; the first option among the multiple options is displayed as the currently selected option, including: The first option is displayed on the uppermost layer among the multiple options.

7. The method according to claim 6, wherein When the multiple options in the second interface support up and down page turning, the second gesture operation is an operation of waving toward or away from the second interface using the first gesture; or When the multiple options in the second interface support left and right page turning, the second gesture operation is an operation of rotating clockwise or counterclockwise toward the second interface using the first gesture.

8. The method according to claim 7, wherein The first gesture is a fist gesture.

9. The method according to any one of claims 1 to 5, wherein: The display areas occupied by the multiple options in the second interface do not overlap with each other; the first option among the multiple options is displayed as the currently selected option, including: The first option is marked as the currently selected option.

10. The method according to claim 9, wherein The second gesture operation is a translation operation using a second gesture.

11. The method according to claim 10, wherein The second gesture is a palm gesture.

12. The method according to any one of claims 1 to 11, wherein: The associated content is in one of multiple formats of the first content, or the associated content is in one of multiple presentation forms of the first content.

13. The method according to claim 12, wherein: The associated content is any of the following: a link to the first content; a screenshot of the first content; The first content is plain text.

14. The method according to any one of claims 1 to 6, 9 and 12 to 13, wherein: When the electronic device is an electronic device of the first type, the second gesture operation is an operation of waving toward or away from the second interface with the first gesture; or When the electronic device is an electronic device of the second type, the second gesture operation is an operation of rotating clockwise or counterclockwise toward the second interface using the first gesture; or When the electronic device is an electronic device of the third type, the second gesture operation is an operation of translating with a second gesture.

15. The method according to any one of claims 1 to 14, wherein: The first gesture operation is an operation of opening the palm.

16. The method according to any one of claims 1 to 15, wherein: When each of the multiple options is an item of content included in the first interface, the first gesture operation is used to select the first option; or When at least one of the multiple options is associated content of the first content included in the first interface, the first gesture operation is used to select the first content.

17. An electronic device, characterized in that: The electronic device includes a memory and one or more processors; The memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device executes the method according to any one of claims 1 to 16.

18. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is run on an electronic device, the electronic device executes the method according to any one of claims 1 to 16.

19. A computer program product, characterized in that The computer program product includes a computer program or instructions. When the computer program or instructions are run on an electronic device, the electronic device is enabled to perform the method according to any one of claims 1 to 16.

Images