Interface interaction method, mobile terminal and storage medium

Abstract

The application provides an interface interaction method, a mobile terminal and a storage medium. The method comprises the following steps: a first trigger instruction is generated; the mobile terminal displays a second interaction interface according to the first trigger instruction, the second interaction interface is a function page of a first shortcut function key; and in response to an execution instruction, a function corresponding to the first shortcut function key is executed in the second interaction interface. The method improves the execution efficiency of an application program and improves the experience.

Description

Technical Field

[0001] This application relates to the field of mobile communication technology, specifically to an interface interaction method, a mobile terminal, and a storage medium. Background Technology

[0002] With the development of technology, mobile devices are widely used in daily life and work. During meetings, users often need to perform text operations. These operations typically include writing content, scheduling events, searching for information using a browser, expanding on existing content, and reflecting on thoughts.

[0003] Users typically use devices such as mobile terminals and personal computers for text manipulation. During text manipulation, users often use different applications to record different content. For example, users can use recording devices to record audio, use notepads to record content, and use calendars to create scheduled events.

[0004] However, in the process of conceiving and implementing this application, the interface interaction method resulted in information being distributed across various application software, leading to disorganized and fragmented information records. Consequently, low efficiency in the later stages of data processing is likely to occur.

[0005] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the Invention

[0006] To address the aforementioned technical issues, this application provides an interface interaction method, a mobile terminal, and a storage medium, enabling users to efficiently complete the post-processing of content.

[0007] To address the aforementioned technical problems, this application provides a user interface interaction method applied to a mobile terminal, comprising:

[0008] Obtain a first trigger command, wherein the first interactive interface includes at least one of the aforementioned shortcut function keys;

[0009] In response to the first trigger command, a second interactive interface is displayed, which is used to display the function page corresponding to the first shortcut function key;

[0010] In response to the execution command, the function corresponding to the first shortcut function key is executed in the second interactive interface.

[0011] Optionally, the method includes:

[0012] In response to the second trigger command, the application interface corresponding to the first shortcut function key is triggered.

[0013] Optionally, the second triggering instruction is triggered on the first interactive interface or the second interactive interface.

[0014] Optionally, the method includes:

[0015] In response to a first editing instruction, the text content in the second interactive interface and / or the application interface is edited, and the edited text content is displayed in the second interactive interface and / or the application interface.

[0016] Optionally, the method includes:

[0017] In response to a search command, search results are output on the second interactive interface and / or the application interface.

[0018] Optionally, S106 includes at least one of the following:

[0019] Search the content related to the search command within the content of the second interactive interface;

[0020] Search the application interface for content related to the search command;

[0021] Search the mobile terminal's memory for content related to the search command.

[0022] Optionally, the method includes:

[0023] In response to an information output command, the information resource corresponding to the first shortcut function key is output in the second interactive interface and / or the application interface.

[0024] Optionally, the second interactive interface and / or application interface includes at least one audio area and at least one text area.

[0025] This application also provides a mobile terminal, including: a memory and a processor, wherein the memory stores a text manipulation program, and when the text manipulation program is executed by the processor, it implements the steps of the method described above.

[0026] This application also provides a computer storage medium storing a computer program that, when executed by a processor, implements the steps of the method described above.

[0027] As described above, the interface interaction method of this application is applied to a mobile terminal. It displays a first interactive interface on a display screen; applies a first preset gesture to a first shortcut function key to generate a first trigger command; displays a second interactive interface from the first interactive interface based on the first trigger command, the second interactive interface being the function page of the first shortcut function key; applies a second preset gesture to a function on the second interactive page to trigger an execution command for that function; and, in response to the execution command, executes the operation of the function of the first shortcut function key. Through this method, users can more conveniently execute the functions in the first shortcut function key, improving user experience and increasing the efficiency of using the first shortcut function key. Attached Figure Description

[0028] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0029] Figure 1 A schematic diagram of the hardware structure of a mobile terminal to implement the various embodiments of this application;

[0030] Figure 2 A communication network system architecture diagram provided for an embodiment of this application;

[0031] Figure 3 This is a flowchart illustrating a user interface interaction method according to the first embodiment;

[0032] Figure 4 This is a schematic diagram of a first interactive interface according to the first embodiment;

[0033] Figure 5 This is a schematic diagram of a second interactive interface according to the first embodiment;

[0034] Figure 6 This is a flowchart illustrating another interface interaction method according to the second embodiment;

[0035] Figure 7 This is a schematic diagram of another second interactive interface according to the second embodiment;

[0036] Figure 8 This is a schematic diagram illustrating a text box editing state according to the second embodiment;

[0037] Figure 9 This is a schematic diagram of a search box according to the second embodiment;

[0038] Figure 10 This is a flowchart illustrating another interface interaction method according to the third embodiment;

[0039] Figure 11 This is a schematic diagram of another third interactive interface shown according to the third embodiment.

[0040] The realization of the objectives, functional features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and textual descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0041] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0042] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Optionally, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which needs to be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0043] It should be understood that although the terms first, second, third, etc., may be used herein to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word “if” as used herein may be interpreted as “when…” or “in response to determination”. Furthermore, as used herein, the singular forms “a,” “an,” and “the” are intended to also include the plural forms unless the context indicates otherwise. It should be further understood that the terms “comprising,” “including,” indicate the presence of a feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms “or,” “and / or,” “including at least one of the following,” etc., as used in this application may be interpreted as inclusive, or mean any one or any combination thereof. For example, "including at least one of the following: A, B, C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Similarly, "A, B, or C" or "A, B, and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Exceptions to this definition only occur when the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0044] It should be understood that although the steps in the flowcharts of this application's embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0045] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0046] It should be noted that step designations such as S101 and S102 are used in this document for the purpose of more clearly and concisely describing the corresponding content, and do not constitute a substantial limitation on the order. In specific implementation, those skilled in the art may execute S102 first and then S101, etc., but these should all be within the protection scope of this application.

[0047] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0048] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustrative purposes and has no specific meaning in itself. Therefore, "module," "part," or "unit" may be used interchangeably.

[0049] Mobile terminals can be implemented in various forms. For example, the mobile terminals described in this application may include mobile terminals such as mobile phones, tablets, laptops, handheld computers, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0050] The following description will use a mobile terminal as an example. Those skilled in the art will understand that, apart from elements specifically designed for mobile purposes, the construction according to the embodiments of this application can also be applied to fixed-type terminals.

[0051] Please see Figure 1 This is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of this application. The mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111, etc. Those skilled in the art will understand that... Figure 1 The mobile terminal structure shown does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0052] The following is combined with Figure 1 A detailed introduction to each component of the mobile terminal:

[0053] The radio frequency unit 101 can be used for receiving and transmitting signals during information transmission or calls. Optionally, it receives downlink information from the base station and processes it with the processor 110; additionally, it transmits uplink data to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc. Optionally, the radio frequency unit 101 can also communicate wirelessly with networks and other devices. The aforementioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), and TDD-LTE (Time Division Duplexing-Long Term Evolution).

[0054] WiFi is a short-range wireless transmission technology. Mobile terminals, through the WiFi module 102, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 1 WiFi module 102 is shown, but it is understood that it is not a necessary component of a mobile terminal and can be omitted as needed without changing the nature of the invention.

[0055] The audio output unit 103 can convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into audio signals and output them as sound when the mobile terminal 100 is in call signal receiving mode, call mode, recording mode, voice recognition mode, broadcast receiving mode, etc. Furthermore, the audio output unit 103 can also provide audio output related to specific functions performed by the mobile terminal 100 (e.g., call signal receiving sound, message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0056] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the GPU 1041 can be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in operating modes such as telephone call mode, recording mode, and voice recognition mode, and can process such sound into audio data. The processed audio (voice) data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 in telephone call mode. The microphone 1042 can implement various types of noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0057] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the ambient light level, and the proximity sensor can turn off the display panel 1061 and / or backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the phone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that may be configured in the phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0058] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0059] User input unit 107 can be used to receive input numerical or character information, and generate key signal inputs related to user settings and function control of the mobile terminal. Optionally, user input unit 107 may include touch panel 1071 and other input devices 1072. Touch panel 1071, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near touch panel 1071), and drive corresponding connection devices according to a pre-set program. Touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to processor 110, and can also receive and execute commands sent by processor 110. Optionally, touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, other input devices 1072 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc., without being specifically limited here.

[0060] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides corresponding visual output on the display panel 1061 based on the type of touch event. Although in Figure 1 In this embodiment, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the mobile terminal. The specific implementation is not limited here.

[0061] Interface unit 108 serves as an interface through which at least one external device can connect to mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, and so on. Interface unit 108 may be used to receive input (e.g., data, power, etc.) from the external device and transmit the received input to one or more elements within mobile terminal 100, or it may be used to transmit data between mobile terminal 100 and the external device.

[0062] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a program storage area and a data storage area. Optionally, the program storage area may store the operating system, applications required for at least one function (such as sound playback, image playback, etc.), etc.; the data storage area may store data created based on the use of the mobile phone (such as audio data, phonebook, etc.). Optionally, the memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0063] The processor 110 is the control center of the mobile terminal. It connects various parts of the mobile terminal via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 109, and by calling data stored in the memory 109, it performs various functions and processes data of the mobile terminal, thereby providing overall monitoring of the mobile terminal. The processor 110 may include one or more processing units; optionally, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the aforementioned modem processor may also not be integrated into the processor 110.

[0064] The mobile terminal 100 may also include a power supply 111 (such as a battery) that supplies power to various components. Optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.

[0065] although Figure 1 As not shown, the mobile terminal 100 may also include a Bluetooth module, etc., which will not be described in detail here.

[0066] To facilitate understanding of the embodiments of this application, the communication network system on which the mobile terminal of this application is based is described below.

[0067] Please see Figure 2 , Figure 2 This application provides a communication network system architecture diagram. The communication network system is an LTE system based on the universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and the operator's IP services 204, which are connected in sequence.

[0068] Optionally, UE201 can be the aforementioned terminal 100, which will not be described in detail here.

[0069] E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. Optionally, eNodeB2021 can connect to other eNodeB2022 via backhaul (e.g., X2 interface), and eNodeB2021 connects to EPC203, providing access from UE201 to EPC203.

[0070] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gateway) 2034, PGW (Packet Data Network Gateway) 2035, and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME2031 is the control node that handles signaling between UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as the Home Location Register (not shown in the figure) and stores user-specific information such as service characteristics and data rates. All user data can be sent through SGW2034. PGW2035 can provide UE 201 IP address allocation and other functions. PCRF2036 is the policy and charging control decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging enforcement function unit (not shown in the figure).

[0071] IP services 204 may include the Internet, intranet, IMS (IP Multimedia Subsystem), or other IP services.

[0072] Although the above description uses the LTE system as an example, those skilled in the art should understand that this application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems, etc., which are not limited here.

[0073] Based on the above-described mobile terminal hardware structure and communication network system, various embodiments of this application are proposed.

[0074] First Embodiment

[0075] Please see Figure 3 , Figure 3 A flowchart illustrating an interface interaction method provided in an embodiment of this application.

[0076] like Figure 3 As shown, with the mobile terminal as the execution subject, the method in this embodiment may include the following steps:

[0077] S101. Obtain the first trigger command. The first interactive interface includes at least one shortcut function key.

[0078] In this embodiment, the mobile terminal can display a first interactive interface on a display screen. This first interactive interface can be as follows: Figure 4 As shown. The first interactive interface is a sidebar on the display interface. Users can trigger the first interactive interface using trigger commands. The first interactive interface may include multiple shortcut function keys. For example... Figure 4 As shown, the first interactive interface includes nine shortcut function keys. Optionally, four shortcut function keys are displayed as icons on the first interactive interface. Optionally, five shortcut function keys are displayed as cards on the first interactive interface. Users can generate or determine a first trigger command by applying a first preset gesture to the first shortcut function key. The first trigger command includes the first shortcut function key. Optionally, the first shortcut function key can be any shortcut function key in the first interactive interface. The first preset gesture can include clicking, double-clicking, dragging, etc.

[0079] S102. In response to the first trigger command, a second interactive interface is displayed, which is used to display the function page corresponding to the first shortcut function key.

[0080] In this embodiment, after the mobile terminal receives the first trigger command, it displays a second interactive interface from the first interactive interface according to the first trigger command. The second interactive interface is the function page of the first shortcut function key. When the user enters the second interactive page, the user can view the various functions of the first shortcut function key. These functions can be displayed on the second interactive page as buttons. For example, when the first shortcut function key is a meeting recording shortcut function key, its second interactive interface can be as follows: Figure 5 As shown. This second interactive page includes an audio area and a text area. Optionally, the audio area includes a button. This button is used to start recording or pause recording during the recording process. Optionally, the text area includes a text box.

[0081] S103. In response to the execution command, execute the function corresponding to the first shortcut function key in the second interactive interface.

[0082] In this embodiment, the user can trigger the execution command of a function by applying a second preset gesture to a function on the second interactive page. The mobile terminal responds to the execution command and executes the function of the first shortcut key. Optionally, the second preset gesture can be a click, double-click, long press, etc. For example, when the second interactive interface is as follows... Figure 5 As shown. When the meeting starts, the user can generate an execution command by clicking the button in the audio area. The mobile terminal responds to this execution command and begins recording. During a break in the meeting, the user can generate an execution command by clicking the button in the audio area again. The mobile terminal responds to this execution command and pauses recording. This second interactive page also includes a text area. This text area generates text content in real time based on the audio content. When the user clicks this text area, an execution command is generated. The mobile terminal can trigger the editing state of the text content based on this execution command. When the meeting ends, the user can generate an execution command by clicking the save button. The mobile terminal saves both the audio and text content based on this execution command.

[0083] In the interface interaction method provided in this application, the mobile terminal can display a first interactive interface on the display screen. The user can generate a first trigger command by applying a first preset gesture to a first shortcut function key. Based on the first trigger command, the mobile terminal displays a second interactive interface from the first interactive interface. This second interactive interface is the function page of the first shortcut function key. The user can trigger the execution command of that function by applying a second preset gesture to the function on the second interactive page. The mobile terminal responds to the execution command and executes the function of the first shortcut function key. In this application, the execution of the function in the first shortcut function key is achieved through the first trigger command and the execution command, improving the execution efficiency of the application, enhancing the user experience, and allowing the user to enter the second interactive page and execute the function corresponding to the first shortcut function key at any time according to actual needs.

[0084] Second Embodiment

[0085] Please see Figure 6 , Figure 6 A flowchart illustrating another interface interaction method provided in this application embodiment. Using a mobile terminal as the execution subject, in... Figure 3 Based on the illustrated embodiment, the method of this embodiment may further include the following steps:

[0086] S104. In response to the second trigger command, the application interface corresponding to the first shortcut function key is triggered.

[0087] In this embodiment, in response to the second trigger command, the mobile terminal displays the application interface corresponding to the first shortcut function key on its display screen. The application interface displays the various functions corresponding to the first shortcut function key. Optionally, the functions can be displayed on the application interface as buttons.

[0088] In one example, the second trigger command is triggered on the first interactive interface. The user can also apply a third preset gesture to a first shortcut function key on the first interactive interface. The mobile terminal generates a second trigger command based on the third preset gesture applied to the first shortcut function key. This second trigger command includes the first shortcut function key. Optionally, the third preset gesture is a gesture different from the first preset gesture. This third preset gesture can be a long press, drag, double-tap, etc.

[0089] In another example, the second trigger command is triggered by the second interactive interface. When the second interactive interface is displayed, the user can apply a third preset gesture to it. The mobile terminal generates the second trigger command based on the third preset gesture applied to the first shortcut function key. For example, the user can click the full-screen button on the second interactive interface to generate the second trigger command. Alternatively, the user can double-click the second interactive interface to generate the second trigger command. Or, the user can drag the second interactive interface to the full-screen area of ​​a preset region to generate the second trigger command.

[0090] S105. In response to the first editing instruction, edit the text content in the second interactive interface and / or application interface, and display the edited text content in the second interactive interface and / or application interface.

[0091] In one example, the second interactive interface and / or application interface includes at least one audio area and at least one text area.

[0092] In this example, the second interactive interface and / or application interface includes the function corresponding to the first shortcut function key. This function can exist as a button, edit box, etc. Users can trigger the execution command of each function by clicking the button, clicking the edit box, etc. Optionally, such as... Figure 5 or Figure 7 As shown, the second interactive interface and / or application interface may include an audio area and a text area.

[0093] In this embodiment, when the second interactive interface or application interface includes a text area, the mobile terminal can generate a first editing instruction for the text box by clicking on the text box in that text area. Once the text box enters an editable state according to the first editing instruction, the user can edit the text content within the edit box. For example, ... Figure 5As shown, when a text area includes a text box, the user can click on the text box to trigger its editing mode. This text box displays the text content converted from the audio content by the mobile device. The user can edit this text content to correct any errors in the conversion. For example, ... Figure 7 As shown, when the text area includes multiple text boxes, the user can edit one of them by clicking on it. When the user clicks on a text box, the mobile terminal generates a first editing command. In response to this first editing command, the text box enters edit mode. The user can then edit the text box. Optionally, the edit mode of the text box can be as follows: Figure 8 As shown. After the user finishes editing, they can save the edited text to the text box by clicking the save button. Alternatively, the user can exit editing by clicking the exit button, and the text box will display the text before editing.

[0094] S106. In response to the search command, output the search results in the second interactive interface and / or application interface.

[0095] In this embodiment, when the second interactive interface and / or application interface includes a search function button, the user can click on it. Figure 7 The search button shown generates a search command. In response to this search command, the mobile terminal can display a search box on the screen. This search box can be displayed as follows: Figure 9 As shown. Users can enter keywords in the input box of this search box. After entering keywords, users can click the search button to search. When the user clicks the search button, the mobile terminal can display the search results in a floating window for the user to view. Optionally, the search box includes buttons 1, 2, 3, and 4. Users can perform different ranges of searches by clicking buttons 1, 2, 3, and 4.

[0096] In one example, when the user selects button 1, the mobile terminal can search for relevant content from the content of the second interactive interface based on keywords. When the mobile terminal finds relevant content from the second interactive interface, it can display one or more relevant content items to the user in a floating window. The user can select one or more of these relevant content items. The selected relevant content will be displayed as follows: Figure 7 The text area shown.

[0097] In another example, when the user selects button 2, the mobile device can search for relevant content from the application interface based on keywords. When the mobile device finds relevant content from the application interface, it can display one or more relevant pieces of content to the user in a floating window. The user can select one or more of these relevant pieces of content. The selected relevant content will be displayed as follows: Figure 7 The text area shown.

[0098] In another example, when the user selects button 3, the mobile terminal can search for relevant content in its memory based on keywords. When the mobile terminal finds relevant content in its memory, it can display one or more related items to the user in a floating window. This related content can be files, images, folders, etc., with names related to the keywords. The user can click to view the related content displayed in the floating window. When the user selects content, the related content will be displayed in a path such as... Figure 7 The text area shown. When a user clicks on this path, they can jump to the corresponding path, or open the corresponding file or image.

[0099] In another example, when the user selects button 4, the mobile device can search for relevant content from the internet based on keywords. When the mobile device finds relevant content, it can display the search interface to the user in a floating window. The user can click on the floating window to view the website corresponding to the search result. When the user selects the website, the website will be displayed as a URL, such as... Figure 7 The text area shown indicates that when a user clicks on the URL, they will be redirected to the corresponding website.

[0100] S107. In response to the information output instruction, output the information resource corresponding to the first shortcut function key in the second interactive interface and / or application interface.

[0101] In this embodiment, when the second interactive interface and / or application interface includes a switch button, the user can click on it. Figure 7 The conversion button shown generates an information output command. In response to this information output command, the mobile terminal can output the text-converted audio content in the text area of ​​the second interactive interface and / or application interface.

[0102] In the interface interaction method provided in this application, the mobile terminal responds to the second trigger command and displays the application interface corresponding to the first shortcut function key on the mobile terminal's display interface. When the second interactive interface or application interface includes a text area, the mobile terminal can generate an editing command for the text box by clicking on the text box in the text area. The edited text content is displayed in the second interactive interface and / or application interface. When the second interactive interface and / or application interface includes a search function button, the user can generate a search command by clicking the search button. In response to the search command, the mobile terminal can pop up a search box on the display interface. The search results are output in the second interactive interface and / or application interface. When the second interactive interface and / or application interface includes a switch button, the user can generate an information output command by clicking the switch button. The information resource corresponding to the first shortcut function key is output in the second interactive interface and / or application interface. In this application, the interaction between the user and the second interactive interface is realized through the above buttons, thereby improving the user's efficiency, the convenience of the second interactive interface, and the user experience.

[0103] Third Embodiment

[0104] Please see Figure 10 , Figure 10 A flowchart illustrating another interface interaction method provided in an embodiment of this application. Figures 3 to 9 Based on the illustrated embodiments, as Figure 10 As shown, with the mobile terminal as the execution subject, when the first shortcut function key is used to record the first information, and the mobile terminal completes the recording of the first information, the method of this embodiment may include the following steps:

[0105] S201. In response to the first viewing command, the third interactive interface is opened. The third interactive interface is used to display the first information recorded by the second interactive interface.

[0106] In this embodiment, the first information may be meeting information, interview information, interview records, etc. This first information includes audio content and text content. The mobile terminal responds to the first viewing command and jumps to the third interactive interface. Optionally, the third interactive interface may be as follows: Figure 11 As shown, this includes audio content, first text content, and second text content. Optionally, the first text content is used to display notes, search records, schedules, and audio-related content. Optionally, the second text content is used to display the text-to-text conversion result of the audio content.

[0107] Optionally, the first viewing command can be triggered in either the first interactive interface or the second interactive interface.

[0108] Optionally, this third interactive interface can also be displayed within the application interface. Optionally, the application interface is the same as the display interface.

[0109] S202. In response to the playback progress of the audio content, display the text content at the corresponding moment.

[0110] In this embodiment, the user can click the play button in the audio area to play the audio content. For example... Figure 11 As shown, the audio area includes a playback progress bar. The first text area and the second text area each include their own progress bars. When the audio file is played, the progress bars of the first and second text areas slide synchronously with the audio area's progress bar. Optionally, the time in the first text area is determined based on the recording time of the first text line in that first text area. Optionally, the time in the second text area is determined based on the time corresponding to the first line of text. When the audio content is played, as the audio area's playback progress bar progresses, the first and second text areas display the text content at the corresponding moment.

[0111] S203. In response to a second viewing command for the text content, adjust the playback progress bar for the audio content.

[0112] In this embodiment, the user can slide the progress bar of either the first text area or the second text area. When the progress bar of the first text area is slid, the mobile terminal obtains the corresponding time for that text area. This time corresponds to the time of the first text content in the first text area. The mobile terminal adjusts the progress of the second text area and the audio area based on this time. When the progress bar of the second text area is slid, the mobile terminal obtains the corresponding time for that text area. This time corresponds to the time of the second text content in the second text area. The mobile terminal adjusts the progress of the first text area and the audio area based on this time.

[0113] S204. In response to the second editing instruction, edit the text in the text box.

[0114] In this embodiment, the mobile terminal can also trigger a second editing instruction for the text boxes in the first and second text areas. In response to this second editing instruction, the text box enters an editing state. This editing state can be as follows: Figure 8 As shown.

[0115] In the interface interaction method provided in this application, the mobile terminal responds to a first viewing command and jumps to a third interactive interface. The mobile terminal responds to the playback progress of the audio content and displays the corresponding text content. The mobile terminal responds to a second viewing command for the text content and adjusts the playback progress bar of the audio content. The mobile terminal responds to a second editing command and edits the text in the text box. In this application, by viewing the first information, post-processing of the first information is achieved. This post-processing method integrates the audio of the first information, the text directly converted from the audio, and related content of the first information into the third interface for display, greatly improving the efficiency of post-processing. Simultaneously, the synchronization function of the progress bars for the audio content, the first text content, and the second text content in this third interface allows users to more quickly determine the correlation between the content, further improving the efficiency of post-processing.

[0116] This application also provides a mobile terminal device, which includes a memory and a processor. The memory stores a text manipulation program, and when the text manipulation program is executed by the processor, it implements the steps of the interface interaction method in any of the above embodiments.

[0117] This application also provides a computer-readable storage medium storing a text manipulation program, which, when executed by a processor, implements the steps of the interface interaction method in any of the above embodiments.

[0118] The embodiments of the mobile terminal and computer-readable storage medium provided in this application include all the technical features of the above-described interface interaction methods. The extended and explanatory content of the specification is basically the same as that of the above-described methods, and will not be repeated here.

[0119] This application also provides a computer program product, which includes computer program code. When the computer program code is run on a computer, it causes the computer to perform the methods described in the various possible implementations above.

[0120] This application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device with the chip installed performs the methods described in the various possible implementations above.

[0121] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0122] In this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions are generally described in detail only when they appear for the first time. When they appear again, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions that are not described in detail later can be referred to their previous relevant detailed descriptions.

[0123] In this application, the descriptions of the various embodiments have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0124] The technical features of the present application can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0125] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of this application.

[0126] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A user interface interaction method, characterized in that, The method includes: In response to a trigger operation on a first shortcut function key in a first interactive interface, a first trigger command is obtained, wherein the first interactive interface includes at least one shortcut function key, and the first shortcut function key is any one of the shortcut function keys in the first interactive interface; In response to the first trigger command, a second interactive interface is displayed, which is used to display the function page corresponding to the first shortcut function key; the functions of the second interactive interface include audio function, text function, and search function. In response to the execution command, the function corresponding to the first shortcut function key is executed in the second interactive interface; In response to the first viewing command, a third interactive interface is opened. The third interactive interface is used to organize and display the first information recorded by the second interactive interface. The first information includes audio content, text content, and search results.

2. The interface interaction method according to claim 1, characterized in that, The method includes: In response to the second trigger command, the application interface corresponding to the first shortcut function key is triggered.

3. The interface interaction method according to claim 2, characterized in that, The second triggering command is triggered on either the first interactive interface or the second interactive interface.

4. The interface interaction method according to claim 2 or 3, characterized in that, The method includes: In response to a first editing instruction, the text content in the second interactive interface and / or the application interface is edited, and the edited text content is displayed in the second interactive interface and / or the application interface.

5. The interface interaction method according to claim 2 or 3, characterized in that, The method includes: In response to a search command, search results are output on the second interactive interface and / or the application interface.

6. The interface interaction method according to claim 5, characterized in that, The step of responding to a search command by outputting search results on the second interactive interface and / or the application interface includes at least one of the following: Search the content related to the search command within the content of the second interactive interface; Search the application interface for content related to the search command; Search the mobile terminal's memory for content related to the search command.

7. The interface interaction method according to claim 2 or 3, characterized in that, The method includes: In response to an information output command, the information resource corresponding to the first shortcut function key is output in the second interactive interface and / or the application interface.

8. The interface interaction method according to claim 2 or 3, characterized in that, The second interactive interface and / or application interface includes at least one audio area and at least one text area.

9. A mobile terminal, characterized in that, The mobile terminal includes a memory and a processor, wherein the memory stores a text manipulation program, and when the text manipulation program is executed by the processor, it implements the steps of the interface interaction method as described in any one of claims 1 to 8.

10. A readable storage medium, characterized in that, The readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the interface interaction method as described in any one of claims 1 to 8.

Images