Display method, intelligent terminal and computer readable storage medium
By displaying multiple signal acquisition controls and multi-window display interfaces on the smart terminal, the user experience problem caused by the single interaction method of the smart assistant is solved, and interactive flexibility and user experience are improved.
Patent Information
- Application Number
- CN202411061742.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-08
AI Technical Summary
Smart assistants usually only support a single interaction and/or display method in response to user needs, resulting in limited user experience.
Provides a display method, allowing users to respond to requirements by displaying multiple signal acquisition controls on the smart terminal, such as voice acquisition controls, text input windows, file import controls, picture upload controls, shooting controls and scanning controls. Choose different interaction methods and display content and operation areas through multi-window display interfaces to improve interactive flexibility.
By providing multiple interaction methods and multi-window display interfaces, the flexibility and user experience of the smart assistant and users are improved, and the user experience is solved by solving the problem of limited user experience caused by a single interaction method.
Smart Images

Figure CN118921424A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a display method, an intelligent terminal and a computer-readable storage medium. Background Art
[0002] Smart terminals such as mobile phones are usually equipped with intelligent assistants (also called smart assistants), which can support natural language input and respond to user needs directly and / or call other applications based on user input.
[0003] In the process of conceiving and implementing this application, the inventors discovered that there are at least the following problems: in the process of responding to user needs, intelligent assistants often only support a single interaction and / or display method, which has limitations and easily affects the user experience.
[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention
[0005] In response to the above technical problems, the present application proposes a display method, an intelligent terminal and a computer-readable storage medium to provide corresponding interaction methods for users to choose when the intelligent assistant responds to user needs, thereby improving the flexibility of the interaction between the intelligent assistant and the user.
[0006] The present application provides a display method, which can be applied to a smart terminal, comprising the steps of:
[0007] S310: In response to the wake-up operation, display the first window;
[0008] S320: Displaying at least one signal acquisition control for representing the interaction mode in the first window.
[0009] Optionally, the signal acquisition control includes at least one of the following: a voice acquisition control, a text input window, a file import control, a picture upload control, a shooting control, a code scanning control and a communication control.
[0010] Optionally, the method further includes: acquiring at least one external feature of the smart terminal, and displaying a signal acquisition control matching the at least one external feature in a first preset manner.
[0011] Optionally, the method further includes: responding to a selection operation corresponding to the signal acquisition control, and displaying the signal acquisition control and / or the signal acquisition page corresponding to the selection operation in a second preset manner.
[0012] Optionally, after responding to the wake-up operation, the method further includes: displaying a second window.
[0013] Optionally, the method further includes: displaying at least part of the interaction process in the second window.
[0014] Optionally, the second window includes a content display area and / or an operation area.
[0015] Optionally, the method further includes: displaying at least part of the interaction process in the content display area.
[0016] Optionally, the method further includes: in response to a first operation received by the operation area, displaying the second window in a third preset manner.
[0017] Optionally, the method further includes: in response to a second operation received by the operation area, closing the second window.
[0018] Optionally, the method further includes: a bottom end of the second window is above a top end of the first window.
[0019] Optionally, the background color of the content display area is used to distinguish the display interface from the displayed content.
[0020] Optionally, the size of the content display area is adapted to the displayed content.
[0021] Optionally, the displayed content carries an entrance to a corresponding application.
[0022] Optionally, the method further includes: when the response content meets a preset condition, displaying the response content through a third window.
[0023] Optionally, satisfying a preset condition includes at least one of the following: a format of the response content satisfies a preset format, and the response content is displayed through a preset platform.
[0024] Optionally, the method further includes: in response to the first screen projection operation, transferring the third window to the first terminal for display.
[0025] Optionally, displaying the response content through the third window includes: responding to the second screen projection operation, displaying the third window on the second terminal, and displaying the response content in the third window.
[0026] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of the above method are implemented.
[0027] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.
[0028] As described above, the display method of the present application can be applied to a smart terminal, including the steps of: displaying a first window in response to a wake-up operation; and displaying at least one signal acquisition control for characterizing an interaction mode in the first window. Through the technical solution of the present application, various corresponding interaction modes can be provided for users to choose from in the process of the smart assistant responding to user needs, and / or the interface content can be displayed through multiple windows, thereby solving the problem that the smart assistant often only supports a single interaction and / or display mode in the process of responding to user needs, which has limitations, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.
[0030] Figure 1 A schematic diagram of the hardware structure of a smart terminal for implementing each embodiment of the present application;
[0031] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application;
[0032] Figure 3 is a flow chart of a display method according to the first embodiment;
[0033] Figure 4a and Figure 4b is a schematic diagram of a first window of a display method according to a first embodiment;
[0034] Figure 5a , Figure 5b and Figure 5c is a schematic diagram of a related interface of the display method according to the first embodiment;
[0035] Figure 6a and Figure 6b is a schematic diagram of a second window of a display method according to a second embodiment;
[0036] Figure 7a , Figure 7b , Figure 7c , Figure 7d and Figure 7e is a schematic diagram of a related interface of a display method according to a second embodiment;
[0037] Figure 8a and Figure 8bis a schematic diagram of a related interface of a display method according to a third embodiment;
[0038] Figure 9a , Figure 9b and Fig.9c It is a schematic diagram of related interfaces of the display method according to the third embodiment.
[0039] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0040] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0041] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.
[0042] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.
[0043] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
[0044] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0045] It should be noted that in this article, step codes such as S310 and S320 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step codes, those skilled in the art may execute S320 first and then S310, etc., but these should all be within the scope of protection of this application.
[0046] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0047] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.
[0048] The intelligent terminal may be implemented in various forms. For example, the intelligent terminal described in the present application may include intelligent terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.
[0049] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.
[0050] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, Wi-Fi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0051] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:
[0052] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communications), GPRS (Generic Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), 5G and 6G, etc.
[0053] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.
[0054] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.
[0055] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042. The graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.
[0056] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.
[0057] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
[0058] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.
[0059] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.
[0060] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
[0061] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0062] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.
[0063] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.
[0064] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.
[0065] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.
[0066] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equ i pment) 201, an E-UTRAN (Evolved UMTS Terrestrial Rad i oAccess Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.
[0067] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.
[0068] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022, etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203, and eNodeB 2021 may provide UE 201 with access to EPC 203.
[0069] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MME 2033, SGW (Serving Gateway) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Rate Function) 2036. Optionally, MME 2031 is a control node for processing signaling between UE 201 and EPC 203, providing bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown), and save some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).
[0070] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.
[0071] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.
[0072] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.
[0073] First embodiment
[0074] Reference Figure 3 , Figure 3 It is a flowchart of the display method according to the first embodiment. The display method of the embodiment of the present application can be applied to a smart terminal (such as a mobile phone), including the following steps S310 and S320.
[0075] S310: In response to the wake-up operation, display the first window.
[0076] Optionally, the wake-up operation includes an operation for waking up the voice assistant of the intelligent terminal. Optionally, the wake-up operation includes a voice wake-up operation, such as an operation for waking up the intelligent assistant by the name of the intelligent assistant. Optionally, the wake-up operation includes an operation received by a control for waking up the intelligent assistant, such as an operation received by a desktop icon for waking up the intelligent assistant and / or an operation received by a shortcut control for waking up the intelligent assistant, etc.
[0077] S320: Displaying at least one signal acquisition control for representing the interaction mode in the first window.
[0078] Optionally, the interaction method includes the method of interaction between the user and the intelligent assistant, which may include voice interaction, interaction by inputting text, interaction by recognizing pictures and / or interaction by scanning a code, etc. Optionally, the signal acquisition control includes a control for obtaining user input information through a corresponding interaction scheme; optionally, each interaction method has a corresponding signal acquisition control, and the interaction method currently provided by the intelligent assistant can be determined through each signal acquisition control displayed in the first window. Optionally, the first window displays at least one (for example, 2, 3 or 4, etc.) signal acquisition control at the same time, so as to provide corresponding various interaction methods for users to choose from in the process of responding to user needs, so as to improve the flexibility of interaction.
[0079] Optionally, the signal acquisition control includes at least one of the following: a voice acquisition control for acquiring voice signals, a text input window for users to input text information, a file import control for users to upload files, a picture upload control for users to upload pictures, a shooting control for entering a shooting interface, a code scanning control for entering a code scanning interface, and a communication control for communicating with a preset user through a preset communication program. Optionally, the first window can refer to Figure 4a and Figure 4b As shown, it includes signal acquisition controls such as text input window, voice acquisition control, file import control, picture upload control, shooting control, communication control and code scanning control.
[0080] The smart terminal can highlight the signal acquisition control currently used by the smart assistant. Optionally, the highlighting method can include at least one of the following (1) to (3): (1) arranging the currently used signal acquisition control in the first row, for example, Figure 4a As shown, the text input window is arranged in the first row, which is used to indicate that the intelligent assistant currently interacts with the user through the text input window. The user can enter text into the text input box to enter the interaction instruction. (2) Enlarge and / or flash the currently used signal acquisition control, such as reference Figure 4b As shown, the signal acquisition control is enlarged and / or flashed to indicate that the intelligent assistant can currently recognize the user's voice and the user can issue voice commands. (3) The currently used signal acquisition control is highlighted to prompt the user the interaction method provided by the intelligent assistant.
[0081] Optionally, signal acquisition controls such as file import controls, image upload controls, shooting controls, code scanning controls, and communication controls used in the smart assistant to acquire other forms of signals can be referred to as multimodal interaction controls, which are set in a multimodal interaction area (also referred to as a multimodal interaction panel). The multimodal interaction area can be set at a later position in the first window, such as the last line of the first window. Voice acquisition controls and text input windows, which are frequently used signal acquisition controls in the smart assistant, can be set at a front position in the first window, such as the first line of the first window, to facilitate user selection.
[0082] Optionally, after any control in the multimodal interactive control is triggered, the smart terminal can pull up the first window and / or the multimodal panel, and the display interface can enter the information acquisition interface of the corresponding point to obtain the information corresponding to the triggered control. Figure 5a As shown, Figure 5a The display interface shown also includes a window (such as a second window) for displaying the interaction process. If the user triggers the file import control, the user can enter Figure 5bThe file import interface shown in the figure allows the user to select the file to be imported. If the user selects the file "P1.pdf", the intelligent terminal can display the file in the window used to display the interaction process and inform the user: "The file has been received. I can help you summarize it. You can also ask me questions directly" and other information for the user to continue to interact with the intelligent assistant based on the imported file. Figure 5c shown.
[0083] Optionally, the display method further includes: acquiring at least one external feature of the smart terminal, and displaying a signal acquisition control that matches at least one of the external features in a first preset manner. Optionally, the external features include features related to the user's choice of interaction method, such as the way the user wakes up the smart assistant, the time period, environment, place and / or location of the smart terminal. Optionally, the first preset method includes a display method that characterizes the signal acquisition control currently used by the smart assistant to interact with the user, such as a highlighting method such as magnification, flashing and / or highlighting. Here, the interaction method used by the smart assistant is adaptively determined based on the external features of the smart terminal, which can enhance the user experience brought by the smart assistant.
[0084] Optionally, the interaction method initially displayed by the smart terminal matches the method in which the user wakes up the smart assistant; for example, if the user wakes up the smart assistant through voice, the smart terminal displays the voice collection control in a first preset manner to indicate that the user's voice can currently be collected; for example, if the user inputs a wake-up operation to the control for waking up the smart assistant, the smart terminal displays the text input window in a first preset manner to indicate that the smart assistant is currently interacting with the user through the text input window.
[0085] Optionally, the smart terminal can remember the interaction mode selected by the user when the smart terminal is in a certain external feature, so that when the smart terminal recognizes that it is facing the external feature, it uses the first preset mode to display the corresponding signal acquisition control to indicate that the signal acquisition control is currently used to interact with the user; for example, the user chooses to use the text input window to input interaction instructions during the period from 8:00 to 9:00, and the smart terminal can remember the interaction mode selected by the user during this period. Later, when the user wakes up the smart assistant during the period from 8:00 to 9:00, the smart assistant can use the first preset mode to display the text input window for the user to enter the corresponding interaction instructions through the text input window.
[0086] Optionally, the smart terminal can identify the environment, position and / or place where the smart terminal is located, automatically select the interaction method corresponding to the environment, position and / or place, and display the corresponding signal acquisition control in a first preset manner to indicate that the signal acquisition control is currently used to interact with the user; for example, if the smart terminal identifies that the environment in which it is located is noisy and voice interaction may be easily disturbed, the text input window can be displayed in the first preset manner for the user to enter the corresponding interaction instruction through the text input window; for another example, if the smart terminal identifies that the environment in which it is located is relatively quiet and more suitable for voice interaction, the voice acquisition control can be displayed in the first preset manner for the user to enter voice interaction instructions; for another example, if the smart terminal identifies that its location is a movie theater, office area and / or conference room, where it is not easy to make sound, the text input window can be displayed in the first preset manner to provide the user with a relatively quiet interaction method.
[0087] Optionally, the display method further includes: responding to the selection operation corresponding to the signal acquisition control, and displaying the signal acquisition control and / or signal acquisition page corresponding to the selection operation in a second preset manner. For example, if the user clicks the scan control, the smart terminal can enter the scan page to obtain information such as a QR code representing the interactive instruction. For example, if the user clicks the text input window, the smart terminal can enlarge the text input window, etc., so that in the process of using the smart assistant, the interaction mode can be quickly switched to the signal acquisition control or method corresponding to the selection operation. Optionally, the second preset method includes a display method that represents what signal acquisition control or method the smart assistant uses to interact with the user, such as a highlighting method such as magnification, flashing and / or highlighting; the second preset method can be the same as the first preset method, or the second preset method can be different from the first preset method.
[0088] The display method of the present application responds to the wake-up operation of the intelligent assistant and displays at least one signal acquisition control for characterizing the interaction mode in the first window, so as to provide corresponding various interaction modes for users to choose from when the intelligent assistant responds to user needs, thereby improving the flexibility of the interaction process between the intelligent assistant and the user.
[0089] Second embodiment
[0090] The basic steps, principles and technical effects of the second embodiment are the same as those of any embodiment. For the sake of brief description, for parts not mentioned in this embodiment, reference may be made to the corresponding contents in any embodiment. Different from the embodiment, in this embodiment, after responding to the wake-up operation, the display method further includes: displaying a second window to display the response result of the intelligent assistant and / or its interaction process with the user in the second window, so that the response process of the intelligent assistant is more intuitive and friendly.
[0091] Optionally, the display method further includes: displaying at least part of the interaction process in the second window. Optionally, at least part of the interaction process is the latest and continuous interaction process, so that based on the display content of the second window, the interaction process between the intelligent assistant and the user is a continuous interaction process, which is more in line with the user's interaction habits and can improve the user experience. Optionally, at least part of the interaction process is an important and / or key information-carrying interaction process, so that based on the display content of the second window, the user can quickly obtain effective and / or key content, which can improve the interaction efficiency; Optionally, the important and / or key information-carrying interaction process may include the interaction content automatically identified by the preset screening model in the intelligent terminal from the response result of the intelligent assistant, and may also include the content determined by the user after adding an important label to the response result when the user learns of a response result of the intelligent assistant.
[0092] Optionally, the second window includes a content display area and / or an operation area, for example, Figure 6a Optionally, the operation area is used to display at least one window control, and the operation area and / or the window control are used to receive an operation to control the second window; for example, if the operation area receives a drag operation, the smart terminal can move the second window along the drag direction; for another example, if the operation area includes a control for closing the second window, after the control is triggered, the smart terminal can close the second window, and so on.
[0093] Optionally, the second window is a window floating on the original display interface of the smart terminal, which can also be called a floating display window. The operation area can be a floating background, which is also used to distinguish the floating content (i.e., the content displayed in the content display area) from the original display interface of the smart terminal (the underlying interface).
[0094] Optionally, the display method further includes: displaying at least part of the interaction process in the content display area, so that the user can obtain the interactive content that has occurred in time when interacting with the smart terminal. Optionally, the display method further includes: in the process of interaction between the smart assistant and the user, in response to a switching operation (or selection operation) corresponding to any signal acquisition control other than the interaction mode currently adopted by the smart assistant, the signal acquisition control and / or signal acquisition page corresponding to the switching operation is displayed in a second preset manner to indicate that the interaction mode has been switched. Before and after the switching of the interaction mode, the interaction process displayed in the content display area is continuous, that is, the display operation of the content display area will not be interrupted or faulted due to the switching of the interaction mode, so as to ensure the continuity and stability of the content displayed in the content display area.
[0095] Optionally, the background color of the content display area (such as the color of the floating background) is used to distinguish the original display interface of the smart terminal from the displayed content; optionally, the smart terminal can also automatically adjust the background color of the content display area according to the color characteristics of at least one of the original display interface and the displayed content, for example, adjusting the background color of the content display area to a color with a higher contrast with the color of at least one of the original display interface and the displayed content, etc., so as to distinguish the display interface and the displayed content through the background color of the content display area, make the displayed content more eye-catching, and enhance the user experience when viewing the displayed content.
[0096] Optionally, the size of the content display area (eg, the height and / or width of the content display area) is adapted to the display content to fully display the content that needs to be displayed.
[0097] Optionally, in some examples, the smart terminal can call its installed application to obtain a response result for the interactive instruction input by the user. In this case, the display content in the content display area comes from other applications. In this case, the display content can carry the entry to the corresponding application, so as to enter the original program interface for obtaining the corresponding display content through the entry, and display the original search interface for obtaining the display content by the corresponding application, so as to provide the user with more complete response content. Optionally, the entry to the application corresponding to the display content can be set on the keyword of the display content, for example, by highlighting, adding a marker and / or changing color to highlight the corresponding keyword to indicate that the keyword carries the entry to the application corresponding to the display content. At this time, the keyword can be triggered to directly enter the original program interface of the display content, for example, refer to Figure 6b As shown, the displayed content includes: A1 is an element used for ***, where "A1" is a keyword. At this time, an underline marker can be added under "A1" to indicate that "A1" carries the entrance to the corresponding application. Click and / or double-click "A1" to enter the original program interface for obtaining the content.
[0098] Optionally, the bottom of the second window is above the top of the first window, for example, Figure 7a As shown, the display content of the second window is placed above the signal acquisition control of the first window, presenting a "view from the top and use from the bottom" structure, which conforms to the user's browsing habits from top to bottom; and the second window and the first window do not overlap each other, which can avoid mutual interference between the two and further improve the user experience. Optionally, the first window is located at the bottom of the display interface of the smart terminal, which can improve the convenience and comfort of user operation.
[0099] Optionally, the operation area can directly receive the user's operation on the second window, so that the intelligent terminal responds to the received operation. Optionally, the operation area can also be provided with a window control for controlling the second window, and the user's operation on the second window is received through the window control. Optionally, the display method further includes at least one of the following (1) and (2):
[0100] (1) In response to the first operation received by the operation area and / or the window control, the second window is displayed in a third preset manner so that the display characteristics of the second window better match the user's needs. Optionally, the third preset manner includes processing such as enlarging, moving, hiding and / or reducing the second window to facilitate the user to use the smart terminal more conveniently. For example, the third preset manner may include at least one of the following display modes: full screen display, reduced to a preset size display, hiding the content display area, and displaying the operation area at the top of the display interface. Optionally, refer to Figure 7a As shown, the operation area is provided with a window control, which can also be called a handle. The first operation includes sliding down, and the third preset mode includes full screen display, such as Figure 7b As shown, if the user slides the window control downward, the smart terminal can display the second window in full screen, such as Figure 7c As shown, it is more convenient for users to obtain the displayed content.
[0101] (2) In response to the second operation received by the operation area and / or the window control, the second window is closed to display the original display interface (such as the desktop, etc.) of the smart terminal. Figure 7a As shown, the operation area is provided with a window control, and the second operation includes sliding upward, such as Figure 7d As shown, if the user slides the window control upward, the smart terminal can close the second window, such as Figure 7e As shown, the desktop and the first window of the smart terminal are displayed.
[0102] This embodiment can display the response results of the intelligent assistant and / or its interaction process with the user in the second window, making the response process of the intelligent assistant more intuitive and friendly; the bottom of the second window is above the top of the first window, so that the display content of the second window is above the signal acquisition control of the first window, presenting a "view from top to bottom" structure, which conforms to the user's top-down browsing habits; and the second window and the first window do not overlap with each other, which can avoid mutual interference between the two, and can further enhance the user experience.
[0103] Third embodiment
[0104] The basic steps, principles and technical effects of the third embodiment are the same as those of any embodiment. For the sake of brief description, for parts not mentioned in this embodiment, reference may be made to the corresponding contents in any embodiment. Different from the embodiment, in this embodiment, the display method further includes: when the response content meets the preset conditions, the response content is displayed through a third window to ensure the display effect of the response content. Optionally, the response content includes the content obtained by the intelligent assistant in response to the interactive instructions input by the user. Optionally, the third window is displayed in a position that does not cover the first window and the second window, for example, refer to Figure 8a As shown, the display of the first window and the second window is not affected on the basis of displaying the third window; optionally, the third window is suspended on the top layer of the display interface, for example, referring to Figure 8b As shown, the third window is suspended at the top layer of the display interface and displayed in full screen, so that the third window has a sufficiently large display interface; optionally, the smart terminal is also connected to other terminals, and displaying the response content through the third window includes: displaying the third window on other terminals, and displaying the response content through the third window. For example, the smart terminal is connected to the other terminal, which is a TV device, through a wireless LAN, and the response content includes X2 video, then the third window can be displayed on the TV device, and the X2 video can be displayed through the third window to improve the display effect of the X2 video and avoid affecting other work of the smart terminal. Optionally, as Figure 8a and Figure 8b As shown, the third window may further include a close control, and the display method further includes: closing the third window in response to a close operation corresponding to the close control.
[0105] Optionally, the preset conditions include conditions that need to be displayed through other programs and / or other platforms. Optionally, the preset conditions include at least one of the following (1) and (2): (1) The format of the response content satisfies the preset format. Optionally, the preset format includes a format that needs to be displayed through a preset application, such as a video format that needs to be played through video playback software, etc. (2) The response content is displayed through a preset platform. Optionally, the preset platform includes a platform that provides environmental information and / or background information for the response content. For example, if the response content is a recommended route, the preset platform is a map display platform, and the recommended route is displayed on the map display platform, which can make the display process of the recommended route more intuitive and complete.
[0106] Optionally, the third window includes a screen projection control, and the display method further includes: responding to a first screen projection operation corresponding to the screen projection control, transferring the third window to the first terminal for display. Optionally, the first terminal includes a terminal device that is connected to the smart terminal corresponding to the smart assistant for communication. Optionally, the user wakes up the voice assistant while driving and enters the interactive command "Please navigate to X3". Figure 9aAs shown, the smart assistant determines the response content of the recommended route for the interactive instruction "Please navigate to X3" and displays the recommended route in the third window. If the smart terminal is connected to the first terminal, the in-vehicle display terminal, and wants to display the recommended route on the in-vehicle display terminal, you can click the screen projection control on the third window, and the smart terminal can respond to the first screen projection operation received by the screen projection control and transfer the third window to the in-vehicle display terminal for display. Optionally, after transferring the third window to the in-vehicle display terminal for display, the smart terminal can close the third window of the local computer, for example, refer to Figure 9b shown to avoid duplication.
[0107] Optionally, after determining the response content that needs to be displayed through the third window, the intelligent assistant can display the options of "local play" and "screen casting", for example, Fig.9c As shown, if the user triggers the "local play" option, the smart terminal can display a third window, and display the response content through the third window, such as Figure 8a As shown. If the user triggers the "screen casting" option, the response content displayed through the third window includes: responding to the second screen casting operation corresponding to the "screen casting" option, displaying the third window on the second terminal, and displaying the response content in the third window. Optionally, the second terminal includes a terminal device that is communicatively connected to the smart terminal corresponding to the smart assistant. For example, the second terminal may include a TV device, a tablet computer and / or a car terminal connected to the smart terminal.
[0108] In this embodiment, when the response content meets the preset conditions, the response content is displayed through the third window, which can improve the display effect of the response content; the third window can also be projected to other terminals for display, which can not only improve the display effect of the corresponding response content, but also avoid affecting other work of the smart terminal.
[0109] An embodiment of the present application further provides an intelligent terminal, including a memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of the display method in any of the above embodiments are implemented.
[0110] An embodiment of the present application further provides a computer-readable storage medium, on which a display program is stored. When the display program is executed by a processor, the steps of the display method in any of the above embodiments are implemented.
[0111] In the embodiments of the smart terminal and computer-readable storage medium provided in the present application, all technical features of any of the above-mentioned display method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.
[0112] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.
[0113] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.
[0114] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0115] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0116] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0117] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0118] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.
[0119] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0120] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.
[0121] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.
[0122] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integration. Available media can be magnetic media, (e.g., floppy disk, storage disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state storage disk So lid State Dis sk (SSD)), etc.
[0123] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A display method, applied to a smart terminal, characterized in that: Includes steps: S310: In response to the wake-up operation, display the first window; S320: Displaying at least one signal acquisition control for representing the interaction mode in the first window.
2. The method according to claim 1, characterized in that The signal acquisition control includes at least one of the following: a voice acquisition control, a text input window, a file import control, a picture upload control, a shooting control, a code scanning control and a communication control.
3. The method according to claim 1, characterized in that The method further comprises at least one of the following: Acquire at least one external feature of the smart terminal, and display a signal acquisition control matching at least one of the external features in a first preset manner; In response to a selection operation corresponding to the signal acquisition control, the signal acquisition control and / or the signal acquisition page corresponding to the selection operation is displayed in a second preset manner.
4. The method according to claim 1, characterized in that After responding to the wake-up operation, the method further includes: displaying a second window; And / or, the display method further includes: displaying at least part of the interaction process in the second window.
5. The method according to claim 4, characterized in that The second window includes a content display area and / or an operation area; The method further comprises at least one of the following: Displaying at least part of the interaction process in the content display area; In response to a first operation received by the operation area, displaying the second window in a third preset manner; In response to a second operation received by the operation area, closing the second window; The bottom end of the second window is above the top end of the first window.
6. The method according to claim 5, characterized in that Include at least one of the following: The background color of the content display area is used to distinguish the display interface from the displayed content; The size of the content display area is adapted to the displayed content; The displayed content carries an entry into the corresponding application program.
7. The method according to any one of claims 1 to 6, characterized in that The method further includes: when the response content meets a preset condition, displaying the response content through a third window; And / or, satisfying a preset condition includes at least one of the following: a format of the response content satisfies a preset format, and the response content is displayed through a preset platform.
8. The method according to claim 7, characterized in that The method comprises: In response to the first screen projection operation, transferring the third window to the first terminal for display; And / or, displaying the response content through the third window includes: responding to the second screen projection operation, displaying the third window on the second terminal, and displaying the response content in the third window.
9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of the display method according to any one of claims 1 to 8 are implemented.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 8 are implemented.
Citation Information
Patent Citations
Catalytic dehydrohalogenation process
EP0002021A1
