Display method, intelligent terminal and storage medium

Abstract

The invention provides a display method, an intelligent terminal and a storage medium, the method can be applied to the intelligent terminal, and the method comprises the steps of opening a target window, obtaining target snip information from at least one target application interface, and displaying the target snip information in the target window. According to the method, the target snippet information in any target application interface is supported, so that the universality is improved, and the limitation is reduced.

Description

Technical Field

[0001] The present application relates to the technical field of smart terminals, and in particular to a display method, a smart terminal and a storage medium. Background Art

[0002] In daily work and life, when an application is opened in a smart terminal, various information can be displayed in the application. If the user is interested in the information displayed in the application, the user can save or copy the information.

[0003] The user opens the target application in the smart terminal and enters the application interface under the target application. The user then drags the target information to the transfer station in the application interface, and the transfer station displays and saves the target information so that the user can obtain the target information from the transfer station when the user needs it.

[0004] In the prior art, various types of information displayed in the target application can be dragged to the transfer station by the user. However, in many scenarios, the information in many applications cannot be dragged to the transfer station, which affects the user's acquisition of information. Therefore, the prior art has limitations and low applicability. Summary of the invention

[0005] In response to the above technical problems, the present application provides a display method, a smart terminal and a storage medium, so that the smart terminal can display target excerpt information in at least one target application interface. The present application is applicable to any target application interface, thus having wider versatility.

[0006] The present application provides a display method, which can be applied to a smart terminal, including:

[0007] S100: open the target window;

[0008] S200: Acquire or determine target excerpt information from at least one target application interface;

[0009] S300: Displaying the target excerpt information in the target window.

[0010] Optionally, the S100 includes:

[0011] In response to receiving the voice command, opening the target window; and / or,

[0012] In response to the first operation, the target window is opened.

[0013] Optionally, the target excerpt information includes video excerpt information, and S200 includes:

[0014] S210: In response to the second operation, identifying a video window in the target application interface;

[0015] S220: Obtaining a video image and its corresponding text content based on the video window;

[0016] S230: In response to the third operation, the video images and the corresponding text contents within the preset processing time are determined as video excerpt information.

[0017] Optionally, the S220 includes:

[0018] Recording the video screen in the video window;

[0019] Extracting the current audio content corresponding to the video screen being played;

[0020] Performing interference elimination processing on the current audio content to obtain target audio content played in the video window;

[0021] The target audio content is converted into text content.

[0022] Optionally, the target excerpt information includes audio excerpt information, and S200 includes:

[0023] In response to a fourth operation, recording the current audio content;

[0024] Performing interference elimination processing on the current audio content to obtain the target audio content played in the target application interface;

[0025] Converting the target audio content into text content;

[0026] In response to the third operation, the target audio content within the preset processing time and the corresponding text content are determined as audio excerpt information.

[0027] Optionally, the target excerpt information includes text excerpt information, and S200 includes:

[0028] In response to a fifth operation, determining or generating a mask for the target application interface;

[0029] Determining or generating a text excerpt rectangular frame on the mask;

[0030] The text within the text excerpt rectangular frame is determined as text excerpt information.

[0031] Optionally, determining or generating a text excerpt rectangular frame on the mask layer includes:

[0032] Determining the edges of a rectangle drawn by a user on the mask;

[0033] A text excerpt rectangular frame is determined or generated based on the rectangular edge.

[0034] Optionally, if the width of the text excerpt rectangular frame is fixed, determining the edge of the rectangle drawn by the user on the mask layer includes:

[0035] Determining or generating an upper edge based on a location where a user first triggers on the mask;

[0036] Determining or generating a lower edge based on a location of a second user trigger on the mask;

[0037] A rectangular edge is determined based on the upper edge and the lower edge and a fixed width.

[0038] Optionally, if the width of the text excerpt rectangular frame is variable, determining the edge of the rectangle drawn by the user on the mask layer includes:

[0039] Determine or generate an upper edge, a right edge, a lower edge and a left edge respectively based on four locations sequentially triggered by a user on the mask;

[0040] A rectangular edge is determined based on the top edge, the right edge, the bottom edge, and the left edge.

[0041] Optionally, performing interference elimination processing on the current audio content to obtain target audio content played in the video window includes:

[0042] Identify interfering sounds in the current audio content according to sound distance and / or sound volume;

[0043] The interfering sound is eliminated to obtain the target audio content played in the video window.

[0044] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of any of the display methods described above are implemented.

[0045] The present application also provides a storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the display method as described in any one of the above items are implemented.

[0046] As described above, a display method, a smart terminal, and a storage medium of the present application are applied to a smart terminal, including: S100: opening a target window; S200: acquiring or determining target excerpt information from at least one target application interface, and displaying the target excerpt information in the target window. In the present application, the target excerpt information can be located in any target application interface, so there is no restriction on the target application interface, and any target application interface is supported, so that it is more versatile and more applicable. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0048] Figure 1 A schematic diagram of the hardware structure of a smart terminal for implementing each embodiment of the present application;

[0049] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application;

[0050] Figure 3 An application scenario diagram of a display method provided by this application;

[0051] Figure 4 A schematic flow chart of a display method provided in Example 1;

[0052] Figure 5 A flow chart of a display method provided in Example 3;

[0053] Figure 6 A schematic diagram of a display method flow chart provided in Example 3;

[0054] Figure 7 A schematic diagram of displaying video excerpt information provided in Example 3;

[0055] Figure 8 A flow chart of a display method provided in Embodiment 4;

[0056] Fig. 9 A schematic diagram of displaying audio excerpt information provided in Example 4;

[0057] Fig.10 A flow chart of a display method provided in Embodiment 5;

[0058] Fig.11 A schematic diagram of displaying text excerpt information provided in Example 5;

[0059] Fig.12 A schematic diagram of the overall flow of a display method provided in Embodiment 9;

[0060] Fig.13 This is a schematic diagram of the structure of a display device provided in the tenth embodiment.

[0061] The purpose of this application, the functional features and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0062] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0063] Optionally, in this document, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context in the specific embodiment.

[0064] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0065] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0066] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0067] Optionally, in this article, step codes such as S10, S20, etc. are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0068] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0069] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0070] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0071] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0072] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0073] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:

[0074] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), 5G and 6G, etc.

[0075] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0076] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0077] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0078] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0079] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0080] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0081] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0082] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0083] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0084] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0085] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0086] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0087] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0088] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0089] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0090] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0091] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0092] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0093] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0094] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0095] In the prior art, a user opens a target application through a smart terminal, and the target application includes at least one application interface. Assuming that one of them is selected as the target application interface, the target application interface includes target information. If the user is interested in the target information, the user needs to manually drag the target information to a transfer station, which displays and saves the target information. When the user needs the target information again, the target information can be obtained from the transfer station. Optionally, in some copying scenarios, if the user wants to copy the target information on the target application interface based on the smart terminal, the user can copy it to a transfer station or a clipboard, and when the target information is needed, the target information can be obtained from the transfer station or the clipboard to achieve the purpose.

[0096] However, the existing technology has certain limitations on the target application and the target application interface. At present, the information in many target applications does not support being extracted to the transfer station. If the user is interested in some of the information, the user can obtain the information by handwriting, but this method is cumbersome for the user, and only some target applications support the extraction of the transfer station, which has large limitations and narrow versatility.

[0097] In order to solve the defects of the prior art, the inventor of this solution has designed a new solution after creative research. This solution provides a display method for solving the problems of large limitations and narrow versatility in the prior art. In this solution, the smart terminal opens the target window, and then obtains or determines the target excerpt information from at least one target application interface. In this application, the target excerpt information can be located in any target application interface. It can be seen that there is no restriction on the target application interface in this application. This application supports any target application interface. The smart terminal then displays the target excerpt information in the target window, thereby obtaining the excerpt note. Therefore, this application can reduce limitations and expand versatility.

[0098] In order to solve the following problem, the present application provides an application scenario of a display method, a smart terminal and a storage medium.

[0099] Figure 3 This is an application scenario diagram of a display method provided by this application. Figure 3 As shown, the application scenario diagram includes a smart terminal 301.

[0100] The intelligent terminal 301 may be a mobile phone, a computer or other device, which is not limited here.

[0101] Optionally, the user can open the target window with a capacitive pen or finger, and the smart terminal 301 responds to the user's triggering of the target window to open the target window, which is in a folded state at this time. Then the smart terminal 301 responds to the user triggering a button to open the target application interface to open the target application interface, which includes the target excerpt information.

[0102] Optionally, the intelligent terminal 301 obtains or determines target excerpt information from at least one target application interface.

[0103] Optionally, the intelligent terminal 301 displays the target excerpt information in the target window, and the target window is in an expanded state.

[0104] Optionally, the target window in the present application may further include a sliding bar. If the target window cannot fully display / extract the target excerpt information, a sliding bar may be generated, and the user may view all the target excerpt information by sliding the sliding bar up and down.

[0105] Optionally, in the present application, the target window is in a folded state when it is opened, and when the intelligent terminal extracts / displays the target excerpt information to the target window, the target window is in an expanded state. Optionally, in the present application, the size of the target window in the folded state and the expanded state is not limited.

[0106] Optionally, in the present application, the target window may include at least one function button, such as a translation button, a video excerpt button, an audio excerpt button, and a text excerpt button.

[0107] Embodiment 1

[0108] The execution subject of Embodiments 1 to 9 of the present application is a display device, which is located in a smart terminal. The method of the present application is applied to the smart terminal, and the specific contents are as follows.

[0109] Figure 4 This is a flow chart of a display method provided in Example 1. Figure 4 As shown, including:

[0110] S100: Open the target window.

[0111] Optionally, the target window is a small window for extracting. The target window includes a folded state and an expanded state.

[0112] Optionally, the target window may include at least one of a video excerpt button, an audio excerpt button, and a text excerpt button.

[0113] Optionally, the intelligent terminal opens the target window in response to the first operation of the user.

[0114] Optionally, the first operation may refer to a user triggering a display program, or other operations that can open a target window, which is not limited here.

[0115] S200: Acquire or determine target excerpt information from at least one target application interface.

[0116] Optionally, the target application interface refers to an application interface that currently needs to be excerpted.

[0117] Optionally, the target application interface is arbitrary, that is, the target application interface can be an application interface in any target application program.

[0118] Optionally, the target excerpt information refers to information to be excerpted into the target window. In the present application, the target excerpt information may be at least one of video excerpt information, audio excerpt information and text excerpt information.

[0119] Optionally, in response to the user triggering any excerpt button, the smart terminal acquires target excerpt information corresponding to any excerpt button in the current target application interface.

[0120] Optionally, assuming that the smart terminal responds to the second operation, the smart terminal obtains the video excerpt information in the current target application interface. The second operation may be a user triggering a video excerpt button or a user issuing a video excerpt voice command, which is not limited here.

[0121] S300: Displaying target excerpt information in the target window.

[0122] Optionally, the intelligent terminal displays the target excerpt information in the target window, thereby generating an excerpt note.

[0123] Optionally, the excerpt note refers to a note that can be saved in a notepad format. The excerpt note includes at least one type of target excerpt information.

[0124] Optionally, the intelligent terminal controls the display of target excerpt information in the target window.

[0125] Optionally, the target window may also include a generate note button, so that when the user triggers the generate note button, the smart terminal integrates all target excerpt information of the target window and determines or generates a corresponding excerpt note.

[0126] This embodiment provides a display method. In this embodiment, the intelligent terminal first opens a target window, then obtains or determines target excerpt information from at least one target application interface, and displays the target excerpt information in the target window. In this embodiment, the target excerpt information is located in any target application interface, so this application supports all application interfaces, so this application reduces limitations and expands versatility. In practical applications, this application also reduces the cumbersomeness of the user side.

[0127] Embodiment 2

[0128] This embodiment is a further refinement of the above-mentioned embodiment 1. This embodiment is an optional method of S100 and can include:

[0129] Method 1: opening the target window in response to receiving the voice command.

[0130] Among them, the voice command is used to open the excerpt window.

[0131] Optionally, the voice command is issued by the user and received by the smart terminal.

[0132] Exemplarily, the user says "open target window", which is a voice command, so that the smart terminal receives the voice command "open target window". Optionally, the smart terminal opens a display program in the background, opens the target window in the display program, and displays the target window on the smart terminal.

[0133] Method 2: In response to the first operation, the target window is opened.

[0134] Optionally, the display program refers to a program for extracting information. Optionally, the display program can be in the form of a notepad or other forms, which are not limited here.

[0135] Optionally, the display program is loaded in the intelligent terminal.

[0136] Optionally, a small icon of the display program may be displayed on the main interface of the intelligent terminal.

[0137] Optionally, the user performs a first operation on the main interface of the smart terminal (i.e., the user clicks on a small icon of a display program), and the smart terminal responds to the user's first operation by opening the display program, i.e., entering an internal entrance to the display program. Then, the user can find an "open target window" button in the internal entrance to the display program, and the user triggers the "open target window" button. The smart terminal responds to the user triggering the "open target window" button to open the target window.

[0138] This embodiment provides a display method. In this embodiment, in response to receiving a user voice command, the smart terminal optionally opens a target window, and / or, in response to a first operation, the smart terminal opens the target window. In this embodiment, the smart terminal can open the target window through a voice command or a first operation, and the opening method is more versatile.

[0139] Embodiment 3

[0140] This embodiment is a further refinement of any of the above embodiments. This embodiment is an optional method of S200, and the details are as follows.

[0141] Figure 5 This is a flow chart of a display method provided in Example 3. Figure 5 As shown, including:

[0142] S210: In response to the second operation, a video window is identified in the target application interface; a video excerpt button is located in the target window.

[0143] Optionally, the target window includes a video excerpt button when in the collapsed state.

[0144] Optionally, the video excerpt button refers to a trigger button for excerpting a video.

[0145] Optionally, the video window refers to a window for playing a video.

[0146] S220: Obtain the video image and its corresponding text content based on the video window.

[0147] Optionally, the video picture refers to each frame of the video when the video window plays the video.

[0148] Optionally, the text content refers to text information corresponding to each frame.

[0149] Optionally, the video screen corresponds to the text content.

[0150] S230: In response to the third operation, the video images and the corresponding text contents within the preset processing time are determined as video excerpt information, and a stop excerpting button is located in the target window.

[0151] Optionally, the target window may include a stop excerpting button when in the expanded state.

[0152] Optionally, the preset processing time refers to the time from the second operation to the third operation, which can be one second, several seconds, or even several minutes, and is not limited here.

[0153] The third operation may refer to the user triggering a stop excerpting button, or the user issuing a stop excerpting voice command, which is not limited here.

[0154] Figure 6 A schematic diagram of a display method flow chart provided in Example 3. Figure 6 As shown, the details are as follows.

[0155] Optionally, the above S220 includes:

[0156] S221: Recording the video screen in the video window.

[0157] Optionally, after the intelligent terminal identifies the video window, it starts to record each frame of the video displayed in the video window, so as to obtain the video frame within a preset processing time.

[0158] S222: Extract the current audio content corresponding to the video picture being played.

[0159] Optionally, the smart terminal may record the video in real time, so that after obtaining each frame of the video, the smart terminal may extract the current audio content corresponding to the video.

[0160] Optionally, the current audio content refers to any audio content corresponding to the time point of recording the video screen. The current audio content includes the audio content played by the video screen itself when the video screen is recorded by the smart terminal, and also includes other external sounds outside the smart terminal when the video screen is recorded. For example, the external sound can be the user's voice, or the sound of the environment in which the current smart terminal is located, which is not limited here.

[0161] Optionally, the current audio content includes not only the audio content played by the video screen itself, but also the sounds outside the smart terminal collected by the smart terminal.

[0162] S223: Perform interference elimination processing on the current audio content to obtain the target audio content played in the video window.

[0163] Optionally, the current content includes sounds other than those of the smart terminal, and the sounds are interference sounds, so the smart terminal needs to perform interference elimination processing on the sounds.

[0164] Optionally, the smart terminal performs interference elimination processing on sounds other than the smart terminal from the current audio content, thereby obtaining target audio content played in the video window.

[0165] Optionally, the target audio content is the audio content played by the video screen itself.

[0166] S224: Convert the target audio content into text content.

[0167] Optionally, the intelligent terminal converts the target audio content into text content.

[0168] Figure 7 This is a schematic diagram of displaying video excerpt information provided by Example 3. Figure 7 Shown, including Figure 7 a. Figure 7 b and Figure 7 c.

[0169] For example, in Figure 7 In a, the user can open the target window through voice commands, and then the target window is displayed below the target application interface currently displayed on the smart terminal. The current target window is in a folded state and includes three function buttons, namely 701 text excerpt button, 702 audio excerpt button and 703 video excerpt button.

[0170] The user can open the target window through voice commands in the current target application interface, or open the target application interface through the smart terminal after opening the target window.

[0171] exist Figure 7 In a, the smart terminal displays a target application interface and a target window. The target application interface includes a video window that plays a video. The target application interface may also include other information, such as text information, which is not limited here.

[0172] Optionally, assuming that at the first second, the smart terminal responds to the second operation, and the smart terminal identifies the video window in the target application interface, such as Figure 7 As shown in b, at this time, the intelligent terminal obtains the video screen and its corresponding text content based on the video window. Figure 7 In b, the text content can be displayed in the target window in real time. It should be noted that as the excerpting time increases, the text content displayed in the target window can increase, and a sliding bar is generated to display downward. Figure 7 In b, the target window is in an expanded state, and the target window includes a stop extracting button 704 .

[0173] Optionally, assuming that at the tenth second, when the smart terminal responds to the third operation, the smart terminal determines the video images and the corresponding text contents recorded within the preset processing time (ie, within these ten seconds) as the video excerpt information.

[0174] Optionally, in Figure 7 In c, the intelligent terminal extracts the target excerpt information (ie, the video excerpt information) into the target window. At this time, the target window includes the video picture within the preset processing time and the corresponding text content.

[0175] Optionally, the target window may further include a translation button, and the intelligent terminal translates the text content on the target window into a text in a corresponding language in response to the user triggering the translation button.

[0176] Optionally, Figure 7 c, the target window may also display a generate note button, a video excerpt button, an audio excerpt button, and a file excerpt button (not shown in the figure).

[0177] Optionally, after completing the excerpting of the video excerpt information, the smart terminal determines or generates an excerpt note for the video excerpt information in response to a generate note button triggered by the user, and saves the note.

[0178] Optionally, after completing the excerpting of the video excerpt information, the smart terminal continues to extract the audio excerpt information in the current target application interface in response to the audio excerpt button (or text excerpt button) triggered by the user.

[0179] Optionally, after completing the extraction of the video extraction information, the intelligent terminal continues to extract the video extraction information in the current video window in response to a video extraction button triggered by the user.

[0180] The present embodiment provides a display method. In the present embodiment, the intelligent terminal responds to the second operation, identifies the video window in the target application interface, and then obtains the video screen and the corresponding text content based on the video window. Optionally, in response to the third operation, the video screen and the corresponding text content within a preset processing time are determined as video excerpt information. In the present embodiment, when obtaining the video screen and the corresponding text content based on the video window, the intelligent terminal records the video screen in the video window, and then extracts the current audio content corresponding to the playing of the video screen, and optionally performs interference elimination processing on it, so as to obtain the target audio content played in the video window, and optionally converts the target audio content into text content. In the present embodiment, the current audio content is subjected to interference elimination processing, so as to further ensure the accuracy and quality of the target audio content.

[0181] Embodiment 4

[0182] This embodiment is a further refinement of any of the above embodiments. The target excerpt information includes audio excerpt information. This embodiment is an optional method of S200 and may include:

[0183] Figure 8 A flow chart of a display method provided in Example 4. Figure 8 As shown,

[0184] S801: In response to the fourth operation, the current audio content is recorded; the audio excerpt button is located in the target window.

[0185] Optionally, the fourth operation may refer to the user triggering an audio excerpt button, or the user issuing an audio excerpt voice command, which is not limited here.

[0186] Optionally, the user sees a target window on the smart terminal, and the target window includes an audio excerpt button. The user performs a fourth operation, and the smart terminal responds to the fourth operation, and the smart terminal can record the current audio content.

[0187] The current audio content in this embodiment is the same as that in the third embodiment, and will not be described in detail here.

[0188] Optionally, in this embodiment, the smart terminal may first respond to the user triggering the audio play button in the target application, then respond to the fourth operation, and then record the played audio and sounds outside the smart terminal to obtain the current audio content.

[0189] Optionally, in this embodiment, the smart terminal can first respond to the fourth operation, and then the user triggers the audio play button on the target application interface. The smart terminal responds to the user triggering the audio play button, and the smart terminal records the played audio and sounds outside the smart terminal to obtain the current audio content.

[0190] S802: Perform interference elimination processing on the current audio content to obtain the target audio content played in the target application interface.

[0191] The manner of eliminating interference on the current audio content in this step is the same as described in Embodiment 3, and will not be described in detail here.

[0192] S803: Convert the target audio content into text content.

[0193] The implementation method of this step is consistent with that of Example 3 and will not be repeated here.

[0194] S804: In response to the third operation, the target audio content and the corresponding text content within the preset processing time are determined as audio excerpt information.

[0195] Exemplarily, assuming that the excerpting time is ten seconds, the target audio content corresponding to the ten seconds and the corresponding text content are determined as the audio excerpting information.

[0196] Fig. 9 This is a schematic diagram of displaying audio excerpt information provided by Example 4. Fig. 9 Shown, including Fig. 9 a. Fig. 9 b and Fig. 9 c.

[0197] In this exemplary example, the method of opening the target window can be as follows: Figure 7 The description is consistent with that in the previous section and will not be repeated here.

[0198] Alternatively, assume that at the first second, Fig. 9In a, the smart terminal responds to the user triggering the audio play button on the target application interface, at which time the smart terminal plays the audio displayed on the target application interface, and then the smart terminal responds to the fourth operation, and the smart terminal starts recording the played audio and sounds outside the smart terminal.

[0199] Optionally, the intelligent terminal performs interference elimination processing on the currently recorded audio content, thereby obtaining target audio content played in the target application interface.

[0200] Optionally, in Fig. 9 In b, the intelligent terminal converts the target audio content into text content and displays it on the target window. More text content can be displayed by sliding the slider on the target window. Fig. 9 In b, the target window includes a stop excerpting button.

[0201] Optionally, assuming that at the tenth second, the intelligent terminal responds to the third operation, the intelligent terminal determines the target audio content within the excerpting time (ie, ten seconds) and its corresponding text content as the audio excerpting information.

[0202] Optionally, in Fig. 9 In c, the intelligent terminal extracts the target excerpt information (ie, the audio excerpt information) into the target window. At this time, the target window includes the target audio content within the preset processing time and its corresponding text content.

[0203] This embodiment provides a display method. In this embodiment, the smart terminal responds to the fourth operation, the smart terminal records the current audio content, and then performs interference elimination processing on it, so as to obtain the target audio content played in the target application interface, and optionally converts it into text content. Then the smart terminal responds to the third operation, and determines the target audio content within a preset processing time and its corresponding text content as audio excerpt information. In this embodiment, interference elimination processing is performed on the current audio content, which can improve the accuracy of the target audio content.

[0204] Embodiment 5

[0205] This embodiment is a further refinement of any of the above embodiments. The target excerpt information includes text excerpt information. This embodiment is an optional method of S200.

[0206] Fig.10 A flow chart of a display method provided in Example 5. Fig.10 As shown, it may include:

[0207] S1001: In response to the fifth operation, determine or generate a mask for the target application interface.

[0208] Optionally, the mask layer refers to a semi-transparent black shielding layer.

[0209] Optionally, after the mask is generated, the interface cannot be slid on the mask.

[0210] S1002: Determine or generate a text excerpt rectangular frame on the mask layer.

[0211] Optionally, the text excerpt rectangular box refers to a rectangular box of a text range to be excerpted.

[0212] S1003: Determine the text within the text excerpt rectangular frame as text excerpt information.

[0213] Fig.11 A schematic diagram of displaying text excerpt information provided in Example 5. Fig.11 Shown, including Fig.11 a. Fig.11 b and Fig.11 c.

[0214] Optionally, in Fig.11 In a, the smart terminal displays the target application interface, which includes multiple text information, and the smart terminal opens the target window.

[0215] Optionally, in Fig.11 In b, the intelligent terminal generates a mask (i.e. Fig.11 b), then the intelligent terminal generates a text excerpt rectangular frame based on the user's triggering of the text excerpt rectangular frame. Optionally, the text excerpt rectangular frame includes text information.

[0216] Optionally, in Fig.11 In c, the intelligent terminal determines the text in the text excerpt rectangle as text excerpt information, and extracts the text excerpt information into the target window. At this time, the target window is in an expanded state. Fig.11 In b, the target application interface includes text information 1 and text information 2, and the text excerpt rectangle encloses text information 2, so Fig.11 The text content in the target window in b is text information 2.

[0217] Embodiment 6

[0218] This embodiment is a further refinement of any of the above embodiments. This embodiment is an optional way to determine or generate a text excerpt rectangular frame on a mask layer, which may include:

[0219] Determine the edges of a rectangle drawn by a user on the mask; and determine or generate a text excerpt rectangle based on the edges of the rectangle.

[0220] Optionally, the rectangular edge refers to an edge of a text excerpt rectangular box.

[0221] Embodiment 7

[0222] This embodiment is a further refinement of any of the above embodiments. In this embodiment, if the width of the text excerpt rectangle is fixed, the following optional methods are provided for determining the edge of the rectangle drawn by the user on the mask, which may include:

[0223] Method 1: determine or generate the upper edge based on the location where the user triggers the mask for the first time; determine or generate the lower edge based on the location where the user triggers the mask for the second time; determine the rectangular edge based on the upper edge, the lower edge and the fixed width.

[0224] Optionally, the fixed width of the text excerpt rectangular box means that the width of the text excerpt rectangular box is fixed, for example, the width may be the width of the screen of the smart terminal, or other defined width.

[0225] Optionally, the intelligent terminal generates an upper edge in the lateral direction of a location on the cover layer in response to the location on the cover layer triggered by the user for the first time, and generates a lower edge in the lateral direction of the location on the cover layer in response to the location on the cover layer triggered by the user for the second time.

[0226] Optionally, the intelligent terminal determines the rectangular edge according to the upper edge, the lower edge and the fixed width.

[0227] Method 2: In this embodiment, if the width of the text excerpt rectangle is variable, the following is an optional method for determining the edge of the rectangle drawn by the user on the mask, specifically including:

[0228] The upper edge, right edge, lower edge and left edge are determined or generated based on four positions triggered in sequence by the user on the mask; the rectangular edge is determined based on the upper edge, right edge, lower edge and left edge.

[0229] Optionally, according to the above method, the following can be generated: Fig.11 Text excerpt in a rectangular box.

[0230] The implementation method of this method is consistent with the description of method 1 in embodiment 7, and will not be repeated here.

[0231] Embodiment 8

[0232] This embodiment is a further refinement of any of the above embodiments. This embodiment is an optional way of eliminating interference from the current audio content to obtain the target audio content played in the video window, which may include:

[0233] Identify interfering sounds in current audio content according to sound distance and / or sound volume; eliminate the interfering sounds to obtain target audio content played in the video window.

[0234] Optionally, the sound distance refers to the distance between the sound and the smart terminal. Optionally, the audio played by the smart terminal is the shortest distance.

[0235] Optionally, the volume of the sound refers to the intensity of the sound. In this embodiment, the sound other than the smart terminal is judged as a low sound source, that is, it can be determined as an interference sound.

[0236] Optionally, the smart terminal determines the external sound (ie, the sound outside the smart terminal) according to the sound distance, and / or determines the external sound according to the sound volume, and determines the external sound as the interference sound.

[0237] Optionally, the method steps of performing interference elimination processing on the current audio content to obtain the target audio content played in the target application interface are the same as the steps of obtaining the target audio content played in the video window in Example 8, and are not repeated here.

[0238] This embodiment provides a display method. In this embodiment, the intelligent terminal identifies the interfering sound according to the sound distance and / or the sound volume, so as to obtain the target audio content with high accuracy.

[0239] Embodiment 9

[0240] Fig.12 This is a schematic diagram of the overall flow of a display method provided in Example 9. Fig.12 As shown, specifically including.

[0241] S1201, the smart terminal opens the target window and enters the excerpting mode. The smart terminal responds to at least one of the second operation, the audio excerpting button and the text excerpting button.

[0242] S1202: The smart terminal identifies a video window in the target application interface in response to the second operation.

[0243] S1203, the intelligent terminal obtains the video image and its corresponding text content based on the video window.

[0244] S1204, in response to the user triggering the stop button, the smart terminal determines the video images and the corresponding text content within the preset processing time as video excerpt information. The target excerpt information includes the video excerpt information.

[0245] S1205, the intelligent terminal displays the target excerpt information in the target window to obtain the excerpt note.

[0246] S1206: The intelligent terminal records the current audio content in response to the fourth operation.

[0247] S1207: The intelligent terminal performs interference elimination processing on the current audio content to obtain the target audio content.

[0248] S1208: The smart terminal converts the target audio content into text content.

[0249] S1209, in response to the third operation, the intelligent terminal determines the target audio content and its corresponding text content within the preset processing time as audio excerpt information. The target excerpt information includes the audio excerpt information, and then executes S1205.

[0250] S1210: In response to the fifth operation, the intelligent terminal determines or generates a mask for the target application interface.

[0251] S1211, the intelligent terminal determines or generates a text excerpt rectangular frame on the mask, determines the text in the text excerpt rectangular frame as text excerpt information, the target excerpt information includes the text excerpt information, and then executes S1205.

[0252] Embodiment 10

[0253] The following is an embodiment of the device of the present application. Fig.13 This is a schematic diagram of a display device structure provided in Example 10. Fig.13 As shown, the display device 1300 may include the following modules:

[0254] The opening module 1301 is used to execute S100: opening the target window;

[0255] The determination module 1302 is used to execute S200: obtain or determine target excerpt information from at least one target application interface;

[0256] The display module 1303 is used to execute S300: display the target excerpt information in the target window.

[0257] When executing S100, the start module 1301 can be used to perform the following steps:

[0258] In response to receiving the voice command, opening the target window; and / or,

[0259] In response to the first operation, the target window is opened.

[0260] The target excerpt information includes video excerpt information. When executing S200, the determination module 1302 may be used to perform the following steps:

[0261] S210: In response to the second operation, a video window is identified in the target application interface; a video excerpt button is located in the target window;

[0262] S220: Obtaining a video image and its corresponding text content based on the video window;

[0263] S230: In response to the third operation, the video images and the corresponding text contents within the preset processing time are determined as video excerpt information, and a stop excerpting button is located in the target window.

[0264] When executing S200, the determination module 1302 may be used to perform the following steps:

[0265] Record the video screen in the video window;

[0266] Extract the current audio content corresponding to the video screen being played;

[0267] Eliminate interference on the current audio content to obtain the target audio content played in the video window;

[0268] Convert the target audio content into text content.

[0269] The target excerpt information includes audio excerpt information. When executing S200, the determination module 1302 may be used to perform the following steps:

[0270] In response to the fourth operation, the current audio content is recorded; the audio excerpt button is located in the target window;

[0271] Eliminate interference on the current audio content to obtain the target audio content played in the target application interface;

[0272] Convert target audio content into text content;

[0273] In response to the third operation, the target audio content within the preset processing time and the corresponding text content are determined as audio excerpt information.

[0274] The target excerpt information includes text excerpt information. When executing S200, the determination module 1302 may be used to perform the following steps:

[0275] In response to the fifth operation, determining or generating a mask for the target application interface;

[0276] Determine or generate a text excerpt rectangle on the mask;

[0277] The text within the text excerpt rectangular frame is determined as text excerpt information.

[0278] Optionally, determine or generate a text excerpt rectangle on the mask, including:

[0279] Determine the edges of the rectangle drawn by the user on the mask;

[0280] A text excerpt rectangle is determined or generated based on the rectangle edge.

[0281] If the width of the text excerpt rectangle is fixed, when determining the edge of the rectangle drawn by the user on the mask, the determination module 1302 may be used to perform the following steps:

[0282] Determining or generating a top edge based on a location where the user first triggers on the mask;

[0283] Determining or generating a bottom edge based on a location of a second user trigger on the mask;

[0284] Determining the edges of the rectangle based on the top and bottom edges and the fixed width; and / or,

[0285] If the width of the text excerpt rectangle is variable, when determining the edge of the rectangle drawn by the user on the mask, the determination module 1302 may be used to perform the following steps:

[0286] Determine or generate an upper edge, a right edge, a lower edge, and a left edge based on four locations triggered sequentially by a user on the mask;

[0287] The edges of the rectangle are determined based on the top edge, the right edge, the bottom edge, and the left edge.

[0288] When performing interference elimination processing on the current audio content to obtain the target audio content played in the video window, the determination module 1302 can be used to perform the following steps:

[0289] Identify interfering sounds in current audio content based on sound distance and / or sound volume;

[0290] Eliminate distracting sounds to get the target audio content played in the video window.

[0291] Embodiment 11

[0292] The present application also provides an intelligent terminal, which includes a memory and a processor. The memory stores a display program, and when the display program is executed by the processor, the steps of the display method in any of the above embodiments are implemented.

[0293] Embodiment 12

[0294] The present application also provides a computer-readable storage medium, on which a display program is stored. When the display program is executed by a processor, the steps of the display method in any of the above embodiments are implemented.

[0295] In the embodiments of the smart terminal and computer-readable storage medium provided in the present application, all technical features of any of the above-mentioned display method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0296] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0297] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0298] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0299] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0300] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0301] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0302] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0303] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0304] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0305] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0306] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, a data center, etc. that contains one or more available media integrated. The available medium can be a magnetic medium, (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0307] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A display method, characterized in that: The method comprises: S100: open the target window; S200: Acquire or determine target excerpt information from at least one target application interface; S300: Displaying the target excerpt information in the target window.

2. The method according to claim 1, characterized in that The S100 includes: In response to receiving the voice command, opening the target window; and / or, In response to the first operation, the target window is opened.

3. The method according to claim 1, characterized in that The target excerpt information includes video excerpt information, and S200 includes: S210: In response to the second operation, identifying a video window in the target application interface; S220: Obtaining a video image and its corresponding text content based on the video window; S230: In response to the third operation, the video images and the corresponding text content within the preset processing time are determined as video excerpt information; the S220 includes: Recording the video screen in the video window; Extracting the current audio content corresponding to the video picture being played; Performing interference elimination processing on the current audio content to obtain target audio content played in the video window; The target audio content is converted into text content.

4. The method according to claim 1, characterized in that The target excerpt information includes audio excerpt information, and S200 includes: In response to a fourth operation, recording the current audio content; Performing interference elimination processing on the current audio content to obtain the target audio content played in the target application interface; Converting the target audio content into text content; In response to the third operation, the target audio content within the preset processing time and the corresponding text content are determined as audio excerpt information.

5. The method according to any one of claims 1 to 4, characterized in that The target excerpt information includes text excerpt information, and S200 includes: In response to a fifth operation, determining or generating a mask for the target application interface; Determining or generating a text excerpt rectangular frame on the mask; The text within the text excerpt rectangular frame is determined as text excerpt information.

6. The method according to claim 5, characterized in that The step of determining or generating a text excerpt rectangular frame on the mask layer includes: Determining the edges of a rectangle drawn by a user on the mask; A text excerpt rectangular frame is determined or generated based on the rectangular edge.

7. The method according to claim 6, characterized in that If the width of the text excerpt rectangular frame is fixed, determining the edge of the rectangle drawn by the user on the mask layer includes: Determining or generating an upper edge based on a location where a user first triggers on the mask; Determining or generating a lower edge based on a location of a second user trigger on the mask; Determining a rectangular edge based on the upper edge and the lower edge and a fixed width; and / or, If the width of the text excerpt rectangular box is variable, determining the edge of the rectangle drawn by the user on the mask layer includes: Determine or generate an upper edge, a right edge, a lower edge and a left edge respectively based on four locations sequentially triggered by a user on the mask; A rectangular edge is determined based on the top edge, the right edge, the bottom edge, and the left edge.

8. The method according to claim 3 or 4, characterized in that: The performing interference elimination processing on the current audio content to obtain the target audio content played in the video window includes: Identify interfering sounds in the current audio content according to sound distance and / or sound volume; The interfering sound is eliminated to obtain the target audio content played in the video window.

9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of the display method according to any one of claims 1 to 8 are implemented.

10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 8 are implemented.

Images