Content display method and device, electronic equipment and storage medium

Abstract

The invention discloses a content display method and device, electronic equipment and a storage medium, and belongs to the technical field of electronic equipment. The method comprises the steps that first audio is acquired, first text content is displayed, and the first text content comprises text content obtained by conducting voice recognition on the first audio; obtaining at least one keyword sentence, and marking at least one text fragment corresponding to the keyword sentence in the first text content; receiving a first input for a first text fragment in the at least one text fragment; and in response to the first input, displaying content induction information of the first text segment.

Description

Technical Field

[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to a content display method, device, electronic equipment and storage medium. Background Art

[0002] With the development of communication technology, especially the emergence of intelligent electronic devices, audio recording has provided great convenience for people's work and study. In the related art, users need to listen to the entire audio file to summarize the main idea and key content of the audio file, which leads to low efficiency in listening to the content of the audio recording. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a content display method, device, electronic device and storage medium, which can solve the technical problem of low efficiency when listening to audio recorded content.

[0004] In a first aspect, an embodiment of the present application provides a content display method, the method comprising:

[0005] Acquire a first audio and display a first text content, where the first text content includes text content obtained by performing speech recognition on the first audio;

[0006] Acquire at least one key word or phrase, and mark at least one text segment corresponding to the key word or phrase in the first text content;

[0007] receiving a first input of a first text segment of at least one text segment;

[0008] In response to the first input, content summary information of the first text segment is displayed.

[0009] In a second aspect, an embodiment of the present application provides a content recording device, the device comprising:

[0010] A first acquisition module is used to acquire a first audio and display a first text content, where the first text content includes text content obtained by performing speech recognition on the first audio;

[0011] A first marking module, which obtains at least one key word and phrase and marks at least one text segment corresponding to the key word and phrase in the first text content;

[0012] A first receiving module, configured to receive a first input of a first text segment of at least one text segment;

[0013] The first display module is used to display content summary information of the first text segment in response to the first input.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method provided in the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method provided in the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method provided in the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method provided in the first aspect.

[0018] In an embodiment of the present application, by obtaining at least one key word or phrase and marking at least one text fragment corresponding to the key word or phrase in the first text content, a user can quickly browse the text fragment corresponding to the key word or phrase, thereby improving the efficiency of the user browsing the first text content; by setting a response to the first input and displaying content summary information of the first text fragment, the user can quickly know the content of the first text fragment through the content summary information, thereby improving the efficiency of browsing the first text fragment. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a flowchart of a content display method provided by an embodiment of the present application;

[0020] Figure 2 This is one of the interface schematic diagrams of the content display method provided by an embodiment of the present application;

[0021] Figure 3 This is the second interface schematic diagram of the content display method provided by an embodiment of the present application;

[0022] Figure 4 This is the third interface diagram of the content display method provided by an embodiment of the present application;

[0023] Figure 5 This is a fourth interface diagram of a content display method provided by an embodiment of the present application;

[0024] Figure 6 This is the fifth interface diagram of the content display method provided by an embodiment of the present application;

[0025] Figure 7This is the sixth interface diagram of the content display method provided by an embodiment of the present application;

[0026] Figure 8 is a structural diagram of a content recording device provided by another embodiment of the present application;

[0027] Fig. 9 is a structural schematic diagram of an electronic device provided by another embodiment of the present application;

[0028] Fig.10 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0031] The content display method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0032] Figure 1 is a flow chart of a content display method provided by an embodiment of the present application, such as Figure 1 As shown, an embodiment of the present application provides a content display method, which may include:

[0033] S110, acquiring a first audio, and displaying a first text content, where the first text content includes text content obtained by performing speech recognition on the first audio;

[0034] The first audio may be obtained by recording in real time by an electronic device, or the first audio may be obtained by pre-storing in an electronic device and receiving the audio from other devices. A semantic recognition model may be pre-stored in the electronic device, and the first audio may be speech recognized by the semantic recognition model to obtain the first text content corresponding to the content of the first audio. In the process of real-time recording of the first audio, the first audio segment may be speech recognized along the time sequence to obtain the text corresponding to each audio segment, and the content of each audio segment is consistent with the text of semantic recognition. After completing the speech recognition of an audio segment, the segment after the audio segment is speech recognized, and so on. The recognized text is displayed in sequence to realize the real-time display of the first text content corresponding to the first audio. The electronic device may also run an audio capture program to obtain the user's voice input in real time, and the electronic device may send the generated first audio to a speech recognition server in the cloud, and the speech recognition server converts the first audio into a real-time text output stream, and transmits the text output stream back to the electronic device through a real-time data transmission protocol (such as WebSocket), and the electronic device displays the received first text content in real time.

[0035] In one example, if Figure 2 As shown, a note application is installed in the electronic device, and the user clicks the "Start Recording" button to trigger the recording function of the note application, and the electronic device starts recording the first audio. The user clicks the "Pause Recording" button 21 to trigger the recording pause function and pause the recording of the first audio. The user clicks the "Start Recording" button to trigger the recording function and continue recording the first audio. The user clicks the "Finish Recording" button 22 to trigger the recording function to stop and store the first audio in the note application. By setting the note application to carry the recording function, it is convenient to record and edit the first audio. By setting the pause function, the user is given more freedom of operation to obtain the first audio with the required content. The first text content corresponding to the first audio is displayed in the "Real-time Transcription" text box 23.

[0036] When the first audio is an audio file imported into an electronic device, the user can add, delete, or modify the audio segments in the audio file that match the voice commands through voice commands. For example, if the user says, "Delete the part that tells the background introduction," the system will search for the part corresponding to the "background introduction" in the first audio, mark it, and delete the part after the user confirms.

[0037] S120, obtaining at least one key word or phrase, and marking at least one text segment corresponding to the key word or phrase in the first text content;

[0038] The key words and phrases may be words and phrases pre-entered by the user, or words and phrases obtained by analyzing the first text content and used to describe the key content in the first text content. The key words and phrases may be a single phrase, or a sentence composed of multiple phrases.

[0039] The first text content can be analyzed by the analysis model pre-stored in the electronic device to obtain the fragments in the first text content that meet the description of the key sentence as the text fragments corresponding to the key sentence. The text fragments may include one or more sentences. By browsing the text fragments corresponding to the key sentence, the user can roughly understand the content related to the key sentence in the first audio.

[0040] For a key word, a matching text segment can be marked in the first text content to correspond to it, or multiple matching text segments can be marked to correspond to it. For the same marked text segment, the marked text segment can correspond to one or more key words. Different text segments can be displayed in a differentiated manner to facilitate users to quickly identify the text segment corresponding to the key word. For example: highlight the text segment corresponding to the key word so that the user can quickly locate the location of the text segment.

[0041] S130, receiving a first input of a first text segment among at least one text segment;

[0042] Optionally, the first input may be an input for browsing information related to the first text segment. For example, the first input may be: a click input by the user on the displayed first text segment, or a specific gesture input by the user, which may be specifically determined according to actual usage requirements, and is not limited in this embodiment of the present application. The specific gesture in the embodiment of the present application may be: any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure recognition gesture, a long press gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and may also be a long press input or a short press input.

[0043] S140: In response to the first input, display content summary information of the first text segment.

[0044] The content summary information of the first text segment is a summary or refinement of the main information and core ideas described in the first text segment. The content summary information helps users quickly understand the main idea of ​​the first text segment, grasp key information, and improve the efficiency of users knowing the content described in the first text segment. The content summary information may include the summary, main idea, keywords, high-frequency words, etc. of the first text segment, and may also include the start and end time, play length, voice emotion, speaker, etc. of the corresponding audio of the first text segment in the first audio.

[0045] For example, a user inputs a key phrase "introduction to the defense process", and marks a text segment corresponding to "introduction to the defense process" in the first text content. The marked text segments include the key words "defense item 1", "defense item 2", and "defense item 1", respectively. The user can click and input any marked text segment, and the content summary information of the text segment is displayed through a floating window, and the key word "defense item 1" is displayed in a preset area corresponding to the content summary information, so that the user can quickly know the specific content related to "defense item 1" described in the text segment. The user can make a first input for each marked text segment to quickly browse the content summary information of each text segment, and then select the text segment that needs to be read in detail from multiple text segments for intensive reading, so as to improve the efficiency of reading the content corresponding to the key phrase.

[0046] In an embodiment of the present application, by obtaining at least one key word or phrase and marking at least one text fragment corresponding to the key word or phrase in the first text content, a user can quickly browse the text fragment corresponding to the key word or phrase, thereby improving the efficiency of the user browsing the first text content; by setting a response to the first input and displaying content summary information of the first text fragment, the user can quickly know the content of the first text fragment through the content summary information, thereby improving the efficiency of browsing the first text fragment.

[0047] In some embodiments, in S120, the step of obtaining at least one key phrase includes at least one of the following:

[0048] S210, identifying a first text content, and acquiring at least one key word or phrase corresponding to the first text content;

[0049] S220, obtaining at least one key word or phrase associated with the first audio input by the user;

[0050] S230, obtaining a filter condition input by a user, and performing content analysis on the second text content in the first application according to the filter condition to obtain at least one key word or phrase related to the second text content.

[0051] S210, S220 and S230 may be executed simultaneously, or in steps, or only one or part of them may be executed. When executing multiple items of S210, S220 and S230, the present application does not limit the execution order.

[0052] The key words and phrases may be preset by the user, received by the electronic device, or obtained by analyzing a preset object by the electronic device. One or more key words and phrases may be set, and the key words and phrases reflect the focus of the user in the first audio. The multiple key words and phrases may be used to describe the content that the user needs to know in various aspects, so that the obtained one or more marked text segments meet the user's needs. Figure 2 In the illustrated embodiment, four key words 24 are displayed in the “keyword” display box, and text segments can be marked by matching the four key words 24 respectively.

[0053] In S210, the semantic analysis of the first text content can be performed by the semantic recognition model to obtain at least one key word corresponding to the first text content, thereby realizing automatic generation of key words. The user can know the orientation of the marked text segment by browsing the generated key words, ensuring that the user can obtain clear information orientation in any situation.

[0054] In S220 , the user independently defines key words and phrases as key monitoring objects. The independently defined key words and phrases reflect the user's focus on the first audio, so that the annotated text segment matches the user's focus.

[0055] The first application may be an application installed in a pre-set electronic device, or may be an application determined by a screening condition input by a user. The content display method provided in the present application may be applied to a second application, and the first application and the second application may be the same program installed in the electronic device, or may be different programs installed in the electronic device. A number of texts are stored in the first application, and the second text content may be a pre-set text content, or may be a text content determined by a screening condition input by a user. The second text content may be analyzed and summarized by a semantic recognition model to obtain key words and sentences. In S230, the setting of key words and sentences is related to the second text content in the first application, and the text fragments in the first text content are marked by key words and sentences obtained by analyzing other text contents.

[0056] Exemplarily, the first application and the second application are both note-taking applications installed in an electronic device. When the note-taking application is started, the first text content is displayed in the program interface of the note-taking application. Based on the filtering conditions input by the user, content analysis is performed on the second text content with the pre-stored notes in the note-taking application to obtain at least one key word or phrase regarding the pre-stored notes.

[0057] Optionally, the first application is a communication application, and the first application may be an instant messaging application or a non-instant messaging application. The non-instant messaging application may be an email, a text message, a multimedia message, etc. The screening condition may include a text receiving time range, a sender identity information, etc., to limit the scope of the second text content. For example: the input screening condition is an email about sender A in the first application. The second application is a note application.

[0058] For example, Figure 2 As shown, 4 key words are displayed in the "keyword" display box, and the user clicks the button 25 in the "keyword" display box to input; Figure 3 In the filtering condition setting interface shown, the user selects the first application as "SMS" in the selection box 71, selects the date as "2024 / 9 / 7" in the selection box 72, and enters the subject "Discussing matters related to thesis and defense with the teacher" in the selection box 73. The user clicks the "Generate Keywords" button, and the second text content in the "SMS" application that meets the receiving time of "2024 / 9 / 7" and the subject of "Discussing matters related to thesis and defense with the teacher" is analyzed to generate key words and phrases about the first text content.

[0059] In some embodiments, the content summary information includes a segment summary; before S140, including:

[0060] S210, performing content analysis on the marked text segment, and extracting a segment summary of the marked text segment.

[0061] When there are multiple marked text segments, the marked text segments can be input into the trained recognition model respectively to extract the segment summaries corresponding to the marked text segments. Users can browse the segment summaries to quickly understand the content of the marked text segments and the content of the audio corresponding to the marked text segments.

[0062] In some embodiments, the content summary information includes the start and end time of the audio corresponding to the text segment in the first audio; after S140, it includes:

[0063] S410, receiving a second input;

[0064] S420: In response to the second input, play the audio in the first audio that matches the start and end time of the first text segment.

[0065] When the first audio is converted by speech recognition to obtain the first text content, a sentence mapping relationship with the first text content can be established at the sentence segment of the first audio. The format of the first mapping relationship is ["sentence", "time position in the audio"] (such as ["Hello, Teacher Li.", "00:26-00:27"]), which is convenient for subsequent marking of text segments and audio segment retrieval. For example: when searching the first text content through the information retrieval function, the text segment matching the search term can be determined in the first text content, and then the audio segment corresponding to the retrieved text segment and the time position of the audio segment in the first audio can be obtained based on the first mapping relationship. For example: when adding, deleting, and modifying the first audio, the matching text segment matching the voice instruction can be determined in the first text content, and then the first time position of the audio segment corresponding to the matching text segment in the first audio can be obtained based on the first mapping relationship. The audio at the first time position in the first audio is added, deleted, and modified according to the voice instruction.

[0066] A text segment can be a collection of multiple sentences. When a text segment has a long content, the user can know the approximate content of the text segment by browsing the content summary information to improve the efficiency of the user browsing the text segment. The start and end times corresponding to the text segment at least include the start and end times of the audio corresponding to the text segment. The start and end times of the audio segment can be queried through the aforementioned mapping relationship. The user can review the audio corresponding to the text segment according to the start and end times, which is convenient for browsing the text segment and the audio in comparison.

[0067] The content summary information may be displayed in a floating window, and a first control may be displayed in the floating window, a second input to the first control may be received, and audio corresponding to the first text segment may be played.

[0068] For example, see Figure 4 , the user clicks on the first text segment 41 of "and because the information is accurate, it can also reduce the chance of errors in the flow of goods", a floating window 42 pops up, and the start and end time "5:16-7:19" of the first text segment in the first audio is displayed in the floating window 42, summary information of the first text segment is displayed in the floating window 42, and a first control 43 of the audio segment corresponding to the first text segment is displayed in the floating window 42. The user clicks and inputs on the first control 43 to play the audio with the start and end time "5:16-7:19" in the first audio.

[0069] In some embodiments, after S210, the following steps are included:

[0070] S510, displaying a progress bar of the first audio, wherein the progress bar includes an identifier of a time segment corresponding to each segment in at least one text segment;

[0071] S520, receiving a third input of a target identifier in the identifiers from a user;

[0072] S530: In response to the third input, play the audio corresponding to the target identifier in the first audio.

[0073] The progress bar of the first audio can represent the playing progress of the first audio. By dragging the position of the slider in the progress bar, different segments of the first audio can be switched to play. The progress bar includes at least one mark of each segment corresponding to the time segment in the text segment, and the user makes a third input to one of the marks to automatically play the audio corresponding to the mark.

[0074] The position of the marker in the progress bar matches the playing time of the audio of the corresponding text segment in the first audio. This makes the order of the positions of the text segments in the first text content, the order of the audio corresponding to the text segments in the first audio, and the order of the display positions of the markers of the text segments in the progress bar consistent, so as to facilitate the user to play the part of the audio that he or she is interested in in the first audio.

[0075] In some embodiments, while the audio corresponding to the target identifier is played, a text segment corresponding to the target identifier is displayed.

[0076] When playing the first audio, each audio segment is played in sequence. When playing audio segment A, the text segment A corresponding to audio segment A is dynamically displayed in the display box, so that the user can quickly locate the text segment A corresponding to audio segment A in the first text content. The dynamic display can be to display part or all of the first text content in a preset text box, and differentiate between the text segment corresponding to the played audio segment and the text segment corresponding to the non-played audio segment. When playing audio B corresponding to the target identifier, the text segment B corresponding to the audio B corresponding to the target identifier is displayed in the display box, so that the user can quickly browse to text segment B.

[0077] In some embodiments, after S120, the following steps are included:

[0078] S610, receiving a fourth input;

[0079] S620, in response to the fourth input, displaying at least one of the subject information, key information, and to-do event information about the first text content;

[0080] S620 and above include at least one of the following:

[0081] S630, obtaining subject information of the first text content according to the key words and sentences analysis;

[0082] S640, obtaining key information of the first text content according to the key words and sentences analysis;

[0083] S650: Analyze the key words and phrases to obtain the to-do event information in the first text content.

[0084] The first text content, subject information, key information, and pending event information can be displayed in pages, and different buttons can be used to trigger the display of the first text content, subject information, key information, and pending event information. For example, please refer to Figure 5 , the user clicks the "original text" button 52, triggering the display of the first text content in the preset text box 51. Figure 6 , the user clicks the "Summary" button 53, triggering the display of the subject information, summary information and to-do items of the first text content in the preset text box 51. The subject information is the main topic of the audio content extracted based on the first text content and the first audio. The summary information is the core points of the audio sorted out based on the text fragments. The to-do items are the schedules, to-do items, etc. involved in the audio, and are displayed one by one. Please refer to Figure 7 , the user clicks the “information retrieval” button 54 , triggering the display of the search box 55 , and based on the search word entered by the user in the search box 55 , the content matching the search word in the first text content is displayed in the preset text box 51 .

[0085] In some embodiments, S120 includes:

[0086] S610, obtaining at least one key word sentence, performing content analysis on the first text content according to the at least one key word sentence, and determining a key sentence in the first text content that semantically matches the key word sentence;

[0087] S620, performing content analysis on the sentence before the keyword in the first text content, and identifying a pre-paragraph sentence that matches the context of the key sentence;

[0088] S630, performing content analysis on the sentence after the keyword in the first text content, and identifying a post-paragraph sentence that matches the context of the key sentence;

[0089] S640: Determine the pre-paragraph sentence, the key words, and the post-paragraph sentence as text segments corresponding to the key words and sentences.

[0090] In the case where the first audio content is large or the first audio is generated by real-time acquisition, the first text content generated by the first audio is gradually increased along the chronological order to generate newly generated text fragments. Streaming text processing technology can be used to continuously analyze the text fragments generated by real-time transcription in order to capture and match the first text fragments. The semantic recognition model processes the text fragments obtained by real-time transcription at a certain frequency to capture keywords. Once the semantic recognition model identifies keywords that match key words in the text, the backtracking mechanism is triggered and S620 is executed. It can identify whether the sentence before the keyword is a context-related fragment, and monitor whether the sentence after the keyword is a context-related fragment, so as to highlight the pre-segment sentence, keyword and post-segment sentence to achieve the marking of the text fragment corresponding to the key word.

[0091] It should be noted that the content display method provided in the embodiment of the present application can be executed by a content recording device. In the embodiment of the present application, the content recording device executing the content display method is taken as an example to illustrate the content recording device provided in the embodiment of the present application.

[0092] Figure 8 is a schematic diagram of the structure of a content recording device provided by another embodiment of the present application. Figure 8 As shown, the content recording device may include:

[0093] A first acquisition module 801 is used to acquire a first audio and display a first text content, where the first text content includes text content obtained by performing speech recognition on the first audio;

[0094] A first marking module 802 is used to obtain at least one key word and phrase, and mark at least one text segment corresponding to the key word and phrase in the first text content;

[0095] A first receiving module 803, configured to receive a first input of a first text segment of at least one text segment;

[0096] The first display module 804 is configured to display content summary information of the first text segment in response to the first input.

[0097] In an optional example, the first marking module 802 includes at least one of the following:

[0098] A first generating unit, configured to identify a first text content and obtain at least one key word or phrase corresponding to the first text content;

[0099] A second generating unit, configured to obtain at least one key word or phrase associated with the first audio input by a user;

[0100] The third generating unit is used to obtain the filtering condition input by the user, and perform content analysis on the second text content in the first application according to the filtering condition to obtain at least one key word or phrase related to the second text content.

[0101] In an optional example, the content summary information includes a segment summary; and the content recording device includes:

[0102] The first analysis module is used to perform content analysis on the marked text segment and extract a segment summary of the marked text segment.

[0103] In an optional example, the content summary information includes the start and end time of the audio corresponding to the text segment in the first audio; and the content recording device includes:

[0104] A second receiving module, used for receiving a second input;

[0105] The first playing module is used to play the audio in the first audio that matches the start and end time of the first text segment in response to the second input.

[0106] In an optional example, the content recording device includes:

[0107] A first display module, used to display a progress bar of the first audio, wherein the progress bar includes an identifier of a time segment corresponding to each segment in at least one text segment;

[0108] A third receiving module, used to receive a third input of the user on the target identifier in the identifier;

[0109] The second playing module is used to play the audio corresponding to the target identifier in the first audio in response to the third input.

[0110] In an optional example, the content recording device includes:

[0111] A fourth receiving module, configured to receive a fourth input;

[0112] A second display module, configured to display at least one of subject information, key information, and to-do event information about the first text content in response to a fourth input;

[0113] A second analysis module is used to obtain subject information of the first text content according to the key words and sentences analysis;

[0114] A third analysis module is used to obtain key information of the first text content according to the key words and sentences analysis;

[0115] The fourth analysis module is used to obtain the to-do event information in the first text content according to the key words and sentences analysis.

[0116] In an optional example, the first marking module 802 includes:

[0117] A first matching unit is used to obtain at least one key word sentence, perform content analysis on the first text content according to the at least one key word sentence, and determine a key sentence in the first text content that semantically matches the key word sentence;

[0118] A second matching unit is used to perform content analysis on the sentence before the key sentence in the first text content, and identify a pre-paragraph sentence that matches the context of the key sentence;

[0119] A third matching unit is used to perform content analysis on the text segment after the key sentence in the first text content, and identify a post-segment sentence that matches the context of the key sentence;

[0120] The marking unit is used to determine that the pre-paragraph sentence, the key sentence and the post-paragraph sentence are text segments corresponding to the key sentence.

[0121] The content recording device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), an ATM or an automated machine, etc., augmented reality (augmented reality, AR), virtual reality (virtual reality, VR) devices, etc., which are not specifically limited in the embodiment of the present application.

[0122] The content recording device in the embodiment of the present application may be a device having at least two operating systems. The at least two operating systems may include an Android operating system, an iOS operating system, a BlueOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0123] The content recording device provided in the embodiment of the present application can achieve Figures 1 to 7To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0124] Alternatively, if Fig. 9 As shown, an embodiment of the present application also provides an electronic device 100, including a processor 101 and a memory 102, wherein the memory 102 stores programs or instructions that can be executed on the processor 101, and when the program or instructions are executed by the processor 101, the various steps of the above-mentioned content display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0125] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0126] Fig.10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0127] The electronic device 1000 includes but is not limited to components such as a radio frequency unit 111, a network module 112, an audio output unit 113, an input unit 114, a sensor 115, a display unit 116, a user input unit 117, an interface unit 118, a memory 119, and a processor 110.

[0128] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0129] The processor 110 is used to obtain the first audio and display the first text content, where the first text content includes the text content obtained by performing voice recognition on the first audio;

[0130] The processor 110 is configured to obtain at least one key word and phrase, and mark at least one text segment corresponding to the key word and phrase in the first text content;

[0131] The processor 110 is configured to receive a first input of a first text segment of at least one text segment;

[0132] The processor 110 is configured to display content summary information of the first text segment in response to the first input.

[0133] Optionally, the processor 110 is configured to identify the first text content and obtain at least one key word or phrase corresponding to the first text content;

[0134] The processor 110 is configured to obtain at least one key word or phrase associated with the first audio input by the user;

[0135] The processor 110 is configured to obtain a filter condition input by a user, and perform content analysis on the second text content in the first application according to the filter condition to obtain at least one key word or phrase related to the second text content.

[0136] Optionally, the content summary information includes a segment summary; the processor 110 is used to perform content analysis on the marked text segment and extract the segment summary of the marked text segment.

[0137] Optionally, the content summary information includes the start and end time of the audio corresponding to the text segment in the first audio; the processor 110 is used to receive a second input;

[0138] The processor 110 is configured to, in response to the second input, play the audio in the first audio that matches the start and end time of the first text segment.

[0139] Optionally, an identifier of a time segment corresponding to each segment in the processor 110 segment;

[0140] The processor 110 is used to receive a third input of a target identifier in the identifier by a user;

[0141] The processor 110 is configured to play the audio corresponding to the target identifier in the first audio in response to the third input.

[0142] Optionally, the processor 110 is configured to receive a fourth input;

[0143] The processor 110 is configured to display at least one of the subject information, key information, and to-do event information about the first text content in response to the fourth input;

[0144] The processor 110 is used to obtain subject information of the first text content according to the key words and phrases analysis;

[0145] The processor 110 is used to obtain key information of the first text content according to the key words and sentences analysis;

[0146] The processor 110 is configured to obtain to-do event information in the first text content according to key word analysis.

[0147] Optionally, the processor 110 is configured to obtain at least one key word sentence, perform content analysis on the first text content according to the at least one key word sentence, and determine a key sentence in the first text content that semantically matches the key word sentence;

[0148] The processor 110 is configured to perform content analysis on the sentence before the key sentence in the first text content, and identify a pre-paragraph sentence that matches the context of the key sentence;

[0149] The processor 110 is configured to perform content analysis on the text segment after the key sentence in the first text content, and identify a post-segment sentence that matches the context of the key sentence;

[0150] The processor 110 is configured to determine that the pre-paragraph sentence, the key sentence, and the post-paragraph sentence are text segments corresponding to the key sentence.

[0151] It should be understood that in the embodiment of the present application, the input unit 114 may include a graphics processor (Graphics Processing Unit, GPU) 1141 and a microphone 1142, and the graphics processor 1141 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 116 may include a display panel 1161, and the display panel 1161 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 117 includes a touch panel 1171 and at least one of other input devices 1172. The touch panel 1171 is also called a touch screen. The touch panel 1171 may include two parts: a touch detection device and a touch controller. Other input devices 1172 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0152] The memory 119 can be used to store software programs and various data. The memory 119 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 119 may include a volatile memory or a non-volatile memory, or the memory 119 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 119 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0153] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0154] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned content display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0155] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0156] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned content display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0157] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0158] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned content display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0159] It should be noted that, in this article, the term "comprises", "includes" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device in the embodiment of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0160] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0161] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A content display method, characterized in that: include: Acquire a first audio, and display a first text content, where the first text content includes text content obtained by performing speech recognition on the first audio; Acquire at least one key word or phrase, and mark at least one text segment corresponding to the key word or phrase in the first text content; receiving a first input of a first text segment of the at least one text segment; In response to the first input, content summary information of the first text segment is displayed.

2. The method according to claim 1, characterized in that The obtaining of at least one key word phrase includes at least one of the following: Identify the first text content and obtain at least one key word or phrase corresponding to the first text content; Acquire at least one key word or phrase associated with the first audio input by a user; A filtering condition input by a user is obtained, and content analysis is performed on the second text content in the first application according to the filtering condition to obtain at least one key word or phrase related to the second text content.

3. The method according to claim 1, characterized in that The content summary information includes a segment summary; before displaying the content summary information of the first text segment, the method includes: Content analysis is performed on the marked text segment to extract the segment summary of the marked text segment.

4. The method according to claim 1, characterized in that The content summary information includes the start and end time of the audio corresponding to the text segment in the first audio; and the display of the content summary information of the first text segment includes: receiving a second input; In response to the second input, the audio in the first audio that matches the start and end times of the first text segment is played.

5. The method according to claim 1, characterized in that The method further comprises: Displaying a progress bar of the first audio, wherein the progress bar includes an identifier of a time segment corresponding to each segment in the at least one text segment; receiving a third input of a target identifier in the identifier by a user; In response to the third input, the audio in the first audio corresponding to the target identifier is played.

6. The method according to claim 1, characterized in that The obtaining of at least one key word phrase then comprises: receiving a fourth input; In response to the fourth input, displaying at least one of subject information, key information, and to-do event information about the first text content; The display of at least one of the subject information, key information, and to-do event information about the first text content includes at least one of the following: Obtaining subject information of the first text content according to the key words and phrases analysis; Obtaining key information of the first text content according to the key words and phrases analysis; The to-do event information in the first text content is obtained based on the key words and sentences analysis.

7. The method according to claim 1, characterized in that The acquiring of at least one key word or phrase and marking a text segment corresponding to the key word or phrase in the first text content includes: Acquire at least one key word sentence, perform content analysis on the first text content according to the at least one key word sentence, and determine a key sentence in the first text content that semantically matches the key word sentence; Performing content analysis on the sentence before the key sentence in the first text content to identify a pre-paragraph sentence that matches the context of the key sentence; Performing content analysis on the text segment after the key sentence in the first text content to identify a post-segment sentence that matches the context of the key sentence; The pre-paragraph sentence, the key sentence and the post-paragraph sentence are determined to be text segments corresponding to the key sentence.

8. A content recording device, characterized in that: include: A first acquisition module, used to acquire a first audio and display a first text content, where the first text content includes text content obtained by performing speech recognition on the first audio; A first marking module, configured to obtain at least one key word or phrase, and mark at least one text segment corresponding to the key word or phrase in the first text content; A first receiving module, configured to receive a first input of a first text segment of the at least one text segment; The first display module is used to display content summary information of the first text segment in response to the first input.

9. An electronic device, characterized in that: It includes a processor and a memory, the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the content display method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the content display method according to any one of claims 1 to 7 are implemented.

Images