Speech processing method and electronic device

Abstract

The present application relates to the technical field of audio processing, and provides a speech processing method and an electronic device. After an electronic device converts a speech file into text, if a touch and hold operation is received, it indicates that a user may want to select speech content in different sections at the same time, and then the electronic device can splice all displayed speech information to obtain a spliced character string. Next, the electronic device determines a target character area by combining a starting position and an ending position corresponding to the touch and hold operation with the spliced character string, wherein the target character area represents selected characters corresponding to the touch and hold operation in the spliced character string. Then, the electronic device displays the spliced character string in a plain text format, and configures the characters in the target character area to be selected, thereby achieving cross-section speech information selection. The electronic device can perform corresponding processing including sharing, searching, copying and other operations on the basis of a function control selected by the user, thereby providing rich services for the user and improving the user experience.

Description

Voice processing method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on July 12, 2023, with application number 202310862032.1 and invention name “A speech processing method and electronic device”, and the Chinese patent application filed with the State Intellectual Property Office on July 12, 2023, with application number 202310855258.9 and invention name “A speech processing method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of audio processing technology, and in particular to a voice processing method and electronic device. Background Art

[0003] With the development of electronic devices, the functions provided by electronic devices are becoming more and more abundant. For example, electronic devices provide recording functions. In daily work and study, many users use the recording function of electronic devices. For example, users add recordings to notes.

[0004] Currently, electronic devices generally provide basic services for recorded voice data, such as converting voice data into text, allowing users to intuitively understand the speaker's speech through text. However, when users have other needs related to voice data, these needs are not met because electronic devices do not provide corresponding services. Therefore, electronic devices urgently need to provide richer services for voice data to meet user needs.

[0005] Summary of the Invention

[0006] In view of this, the present application provides a speech processing method and electronic device for realizing cross-segment selection or merging of speech texts, and providing richer services for voice data.

[0007] In a first aspect, the present application provides a voice processing method, wherein during recording, an electronic device displays a first interface of a first note in a note application, the first interface including a first recording card, and the first recording card displays a first control for triggering to stop recording.

[0008] After receiving the latest voice data, the electronic device converts the latest voice data into text to obtain the latest speech information corresponding to the latest voice data.

[0009] Afterwards, the electronic device adds the latest speech information to the first recording card. Afterwards, upon receiving a user trigger operation (such as a click operation) on the above-mentioned first control, the electronic device responds to the trigger operation, stops recording, and displays the second interface of the first note. The recording card displayed on the second interface serves as the second recording card. The second recording card may include all speech information obtained during the recording and a second control. Generally speaking, the number of all speech information is multiple. The second control is used to trigger the electronic device to continue recording.

[0010] After receiving a long press input from the user, indicating that the user wants to select the content of the speech information, the electronic device updates the second recording card to a third recording card. In the third recording card, the target character area in the spliced ​​string is selected. The spliced ​​characters are obtained by splicing multiple speech information, that is, the speech information is displayed in text form.

[0011] The target character area is determined based on the start position and the end position corresponding to the long press operation. The target character area includes at least two speech information among the multiple speech information or information in different rows in one speech information among the multiple speech information.

[0012] The electronic device may display at least one function control, and the function control is used to trigger the electronic device to perform corresponding processing on the characters in the target character area.

[0013] In this application, the note application provides a recording function. Users can add recordings while editing notes (such as the first note). Accordingly, during the recording process, the electronic device converts the received voice data into speech information in real time and displays it, intuitively showing the speech content, so that the user can quickly understand the speech content corresponding to the voice data. Afterwards, when the recording is stopped, if the user wants to select the speech information, the user can input a long press operation. After receiving the long press operation, the electronic device can obtain the starting position and end position corresponding to the long press operation, and splice the characters in all the speech information to obtain a spliced ​​string. The spliced ​​string is consistent with the content of the speech information. The electronic device displays the spliced ​​string to display the speech information in plain text form, and selects and sets the target character area in the spliced ​​string. Since the spliced ​​string, that is, the spliced ​​speech information is plain text, the electronic device can select different speech information at the same time, such as selecting characters in multiple consecutive speech information at the same time, and selecting different types of information located in different lines in a speech information (such as selecting the speaker identifier and speech text at the same time), realizing cross-segment selection of speech information. Afterwards, the electronic device can display function controls so that the user can select function controls according to usage needs. The electronic device performs corresponding processing based on the function controls selected by the user, providing the user with rich services, meeting the user's usage needs, and improving the user experience.

[0014] The first control may be a control for pausing recording, and the second control may be a control for starting recording.

[0015] In one possible design, the electronic device may start splicing from the first character of all speech information displayed on the third recording card and stop splicing after splicing the last character of all speech information, thereby splicing the speech information and thus achieving format conversion of the speech information.

[0016] In a possible design, the target character area includes the character corresponding to the offset character position and the selected number of characters after the offset character position.

[0017] Among them, the process of determining the above-mentioned offset character position may include: the electronic device counts the number of characters starting from the first character in the multiple speech information and ending at the starting position corresponding to the long press operation to obtain the offset character position, and the offset character position represents the position of the first selected character relative to the spliced ​​character string.

[0018] The number of selected characters is determined based on the starting position and the ending position corresponding to the long press operation.

[0019] In the present application, the position of the first selected character in the concatenated character string can be determined by utilizing the offset character position, thereby enabling accurate determination of the selected character, that is, accurate determination of the target character area.

[0020] In one possible design, the second recording card includes a sliding component, and the multiple speech information is carried by the sliding component; the sliding component includes multiple entries, the speech information corresponds to the item one by one, and each item carries the corresponding speech information. The item includes at least two text components, one of the at least two text components can include a speaker ID, and the other text component can include a speech text. The speech text and the speaker ID are generally located in different rows. Since multiple items cannot be selected at the same time, and the contents of different text components cannot be selected at the same time, the electronic device can replace the sliding component in the second recording card with a preset text component, that is, instead of using the sliding component to carry the speech information, the preset text component is used to display the spliced ​​speech information, that is, the preset text component is used to display the speech information in plain text form, so that the electronic device can select multiple speech information at the same time, or select information in different rows of the same speech information at the same time, to achieve cross-row (or cross-segment) selection of speech information.

[0021] Optionally, the types of the at least two text components may be the same or different. The text components may include EditText and TextView. The preset speech text may be a TextView.

[0022] In one possible design method, after displaying at least one function control, when the function control stops displaying, the layout component of the speech information of the electronic device can be replaced by a sliding component from a preset text component, that is, the preset text component of the third recording card is replaced by a sliding component, and the sliding component carries multiple speech information, which makes it easier for the electronic device to respond to user operations and ensure the accuracy of operations.

[0023] In one possible design approach, the note-taking application also supports responding to click operations.

[0024] After receiving a click operation input by the user, in response to the click operation, if the click position corresponding to the click operation is in the speech text, it is determined whether it is in the playing state.

[0025] If the electronic device is not in the playing state, the electronic device enters the editing state.

[0026] If the electronic device is in a play state, the electronic device plays the voice data corresponding to the first speaking time, wherein the first speaking time refers to the speaking time corresponding to the character corresponding to the clicked position; wherein the play state indicates that the electronic device plays the voice data.

[0027] In an embodiment of the present application, when it is determined that the user has clicked on a speech text, the electronic device can determine whether the tablet computer is in a play state to determine the user's usage intention, that is, to determine whether the user wants to edit the clicked speech text, or to display the progress bar of the play progress to the time corresponding to the clicked speech text. When the electronic device is not in a play state, the possibility that the user wants to play voice data is small, and the possibility of editing the speech text is large. Therefore, the electronic device can enter an edit state to enable the user to edit the clicked speech text. When the electronic device is in a play state, the possibility that the user wants to play voice data is large, and the possibility of editing the speech text is small. Therefore, the electronic device can play the voice data corresponding to the speech time corresponding to the clicked character, thereby achieving accurate playback of voice data without manual adjustment by the user.

[0028] In a possible design, the second recording card further includes a progress bar. If the electronic device is in a playback state, the electronic device moves the playback progress of the progress bar to the first speaking time, so that the user can intuitively know the playback status of the voice data.

[0029] In one possible design, the first speech time is calculated by adding an offset time to the speech start time corresponding to the first target speech text. The offset time is based on the speaking speed and the number of offset characters corresponding to the first target speech text. The offset character number refers to the number of characters in the first target speech text preceding the click position. The first target speech text represents the speech text at the click position. This allows for accurate determination of the speech time.

[0030] In a possible design, the speech information also includes a speaker identification, that is, the electronic device can also display the speaker identification.

[0031] When the click position corresponding to the above-mentioned click operation is on the speech text, it is determined whether it is in the playing state.

[0032] If the electronic device is not in the playback state, the user is less likely to want to play voice data, but is more likely to want to edit the speaker identification. The electronic device can enter the editing state and display the speaker modification control. The speaker modification control is used to trigger the electronic device to modify the speaker identification, so that the user can use the speaker modification control to modify the speaker identification, thereby modifying the speech content and meeting the user's modification needs.

[0033] If the electronic device is in the playback state, the user is more likely to want to play voice data and less likely to want to edit the speaker identifier. The electronic device plays the voice data corresponding to the target speech start time; the target speech start time refers to the speech start time corresponding to the speaker identifier, that is, the speech start time corresponding to the speaker identifier clicked by the user, to achieve accurate playback of voice data.

[0034] In a possible design, the electronic device may also move the playback progress of the progress bar to the target speech start time, so that the user can intuitively know the playback status of the voice data.

[0035] In a second aspect, the present application provides a voice processing method, wherein during recording, the electronic device displays a first interface of a first note in a note application, the first interface including a first recording card, and the first recording card displays a first control for triggering to stop recording.

[0036] After receiving the latest voice data, the electronic device converts the latest voice data into text to obtain the latest speech information corresponding to the latest voice data.

[0037] Afterwards, the electronic device adds the latest speech information to the first recording card. Afterwards, after receiving the user's trigger operation (such as a click operation) on the above-mentioned first control, the electronic device responds to the trigger operation, stops recording, and displays the second interface of the first note. The recording card displayed on the second interface serves as the second recording card. The second recording card may include all speech information obtained during the recording, such as the first speech information and the second speech information. The first speech information includes the first speech text, and the second speech information includes the second speech text; the speech time corresponding to the first speech information is earlier than the speech time corresponding to the second speech information, and the first speech information and the second speech information are displayed adjacent to each other; the second recording card also includes a second control for triggering continued recording.

[0038] Afterwards, after receiving the user's first operation on the second speech text, in response to the first operation, the cursor is displayed at the beginning of the line of the second speech text. That is, the first operation is used to trigger the electronic device to display the cursor at the beginning of the line of the second speech text.

[0039] Afterwards, after receiving the deletion operation input by the user, in response to the deletion operation, the electronic device updates the second recording card to the fourth recording card. In the fourth recording card, the second speech text and the first speech text are merged into the third speech information, that is, the second speech text is merged into the first speech text, the second speech information is deleted, and the speaker identifier corresponding to the third speech information is the same as the speaker identifier corresponding to the second speech text.

[0040] In this application, the note application provides a recording function, and the user can add a recording while editing a note (such as the first note). Accordingly, during the recording, the electronic device converts the received voice data into speech information in real time and displays it, intuitively showing the speech content, so that the user can quickly know the speech content corresponding to the voice data. Afterwards, when the recording is stopped, if the user wants to merge a speech text (such as the second speech text) into another speech text (such as the first speech text), the user can perform a first operation on the second speech text. In response to the first operation, the electronic device displays the cursor at the beginning of the line of the second speech text. Afterwards, after the electronic device receives the deletion operation input by the user, since the cursor is at the beginning of the line of the second speech text and there is no character of the second speech text before the cursor, the electronic device can determine that the deletion operation is not intended to delete the characters before the cursor, but to merge the second speech text into the first speech text. The electronic device can then respond to the deletion operation and merge the second speech text into the first speech text to achieve cross-line merging of the speech texts. Then, when the speaker recognizes an error, the user believes that two adjacent speech texts are related, or the user wants to integrate the speech texts of the same speaker together, the electronic device can achieve this by merging the speech texts, thereby providing users with rich services, meeting users' usage needs, and improving user experience.

[0041] The first operation may be a click operation on the beginning of a line of the second speech text, such as the user clicking the beginning of a line of the second speech text with a finger or a mouse.

[0042] In one possible design, when the second recording card does not display the speaker identifier, it indicates that the electronic device is not in the speaker display state. The electronic device can update the second recording card to the fourth recording card to achieve cross-segment merging of the speech text. If the second recording card displays a speaker identifier, it indicates that the electronic device is in the speaker display state. The speech texts in different speech information, that is, the speech texts in different segments are separated by speaker identifiers. In response to the deletion operation input by the user, the electronic device will add the second speech text to the previous segment (or describe it as the previous line) of the second speech text, that is, merge the second speech text into the line where the speaker identifier corresponding to the second speech text is located, and cannot merge the second speech text into the first speech text, resulting in the failure of cross-line merging of speech texts. Therefore, the electronic device needs to perform cross-line merging of speech texts when it is not in the speaker state.

[0043] In one possible design method, in order to achieve cross-line merging of speech texts, when the electronic device displays the speaker identifier corresponding to the first speech text and the speaker identifier corresponding to the second speech text on the second recording card, it indicates that the electronic device is in the speaker display state, and the electronic device receives a second operation input by the user, and the second operation can trigger the electronic device to stop displaying the speaker identifier.

[0044] In response to the second operation, the electronic device updates the second recording card to a fifth recording card. The fifth recording card includes the first and second speech texts, but does not include the speaker identifier corresponding to the first and second speech texts. In other words, the electronic device stops displaying the speaker identifier on the second recording card and only displays the speech text, thereby switching the display status of the speaker. Accordingly, after receiving the delete operation, the electronic device can, in response to the delete operation, update the fifth recording card to the fourth recording card, thereby merging the speech texts across multiple lines.

[0045] Optionally, the second operation may be a click operation on a control for stopping displaying the speaker.

[0046] In another possible design method, in order to ensure the cross-line merging of speech texts, when the electronic device is in the speaker display state and receives a delete operation, it can automatically switch to the speaker display state, that is, automatically update the above-mentioned second recording card to the fifth recording card, to achieve rapid switching of the speaker display state, and can achieve the merging of speech texts across lines.

[0047] In one possible design method, the above-mentioned first speech information and the above-mentioned second speech information are laid out through a sliding component (such as recycleview), the first speech information is carried by the first item in the sliding component, and the second speech information is carried by the second item in the sliding component, and the first item and the second item are different; wherein, the text component in the first item includes the first speech text, and the text component in the second item includes the second speech text.

[0048] In one possible design, the text component may be a textview, and the first entry includes at least two textviews, one of which is used to carry the speaker's ID, and the other is used to carry the speech text. The textview to which the speaker's ID belongs (or corresponds) is generally located above the textview to which the speech text belongs.

[0049] Accordingly, the above text merging process may include: the electronic device merging the second speech text in the text component in the second item into the text component in the first item, and deleting the second item.

[0050] In one possible design, the speaker identifier corresponding to the first speech text is different from the speaker identifier corresponding to the second speech text. In the event of a voiceprint recognition error, the second speech text is actually the speech content of the speaker corresponding to the first speech text. By merging the second speech text into the first speech text, the speaker can make corrections and ensure the accuracy of the text.

[0051] In one possible design, the second recording card may further include fourth speech information, the fourth speech information including a fourth speech text, the speech time corresponding to the fourth speech information being between the speech time corresponding to the first speech information and the speech time corresponding to the second speech information; the first speech text and the second speech text correspond to a first speaker identifier; and the speaker identifier corresponding to the fourth speech text is different from the first speaker identifier.

[0052] In order to integrate the speech information of the same speaker, the electronic device may first filter out the speech information of the speaker and then merge the speech information across rows. Specifically, the electronic device may receive a third operation on the second recording card, and the third operation is used to trigger the electronic device to display the speech information corresponding to the first speaker identifier in the multiple speech information;

[0053] In response to the third operation, the electronic device displays the sixth recording card, which includes all speech information corresponding to the first speaker identifier, but does not include the fourth speech information. That is, the electronic device stops displaying speech information on the second recording card except the speech information corresponding to the first speaker identifier, thereby realizing the screening of speech information.

[0054] Correspondingly, after receiving the deletion operation, the electronic device may update the sixth recording card to the fourth recording card in response to the deletion operation, that is, merge the speech texts across lines.

[0055] Optionally, the fourth operation may be a selection operation of an option corresponding to the first speaker identifier.

[0056] In one possible design, after integrating multiple speech messages from the same speaker, the electronic device can redisplay the speech messages corresponding to all speaker identifiers. Specifically, the electronic device receives a fourth operation on a fourth recording card, where the fourth operation is used to trigger the electronic device to display all speech messages. In response to the fourth operation, the electronic device displays a seventh recording card, where the seventh recording card displays speech messages corresponding to all speaker identifiers. For example, if the seventh recording card includes the fourth speech message, and the fourth speech message is located after the third speech message, the second speech text is displayed above the fourth speech message.

[0057] In one possible design, in response to the fifth operation, the electronic device saves all currently displayed speech information based on a first target format; the first target format represents a default file format or a selected file format. All currently displayed speech information corresponds to the same speaker identifier, enabling targeted storage of the speech information.

[0058] In one possible design method, the electronic device responds to the sixth operation, and the electronic device shares all the currently displayed speech information with the application of the electronic device based on the second target format; the second target format represents a default file format or a selected file format, wherein all the currently displayed speech information corresponds to the same speaker identifier, thereby realizing targeted sharing of speech information.

[0059] In one possible design, the speech information obtained during the recording is saved in a target data list file. When performing a cross-text merge, the electronic device can also merge the second speech text in the target data list file into the first speech text and delete the second speech information. Specifically, the target data list file includes multiple records, each of the multiple records corresponds to a speech information, that is, the content of the speech information is stored through records; each record includes a speech text corresponding to a speech text field (or called a column name). Accordingly, after receiving a delete operation input by the user, the electronic device can respond to the delete operation by merging the second speech text corresponding to the speech text field in the second record in the target data list into the first speech text corresponding to the speech text field in the first record; the first record corresponds to the first speech information, and the second record corresponds to the second speech information.

[0060] In a third aspect, the present application provides a voice processing method, wherein the electronic device displays a first interface of a first note in a note-taking application, the first interface includes a first recording card, and the first recording card includes a first control; the first control is used to trigger the stop of recording;

[0061] When the electronic device displays a first interface of a first note in a note-taking application, the electronic device converts the acquired latest voice data into corresponding latest speech information, wherein the first interface includes a first recording card, and the first recording card includes a first control; the first control is used to trigger stopping recording;

[0062] The electronic device displays the latest speech information in the first recording card;

[0063] In response to a triggering operation on the first control, the electronic device displays a second interface of the first note, the second interface including a second recording card; wherein the second recording card includes first speech information, second speech information, and a second control; the first speech information includes first speech text, and the second speech information includes second speech text; the speech time corresponding to the first speech information is earlier than the speech time corresponding to the second speech information, and the first speech information and the second speech information are displayed adjacent to each other; the second control is used to trigger recording;

[0064] In response to a seventh operation on the second speech text (such as clicking the second speech text), displaying a merge control;

[0065] In response to the user's click operation on the merge control, the electronic device updates the second recording card to a fourth recording card. In the fourth recording card, the second speech text and the first speech text are merged into the third speech information, and the second speech information is deleted; the speaker identifier corresponding to the third speech information is the same as the speaker identifier corresponding to the second speech text.

[0066] In a fourth aspect, the present application provides an electronic device, comprising a display screen, a memory, and one or more processors; the display screen, the memory, and the processor are coupled; the display screen is used to display an image generated by the processor, and the memory is used to store computer program code, wherein the computer program code comprises computer instructions; when the processor executes the computer instructions, the electronic device executes the speech processing method as described above.

[0067] In a fifth aspect, the present application provides a computer-readable storage medium comprising computer instructions, which, when executed on an electronic device, enables the electronic device to execute the speech processing method as described above.

[0068] In a sixth aspect, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the speech processing method as described above.

[0069] It can be understood that the beneficial effects that can be achieved by the speech processing method described in the third aspect, the electronic device described in the fourth aspect, the computer-readable storage medium described in the fifth aspect, and the computer program product described in the sixth aspect provided above can be referred to the beneficial effects in the first aspect, the second aspect and any possible design methods thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] FIG1A is a schematic diagram of an interface of a recording note provided in an embodiment of the present application;

[0071] FIG1B is a second schematic diagram of an interface for recording notes provided in an embodiment of the present application;

[0072] FIG1C is a third schematic diagram of an interface for recording notes provided in an embodiment of the present application;

[0073] FIG2A is a first diagram of an interface of a recording application provided in an embodiment of the present application;

[0074] FIG2B is a second schematic diagram of an interface of a recording application provided in an embodiment of the present application;

[0075] FIG2C is a third schematic diagram of an interface of a recording application provided in an embodiment of the present application;

[0076] FIG2D is a first diagram of an interface of a recording file provided in an embodiment of the present application;

[0077] FIG3A is a first diagram of a call recording interface provided by an embodiment of the present application;

[0078] FIG3B is a second diagram of a call recording interface provided by an embodiment of the present application;

[0079] FIG3C is a second schematic diagram of an interface of a recording file provided in an embodiment of the present application;

[0080] FIG4A is a first schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0081] FIG4B is a second schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0082] FIG4C is a third schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0083] FIG5 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0084] FIG6 is a schematic diagram of a software framework of an electronic device provided in an embodiment of the present application;

[0085] FIG7 is a flowchart of a speech processing method according to an embodiment of the present application;

[0086] FIG8A is a fourth schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0087] FIG8B is a fifth diagram of a speech-to-text interface provided in an embodiment of the present application;

[0088] FIG8C is a sixth schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0089] FIG8D is a seventh schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0090] FIG8E is a schematic diagram of an eighth speech-to-text interface provided in an embodiment of the present application;

[0091] FIG8F is a ninth diagram of a speech-to-text interface provided in an embodiment of the present application;

[0092] FIG9A is a first schematic diagram of a display interface of a note-taking application provided in an embodiment of the present application;

[0093] FIG9B is a second schematic diagram of a display interface of a note-taking application provided in an embodiment of the present application;

[0094] FIG10A is a schematic diagram of an interface layout provided in an embodiment of the present application;

[0095] FIG10B is a second schematic diagram of an interface layout provided in an embodiment of the present application;

[0096] FIG10C is a third schematic diagram of an interface layout provided in an embodiment of the present application;

[0097] FIG11A is a first editing diagram provided in an embodiment of the present application;

[0098] FIG11B is a second editing diagram provided in an embodiment of the present application;

[0099] FIG12 is a schematic diagram of an editing process according to an embodiment of the present application;

[0100] FIG13 is a second schematic diagram of an editing process provided in an embodiment of the present application;

[0101] FIG14 is a schematic diagram of a linked playback provided in an embodiment of the present application;

[0102] FIG15A is a third schematic diagram of an editing process provided in an embodiment of the present application;

[0103] FIG15B is a fourth schematic diagram of an editing process provided in an embodiment of the present application;

[0104] FIG15C is a fifth schematic diagram of an editing process provided in an embodiment of the present application;

[0105] FIG15D is a sixth schematic diagram of an editing process provided in an embodiment of the present application;

[0106] FIG15E is a seventh schematic diagram of an editing process provided in an embodiment of the present application;

[0107] FIG15F is an eighth schematic diagram of an editing process provided in an embodiment of the present application;

[0108] FIG16A is a first schematic diagram of displaying speech information provided by an embodiment of the present application;

[0109] FIG16B is a second schematic diagram of displaying speech information provided in an embodiment of the present application;

[0110] FIG17A is a first long press diagram provided in an embodiment of the present application;

[0111] FIG17B is a second long press diagram provided in an embodiment of the present application;

[0112] FIG17C is a schematic diagram of a selection provided in an embodiment of the present application;

[0113] FIG17D is a schematic diagram of a layout replacement provided in an embodiment of the present application;

[0114] FIG17E is a schematic diagram showing a function control display according to an embodiment of the present application;

[0115] FIG18A is a first screening diagram provided in an embodiment of the present application;

[0116] FIG18B is a second screening schematic diagram provided in an embodiment of the present application;

[0117] FIG18C is a third screening diagram provided in an embodiment of the present application;

[0118] FIG19A is a first schematic diagram of a text saving interface provided in an embodiment of the present application;

[0119] FIG19B is a second schematic diagram of a text saving interface provided in an embodiment of the present application;

[0120] FIG19C is a third diagram of a text saving interface provided in an embodiment of the present application;

[0121] FIG19D is a fourth diagram of a text saving interface provided in an embodiment of the present application;

[0122] FIG19E is a first diagram of a text sharing interface provided in an embodiment of the present application;

[0123] FIG19F is a second diagram of a text sharing interface provided in an embodiment of the present application;

[0124] FIG19G is a third diagram of a text sharing interface provided in an embodiment of the present application;

[0125] FIG19H is a fifth diagram of a text saving interface provided in an embodiment of the present application;

[0126] FIG20 is a second flow chart of a voice processing method provided in an embodiment of the present application;

[0127] FIG21 is a first schematic diagram of a speech processing process provided by an embodiment of the present application;

[0128] FIG22 is a third flow chart of a voice processing method provided in an embodiment of the present application;

[0129] FIG23A is a first schematic diagram of a delete control provided in an embodiment of the present application;

[0130] FIG23B is a second schematic diagram of a delete control provided in an embodiment of the present application;

[0131] FIG23C is a third schematic diagram of a delete control provided in an embodiment of the present application;

[0132] FIG23D is a first diagram of a text processing interface provided by an embodiment of the present application;

[0133] FIG24 is a second diagram of a text processing interface provided by an embodiment of the present application;

[0134] FIG25A is a third diagram of a text processing interface provided by an embodiment of the present application;

[0135] FIG25B is a fourth diagram of a text processing interface provided by an embodiment of the present application;

[0136] FIG26 is a schematic diagram of a prompt interface provided in an embodiment of the present application;

[0137] FIG27 is a fifth diagram of a text processing interface provided by an embodiment of the present application;

[0138] FIG28A is a sixth diagram of a text processing interface provided by an embodiment of the present application;

[0139] FIG28B is a seventh diagram of a text processing interface provided by an embodiment of the present application;

[0140] FIG28C is a diagram eight of a text processing interface provided by an embodiment of the present application;

[0141] FIG29A is a ninth diagram of a text processing interface provided by an embodiment of the present application;

[0142] FIG29B is a diagram 10 of a text processing interface provided by an embodiment of the present application;

[0143] FIG29C is a diagram 11 of a text processing interface provided by an embodiment of the present application;

[0144] FIG30 is a diagram 12 of a text processing interface provided by an embodiment of the present application;

[0145] FIG31A is a thirteenth diagram of a text processing interface provided in an embodiment of the present application;

[0146] FIG31B is a fourteenth diagram of a text processing interface provided by an embodiment of the present application;

[0147] FIG32A is a sixth diagram of a text saving interface provided in an embodiment of the present application;

[0148] FIG32B is a seventh diagram of a text saving interface provided in an embodiment of the present application;

[0149] FIG32C is a diagram eight of a text saving interface provided in an embodiment of the present application;

[0150] FIG32D is a ninth diagram of a text saving interface provided in an embodiment of the present application;

[0151] FIG32E is a fourth diagram of a text sharing interface provided in an embodiment of the present application;

[0152] FIG32F is a fifth diagram of a text sharing interface provided in an embodiment of the present application;

[0153] FIG32G is a sixth diagram of a text sharing interface provided in an embodiment of the present application;

[0154] FIG32H is a diagram 10 of a text saving interface provided in an embodiment of the present application;

[0155] FIG33 is a fourth flow chart of a voice processing method provided in an embodiment of the present application;

[0156] FIG34 is a schematic diagram of data storage and display provided in an embodiment of the present application;

[0157] FIG35 is a schematic diagram of data storage provided by an embodiment of the present application;

[0158] Figure 36 is a second schematic diagram of a speech processing process provided in an embodiment of the present application. DETAILED DESCRIPTION

[0159] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0160] Electronic devices (such as tablet computers) generally provide a recording function. Users can use the tablet computer's recording function to record audio. For example, a tablet computer can support the recording note function. When a user takes a note using the tablet computer's note application, they can add an audio recording to the note, that is, add an audio recording card. For example, a user clicks the start recording control 11 on the first note interface 10 shown in FIG1A . In response to the click of the start recording control 10 , the tablet computer starts recording and displays the second note interface 12 shown in FIG1B . The tablet computer receives a click of the pause recording control (or stop recording control) 13 on the second note interface 12 , indicating that the user wants to stop recording. In response to the click of the pause recording control 13 , the tablet computer stops recording and displays the third note interface 14 shown in FIG1C . Compared to the recording duration displayed in the first note interface 10 (i.e., 03:10), the recording duration displayed in the third note interface 14 is longer (i.e., 04:10). The third note interface 14 may also include controls such as a recording playback control 15 , which can be used to trigger the tablet computer to play the recording.

[0161] For another example, the tablet computer also includes a recording application, so that the user can record through the recording application. For example, the user clicks the recording application icon 20 as shown in Figure 2A. In response to the click operation of the recording application icon 20, the tablet computer starts the recording application and displays the interface 21 as shown in Figure 2B. The recording interface includes a start recording control 22, which can be used to trigger the tablet computer to start recording. Later, when the user wants to record, the user can click the start recording control 22. In response to the click operation of the start recording control 22, the tablet computer can start recording and display the interface 23 as shown in Figure 2C, which includes a stop recording control 24 and a recording time prompt information 25. The stop recording control 24 can be used to trigger the tablet computer to stop recording, and the recording time prompt information indicates the time of recording. Later, when the user wants to stop recording, the user can click the stop recording control 24. In response to the click operation of the stop recording control 24, the tablet computer can stop recording and generate a corresponding voice file (voice file 1 as shown in Figure 2D).

[0162] For another example, during a call, the tablet computer supports the call recording function, that is, the user can use the recording function provided by the tablet computer to record the call content. The user can click the start recording control 30 as shown in Figure 3A. In response to the click operation of the start recording control 30, the tablet computer can start recording and display the stop recording control 31 as shown in Figure 3B. When the user wants to stop recording the call content, the user can click the stop recording control 31. In response to the click operation of the stop recording control 31, the tablet computer can stop recording and generate a corresponding voice file (voice file 3 as shown in Figure 3C). Alternatively, when the call ends, the tablet computer can automatically end recording and generate a corresponding recording file without the user manually stopping recording.

[0163] It should be noted that the above-mentioned start recording control 11 and the above-mentioned pause recording control 13 can be different controls or the same control. Specifically, when the tablet computer is recording, the control is in the recording-on state, and the control can be used as the pause recording control 13. After receiving the user's click operation on the pause recording control 13, the tablet computer can stop recording, and the control is in the recording-stop state, and the control can be used as the start recording control 11. Similarly, the above-mentioned start recording control 22 and the above-mentioned stop recording control 24 can be different controls or the same control. The above-mentioned start recording control 30 and the above-mentioned stop recording control 31 can also be different controls, or can be the same control, and this application does not limit them.

[0164] In some embodiments, the electronic device also supports a service for converting voice files to text. For example, when a user clicks on a voice file 3 as shown in FIG4A , the electronic device starts playing the voice file 3 and displays an interface as shown in FIG4B , which provides a text conversion control 40 . The text conversion control 40 is used to trigger the electronic device to convert the voice file (or recording file) into text. After the electronic device receives a trigger operation (such as a click operation) of the text conversion control 40 , the electronic device can convert the voice file 3 into text. After the conversion is successful, the electronic device can display an interface as shown in FIG4C , which displays a speaker identifier (such as Speaker 1, Speaker 2) and its corresponding speech text, speech time, and other speech information. The speech text represents the content of the speaker's speech, which is obtained by converting the voice file (such as "The weather is great today, shall we go to the park together?" as shown in FIG4C ), and the speech time corresponding to the speech text represents the time when the speech content was spoken (such as 00:00, 00:20, etc. as shown in FIG4C ).

[0165] However, the user may also have other usage requirements, such as selecting speech information across lines (or across segments). For example, if the user wants to process multiple consecutive speech messages at the same time, such as if the user wants to copy or share the contents of speech information 41 and speech information 42 shown in Figure 4C above at the same time, then the user needs to select speech information 41 and speech information 42 at the same time first, so that the tablet computer can copy or share the selected speech information 41 and speech information 42. For another example, if the user wants to process different types of information located in different segments in a speech message, such as if the user wants to copy, share, or search the speaker identifier and speech text in the speech information 43 shown in Figure 4C above, then the user needs to select the speaker identifier and speech text in the speech information 43 at the same time first, so that the tablet computer can copy, share, or search the speaker identifier and speech text in the selected speech information 43. Alternatively, however, the user may also have other usage requirements, such as the need to edit speech text across lines (or across segments), that is, to merge the next speech text into the previous speech text. For example, since the speech-to-text service has the probability of conversion errors (such as voiceprint recognition errors), the speech content of one speaker may be identified as the speech content of another person. For example, the speech text 44 of speaker 1 shown in Figure 4C is actually the speech content of speaker 2. In order to improve the accuracy of the text, the user wants to merge the speech text 44 of speaker 1 into the previous speech text, that is, to become the speech content of speaker 2. For another example, the user believes that there is a correlation between the two adjacent speech texts of speaker 1 and wants to merge the two adjacent speech texts into one speech text. For example, the user wants to merge the speech text 45 of speaker 1 into the speech text 46 of speaker 1. For another example, the user wants to integrate the speech texts of one speaker together and then display the speech content of other speakers. For example, the user wants to integrate the speech text 44 of speaker 1 and the speech text 46 of speaker 1 shown in Figure 4C together, and then display the speech information of speaker 2.

[0166] Therefore, in order to meet more user needs, the electronic device provides a voice processing method. During recording, after receiving the latest voice data, the electronic device performs text conversion and displays the latest speech information corresponding to the latest voice data. The electronic device also displays historical speech information, which is the speech information corresponding to the voice data received from the beginning of this recording to the receipt of the latest voice data. That is to say, the electronic device displays the speech information corresponding to all voice data obtained in the recording during recording. After receiving the long press operation input by the user, the electronic device obtains the starting position (such as the position where the user's finger falls) and the ending position (such as the position where the user's finger leaves) corresponding to the long press operation. Afterwards, the electronic device splices all the speech information displayed to obtain a spliced ​​character string. Afterwards, the electronic device determines the target character area based on the starting position and the ending position corresponding to the long press operation, combined with the spliced ​​character string. The target character area represents the selected character corresponding to the long press operation.

[0167] The electronic device then displays the concatenated string in plain text and selects the characters in the target character area. Because the concatenated string, or the concatenated speech information, is plain text, the electronic device can simultaneously select speech information in different segments, such as information in multiple consecutive speech messages, or different types of information in different segments within a single speech message, enabling cross-segment selection of speech information.

[0168] Afterwards, the electronic device can display function controls so that users can select function controls according to their usage needs. The electronic device performs corresponding processing based on the function controls selected by the user, such as sharing, searching, copying and other operations, providing users with rich services, meeting users' usage needs and improving user experience.

[0169] or,

[0170] After converting received voice data into text in real time, the electronic device displays the converted speech information. When a user wishes to merge the speech text (i.e., speech text 1) in a speech information into the speech text (i.e., speech text 2) in the previous speech information displayed adjacent to the speech information, the user can perform a first operation on speech text 1. In response to the first operation, the electronic device displays the cursor at the beginning of the line of speech text 1. Subsequently, if a delete operation is received for speech text 1, indicating that the electronic device needs to perform cross-segment editing, i.e., it needs to merge speech text 1 into the previous speech text (i.e., speech text 2) of speech text 1, the electronic device can add speech text 1 to speech text 2 to obtain an updated speech text 2, and delete speech text 1. The electronic device can then display the updated speech text 2 instead of speech text 1, thus achieving cross-line merging of speech texts. Furthermore, when a speaker recognition error occurs, the user believes that two adjacent speech texts are related, or the user wants to integrate speech texts from the same speaker, the electronic device can achieve this by merging speech texts, providing users with rich services, meeting their usage needs, and improving the user experience.

[0171] For example, the electronic device in the embodiments of the present application may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR) or virtual reality (VR) device, and other electronic devices with a recording function. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0172] 5 shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195.

[0173] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0174] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0175] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0176] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0177] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0178] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0179] The charging management module 140 is configured to receive charging input from a charger. While charging the battery 142 , the charging management module 140 can also provide power to the electronic device through the power management module 141 .

[0180] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0181] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0182] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0183] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0184] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0185] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0186] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0187] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0188] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0189] The ISP is used to process data fed back by the camera 193 .

[0190] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0191] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0192] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0193] NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn.

[0194] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0195] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0196] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0197] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0198] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0199] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0200] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0201] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0202] Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0203] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0204] The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0205] The SIM card interface 195 is used to connect a SIM card.

[0206] The software system of the electronic device 200 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. TM Taking the system as an example, the software structure of the electronic device 200 is exemplified.

[0207] FIG6 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.

[0208] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0209] The application layer can include a series of application packages.

[0210] As shown in FIG6 , the application package may include applications such as camera, note, call, recording, WLAN, short message, gallery, etc.

[0211] Among them, the above-mentioned note application can provide an interface for user operation, and the interface can have a toolbar control panel, a sliding component (such as recycleview) and a text component (such as textview, EditTextView). Among them, the toolbar control panel can be a control for user operation, and the user can trigger the electronic device to perform relevant operations by triggering relevant controls. The text component can be laid out on the sliding component, and the text component can be used to display speech information. Among them, each item in the sliding component carries a speech information, and each item can include a text component to carry the information in its corresponding speech information.

[0212] Exemplarily, the note application may include a note recording module, a note speaker display module, a note data management module, and a text-to-text engine.

[0213] The text-to-text engine is used to send the voice data or voice text obtained from the recording to the cloud, so that the cloud can convert the voice data or voice text into text.

[0214] The recording module is used to obtain the voice data obtained by recording.

[0215] The note speaker display module is used to display the note application interface, such as a recording card. This recording card can include the aforementioned toolbar control panel, slider component, and text component. The toolbar control panel can be a tool control in the recording card, which is used to trigger the tablet computer to perform corresponding operations, such as recording, stopping recording, text conversion, displaying speaker status switching, exporting, sharing, and filtering speakers. The recording card may also include speech information.

[0216] The note data management module is used to store speech information in a preset storage location.

[0217] It should be understood that the above-mentioned note recording module, note speaker display module, note data management module, and text-to-text engine may be internal implementations of the note application, wherein the text-to-text engine is a software development kit (SDK).

[0218] Applications (such as note-taking, call, and recording applications) can use the Data Manager module to operate on the data in the database, such as adding, deleting, modifying, and querying. In other words, the Data Manager module can be used to manage the data in the database (such as the save path of the voice file or the data list file corresponding to the voice file).

[0219] Applications can display backend data on frontend controls by using data adapters. That is, data adapters are adapter interfaces that connect backend data and frontend display, establish an adaptation relationship between the data source and RecycleView, and convert the data source into a data format that can be displayed by RecycleView.

[0220] It should be understood that the above-mentioned data management module and data adapter may be internal implementations of the application.

[0221] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0222] As shown in FIG6 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0223] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0224] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0225] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0226] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0227] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0228] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0229] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0230] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0231] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0232] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0233] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0234] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0235] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0236] A 2D graphics engine is a drawing engine for 2D drawings.

[0237] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0238] It is understood that the layers in the structure shown in FIG6 and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the structure may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0239] The present application provides a voice processing method. After starting recording, the electronic device can convert voice data into text in real time. After receiving a click operation on the speech information input by the user, the electronic device can determine the user's usage intention based on the click position corresponding to the click operation and whether the electronic device is playing the recording, thereby entering the editing state according to the user's usage intention to meet the user's editing needs for the speech information, or performing linked playback of the recording to achieve accurate playback of the recording. After receiving a long press operation on different types of speech information located in different rows input by the user, all speech information displayed on the interface is displayed in plain text, and the user-selected characters in the speech information displayed in plain text are selected and set to meet the user's usage needs of selecting speech information across segments, so that the electronic device can process the speech information of different rows selected at the same time and provide rich text services. Among them, the voice data can be the recording in the recording note scenario introduced above, the recording in the recording application scenario, the recording in the call recording scenario (or called a voice file), etc. Of course, the voice data can also be other recording data generated in one scene.

[0240] The following will take the electronic device being a tablet computer and the application scenario being a recording and note-taking scenario, that is, a note-taking application, as an example, and describe in detail a speech processing method provided by an embodiment of the present application in conjunction with the accompanying drawings. As shown in FIG7 , the method may include steps S301 to S323.

[0241] S301. During the recording process, the tablet computer receives the latest voice data.

[0242] S302: The tablet computer converts the latest voice data into text to obtain the latest speech information.

[0243] Among them, the above-mentioned latest speech information includes the latest speaker identifier, and the latest speech text corresponding to the latest speaker identifier, the latest speech start time and the latest speech start time. The latest speech text includes at least one character, which can be a text, punctuation mark, letter, etc. The latest speech start time indicates the time when the speaker starts speaking. For example, a speech information includes speaker 1, 00:40 and "Do you bring fruit?" Among them, speaker 1 is the speaker identifier, 00:40 is the speech start time (or called speech time), and "Do you bring fruit?" is the speech text. Accordingly, the speech information indicates the speaker's speech at 00:40, and the content of the speech is "Do you bring fruit?"

[0244] In an embodiment of the present application, the above-mentioned text conversion may include speech recognition and voiceprint recognition. In the process of editing notes (such as the first note), the tablet computer can record according to the user's needs. During the recording, after the tablet computer receives the speaker's voice data (such as the latest voice data), it performs speech recognition on the latest voice data to convert the voice into text and obtain the latest speech text. In addition, in order to better enable users to intuitively understand the speeches of different speakers, the tablet computer can perform voiceprint recognition on the voice data to distinguish the speeches of different speakers, thereby obtaining the latest speaker identification corresponding to the latest speech text. Of course, the tablet computer can also request the server to perform speech recognition and voiceprint recognition on the above-mentioned voice data, and the embodiment of the present application does not impose any restrictions on this.

[0245] In some embodiments, after receiving the speech information, the tablet computer may save the speech information in a preset storage location (e.g., a database (DB) or other location capable of storing data). For example, the storage format of a speech information may be as shown in Table 1. Here, Offset represents the start time of the speech, Content represents the speech text, Speaker represents the speaker identifier, and Duration represents the duration.

[0246] Table 1

[0247] The duration indicates the duration of the continuous speech of the speaker corresponding to the speaker ID. The transcribed text content can also be called the speech text.

[0248] In some embodiments, the information included in the latest speech information introduced above is only an example. The content included in the latest speech information can be set according to actual needs. For example, the latest speech information can include the speaker identification and speech text, but not the speech start time and duration.

[0249] S303: The tablet computer displays the latest speech text on interface 1. Interface 1 also displays historical speech texts.

[0250] The historical speech text is obtained based on the voice data received before the latest voice data.

[0251] In an embodiment of the present application, after receiving the latest speech information, the tablet computer can display the latest speech text in the latest speech information on interface 1 (or the first interface). Interface 1 (i.e., the recording card displayed on interface 1, such as the first recording card) displays all speech texts obtained during the recording period, achieving real-time conversion and display of speech content. The speech text corresponding to different speaker identifiers is displayed in segments. For example, during the recording period, the tablet computer first receives "today" spoken by speaker 1. This "today" is the latest voice data, and "today" is displayed on interface 1 (as shown in Figure 8A). Later, the tablet computer receives "day" spoken by speaker 1 and displays "day" on interface 1 (as shown in Figure 8B). Here, "today" shown in Figure 8A can be considered as historical speech text, and "day" shown in Figure 8B can be considered as the latest speech text. As the recording time increases, the tablet computer converts the received voice data into text and displays it on interface 1 (as shown in Figure 8C, "The weather is great today, shall we go to the park together?"). Later, the tablet computer receives the latest voice data, such as "yes." The tablet computer converts the most detailed voice data into text and obtains the latest speech text "Yes". It also recognizes that the speaker ID corresponding to the latest speech text is Speaker 2. The tablet computer can then display the latest speech text "Yes" after Speaker 1's speech text (as shown in FIG8D ). Here, "The weather is nice today, shall we go to the park together?" shown in FIG8D can be considered as the historical speech text, and "Yes" is the latest speech text.

[0252] It should be understood that the above-described tablet computer displaying one character at a time is only an example of real-time display of speech text. The tablet computer can also display multiple characters at a time, and this application is not limited thereto.

[0253] In some embodiments, if the speech start time corresponding to the latest speech text differs significantly from the speech start time corresponding to the previous speech text, the latest speech text may not be merged into the previous speech text, regardless of whether the speaker identifier corresponding to the latest speech text and the speaker identifier corresponding to the previous speech text are the same. Of course, if the speaker identifier corresponding to the latest speech text and the speaker identifier corresponding to the previous speech text are the same, the tablet computer may directly merge the latest speech text into the previous speech text.

[0254] In some embodiments, the speech texts displayed in the interface 1 are arranged in order of speech start time from earliest to latest. For example, as shown in FIG8D , the speech start time corresponding to “It’s a nice day today, shall we go to the park together?” is earlier than the speech start time corresponding to “Yes”.

[0255] In some embodiments, the interface 1 may display not only the speech text but also first information corresponding to the speech text, including a speaker identifier and / or a speech start time. For example, as shown in FIG8E , the interface 1 displays the speech text, the speaker identifier, and the speech start time, where 00:00, 00:20, 00:40, and 00:44 in FIG8E are all speech start times, and Speaker 1 and Speaker 2 are both speaker identifiers.

[0256] Optionally, if the tablet computer is not in the speaker display state (i.e., the control for displaying the speaker is not selected), the tablet computer may only display the speech text in the speech information, without displaying the first information in the speech information. If the tablet computer is in the speaker display state (i.e., the control for displaying the speaker is selected), the tablet computer may display not only the speech text but also the first information such as the speaker identification and / or the speech start time (as shown in FIG. 8E above, the tablet computer displays the speech text, the speaker identification, and the speech start time).

[0257] In some embodiments, the tablet computer may not automatically display the speech content in real time, but instead, after receiving operation a input by the user, in response to operation a, convert the voice data recorded before and / or after receiving operation a into text. For example, the tablet computer may display an interface 50 as shown in FIG8F , which includes a control 51 that can trigger the tablet computer to convert the voice data in the note into text. When the user wants to display the speech content corresponding to the voice data in text, the user can click the control 51 shown in FIG8F above. Here, the click operation of the control 51 is the above-mentioned operation a.

[0258] Of course, the operation a described above is only an example. Operation a can also be other types of operations. For example, the above operation a can be a user inputting a first preset gesture on a relevant interface, such as inputting an S-shaped gesture on the above interface 50. The first preset gesture is used to trigger the tablet computer to convert voice data (or voice files) into text. The first preset gesture can be pre-configured in the tablet computer. In addition, the tablet computer can prompt the user on the relevant interface of the function triggered by the first preset gesture.

[0259] In the embodiment of the present application, when displaying speech information, the tablet computer differentiates and displays it according to different speakers, and the speech information of different speakers is located in different sections, intuitively showing the speech status of different speakers.

[0260] S304: The tablet computer receives an operation to stop recording.

[0261] The stop recording operation can trigger the tablet computer to stop recording, that is, to stop receiving voice data. Exemplarily, the stop recording operation can include a user clicking a stop recording control on the interface 1 (such as the stop recording control 30 shown in FIG8A ). Of course, the stop recording operation can also be other types of operations, as long as it can trigger the tablet computer to stop recording, and this application is not limited thereto.

[0262] S305: In response to the stop recording operation, the tablet computer stops recording and displays Interface 2, where Interface 2 displays the speech text, playback controls, and a progress bar.

[0263] The speech text displayed on Interface 2 (or the second interface) includes all speech text obtained during the current recording. The play control can trigger the tablet computer to play the voice data recorded during the recording. The progress bar can display the recording playback progress when the tablet computer is in the playback state. The playback state indicates that the tablet computer is playing the recording, that is, the state of playing the voice data recorded during the recording.

[0264] In some embodiments, when the tablet computer is not in the speaker display state, the above-mentioned interface 2 displays the speech text in the speech information without displaying other information in the speech information, such as the speaker identification and the speech start time, as shown in Figure 9A. The interface shown in Figure 9A (i.e., interface 2) displays a play control 53 and a progress bar 54. In addition, the second interface may also include a control for starting recording.

[0265] When the tablet computer is in the speaker display mode, the aforementioned interface 2 displays not only the speech text in the speech information but also the first information in the speech information, which includes the speaker ID and / or the speech start time. If the first information includes the speaker ID and the speech start time, the tablet computer displays the playback controls 53, progress bar 54, speech text, speech start time, and speaker ID on interface 2 as shown in FIG9B .

[0266] S306: The tablet computer receives operation 1, where operation 1 is used to trigger switching to displaying the speaker state.

[0267] In some embodiments, when the tablet computer is in a state of displaying a speaker, if the user receives a click operation on the tablet computer's interface display to stop displaying a speaker control, the tablet computer can respond to the click operation by stopping being in a state of displaying a speaker, that is, only displaying the speech text in the speech information, and canceling the display of information other than the speech text in the speech information, such as canceling the display of the first information and only displaying the speech text (as shown in Figure 9A above).

[0268] When the tablet computer is not in the display speaker state, upon receiving a user click operation on the display speaker control displayed on the tablet computer interface (such as interface 1 or interface 2 described above), the tablet computer can, in response to the click operation, switch to the display speaker state, that is, display not only the speech text but also the first information (as shown in FIG. 9B ), thereby switching to the speaker state. Here, the user click operation on the display speaker control is operation 1.

[0269] It should be noted that the above-mentioned stop display speaker control and the above-mentioned display speaker control can be different controls or the same control. Specifically, the tablet computer only displays the speech text in the speech information, and the control is in the display speaker state. The control can be used as a stop display speaker control, such as the display speaker control shown in Figure 9A above is in the stop display speaker state (i.e., not selected), and the control can be used as a display speaker control. The tablet computer displays the speech text and the first information of the speech information, and the control is in the display speaker state (i.e., selected), and the control can be used as a stop display speaker control. Such as the display speaker control shown in Figure 9B above is in the display speaker state, and the control can be used as a stop display speaker control.

[0270] S307: In response to operation 1, the tablet computer displays interface 3. Interface 3 displays the speech text, the first information, a playback control, and a progress bar. The first information includes the speaker identifier and / or the speech start time.

[0271] In some embodiments, when the tablet computer is in the speaker display state, it receives a stop recording operation. The tablet computer does not need to receive operation 1 to display the above-mentioned interface 3. Instead, it can directly display interface 3 in response to the stop recording operation. That is, the above-mentioned interface 2 can be used as interface 3.

[0272] For the convenience of description, the above-mentioned first information is limited to the first information including the speaker identification and the speech start time. Accordingly, when the tablet computer is in the speaker display state, the displayed speech information includes the speech text, the speech start time and the speaker identification. However, it should be understood that the first information including the speaker identification and the speech start time is only a limitation for the convenience of description. The first information only needs to include at least one of the speaker identification and the speech start time.

[0273] In some embodiments, the multiple speech information (i.e., speech text and first information) displayed in the above interface 3 can be carried by the RecycleView component. Among them, a speech information (i.e., speech text and first information) is an item (or called an Adapter item) of the RecycleView component. The layout style of this item can be as shown in Figure 10A, including two sub-layouts, one sub-layout is a linear layout control (LinearLayout), and the other sub-layout is an edit box (EditText).

[0274] Among them, the child controls (such as textview) in LinearLayout will be arranged in a horizontal or vertical manner. The child controls in this application are arranged in a horizontal manner. The child controls are used to carry the first information, such as one child control carries the speaker ID, and another child control carries the speech start time. The speech start time and the speaker ID are located in the same row (or the same section) and arranged in a horizontal manner (as shown in Figure 10C). Optionally, the speech start time and the speaker ID can be carried by other types of view components (such as textview).

[0275] EditText carries the speech text (as shown in FIG10C ). Optionally, the speech text can also be carried by a textview.

[0276] In some embodiments, each item of the above-mentioned recycleview component can also include a speaker avatar, which can be displayed on the left side of the speech start time. The speaker avatar can be carried by imgview, that is, the LinearLayout of the item can also include a child control corresponding to the speaker avatar, as shown in Figure 10B.

[0277] S308: The tablet computer receives a click operation input by the user.

[0278] S309: In response to the above click operation, the tablet computer obtains a click position corresponding to the click operation.

[0279] In an embodiment of the present application, when the tablet computer receives a click operation from the user on the speech information on interface 3, the tablet computer obtains the click position corresponding to the click operation, that is, obtains the position where the user's finger falls, so that the tablet computer can use the click position to determine the user's usage intention.

[0280] S310: When the click position is on the speech text, the tablet computer determines whether it is in a playing state.

[0281] Exemplarily, the play state indicates that the tablet computer is in a state of playing voice data. When the tablet computer is at a speech text when clicked, it indicates that the user has clicked on the speech text, and the tablet computer can determine whether the tablet computer is in the play state to determine the user's usage intention. Simply put, the tablet computer determines whether the user wants to edit the clicked speech text or displays the time corresponding to the clicked speech text by judging whether the tablet computer is in the play state. Specifically, when the tablet computer is not in the play state, it indicates that the tablet computer is not currently playing a recording, and the possibility that the user wants to edit the clicked speech text is high, and the tablet computer can execute S311. When the tablet computer is in the play state, it indicates that the tablet computer is currently playing a recording, and the possibility that the user wants the tablet computer to play the voice data corresponding to the clicked speech text is high, and the tablet computer can execute S312.

[0282] It should be noted that the tablet computer may be connected to an external mouse, so the above-mentioned click position may be the position where the mouse is clicked.

[0283] S311. The tablet computer enters the editing state.

[0284] In an embodiment of the present application, after the tablet computer enters the editing state, it can receive user input for editing operations on the clicked speech text (or referred to as the first target speech text). In response to the user's editing operations on the first target speech text, such as deletion, modification, adding characters, etc., the first target speech text is processed accordingly. Exemplarily, when the tablet computer is not in the playback state, it displays a virtual keyboard as shown in Figure 11A so that the user can use the virtual keyboard to edit the speech text. In addition, the tablet computer can be connected to an external keyboard (as shown in Figure 11B). The tablet computer can enter the editing state without displaying the virtual keyboard.

[0285] In some embodiments, the tablet computer entering the editing state may include the tablet computer moving the cursor to the click position (the position of the cursor shown in Figure 11A or Figure 11B above is the position of the click operation input by the user), or moving to any character in the first target speech text. This application does not limit it.

[0286] In some embodiments, the tablet computer processes the first target speech text (or the original speech text) in response to a user's editing operation on the first target speech text, obtains the processed speech text, and displays the processed speech text. Among them, the content of the first target speech text in the above-mentioned preset storage location is also the processed speech text. For example, assume that the speech text 1 is "Sure, do I need to bring anything?" The user clicks on the speech text 1 (as shown in (a) of FIG. 12), and this speech text 1 is the first target speech text. In response to the click operation on the speech text 1, when not in the playing state, the tablet computer displays a virtual keyboard (as shown in (b) of FIG. 12). Then, the user deletes the word "Sure" in the speech text 1 through the virtual keyboard, that is, inputs a deletion operation (such as clicking the deletion key shown in (b) of FIG. 12 above). In response to this deletion operation, the tablet computer deletes the word "Sure", and the processed speech text 1 becomes "do I need to bring anything?". The tablet computer can display this processed speech text 1 instead of the original speech text 1 (as shown in (c) of FIG. 12). Correspondingly, the tablet computer will also delete the word "Sure" in the speech text 1 in the preset storage location. As shown in (a) of FIG. 13, "Sure, do I need to bring anything?" is the original speech text of the speech text 1, and the deleted speech text 1 can be as shown in (b) of FIG. 13.

[0287] In some embodiments, the above-mentioned preset storage location may be the target data list text shown in (a) or (b) of FIG. 13 above. The target data list file includes the above-mentioned speech information, where Speaker represents the speaker identifier, Offset represents the speech time, and Content represents the speech content.

[0288] In some embodiments, the above-mentioned database may store the above-mentioned target data list file. Correspondingly, the tablet computer can directly query the target data list file from the database to obtain the speech information corresponding to the target speaker.

[0289] In some other embodiments, the above-mentioned database may store the save path corresponding to the target data list file. Correspondingly, the tablet computer queries the save path corresponding to the target data list file from the database for querying the target data list file using this save path.

[0290] In some embodiments, the above-mentioned preset storage location (such as the above-mentioned target data list) may further include a duration.

[0291] In some embodiments, if the speech text is carried by a textview, the tablet computer can convert the textview corresponding to the first target speech text into an EditText when in a playing state, so that the user can edit the speech text in the EditText.

[0292] S312: The tablet computer calculates the speaking time corresponding to the clicked character based on the clicked position, wherein the clicked character is the character corresponding to the clicked position.

[0293] S313: The tablet computer moves the play progress of the progress bar to the speaking time, and plays the voice data corresponding to the speaking time.

[0294] In an embodiment of the present application, when the tablet computer is in a playback state, the tablet computer determines the voice data that the user wants to play based on the position of the speech text clicked by the user (i.e., the click position). The tablet computer can use the click position and the duration corresponding to the speech text corresponding to the click position (i.e., the first target speech text) to determine the offset time of the click position relative to the speech start time corresponding to the first target speech text. The duration corresponding to the first target speech text is the duration in the speech information to which the first target speech text belongs, and the speech start time corresponding to the first target speech text is the speech start time in the speech information to which the first target speech text belongs.

[0295] The tablet then calculates the sum of the speech start time and the offset time to determine the speech time corresponding to the clicked position (or first speech time), that is, the speech time corresponding to the clicked character (referred to as the clicked character). The tablet then moves the playback progress bar to the position corresponding to the speech time and plays the voice data corresponding to the speech time, that is, starting to play the voice data from the speech time, achieving linked playback of the recording and speech text, and achieving accurate playback of the voice data, allowing the user to quickly hear the voice data they need, meeting the user's voice playback needs.

[0296] In some embodiments, the specific calculation process of the offset time may include: the tablet computer may obtain the total number of all characters in the first target speech text. Then, the tablet computer may calculate the ratio of the total number of all characters to the duration corresponding to the first target speech text to obtain the speaking speed. Then, the tablet computer may count the number of characters in the first target speech text that precede the click position to obtain the number of offset characters. Then, the tablet computer may calculate the product of the number of offset characters and the speaking speed to obtain the offset time corresponding to the click position.

[0297] For example, the user clicks on "water" in "Do you bring fruit?" as shown in (a) in Figure 14. The tablet computer is in the playback state, and the tablet computer calculates that the speaking time corresponding to "water" is 00:40 and the duration is 4 seconds. Therefore, the speaking speed is 4 / 4=1 character / second, that is, 1 character is spoken per second. Afterwards, the number of characters before "water" in "Do you bring fruit?" is 1, that is, the number of offset characters is 1. Correspondingly, the offset time is 1 character / second*1=1 second. Then, the speaking time corresponding to the click operation is 00:41, and the tablet computer moves the playback progress of the progress bar to the 00:41 position (as shown in (b) in Figure 14), and starts playing the voice data from 00:41, so that the user can quickly hear the voice data at 00:41 without the user manually moving the playback progress, thereby avoiding the user manually adjusting the playback progress, resulting in inaccurate playback progress adjustment and the need for repeated movement and adjustment, and achieving fast and accurate adjustment of the playback progress to meet user usage needs.

[0298] In some embodiments, after calculating the speaking time, the tablet computer may not move the playback progress of the progress bar to the speaking time, but only play the voice data corresponding to the speaking time.

[0299] The above describes a case where the click position corresponding to the click operation is located on the speech text, that is, the user clicks the speech text. The following will continue to describe a case where the click position corresponding to the click operation is located on the first information, that is, the user clicks the first information.

[0300] S314: When the click position is in the first information, the tablet computer determines whether it is in a playing state.

[0301] In an embodiment of the present application, when the tablet computer is in a first information (such as a speaker identifier) ​​at the click position, it indicates that the user has clicked on the first information, and the tablet computer can determine whether the tablet computer is in a play state to determine the user's intention of use. Simply put, the tablet computer determines whether the user wants to edit the clicked first information by determining whether the tablet computer is in a play state, or whether the user wants the play progress of the progress bar to move to the speech start time corresponding to the first information. Specifically, when the tablet computer is not in a play state, it indicates that the tablet computer is not currently playing a recording, and the user is likely to want to edit the first information, and the tablet computer can execute S315. When the tablet computer is in a play state, it indicates that the tablet computer is currently playing a recording, and the user is likely to want the tablet computer to play the voice data corresponding to the first information, and the tablet computer can execute S316.

[0302] S315. The tablet computer displays a speaker modification control.

[0303] The speaker modification control is used to obtain a new speaker ID input by the user.

[0304] For example, generally speaking, the speech start time cannot be changed. Therefore, regardless of whether the user clicks the speaker identifier (or the original speaker identifier) ​​or the speech start time, the tablet computer, when not in the playback state, will assume that the user wants to modify the speaker identifier. The tablet computer can enter the editing state and display the speaker modification control (or rename control). The tablet computer can then obtain the new speaker identifier entered by the user in the speaker modification control and modify the first target speaker identifier (i.e., the speaker identifier in the first information clicked by the user) to the new speaker identifier.

[0305] Modifying the first target speaker identifier to the new speaker identifier may include modifying the displayed first target speaker identifier to the new speaker identifier, and / or modifying the first target speaker identifier in a preset storage location to the new speaker identifier.

[0306] For example, as shown in FIG15A , the user clicks on the speaker identifier (i.e., speaker 1) corresponding to the speech text “The weather is nice today, shall we go to the park together?”. Afterwards, in response to the click operation on speaker 1, the tablet computer displays a speaker modification control (a rename control as shown in FIG15B ) when not in the playback state. Among them, speaker 1 is the first target speaker identifier. Afterwards, the user enters Xiao Ming in the rename control (as shown in FIG15C ), that is, enters a new speaker identifier. The tablet computer can modify the speaker identifier corresponding to the displayed speech text “The weather is nice today, shall we go to the park together?” to Xiao Ming (as shown in FIG15D ), and modify the first target speaker identifier in the preset storage location to Xiao Ming.

[0307] In some embodiments, when the user wants to change the speaker identifier that is identical to the first target speaker identifier in all speech information to the above-mentioned new speaker identifier, the user can click the all modification control 70 as shown in Figure 15E above. In response to the click operation of the all modification control 70, the tablet computer changes the speaker identifier that is identical to the first target speaker identifier in all speech information to the above-mentioned new speaker identifier, such as changing the speaker identifier whose displayed value is the first target speech identifier to the new speaker identifier (as shown in Figure 15F), and changing the first target speaker identifier in the preset storage location to the new speaker identifier, thereby achieving consistent modification of the information.

[0308] In the embodiment of the present application, since there is a probability of conversion error in speech-to-text conversion, such as the probability of text conversion error, the user can edit the speech text by clicking on the speech text when the tablet is not in the playback state to correct the speech text and improve the accuracy of text conversion; speech-to-text conversion also has voiceprint recognition errors, such as recognizing the speech content of a speaker as the speech content of another person. The user can edit the speaker identifier by clicking on the speaker identifier or the speech start time when the tablet is in the playback state to modify the speaker identifier, thereby correcting the speaker identifier and improving the accuracy of text conversion. Of course, the user can also edit the speech information based on needs. The note application provides users with rich services to meet user needs and improve user experience.

[0309] S316: The tablet computer moves the playback progress bar to the target speech start time and plays the voice data corresponding to the target speech start time, wherein the target speech start time is the speech start time in the speech information corresponding to the clicked position.

[0310] In some embodiments, when the tablet computer is in the playback state, the tablet computer directly plays the voice data corresponding to the speech start time (i.e., the target speech time) in the speech information to which the user clicks the first information, that is, the voice data is played directly from the target speech start time, realizing the linkage playback of the recording and the speech text, and realizing fast and accurate playback of the voice data, so that the user can quickly hear the voice data they need, meeting the user's voice playback needs, without the user having to manually adjust the playback progress, and improving the user experience. For example, when the user clicks on the speaker 2 identifier at 00:20 as shown in (a) of Figure 14 above, the tablet computer is in the playback state, and the playback progress of the progress bar is directly moved to 00:20, and the voice data continues to be played from 00:20.

[0311] In some embodiments, upon receiving a click operation, if the click position corresponding to the click operation is not within a preset valid area, the tablet computer may deem the click operation invalid and may not respond to the click operation, i.e., may not process the operation. If the click position corresponding to the click operation is within the preset valid area, the tablet computer may deem the click operation valid and may respond to the click operation and perform corresponding processing based on the click position and the playback status.

[0312] The above-mentioned preset effective area can be set according to needs, for example, the preset effective area is a blank area on the recording card.

[0313] The above describes how a tablet computer processes a user's click on a speech displayed on the tablet computer. The tablet computer can also simultaneously select different types of information displayed in different segments based on a long press, thus enabling cross-segment selection of speech information. The following describes how the tablet computer processes this scenario.

[0314] S317: The tablet computer receives a long press operation input by the user.

[0315] S318: In response to the long press operation, the tablet computer obtains a start position and an end position corresponding to the long press operation.

[0316] The starting position indicates the position where the user's finger falls, and the ending position indicates the position where the user's finger is lifted. For example, the starting position and the ending position can be represented by (x, y) coordinates. For example, the user's finger falling can indicate that the user's finger falls on the display screen of the tablet computer, or the user's finger presses the mouse (such as the left mouse button). The user's finger lifting can indicate that the user's finger leaves the display screen of the tablet computer, or the user's finger leaves the mouse.

[0317] S319: The tablet computer concatenates the characters from the first speech character displayed on interface 3 to the last speech character to obtain a concatenated string. The first speech character refers to the first character of the first speech information displayed on interface 3. The last speech character refers to the last character of the last speech information displayed on interface 3.

[0318] Exemplarily, the above characters include words, punctuation marks (such as commas, question marks, periods, etc.) and spaces.

[0319] In this embodiment of the present application, the tablet computer concatenates the characters in all speech messages displayed on interface 3 to obtain a concatenated string, i.e., the concatenated speech message. This concatenated speech message is in plain text format. For example, as shown in Figures 16A and 16B, interface 3 displays five speech messages. The tablet computer concatenates the displayed speech messages one by one. First, the tablet computer concatenates the contents of the first (or first) speech message to obtain a concatenated string. The concatenated string is: 00:00 + space + speaker 1 + "It's a nice day today. Shall we go to the park together?" The space refers to the space between the speech time and the speaker identifier. Next, the tablet computer concatenates the second speech message onto this concatenated string, resulting in a new concatenated string: 00:00 + space + speaker 1 + "It's a nice day today. Shall we go to the park together?" + 00:20 + space + speaker 2 + "Yes, do I need anything to bring?" This concatenation continues until the last character of the fifth speech message is reached, stopping the concatenation process, thus completing the concatenation of all speech messages.

[0320] In some embodiments, in order to make the spliced ​​character string correspond to the format of the speech information displayed on interface 3, the tablet computer can also, during the splicing process, if the currently spliced ​​character and the previous character are on different lines, splice a line break character (such as '\n') before the currently spliced ​​character, so that when the tablet computer displays the spliced ​​character string, the user cannot perceive the difference from the speech information displayed on interface 3, thereby realizing seamless switching display of the speech information.

[0321] S320: The tablet computer counts the number of characters starting from the first spoken character and ending at the starting position to obtain an offset character position, wherein the offset character position indicates the position of the first selected character relative to the concatenated character string.

[0322] In an embodiment of the present application, the tablet computer is in a speaker display state, and a speech message displayed on the tablet computer includes a speech text and a first message. The speech text is displayed after the first message, and can usually be displayed on the next line (herein, referred to as the next paragraph) of the first message. The tablet computer determines the item to which the starting position corresponding to the received long press operation belongs, that is, determines the item number to which it belongs, that is, determines the speech message to which the starting position belongs (or is described as the first speech message).

[0323] During the process of splicing the above speech information, when the tablet computer splices to the first speech information, it can start splicing from the first character in the first speech information. After that, when splicing to the character corresponding to the starting position of the long-press operation, the tablet computer can count the number of characters that have been spliced to obtain the position of the first character selected by the user in all the speech information, that is, obtain the offset character position. And the tablet computer can continue to splice the remaining characters, that is, the characters after the character corresponding to the starting position.

[0324] For example, the character corresponding to the starting position of the long-press operation input by the user, that is, the character corresponding to the selection operation, is the character '可' in the second speech information shown in FIG. 17A. The spliced string obtained by the tablet computer when splicing to the second speech information is 00:00 + space + Speaker 1 + Is the weather nice today? Let's go to the park together. After that, the tablet computer continues to splice the characters in the second speech information. When splicing to the character '可', the current spliced string is 00:00 + space + Speaker 1 + Is the weather nice today? Let's go to the park together. + 00:20 + space + Speaker 2 + 可. The tablet computer counts the number of characters included in the current spliced string, that is, the number of characters that have been spliced is 00:00 (5 characters) + space (1 character) + Speaker 1 (4 characters) + Is the weather nice today? Let's go to the park together. (17 characters) + 00:20 (5 characters) + space (1 character) + Speaker 2 (4 characters) + 可 (1 character) = 38, that is, the offset character position is 38.

[0325] S321. The tablet computer determines the number of selected characters based on the starting position and the ending position corresponding to the long-press operation.

[0326] Exemplarily, the tablet computer counts the number of characters in the area from the starting position to the ending position to obtain the number of selected characters. Specifically, the tablet computer determines the character corresponding to the starting position as the starting character and determines the character corresponding to the ending position as the ending character. After that, the tablet computer counts the number of characters between the starting character and the ending character to obtain the number of selected characters. Among them, the characters between the starting character and the ending character include the starting character, the ending character, and the characters after the starting character and before the ending character.

[0327] Continuing with the above example, the character corresponding to the end position of the long - press operation input by the user is the character "ma" in the third speech message shown in Figure 17B. Correspondingly, the characters between the start character and the end character are "Sure, do I need to bring anything? (11 characters)+00:40 (5 characters)+space (1 character)+Speaker 1 (4 characters)+Do I need to bring fruits? (4 characters)", and the number of selected characters is 25.

[0328] S322. The tablet computer displays the above - spliced string, and sets the target character area in the spliced string to the selected state. Among them, the target character area includes the character corresponding to the offset character position and the characters with the number of selected characters after the offset character position.

[0329] In the embodiment of the present application, the tablet computer displays the finally obtained spliced string (that is, displays the spliced string in the recording card), realizes the display of all speech messages in pure text form, and enables the tablet computer to select different segments of speech content. The tablet computer displays the target character area in the spliced string according to the preset selection style, so that the characters in the target character area are in the selected state (as shown in 17C), that is, the target character area in the spliced string in the recording card is selected. Among them, optionally, the preset selection style can be highlighted display. Compared with the characters not being selected, the color of the characters becomes darker after being selected. Of course, the user can also set the selection style according to the needs, as long as it is different from the style when the characters are not selected.

[0330] In some embodiments, the above - mentioned speech messages are carried by recycleview, and each speech message is an item. Multiple items cannot be selected simultaneously, that is, the tablet computer cannot select multiple speech messages across items. An item includes multiple view components, and the first information and the speech text in the speech message belong to different view controls in the item. Similarly, view components cannot be selected across rows, that is, the information in different segments (or different types of information in different rows) in a speech message cannot be selected simultaneously. Therefore, in order to provide rich text services, after receiving the long - press operation, the tablet computer indicates that the user may have the usage requirement of selecting speech messages across segments. The tablet computer can replace the recycleview component with a textview component (as shown in Figure 17D), that is, all speech messages (that is, the spliced string) are located in a textview component. In other words, all speech messages are displayed in pure text form in the textview, enabling the user to select multiple speech messages at one time (such as selecting speech messages across speakers, that is, selecting the speech messages of different speakers), or selecting different types of information in a speech message (or described as information in different views).

[0331] As can be seen from the above description, the view component containing the first information can be a textview, and the view component containing the speech text can be an EditView or a textview. Optionally, the speaker ID and speech start time in the first information can each correspond to a textview, or the speaker ID and speech start time can both correspond to a textview, which is not limited by this application.

[0332] S323: The tablet computer displays at least one function control, where each function control is used to trigger the tablet computer to perform a corresponding processing operation on the characters in the target character area.

[0333] For example, the above-mentioned function controls may be sharing controls, copy controls, translation controls, search controls, video search controls, or application search controls, such as the function controls displayed in the form of bubbles on a tablet computer as shown in FIG17E . The application 1 search shown in FIG17E indicates a search using the selected characters as keywords in application 1 on the tablet computer.

[0334] The sharing control is used to trigger the tablet computer to share the selected characters, such as sharing them with an application on the tablet computer.

[0335] The copy control is used to trigger the tablet computer to copy the selected characters, so that the user can paste the selected characters to other locations as needed without the user having to re-enter the selected characters.

[0336] The translation control is used to trigger the tablet to translate the selected characters into another voice.

[0337] The search control is used to trigger the tablet computer to search using the selected characters as keywords, such as searching for the selected characters in a browser application.

[0338] The above video control is used in a video application on a tablet computer to search for related videos using the selected characters as keywords.

[0339] The above application search control is used for a tablet computer to search for related content in a specific application on the tablet computer using the selected characters as keywords.

[0340] It should be understood that the functional controls listed above are only examples, and the functional controls may also be other types of controls, as long as they can trigger the tablet computer to process text, and this application does not limit them.

[0341] It should be noted that, when the above interface 3 displays the speaker's portrait, the tablet computer will no longer display the speaker's portrait when displaying the speech information in plain text.

[0342] In some embodiments, after the tablet computer displays the above-mentioned function control, when the above-mentioned function control stops being displayed, the tablet computer can replace the layout component of the speech information from textview to recycleview, that is, continue to display the speech information according to the layout style shown in Figure 10A or Figure 10B above, so that the tablet computer can continue to perform corresponding processing based on the operation input by the user, such as editing the speech content (such as speech text, speaker identification) or realizing the linkage playback of recording and text based on the click operation, and filtering the displayed speech information. For example, the tablet computer can stop displaying the function control after receiving a trigger operation (such as a click operation) of the user on a preset area (such as a blank area) on the interface 3. For another example, the tablet computer can stop displaying the function control after receiving a click operation of the user on a certain function control, and in response to the click operation on the function control, perform corresponding processing on the characters in the target character area, that is, the characters selected by the user. For another example, after the tablet computer displays the function control for a certain period of time, it still does not receive a click operation on the function control by the user, and can stop displaying the function control.

[0343] It should be understood that compared to TextView, tablets can more accurately obtain the location of user input operations (such as click locations, the start and end locations corresponding to long press operations, etc.) by using RecycleView to carry speech information, thereby improving the accuracy of processing based on such operations. In addition, because each speech information corresponds to an item when RecycleView carries speech information, the tablet can filter the displayed items, that is, it can filter the displayed speech information.

[0344] In some embodiments, the tablet computer can filter and display the speech information. The tablet computer can receive an action b on the fourth interface from the user, which triggers the tablet computer to display the speech information corresponding to the target speaker identifier selected by the user. Subsequently, in response to action b, the tablet computer can display only the speech information corresponding to the target speaker identifier, and no longer display the speech information corresponding to speaker identifiers other than the target speaker identifier. For example, a user clicks the speaker filtering control shown in FIG18A . In response to the click of the speaker filtering control, the tablet computer displays speaker options 80 as shown in FIG18B . After receiving the selection of Speaker 1 in Speaker options 80 , the tablet computer displays the speech information corresponding to Speaker 1 as shown in FIG18C , thereby filtering the speaker text. It should be understood that the speech information shown in FIG18C is the filtered speech information corresponding to Speaker 1. Compared to the speech text shown in FIG18A , since the speech information corresponding to Speaker 2 is no longer displayed, the tablet computer displays more speech information for Speaker 1. The speech information corresponding to Speaker 1, which is arranged at the bottom, moves upward to be displayed directly, without having to scroll the scroll bar (as shown in FIG18C , "Then we'll see you later").

[0345] It should be noted that Figures 18A to 18C above illustrate the process of filtering a speaker's speech text when the tablet is in the speaker display mode, that is, the process of displaying the speech text corresponding to the target speaker ID selected by the user. Even when the tablet is not in the speaker display mode, it can still filter speakers and only display the speech text corresponding to the target speaker ID.

[0346] In this application, the tablet supports the speaker filtering function. Users can select the speakers' speech information they want to display according to their needs. Ping An Computer can display the speech information of the desired speakers, meeting the user's need to view only the speech information of some speakers.

[0347] In some embodiments, when a user wants to simultaneously select multiple speech information of a speaker, they can first select the speaker identifier corresponding to the speaker (i.e., the target speaker identifier). The tablet computer will then display all speech information corresponding to the target speaker identifier, making the speaker's speech information adjacent to the speech information. The user can then long-press all speech information corresponding to the displayed target speaker identifier as needed, so that the tablet computer can respond to the long-press operation and simultaneously select multiple speech information of the speaker, thereby processing the multiple speech information of the speaker accordingly to meet the user's usage needs.

[0348] In some embodiments, the above introduction is about the processing process of receiving click operations and long press operations on the tablet computer when it is in the state of displaying the speaker. The tablet computer can also receive click operations and long press operations when it is not in the state of displaying the speaker. The processing process is similar to the processing process of click operations and long press operations introduced above, except that after receiving the click operation, there is no need to determine whether the user clicked on the speech text or the first information.

[0349] In some embodiments, the tablet computer supports exporting voice data and speech information. The tablet computer receives operation c, and in response to operation c, exports the speech information currently displayed on the tablet computer.

[0350] It should be understood that when the tablet computer is not in the display speaker state, the tablet computer currently displays the speech text in the speech information, then the tablet computer exports the currently displayed speech text in response to operation c. When the tablet computer is in the display speaker state, the tablet computer currently displays the entire content of the speech information, then the tablet computer exports the entire currently displayed speech information in response to operation c. For example, assume that the first information includes the speaker ID, speech text, and speech time. When the tablet computer is in the display speaker state, the speech information currently displayed on the tablet computer includes the speech text, speaker ID, and speech time, and the content exported by the tablet computer includes the speech text, speaker ID, and speech time. When the tablet computer is not in the display speaker state, the speech information currently displayed on the tablet computer includes the speech text, and the content exported by the tablet computer includes the speech text.

[0351] Furthermore, if the currently displayed speech information on the tablet corresponds to a subset of speakers, the exported speech information also corresponds to that subset of speakers. If the currently displayed speech information on the tablet corresponds to all speakers, the exported speech information also corresponds to all speakers, thus meeting various user export needs.

[0352] Optionally, the tablet computer can support exporting in multiple formats. That is, the tablet computer can save the speech information currently displayed based on the first target format, that is, save the currently displayed speech information in the first target format to a target location. The target location can be a default save location or a user-selected storage location. Exemplarily, the first target format can be a document format or an image format. The document format can include at least one of txt format, pdf format, doc format, docx format, and html format.

[0353] In one example, the first target format may be a default format (or a default file format). The tablet computer displays an interface 90 as shown in FIG19A , which includes a control 91 for triggering the tablet computer to save the currently displayed speech information. In response to a user clicking on the control 91 , the tablet computer saves the currently displayed speech information in a default format (e.g., txt format) to a target location. In addition, after saving, the tablet computer may also display location prompt information (as shown in FIG19B , location prompt information 92 ), which prompts the user where the currently displayed speech information is saved, making it easier for the user to view.

[0354] In another example, the first target format may be a format selected by the user (i.e., a file format). The tablet computer may display at least one first format option. After receiving a user selection operation for a target format option in the at least one format option, in response to the selection operation for the target format option, the tablet computer may save the currently displayed speech information in the format corresponding to the target format option (i.e., the first target format). For example, in response to a user click operation on the control 91 in FIG. 19A , the tablet computer displays five first format options as shown in FIG. 19C , namely, a doc format option, a txt format option, an image format option, an html format option, and a docx format option. When the user wants to save the speech information in doc format, the user may click on the doc format option. In response to the click operation on the doc format option, the tablet computer may save the currently displayed speech information in doc format. After saving, the tablet computer may also display location prompt information (as shown in location prompt information 93 in FIG. 19D ), which prompts the user where the currently displayed speech information is saved for easy viewing.

[0355] In other embodiments, the tablet computer also supports sharing the speech information currently displayed on the tablet computer based on the second target format in response to the received operation d, such as the tablet computer sharing the currently displayed speech information in the second target format to the application on the tablet computer.

[0356] The second target format is similar to the first target format and can be a default format or a format selected by the user. The second target format will be described in detail below with two examples.

[0357] In one example, the second target format is a default format. Exemplarily, in response to a sharing operation input by a user (such as a click operation on a sharing control), the tablet computer displays an interface including a third control, and the third control is used to trigger the tablet computer to display a first candidate application. Afterwards, in response to the user's selection operation of the first target application in the first candidate application, the currently displayed speech information in the second target format is shared to the first target application. The first candidate application refers to an application that can receive files in the second target format. For example, in response to the user's click operation on the sharing control 94 shown in Figure 19E, the tablet computer displays an interface 95 as shown in Figure 19F. The interface 95 displays the format of the currently displayed speech information (such as txt format), the speech information, the first candidate application 96, etc. The first candidate application 96 represents an application that can receive files in txt format, so that the user can select the application to share according to needs.

[0358] In another example, the second target format is selected by the user. When the user wants to share the currently displayed speech information in picture format, the user can select the picture format sharing option displayed on the tablet (such as the share as picture option shown in Figure 19A above). In response to the user's selection of the picture format sharing option, an interface as shown in Figure 19G is displayed, which includes the currently displayed speech information 97 in picture format and a second candidate application 98. The second candidate application 98 represents an application that can receive files in picture format, so that the user can select an application to share.

[0359] In some embodiments, as shown in FIG19H , the tablet computer may display the currently displayed speech information in the first target format or the second target format on an interface displaying a recording card (such as speech information, various controls, etc.).

[0360] In some embodiments, the tablet computer may also export or share the speech information of all speakers or some speakers according to the user's choice. For example, in response to the above-mentioned control 91, the tablet computer may display an export speaker option, which includes an export all option and at least one export speaker option. The export all option is used to trigger the tablet computer to export the speech information of all speakers. The export speaker option corresponds to the speaker identifier one by one, and the export speaker option is used to trigger the tablet computer to export the speech information of the speaker corresponding to the speaker option. Similarly, the tablet computer may also export or share the speech information according to the user's choice to determine whether there is content other than the speech text, such as the speaker identifier and the speech time.

[0361] In some embodiments, the tablet computer can also share the currently displayed speech information with other devices in a default or user-selected file format.

[0362] It should be understood that the above-mentioned sharing and exporting operations can be performed after the tablet computer stops recording. During recording, the tablet computer generally does not export or share the first voice file or the speech information corresponding to the first voice file. However, operations such as displaying speaker status switching, filtering speaker speech information, displaying all speaker speech information, selecting and editing speech information, and linked playback of voice data can be performed during recording or after stopping recording.

[0363] The above describes electronic devices supporting functions such as converting speech into speech information, responding to user clicks on speech information, and responding to user selections of speech information. The following describes the specific implementation process of the electronic device for converting speech into speech information, responding to user clicks on speech information, and responding to user selections of speech information, using the software framework shown in FIG6 . Converting speech into speech information may include steps S1-S9 shown in FIG20 .

[0364] The implementation process of responding to the user's click operation on the speech information may include S10-S17 as shown in Figure 20. The implementation process of responding to the user's click operation on the speech information may include S18-S28 as shown in Figure 20.

[0365] S1. The note recording module receives the latest voice data.

[0366] S2. The note recording module sends the latest voice data to the text-to-text engine.

[0367] S3. The text-to-text engine sends the latest voice data to the voice cloud module.

[0368] S4. The voice cloud module converts the latest voice data into text to obtain the latest speech information corresponding to the latest voice data.

[0369] S5. The voice cloud module sends the latest speech information to the text conversion engine.

[0370] For example, the note recording module sends the latest voice data to the cloud (such as the voice cloud module) through the text conversion engine. The cloud converts the latest voice data into text and obtains a text recognition result, which includes the latest speech information corresponding to the latest voice data.

[0371] In some embodiments, the data structure of the latest speech information in the above text recognition result may be {speaker identification, speech start time, duration, converted text content}.

[0372] S6. The text-to-text engine sends the latest speech information to the note recording module.

[0373] S7. The note recording module displays the latest speech information on the interface 1 through the note speaker display module. The interface 1 also displays historical speech information.

[0374] For example, after receiving the text recognition result, the note recording module can extract the speech information in the text recognition result, and split and display the speech information through the note speaker display module. That is, the speech information corresponding to different speakers is displayed through different segments to avoid the speech information corresponding to different speakers being displayed in the same item.

[0375] In addition, the note recording module can also save the extracted speech information to a preset storage location. Exemplarily, the note recording module can save the extracted speech information to a target data list file through the note data management module.

[0376] S8. The note speaker display module receives a user click operation on the stop recording control on interface 1.

[0377] S9. In response to a click operation on the stop recording control, the note speaker display module triggers the note recording module to stop recording and displays interface 2. Interface 2 displays speech information, playback controls, and a progress bar.

[0378] The above describes the process of converting voice data into text in real time during recording and stopping recording. The following will continue to describe the process of the tablet responding to the user's click operation on the speech information displayed on the tablet after stopping recording, and the process of the tablet responding to the user's long press operation on the speech information displayed on the tablet.

[0379] S10: The parent layout in the note speaker display module monitors a user click event on a child layout corresponding to the parent layout. The parent layout is used to carry a speech message, and the child layouts corresponding to the parent layout include a first child layout and a second child layout. The first child layout is used to carry the speech text, and the second child layout is used to carry the first message.

[0380] The parent layout corresponds to an item. The first child layout can be the EditText shown in Figure 10A or 10B, and the second child layout can be the LinearLayout shown in Figure 10A or 10B. The parent layout can intercept click events on the child elements (or child layouts) of the item. After the child layout detects the click event, it does not process the click event. Instead, the parent layout to which the child layout belongs handles the click event.

[0381] In some embodiments, each item corresponds to a flag bit, and in a click event for the item, a response is processed based on the flag bit. That is, if a user clicks on a certain post, the flag bit corresponding to the item corresponding to the post is updated from a first flag to a second flag, causing the item corresponding to the post to respond to the click event. The first flag and the second flag are different, e.g., the first flag is 0 and the second flag is 1.

[0382] S11. The parent layout responds to a click event and, when the click position is in the first child layout, determines whether it is in a playing state.

[0383] For example, after the parent layout detects a click event, indicating that the user clicked on the speech information, the parent layout obtains the location of the user's click, that is, the click location corresponding to the click event. If the click location is in the first child layout corresponding to the parent layout, it indicates that the click is located on the speech text carried by the first child layout. The parent layout can determine the user's usage intention based on the playback status of the recording. The playback status of the recording can also be determined by the status of the playback control on interface 2.

[0384] S12. When the parent layout is not in the playing state, the parent layout enters the editing state.

[0385] S13. In the playback state, the parent layout calculates the speaking time based on the click position.

[0386] S14. The parent layout moves the play progress of the progress bar on interface 2 to the speaking time, and plays the voice data corresponding to the speaking time.

[0387] The above describes a case where the click position corresponding to the click operation is located on the speech text, that is, the user clicks the speech text. The following will continue to describe a case where the click position corresponding to the click operation is located on the first information, that is, the user clicks the first information.

[0388] S15: When the click position is in the second sub-layout, determine whether it is in the playing state.

[0389] S16. When not in playback state, the parent layout displays speaker modification controls.

[0390] S17: When in the playback state, the parent layout moves the playback progress bar on interface 2 to the target speech start time and plays the voice data corresponding to the target speech start time. The target speech start time is the speech start time in the speech information corresponding to the clicked position.

[0391] The above describes the process of the tablet receiving a user click operation on the speech information displayed on the tablet and processing the operation based on the click operation. The user can also select at least one speech information displayed on the tablet, and the following will continue to describe the process of the tablet processing based on the selection operation.

[0392] S18. The note spokesperson display module detects a long press event on the first sub-layout.

[0393] S19. The note spokesperson display module intercepts the default function control corresponding to the first sub-layout.

[0394] S20. The note spokesperson display module obtains the location information of the first item belonging to the first sub-layout.

[0395] S21. The note speaker display module obtains the starting position and ending position corresponding to the long press event.

[0396] For example, an OnTouchListener event listener is set for EditText. Both pressing and releasing the touchpad trigger the event. The position where the finger lands and the position where the finger leaves each time the EditText is clicked are recorded. When the click duration is long, the click operation is identified as a long press event, thereby implementing the monitoring of the long press event. Accordingly, after the user's finger falls to trigger the event, the position where the user's finger lands is recorded to obtain the starting position corresponding to the long press event. Similarly, after the user's finger leaves the touchpad to trigger the event, the position where the user's finger leaves is recorded to obtain the ending position corresponding to the long press event.

[0397] The position information of the first item indicates the number of speech information displayed by the first item. The speaker display module can obtain the position information of the first item in the onclick of the first item.

[0398] In some embodiments, a component corresponding to the first information, such as a textview, can also monitor long press events. For example, a listener for a click event can be set for the textview to monitor long press events.

[0399] S22. The note speaker display module concatenates the characters from the first speech character displayed on interface 2 to the last speech character to obtain a concatenated string. The first speech character refers to the first character of the first speech information displayed on interface 2. The last speech character refers to the last character of the last speech information displayed on interface 2.

[0400] S23. The note speaker display module counts the number of characters starting from the first speaking character and ending at the starting position to obtain the offset character position.

[0401] For example, the offset character position may represent the starting index of the currently selected character, that is, the position of the first selected character.

[0402] S24. The note speaker display module determines the number of selected characters based on the first item, the starting position and the ending position corresponding to the long press event.

[0403] S25. The note speaker display module replaces the recycleview component with the textview component.

[0404] S26. The note speaker display module displays the concatenated string in the above textview component.

[0405] S27: The note speaker display module sets the target character area in the textview component to a selected state, wherein the target character area includes the character corresponding to the offset character position and the selected number of characters after the offset character position.

[0406] S28. The note speaker display module displays a function control, which is used to trigger the tablet computer to perform corresponding processing operations on the selected characters.

[0407] In some embodiments, the note application also provides a toolbar control panel, which can be a tool control in the recording card. The toolbar control panel (such as the toolbar control panel 73 shown in Figure 17C above) is used to trigger the tablet computer to perform corresponding operations, such as recording, stopping recording, text conversion, displaying speaker status switching, exporting, sharing, filtering speakers, etc. The recording card (such as the recording card 74 shown in Figure 17C above) can also include speech information, etc. As shown in Figure 21, when the user clicks the recording control, the toolbar control panel responds to the click operation of the recording control and triggers the note recording module to record to collect the corresponding voice data. Accordingly, the tablet computer supports automatic real-time voice-to-text conversion. Therefore, the note recording module can send voice data to the voice-to-text service (or voice cloud module). Afterwards, the voice-to-text service can send it to the note application after the conversion is successful. After obtaining the speech information, the note application can display it on the recycleview component and perform data storage through the data management module to achieve storage of speech information.

[0408] Among them, the speech-to-text service can be located in the cloud as shown in Figure 21 above, or the speech-to-text service can be located locally on the tablet computer, and this application does not limit it.

[0409] It should be noted that the tool controls included in the toolbar control panel 73 shown in FIG17C are merely examples and are not limited to them in this application.

[0410] In some embodiments, when the note speaker display module receives a click operation on the save control (such as the save control 76 shown in Figure 17C above), it can save the currently edited notes through the note data management module, thereby saving the relevant data of the recording card displayed on the current interface (such as speech information).

[0411] The present application provides a voice processing method. After starting recording, the electronic device can convert the voice data into text in real time. After receiving the delete operation input by the user, the electronic device can judge the user's needs based on the position of the cursor in the speech text, and thus perform corresponding processing on the speech text where the cursor is located to meet the user's usage needs. Among them, the voice data can be the recording in the recording note scenario introduced above, the recording in the recording application scenario, the recording in the call recording scenario (or called a voice file), etc. Of course, the voice data can also be other recording data generated in a scene. Below, the above-mentioned electronic device is a tablet computer, and the application scenario is a recording note scenario, that is, a note application, as an example, and a voice processing method provided by an embodiment of the present application is described in detail in combination with the accompanying drawings. As shown in Figure 22, the method may include steps S401-S410.

[0412] S401. During the recording process, the tablet computer receives the latest voice data.

[0413] S402: The tablet computer converts the latest voice data into text to obtain the latest speech information.

[0414] S403: The tablet computer displays the latest speech text on interface 1. Interface 1 also displays historical speech texts.

[0415] S404: The tablet computer receives a deletion operation.

[0416] S405 : In response to the above-mentioned deletion operation, the tablet computer uses the text where the cursor is currently located as speech text 1 .

[0417] In some embodiments, the delete operation represents an input operation using the delete key of an input method. When a user enters the delete key (delete key 52a on the virtual keyboard shown in FIG23A ) in one of the multiple speech texts displayed on the tablet computer's interface 1, the speech text is referred to as speech text 1, and the delete key input operation is referred to as a delete operation. Furthermore, the delete key 52a shown in FIG23A is merely an example. The tablet computer can also be connected to an external keyboard, and the delete key can be the delete key 53a on the keyboard shown in FIG23B . The delete key 53a shown in FIG23B can also be referred to as a backspace key.

[0418] In other embodiments, the above-mentioned deletion operation can be a triggering operation of a deletion control (such as a click operation). When the user wants to merge a speech text, such as speech text 1, into another speech text, such as speech text 2, when the cursor of the tablet computer is at the location of speech text 1, the user can click the deletion control displayed on the tablet computer (the deletion control 54a shown in Figure 23C). The operation of the user clicking the deletion control is a deletion operation. It should be understood that if the cursor of the tablet computer is not in speech text 1, the user can click a certain position in speech text 1 (such as the initial position), and the tablet computer will move the cursor to the corresponding position in response to the click operation.

[0419] Optionally, the deletion control may be displayed by the tablet computer in response to a specific trigger operation input by the user, such as the user pressing the screen for a certain period of time at the cursor position, clicking the screen multiple times in a row, etc.

[0420] In other embodiments, the deletion operation may be a second preset gesture input operation. When the user wants to merge a speech text into another speech text, the user may input the second preset gesture on the tablet computer. In response to the second preset gesture, the tablet computer changes the speech text where the cursor is located to speech text 1.

[0421] The speech text 2 is a speech text that is adjacent to the speech text 1 and is earlier than the speech text 1 and is currently displayed on the interface 1 .

[0422] In some embodiments, the deletion operation can be performed after the tablet computer stops recording. In response to the stop recording operation, the tablet computer stops recording and displays a second interface. The second interface displays the speech text and a start recording control (or second control). The start recording control is used to trigger the tablet computer to resume recording.

[0423] The speech text displayed on the second interface includes all speech texts obtained during the current recording. The play control can trigger the tablet computer to play the voice data recorded during the recording.

[0424] In some embodiments, when the tablet computer is not in the speaker display state, the second interface displays the speech text in the speech information, but does not display other information in the speech information, such as the speaker ID and the speech start time.

[0425] When the tablet computer is in the speaker display state, the second interface displays not only the speech text in the speech information but also the speaker identifier in the speech information.

[0426] Exemplarily, the above-mentioned stop recording operation may be a user clicking operation on the pause recording control (or referred to as the first control).

[0427] S406: The tablet computer determines whether the current position of the cursor is at the beginning position of speech text 1.

[0428] The start position of speech text 1 indicates the position before the first character in speech text 1. The cursor shown in FIG23D is at the start position of the speech text (ie, speech text 1) where the cursor is located, that is, the beginning of the line.

[0429] In the embodiment of the present application, after receiving a delete operation, the tablet computer determines whether to merge the speech text based on the current position of the cursor, that is, determines whether the delete operation actually triggers the merging of the speech text. In other words, the tablet computer determines which operation is triggered by the delete operation based on the current position of the cursor.

[0430] When the current cursor position is not at the beginning of speech text 1, it indicates that the user may want to delete a character before the current cursor position, rather than wanting to merge speech text 1 into speech text 2. That is, the deletion operation does not trigger speech text merging, and the tablet computer can execute S407.

[0431] When the current position of the cursor is at the beginning of speech text 1, it indicates that the cursor is currently before the first character in speech text 1, which means that there is no character in speech text 1 before the cursor. The user does not want to delete the character before the current position of the cursor, but wants to merge speech text 1 into speech text 2 (that is, the speech text that is adjacent to speech text 1 and earlier than speech text 1 in the current interface), which means that the deletion operation actually triggers the merging of speech texts, and the tablet computer can execute S408.

[0432] In some embodiments, the process of determining whether the current position of the cursor is at the start position of the speech text 1 may include: the tablet computer may determine whether there are characters of the speech text 1 before the current position of the cursor. If there are, it indicates that the current position of the cursor is not at the start position of the speech text 1. If there are not, it indicates that the current position of the cursor is not at the start position of the speech text 1.

[0433] S407. The tablet computer deletes the characters before the current position of the cursor.

[0434] Exemplarily, the tablet computer may delete one character that is before the current position of the cursor and adjacent to the cursor. After the deletion is completed, the latest speech text is displayed. For example, as shown in (a) of FIG. 24, the cursor of the tablet computer is currently located in the middle of "can" in the speech text 60a. "Ke" is one character that is before the current position of the cursor and adjacent to the cursor. Therefore, the tablet computer may delete "Ke" and display the speech text 61a shown in (b) of FIG. 24.

[0435] S408. The tablet computer merges the speech text 1 into the speech text 2 to obtain the updated speech text 2. The speech text 2 is the previous speech text of the speech text 1 displayed on the interface 1.

[0436] In some embodiments, the speech text and the speaker identifier in the above speech information may be displayed through different views (such as textview). When the tablet computer is in the speaker display state, there is also a view (such as the third textview) where the speaker identifier is located between the textview where the speech text 2 is located (i.e., the second textview) and the textview where the speech text 1 is located (i.e., the first textview). Assuming that in response to the above deletion operation, the speech text 1 is moved according to the method of step S407, it will only be added after the view where the speaker identifier is located, while the user's intention is to add the speech text 1 in the first textview into the second textview. Therefore, the tablet computer cannot directly merge the speech text 1 into the speech text 2.

[0437] Accordingly, before executing the above S408, the tablet computer can determine whether it is possible to merge the speech texts, that is, it can execute S60 as shown in Figure 22, and the tablet computer determines whether it is in the display speaker state. When it is in the display speaker state, it indicates that the tablet computer needs to display information such as the speaker identification. Therefore, the tablet computer cannot directly add the speech text 1 in the first textview to the second textview. The tablet computer can execute S61, that is, it does not respond to this deletion operation. When the tablet computer is in the non-display speaker state, it indicates that there is no other view between the first textview and the second textview. Therefore, the tablet computer can add the speech text 1 to the speech text 2 to obtain the updated speech text 2, that is, to obtain the updated speech information 2. The tablet computer can execute the above S408 to support the rapid integration of speech texts across time periods.

[0438] The tablet computer not being in the display speaker state means that it only displays the speech text in the speech information (as shown in FIG25A ), and does not display content other than the speech text, such as the speaker ID, speech time, etc. Correspondingly, the tablet computer being in the display speaker state means that it displays the speech text in the speech information and also displays the remaining content in the speech information, that is, it displays the entire content of the speech information. For example, if the speech information includes the speaker ID, speech time, and speech text, and the tablet computer displays the speaker ID, speech time, and speech text (as shown in FIG8E ), it is in the display speaker state.

[0439] In some embodiments, when the tablet computer is in the display speaker state, if a user clicks on the control to stop displaying the speaker on interface 1 (or a second operation), the tablet computer can respond to the click by stopping the display speaker state (or describing it as displaying the fifth recording card), that is, only displaying the speech text in the speech information and canceling the display of information other than the speech text in the speech information, such as canceling the display of the speaker identifier (as shown in FIG25A ). If the tablet computer is not in the display speaker state, if a user clicks on the control to display the speaker, the tablet computer can respond to the click by switching to the display speaker state, thereby switching the speaker state.

[0440] It should be noted that the above-mentioned stop display speaker control and the above-mentioned display speaker control can be different controls or the same control. Specifically, if the tablet computer displays the entire content of the speech information and the control is in the display speaker state, the control can be used as a stop display speaker control. For example, the display speaker control 62a shown in Figure 24 (a) is in the display speaker state and the control can be used as a stop display speaker control. If the tablet computer only displays the speech text in the speech information and the control is in the display speaker state, the control can be used as a stop display speaker control. For example, the display speaker control 63a shown in Figure 25A is in the stop display speaker state and the control can be used as a display speaker control.

[0441] In some embodiments, the above-mentioned tablet computer merging speech text 1 into speech text 2 can represent adding speech text 1 to a specific position of speech text 2. In one example, generally speaking, the speech content has a sequence, and the speech time corresponding to speech text 1 is later than the speech time corresponding to speech text 2. Therefore, the tablet computer can add speech text 1 to the end position of speech text 2. Among them, the end position of speech text 2 represents the position of the last character in speech text 2, that is, the end of the line position, to match the order of the actual speech content. For example, if the above-mentioned speech text 1 is "Okay, do you need to bring anything?" as shown in Figure 25A above, and speech text 2 is "The weather is very good today, shall we go to the park together?", the tablet computer will add the speech text 1 to the end position of speech text 2 (as shown in Figure 25B).

[0442] In another example, the tablet computer can add Speech Text 1 to the initial position of Speech Text 2 to meet the user's need to adjust the order of speech content. For example, the user finds that the speech content corresponding to Speech Text 1 should actually be before the speech content corresponding to Speech Text 2. Therefore, the user can enter a deletion operation, and the tablet computer, based on this deletion operation, adds Speech Text 1 to the initial position of Speech Text 2. Of course, the tablet computer can also add Speech Text 1 to other positions within Speech Text 2, for example, to the middle of Speech Text 2, and this application is not limited to this.

[0443] The above-mentioned specific location can be a default location. For example, the end location of the speech text can be used as the default location. Of course, the tablet computer can also provide at least one location option, and the user can select the location option according to actual needs. After obtaining the location option (i.e., the target location option) selected by the user, the tablet computer adds speech text 1 to the location corresponding to the target location option of speech text 2. For example, if the location option selected by the user is the end location option, the tablet computer will add speech text 1 to the end location of speech text 2.

[0444] S61. The tablet computer does not respond.

[0445] In an embodiment of the present application, when the tablet computer is in the speaker display state, the tablet computer may not merge speech text 1 into speech text 2. In some embodiments, to avoid the user's confusion about inputting a deletion operation but the tablet computer does not respond, the tablet computer may display a first prompt message, which is used to prompt the user to cancel the display of the speaker (for example, the tablet computer displays the first prompt message 64a as shown in Figure 26).

[0446] It is understandable that, regardless of whether the tablet computer is in the speaker display state or not, various editing operations can be performed on a speech text, such as deletion, modification, and addition of characters.

[0447] In some embodiments, when interface 1 displays a speaker identifier, indicating that the tablet is displaying the speaker, if the user wishes to merge speech texts, the user can enter a second operation on interface 1. In response to this second operation, the tablet can remove the display of the speaker identifier to facilitate the user's merging of different speech texts, thereby satisfying the user's need to merge speech texts. Here, interface 1 without the display of the speaker identifier can serve as interface 3. The user can then enter a delete operation, and the tablet, in response to this delete operation, will add speech text 1 to speech text 2, with the cursor currently positioned at the beginning of speech text 1.

[0448] In some embodiments, after the tablet computer receives the above-mentioned deletion operation, if the tablet computer is in the display speaker state, but the cursor is currently at the starting position of speech text 1, the tablet computer can automatically stop being in the display speaker state and merge speech text 1 into speech text 2 to realize the merging of speech texts and meet the user's operation needs.

[0449] In some embodiments, the above-mentioned speech text 2 and speech text 1 can be two speech texts with adjacent speech times, that is, speech text 1 and speech text 2 are directly adjacent. In one case, the second speaker identifier corresponding to speech text 2 is different from the first speaker identifier corresponding to speech text 1. When the user believes that speech text 1 is not actually the speech of speaker 1, but the speech of speaker 2 corresponding to speech text 2, that is, when the voiceprint recognition is wrong, the user can delete speech text 1. The tablet computer responds to the deletion operation. If the cursor is at the beginning of speech text 1, speech text 1 can be merged into speech text 2. The speaker identifier corresponding to speech text 2 merged with speech text 1 (i.e., the updated speech text 2) is the identifier of speaker 2, so as to realize the modification of the speaker, improve the accuracy of text conversion, and restore the voice more accurately.

[0450] In another case, the second speaker identifier corresponding to speech text 2 is the same as the first speaker identifier corresponding to speech text 1, that is, the tablet computer also supports merging two directly adjacent speech texts of the same speaker (as shown in Figure 27, the speech text 70a of speaker 1 and the speech text 71a of speaker 1 are directly adjacent). Then, after receiving the delete operation, if the current position of the cursor is at the beginning of speech text 71a, indicating that the user wants to merge speech text 71a into speech text 70a, the tablet computer can merge speech text 71a into speech text 70a. Optionally, the tablet computer can merge speech text 71a into speech text 70a when the current position of the cursor is at the beginning of speech text 71a and is not in the speaker display state. Therefore, when the user believes that the two speech texts of the speaker are related, the two speech texts can be merged into one speech text.

[0451] In other embodiments, the second speaker identifier corresponding to speech text 2 is the same as the first speaker identifier corresponding to speech text 1, but speech text 1 and speech text 2 are indirectly adjacent, i.e., another speaker's speech text (e.g., speech text 3) actually exists between the two adjacent speech texts. In other words, the speech time corresponding to speech text 3 falls between speech text 1 and speech text 2. For example, if a user believes that speech text 70a and speech text 72a of speaker 1 are related as shown in FIG27 , the user wishes to merge speech text 70a into speech text 72a. However, because speech text 70a and speech text 72a are separated by speech text 73a of speaker 2, the tablet computer cannot directly merge speech text 70a of speaker 1 into speech text 72a of speaker 1. The tablet computer can first filter the speakers and display only the speech text of speaker 1, thereby making the two indirectly adjacent speech texts of speaker 1 directly adjacent, thereby merging the speech texts. Here, the speech text 70a of speaker 1 can be considered as the above-mentioned speech text 1, the speech text 72a of speaker 1 can be considered as the above-mentioned speech text 2, and the speech text 73a of speaker 2 can be considered as the above-mentioned speech text 3 (or called the third speech text).

[0452] Specifically, the tablet computer can receive operation B (or the third operation) performed by the user on interface 4, and operation B is used to trigger the tablet computer to display the speech information of the target speaker identifier (such as the first speaker identifier) ​​selected by the user. Afterwards, in response to operation B, the tablet computer can only display the speech information corresponding to the first speaker identifier (or describe the update of the currently displayed recording card, and the updated recording card only displays the speech information corresponding to the first speaker identifier, and the updated recording card can be the sixth recording card), and no longer display the speech information corresponding to speaker identifiers other than the first speaker identifier, so that the above-mentioned speech text 1 and speech text 2 become adjacent to each other. For example, the user clicks on the speaker filtering control as shown in Figure 28A. In response to the click operation of the speaker filtering control, the tablet computer displays the speaker option 74a as shown in Figure 28B. After receiving the selection operation of the speaker 1 option in the speaker option 74a, the tablet computer displays the speech text corresponding to speaker 1 as shown in Figure 28C, thereby implementing the filtering of the speaker text. It should be understood that the speech text shown in Figure 28C is the speech text corresponding to speaker 1 after screening. Compared with the speech text shown in Figure 28A, since the speech text corresponding to speaker 2 is no longer displayed, the speech text of speaker 1 displayed on the tablet computer increases, and the speech text corresponding to speaker 1 arranged at the bottom can be moved upward and displayed directly without moving the scroll bar (as shown in Figure 28C "Then let's see you later").

[0453] Afterwards, in response to the user's input of a delete operation, the tablet computer can merge speech text 1 corresponding to speaker 1 into speech text 2 corresponding to speaker 1, thereby merging the two indirectly adjacent speech texts corresponding to speaker 1 into one speech text. Afterwards, when the user inputs a fourth operation, such as a selection operation on all displayed speaker options, the tablet computer responds to the fourth operation and displays the speech information corresponding to all speaker identifiers corresponding to all voice data obtained during the recording period in ascending order of speech time, that is, displays the seventh recording card. The seventh recording card includes not only speech text 2 (i.e., updated speech text 2) merged with speech text 1, but also speech texts corresponding to other speaker identifiers (e.g., speech text 3), and speech text 3 is displayed after the updated speech text 2.

[0454] In an embodiment of the present application, when a user believes that two indirectly adjacent speech texts of a speaker are related and wants to integrate the two speech texts, or wants to integrate the speech information of a speaker, such as first displaying all the speech texts of a speaker and then displaying the speech texts of other speakers, the user can first filter the speaker identifier that needs to be integrated, and the tablet computer will respond by displaying all the speech texts corresponding to the speaker identifier, so that the user can integrate them according to needs, realize the merging of speech texts, and provide rich text processing functions so that the display of speech texts can meet the user's usage needs.

[0455] In some embodiments, Figures 28A to 28C above describe the process of filtering the speech text of the speaker when the tablet computer is not in the speaker display state, that is, the process of displaying the speech text corresponding to the target speaker identifier selected by the user. When the tablet computer is in the speaker display state, it also supports filtering speakers and only displays the speech information corresponding to the target speaker identifier. For example, when the tablet computer is in the speaker display state, the tablet computer responds to the user clicking the filter speaker control as shown in Figure 29A and displays the speaker option 75a as shown in Figure 29B. After receiving the selection operation of the speaker 1 option in the speaker option 75a, the tablet computer displays the speech information corresponding to the speaker 1 as shown in Figure 29C, thereby filtering the speaker's speech information and meeting the user's need to browse a certain person's speech information.

[0456] In this application, the tablet supports the speaker filtering function. Users can select the speakers' speech information they want to display according to their needs. Ping An Computer can display the speech information of the desired speakers, meeting the user's need to view only the speech information of some speakers.

[0457] In some embodiments, the above-mentioned tablet computer determines whether to merge the speech texts based on the delete operation in combination with the current position of the cursor. This is only an example of triggering the tablet computer to merge the speech texts. The tablet computer can also directly provide a merge control (as shown in Figure 30). When the user triggers (such as clicking) the merge control, the tablet computer responds to the triggering operation of the merge control and merges speech text 1 into speech text 2. Here, speech text 1 is the speech text where the cursor is located. Of course, the tablet computer can also provide other methods, such as setting corresponding gestures, so that the user triggers the tablet computer to perform a merge operation after performing the other method.

[0458] In other words, after receiving operation A, the tablet computer merges speech text 1 into speech text 2 based on operation A. Operation A represents an operation that may be able to trigger the tablet computer to perform a merge operation. For example, operation A can be the above-mentioned deletion operation, a click operation of a merge control, etc. It should be understood that in the case where operation A is the above-mentioned deletion operation, the tablet computer can first determine whether to merge the speech texts based on the current position of the cursor. Thereafter, in the case of merging the speech texts, the tablet computer can merge speech text 1 into speech text 2, that is, the tablet computer can execute the above-mentioned S404-S408. In the case where operation A is a click operation of a merge control, the tablet computer can directly merge speech text 1 into speech text 2.

[0459] Among them, optionally, the above-mentioned merge control can be displayed by the tablet computer in response to a specific trigger operation input by the user, such as the user pressing the screen for a long time at the cursor position for more than a certain time, clicking the screen multiple times in a row, or clicking at the beginning of a line of the speech text 1.

[0460] S409: The tablet computer deletes the speech information corresponding to the speech text 1 and obtains the latest speech information.

[0461] S410: The tablet computer displays an interface 2, which includes the latest speech information, wherein the latest speech information includes an updated speech text 2.

[0462] In some embodiments, the speech information corresponding to the voice data obtained during the above-mentioned recording is stored in a preset storage location (such as a location that can store data, such as a database). After the tablet computer merges the speech text 1 into the speech text 2, it can delete the speech information belonging to the speech text 1 (that is, the speech information corresponding to the speech text 1) from the preset storage location, and obtain the latest speech information corresponding to the voice data obtained during the recording, that is, the latest speech information includes the updated speech information 2, but does not include the speech information belonging to the speech text 1. Afterwards, the tablet computer can display the latest speech information. For example, the above-mentioned interface 1 includes speech text 1 and speech text 2. After merging speech text 1 into speech text 2 to obtain the updated speech text 2, the tablet computer displays interface 2, which includes the updated speech text 2, but no longer includes speech text 1.

[0463] It should be understood that the above merging operation is performed when the tablet is not in the speaker display state. Therefore, the tablet displays the speech text in the latest speech information without displaying other information. After receiving the user's operation of clicking the display speaker control as shown in Figure 31A, the tablet can display the entire content of the latest speech information (as shown in Figure 31B).

[0464] In some embodiments, the storage format of the aforementioned speech information can be as shown in Table 2. After the tablet computer merges Speech Text 1 into Speech Text 2, Speech Text 1 becomes part of Speech Text 2. That is, the content of Speech Text 1 is added to the content of Speech Text 2. Furthermore, the speech time corresponding to Speech Text 1 is the same as the speech time corresponding to Speech Text 2. In other words, the speech time corresponding to Speech Text 2 after Speech Text 1 is merged remains unchanged and continues to be the time recorded by Offset. As shown in FIG31B above, the speech time corresponding to Speaker 1's first speech text remains 00:00.

[0465] Table 2

[0466] In some embodiments, after merging the speech text 1 into the speech text 2 , the tablet computer moves the cursor to the end position of the speech text 2 merged with the speech text 1 .

[0467] In some embodiments, the tablet computer supports exporting voice data and speech information. The tablet computer receives operation C (i.e., the fifth operation), which triggers the tablet computer to export the latest speech information. In response to operation C, the tablet computer exports the speech information currently displayed on the tablet computer, such as the latest speech information.

[0468] It should be understood that if the tablet computer is not in the speaker display state and the tablet computer is currently displaying the speech text in the speech information, then the tablet computer, in response to operation C (or the fifth operation), exports the currently displayed speech text. If the tablet computer is in the speaker display state and the tablet computer is currently displaying the entire content of the speech information, then the tablet computer, in response to operation C, exports the entire currently displayed speech information.

[0469] Among them, optionally, the tablet computer can support export in multiple formats, that is, it can save the speech information currently displayed on the tablet computer based on the first target format, that is, save the currently displayed speech information in the first target format to the target location, which can be the default save location or the storage location selected by the user.

[0470] In one example, the first target format may be a default format (or a default file format). The tablet computer displays an interface 90a as shown in FIG32A , which includes a control 91a for triggering the tablet computer to save the currently displayed speech information. In response to a user clicking the control 91a, the tablet computer saves the currently displayed speech information in a default format (e.g., txt format) to a target location. In addition, after saving, the tablet computer may also display location prompt information (as shown in location prompt information 92a in FIG32B ), which prompts the user where the currently displayed speech information is saved, making it easier for the user to view.

[0471] In another example, the first target format can be a format selected by the user (i.e., a file format). The tablet computer can display at least one first format option. After receiving the user's selection operation for the target format option in the at least one format option, in response to the selection operation of the target format option, the tablet computer can save the currently displayed speech information in the format corresponding to the target format option (i.e., the first target format). For example, in response to the user's click operation on the control 91a in Figure 32A above, the tablet computer displays five first format options as shown in Figure 32C: doc format option, txt format option, image format option, html format option, and docx format option. When the user wants to save the speech information in doc format, the user can click on the doc format option. In response to the click operation on the doc format option, the tablet computer can save the currently displayed speech information in doc format. After saving, the tablet computer can also display location prompt information (as shown in location prompt information 93a in Figure 32D), which prompts the user where the currently displayed speech information is saved for easy viewing.

[0472] In other embodiments, the tablet computer also supports sharing the speech information currently displayed on the tablet computer based on the second target format in response to operation D (or the sixth operation), such as the tablet computer shares the currently displayed speech information in the second target format to the application on the tablet computer.

[0473] The second target format is similar to the first target format and can be a default format or a format selected by the user. The second target format will be described in detail below with two examples.

[0474] In one example, the second target format is a default format. Exemplarily, in response to a sharing operation input by a user (such as a click operation on a sharing control), the tablet computer displays an interface including a third control, and the third control is used to trigger the tablet computer to display a first candidate application. Afterwards, in response to the user's selection operation of the first target application in the first candidate application, the currently displayed speech information in the second target format is shared to the first target application. The first candidate application refers to an application that can receive files in the second target format. For example, in response to the user's click operation on the sharing control 94a shown in Figure 32E, the tablet computer displays an interface 95a as shown in Figure 32F. The interface 95a displays the format of the currently displayed speech information (such as txt format), the speech information, the first candidate application 96a, etc. The first candidate application 96a represents an application that can receive files in txt format, so that the user can select the application to share according to needs.

[0475] In another example, the second target format is selected by the user. When the user wants to share the currently displayed speech information in picture format, the user can select the picture format sharing option displayed on the tablet (such as the share as picture option shown in Figure 32A above). In response to the user's selection of the picture format sharing option, an interface as shown in Figure 32G is displayed, which includes the currently displayed speech information 97a in picture format and a second candidate application 98a. The second candidate application 98a represents an application that can receive files in picture format, so that the user can select the application to share.

[0476] In some embodiments, as shown in Figure 32H, the tablet computer can display the currently displayed speech information in the first target format or the second target format on the interface displaying the relevant controls of the above-mentioned first voice file (such as the playback control, the first control, etc.), such as on the interface displaying the above-mentioned currently displayed information.

[0477] In some embodiments, the tablet computer may also export or share the speech information of all speakers or some speakers according to the user's choice. For example, in response to the above-mentioned control 91a, the tablet computer may display an export speaker option, which includes an export all option and at least one export speaker option. The export all option is used to trigger the tablet computer to export the speech information of all speakers. The export speaker option corresponds to the speaker identifier one by one, and the export speaker option is used to trigger the tablet computer to export the speech information of the speaker corresponding to the speaker option. Similarly, the tablet computer may also export or share the speech information according to the user's choice to determine whether there is content other than the speech text, such as the speaker identifier and the speech time.

[0478] In some embodiments, the tablet computer can also share the currently displayed speech information with other devices in a default or user-selected file format.

[0479] It should be noted that the above-mentioned sharing and exporting operations can be performed after the tablet computer stops recording (as shown in Figure 32A above). During the recording period, the tablet computer generally does not export or share the first voice file or the speech information corresponding to the first voice file. Operations such as displaying the speaker status switch, merging the speech text, filtering the speaker's speech information, and displaying the speech information of all speakers can be performed during the recording period or after the recording is stopped. For example, as shown in Figures 28A to 28C above, the tablet computer filters the speech text of speaker 1 after stopping the recording.

[0480] The above describes the electronic device's support for displaying speaker status switching, merging speech texts, filtering speaker speech information, and displaying all speaker speech information. The following describes the specific implementation process of the electronic device for filtering speaker speech information, displaying speaker status switching, merging speech texts, and displaying all speaker speech information, in conjunction with the software framework shown in FIG6 . Filtering speaker speech information may include S501-S505 shown in FIG33 .

[0481] The implementation process of displaying speaker status switching may include S506-S507 as shown in Figure 33. The implementation process of merging speakers may include S508-S512 as shown in Figure 33, and the implementation process of displaying speech information of all speakers may include S513-S517 as shown in Figure 33.

[0482] S501: The toolbar control panel receives a user's selection operation on a target speaker option.

[0483] The toolbar control panel may be a tool control in a recording card. The toolbar control panel (such as 80a shown in FIG. 31B ) is used to trigger the tablet computer to perform corresponding operations, such as recording, stopping recording, text conversion, displaying speaker status switching, exporting, sharing, filtering speakers, etc. The recording card (such as recording card 81a shown in FIG. 31B ) may also include speech information, etc.

[0484] S502: In response to the selection operation of the target speaker option, the toolbar control panel calls the data management module to query the target data list file for the speech information corresponding to the target speaker.

[0485] In an embodiment of the present application, when a user wants to view the speech information of some speakers, the user can click on the speaker filter control as shown in Figure 28A above. The tablet computer will display the speaker options for the user to select one or more speaker options. When the toolbar control panel obtains the speaker option selected by the user, it can use the speaker option selected by the user as the target speaker option. Afterwards, the toolbar control panel can call the data management module and use the database (DB) to query the speech information corresponding to the target speaker option in the target data list file. If the target speaker is speaker 1, the speech information corresponding to the target speaker is the speech information corresponding to speaker 1.

[0486] The target data list file (as shown in (a) of FIG34 ) includes the aforementioned speech information. That is, each speech information corresponds to one record in the target data list file. The Speaker field represents the speaker ID, which records the speaker ID in the speech information. The Offset field represents the speech time, which records the speech time in the speech information. The Content field represents the speech content, which records the speech text in the speech information.

[0487] In some embodiments, the speech information is carried by RecycleView, and each speech information is an item. An item includes multiple view components (such as TextView components). Among them, one TextView component among the multiple TextView components is used to carry the speech text, that is, one TextView component includes the speech text, and another TextView component is used to carry the speaker identifier.

[0488] Optionally, the speaker ID and speaking time can be in different view components or in the same view component.

[0489] In some embodiments, the database may store the target data list file. Accordingly, the data management module may directly query the target data list file from the database to obtain the speech information corresponding to the target speaker.

[0490] In other embodiments, the database may store a storage path corresponding to the target data list file. Accordingly, the data management module queries the storage path corresponding to the target data list file from the database, so as to query the target data list file using the storage path.

[0491] S503: The data management module sends the speech information corresponding to the target speaker to the data adapter.

[0492] S504: The data adapter performs an interface refresh operation.

[0493] S505 . The recycleview component displays the speech information corresponding to the target speaker on the textview component.

[0494] For example, the TextView component can be understood as being laid out on a RecycleView component. Each item of speech information is displayed via a corresponding TextView. As shown in Figure 34(b), the speaker ID and speaker text are placed on different TextViews. When displaying speakers, adjacent speech files are separated by a TextView.

[0495] In some embodiments, an imgview may be further arranged on the recycleview component, which may be used to display a speaker's avatar. For example, the speaker's avatar may be displayed on the left side of the speaking time.

[0496] The above describes the implementation process of filtering the speaker's speech information. The following will continue to introduce the implementation process of displaying the speaker status switch.

[0497] S506: When the tablet computer is in a state of displaying a speaker, the toolbar control panel receives a click operation for stopping displaying a speaker control.

[0498] S507 : In response to the click operation for stopping displaying the speaker control, the toolbar control panel triggers the recycleview component to call the data adapter to hide information other than the speech text in the speech information.

[0499] For example, when the toolbar control panel receives a user click operation to stop displaying the speaker control, it indicates that it is necessary to cancel the display of the speaker (such as the speaker ID and speaking time) and only display the speech text. Therefore, it can trigger the recycleview component to call the data adapter to hide the textview used to display the speaking time and speaker ID, so that only the speech text is displayed, meeting the user's need to cancel the display of the speaker.

[0500] The above describes the implementation process of speaker status switching. The following will continue to introduce the implementation process of merging speech texts.

[0501] S508 : When the textview component monitors the keyboard delete event, it determines whether the current position of the cursor is at the beginning position of the speech text 1 .

[0502] Among them, the speech text displayed by the textview component that monitors the keyboard delete event may be speech text 1.

[0503] For example, the user places the cursor in a speech text, the tablet enters the editing state, and displays the soft keyboard. Afterwards, when the user clicks the delete key on the soft keyboard, the textview component listens for the keyboard delete event and needs to use the current cursor position to determine the user's usage needs.

[0504] S509. When at the above starting position, the textview component calls the data management module to add speech text 1 in the target data list file to the end position of speech text 2 in the target data list file, deletes the speech information where speech text 1 is located, and obtains the latest target data list file.

[0505] For example, suppose the tablet currently displays all the speakers' speech texts (as shown in FIG25A ), and Speech Text 1 is "Okay, do you need anything to bring?" and Speech Text 2 is "The weather is nice today, shall we go to the park together?" The data management module can then splice Speech Text 1 in the target data list file to Speech Text 2 to obtain updated Speech Text 2, and delete the speech information belonging to Speech Text 1 in the target data list file, that is, delete the record belonging to Speech Text 1, to obtain the latest target data list file, as shown in FIG35 .

[0506] S510: The data management module sends the latest target data list file to the data adapter.

[0507] S511: The data adapter performs an interface refresh operation.

[0508] S512. The recycleview component displays the latest speech text on the textview component.

[0509] Exemplarily, the latest speech text includes the updated speech text 2 but not speech text 1. When the tablet computer is in a state where the speaker is not displayed, the speech text in the latest target data list will be displayed (as shown in FIG. 31A above), but the speaker identification and speech time will not be displayed.

[0510] When the tablet computer is in the speaker display state, all the contents of the speech information in the latest target data list (as shown in FIG. 31B ) will be displayed, that is, not only the latest speech text but also the speaker identification and speech time will be displayed.

[0511] The above describes the implementation process of merging speech texts. The following will continue to introduce the implementation process of displaying the speech information of all speakers.

[0512] S513: The toolbar control panel receives the user's selection operation on all speaker options.

[0513] For example, when the user wants the tablet to display the speech information of all speakers, the user can select the All Speakers option (such as the All options shown in FIG. 28B ). The toolbar control panel queries the speech information of all speakers based on the selection operation of the All Speakers option.

[0514] S514 : In response to the selection operation on the all speakers option, the toolbar control panel calls the data management module to query the speech information corresponding to all speakers in the target data list file.

[0515] S515: The data management module sends the speech information corresponding to all speakers to the data adapter.

[0516] S516: The data adapter performs an interface refresh operation.

[0517] S517. The recycleview component displays the speech information corresponding to all speakers on the textview component.

[0518] In some embodiments, the above-mentioned toolbar control panel is provided by the note application, and the toolbar control panel may further include a recording control. As shown in Figure 36, when the user clicks the recording control, the toolbar control panel responds to the click operation of the recording control, triggers the recording module to record, and collects the corresponding voice data. Correspondingly, the tablet computer supports automatic real-time voice-to-text conversion, so the recording module can send voice data to the voice-to-text service. Afterwards, the voice-to-text service can send it to the note application after the conversion is successful. After obtaining the speech information, the note application can display it on the corresponding textview component on the recycleview component, and perform data storage through the data management module to realize the storage of speech information.

[0519] Among them, the speech-to-text service can be located in the cloud as shown in Figure 36 above, or the speech-to-text service can be located locally on the tablet computer, and this application does not limit it.

[0520] In some embodiments, the present application provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the voice processing method as described above.

[0521] In some embodiments, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the speech processing method described above.

[0522] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0523] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0524] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0525] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0526] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0527] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A speech processing method, characterized in that: include: When the electronic device displays the first interface of the first note in the note application, the electronic device converts the acquired latest voice data into corresponding latest speech information, the first interface includes a first recording card, the first recording card includes a first control; the first control is used to trigger the stop of recording; The electronic device displays the latest speech information in the first recording card; In response to the triggering operation of the first control, the electronic device displays a second interface of the first note, the second interface includes a second recording card; wherein the second recording card includes a plurality of speech information and a second control; the second control is used to trigger recording; the speech information includes at least a speech text; the second control is used to trigger recording; In response to a long press operation input by the user, the electronic device updates the second recording card to a third recording card, in which a target character area in the spliced ​​character string is selected; wherein the spliced ​​character is obtained by splicing the multiple speech information; the target character area is determined based on a starting position and an ending position corresponding to the long press operation, and the target character area includes at least two speech information among the multiple speech information or one speech information among the multiple speech information in different rows; The electronic device displays at least one function control, and the function control is used to trigger the electronic device to perform corresponding processing on the characters in the target character area.

2. The method according to claim 1, characterized in that The target character area includes characters corresponding to the offset character position and characters of the selected character number after the offset character position; The offset character position indicates the number of characters starting from the first character in the plurality of speech information and ending at the starting position corresponding to the long press operation; the offset character position indicates the position of the first selected character relative to the concatenated character string; The number of selected characters is determined based on the starting position and the ending position corresponding to the long press operation.

3. The method according to claim 1 or 2, characterized in that: The concatenated character string is concatenated from the first character in the plurality of speech information to the last character in the plurality of speech information.

4. The method according to any one of claims 1 to 3, characterized in that The second recording card includes a sliding component, and the plurality of speech information is carried by the sliding component; The electronic device updates the second recording card to a third recording card, including: The electronic device replaces the sliding component in the second recording card with a preset text component; The electronic device displays the spliced ​​character string in the preset text component to obtain the third recording card.

5. The method according to claim 4, characterized in that After displaying at least one functional control, the method further includes: When the function control stops displaying, the electronic device replaces the preset text component of the third recording card with the sliding component, and the sliding component carries the multiple speech information.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: In response to a click operation input by a user, when the click position corresponding to the click operation is in the speech text, if the electronic device is not in a playing state, the electronic device enters an editing state; If the electronic device is in the playing state, the electronic device plays the voice data corresponding to the first speaking time; wherein the first speaking time indicates the speaking time corresponding to the character corresponding to the click position; The playing state indicates that the electronic device plays voice data.

7. The method according to claim 6, characterized in that The second recording card also includes a progress bar; If the electronic device is in the playing state, the method further includes: The electronic device moves the playing progress of the progress bar to the first speaking time.

8. The method according to claim 6 or 7, characterized in that: The first speech time is obtained by taking the speech start time corresponding to the first target speech text as a reference and superimposing the offset time; the offset time is obtained based on the speech speed corresponding to the first target speech text and the number of offset characters; the number of offset characters refers to the number of characters in the first target speech text that are before the click position; The first target speech text indicates the speech text at the click position.

9. The method according to any one of claims 1 to 5, characterized in that The speech information also includes a speaker identification; The method further comprises: In response to a click operation input by a user, when the click position corresponding to the click operation is at the speaker identifier, if the electronic device is not in a playing state, the electronic device displays a speaker modification control; the speaker modification control is used to trigger the electronic device to modify the speaker identifier; If the electronic device is in the playing state, the electronic device plays the voice data corresponding to the target speech start time; the target speech start time refers to the speech start time corresponding to the speaker identifier; The playing state indicates that the electronic device plays voice data.

10. A speech processing method, characterized in that: include: When the electronic device displays the first interface of the first note in the note application, the electronic device converts the acquired latest voice data into corresponding latest speech information, the first interface includes a first recording card, the first recording card includes a first control; the first control is used to trigger the stop of recording; The electronic device displays the latest speech information in the first recording card; In response to the triggering operation of the first control, the electronic device displays a second interface of the first note, the second interface includes a second recording card; wherein the second recording card includes first speech information, second speech information and a second control; the first speech information includes a first speech text, and the second speech information includes a second speech text; the speech time corresponding to the first speech information is earlier than the speech time corresponding to the second speech information, and the first speech information and the second speech information are displayed adjacently; the second control is used to trigger recording; In response to a first operation on the second speech text, displaying a cursor at the beginning of a line of the second speech text; In response to a deletion operation input by the user, the electronic device updates the second recording card to a fourth recording card, in which the second speech text and the first speech text are merged into the third speech information, and the second speech information is deleted; the speaker identifier corresponding to the third speech information is the same as the speaker identifier corresponding to the second speech text.

11. The method according to claim 10, characterized in that The electronic device updates the second recording card to a fourth recording card, including: When the second recording card does not display the speaker identifier, the electronic device updates the second recording card to a fourth recording card.

12. The method according to claim 11, characterized in that The first speech information also includes a speaker identifier corresponding to the first speech text; the second speech information also includes a speaker identifier corresponding to the second speech text; The method further comprises: The electronic device receives a second operation input by the user; the second operation is used to trigger the electronic device to stop displaying the speaker identification; In response to the second operation, the electronic device updates the second recording card to a fifth recording card, wherein the fifth recording card includes the first speech text and the second speech text, but does not include a speaker identifier corresponding to the first speech text and a speaker identifier corresponding to the second speech text; The electronic device updates the second recording card to a fourth recording card, including: The electronic device updates the fifth recording card to a fourth recording card.

13. The method according to claim 11, characterized in that The first speech information also includes a speaker identifier corresponding to the first speech text; the second speech information also includes a speaker identifier corresponding to the second speech text; In response to the deletion operation input by the user, the electronic device updates the second recording card to a fourth recording card, comprising: In response to a deletion operation input by the user, the electronic device updates the second recording card to a fifth recording card, wherein the fifth recording card includes the first speech text and the second speech text, but does not include a speaker identifier corresponding to the first speech text and a speaker identifier corresponding to the second speech text; The electronic device updates the fifth recording card to a fourth recording card.

14. The method according to any one of claims 10 to 13, characterized in that The second recording card further includes fourth speech information, the fourth speech information includes a fourth speech text, the speech time corresponding to the fourth speech information is between the speech time corresponding to the first speech information and the speech time corresponding to the second speech information; the first speech text and the second speech text correspond to the first speaker identifier; The speaker identifier corresponding to the fourth speech text is different from the first speaker identifier; The method further comprises: receiving a third operation on the second recording card; the third operation is used to trigger the electronic device to display all speech information corresponding to the first speaker identifier; In response to the third operation, the electronic device updates the second recording card to a sixth recording card; the sixth recording card includes all speech information corresponding to the first speaker identifier, but does not include the fourth speech information; The electronic device updates the second recording card to a fourth recording card, including: The electronic device updates the sixth recording card to a fourth recording card.

15. The method according to claim 14, characterized in that After the electronic device updates the sixth recording card to a fourth recording card, the method further includes: The electronic device receives a fourth operation on the fourth recording card, where the fourth operation is used to trigger the electronic device to display speech information corresponding to all speaker identifiers; In response to the fourth operation, the electronic device displays a seventh recording card; the seventh recording card includes the fourth speech information, and the fourth speech information is located after the third speech information.

16. The method according to any one of claims 10 to 13, characterized in that The speaker identifier corresponding to the first speech text is different from the speaker identifier corresponding to the second speech text.

17. The method according to any one of claims 10 to 16, characterized in that The first speech information and the second speech information are carried by a sliding component, the first speech information is carried by a first item in the sliding component, and the second speech information is carried by a second item in the sliding component, and the first item and the second item are different; wherein the text component in the first item includes the first speech text, and the text component in the second item includes the second speech text; The second speech text and the first speech text are merged into the third speech information, and the second speech information is deleted, including: the second speech text in the text component in the second item is merged into the text component in the first item, and the second item is deleted.

18. The method according to any one of claims 10 to 16, characterized in that The electronic device includes a target data list file, the target data list file includes a plurality of records, each of the plurality of records corresponds to a speech information; each record includes a speech text corresponding to a speech text field; The method further comprises: In response to the deletion operation, the electronic device merges the second speech text corresponding to the speech text field in the second record in the target data list into the first speech text corresponding to the speech text field in the first record; the first record corresponds to the first speech information, and the second record corresponds to the second speech information.

19. The method according to any one of claims 10 to 18, characterized in that In response to the fifth operation, the electronic device saves all currently displayed speech information based on a first target format; the first target format represents a default file format or a selected file format; or, In response to the sixth operation, the electronic device shares all the currently displayed speech information with an application of the electronic device based on a second target format; the second target format represents a default file format or a selected file format; All the currently displayed speech information corresponds to the same speaker identifier.

20. An electronic device, characterized in that: The electronic device includes a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, and the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes the method described in any one of claims 1 to 19.

21. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 19.

Images