Voice processing method and electronic equipment

Abstract

The invention provides a voice processing method and electronic equipment, and relates to the technical field of audio processing. After the electronic equipment converts a voice file into a text, if a first operation input by a user for a speaking text of a certain spokesman in the text is received, the electronic equipment displays a cursor at the line head of the speaking text. Afterwards, under the condition that the deletion operation for the speaking text 1 is received, it is indicated that the electronic equipment needs to carry out cross-section combination, the electronic equipment can add the speaking text to the previous speaking text of the speaking text, cross-section combination of different speaking texts is achieved, and the method is suitable for the electronic equipment. Therefore, when a spokesman identifies mistakenly, a user considers that two adjacent sections of speaking texts are associated, or the user wants to integrate the speaking texts of the same spokesman, the electronic equipment can be implemented by combining the speaking texts, rich services are provided for the user, the use requirements of the user are met, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of audio processing, and in particular to a voice processing method and electronic equipment. Background Art

[0002] With the development of electronic devices, the functions provided by electronic devices are becoming more and more abundant. For example, electronic devices provide a recording function. In daily work and study, many users will use the recording function of electronic devices. For example, users add recordings to notes.

[0003] At present, electronic devices generally provide basic services for voice data obtained by recording, such as services that support converting voice data into text, so that users can intuitively know the speaker's speech through text. However, when users have other needs for using voice data, since electronic devices do not provide corresponding services, the user's needs are not met. Therefore, electronic devices urgently need to provide richer services for voice data to meet user needs. Summary of the invention

[0004] In view of this, the present application provides a speech processing method and electronic device for realizing cross-segment merging of speech texts and providing richer services for voice data.

[0005] In a first aspect, the present application provides a voice processing method, wherein during recording, an electronic device displays a first interface of a first note in a note application, wherein the first interface includes a first recording card, and the first recording card displays a first control for triggering stopping recording.

[0006] After receiving the latest voice data, the electronic device converts the latest voice data into text to obtain the latest speech information corresponding to the latest voice data.

[0007] Afterwards, the electronic device adds the latest speech information to the first recording card. Afterwards, after receiving a trigger operation (such as a click operation) from the user on the above-mentioned first control, the electronic device responds to the trigger operation, stops recording, and displays the second interface of the first note, and the recording card displayed on the second interface serves as the second recording card. The second recording card may include all speech information obtained during the recording, such as the first speech information and the second speech information. The first speech information includes the first speech text, and the second speech information includes the second speech text; the speech time corresponding to the first speech information is earlier than the speech time corresponding to the second speech information, and the first speech information and the second speech information are displayed adjacent to each other; the second recording card also includes a second control for triggering continued recording.

[0008] Afterwards, after receiving the user's first operation on the second speech text, in response to the first operation, a cursor is displayed at the beginning of a line of the second speech text, that is, the first operation is used to trigger the electronic device to display the cursor at the beginning of a line of the second speech text.

[0009] Afterwards, after receiving the deletion operation input by the user, in response to the deletion operation, the electronic device updates the second recording card to a third recording card. In the third recording card, the second speech text and the first speech text are merged into the third speech information, that is, the second speech text is merged into the first speech text, the second speech information is deleted, and the speaker identifier corresponding to the third speech information is the same as the speaker identifier corresponding to the second speech text.

[0010] In the present application, the note application provides a recording function, and the user can add a recording while editing a note (such as the first note). Accordingly, during the recording, the electronic device converts the received voice data into speech information in real time and displays it, intuitively showing the speech content, so that the user can quickly know the speech content corresponding to the voice data. Afterwards, when the recording is stopped, if the user wants to merge a speech text (such as the second speech text) into another speech text (such as the first speech text), the user can perform a first operation on the second speech text. In response to the first operation, the electronic device displays the cursor at the beginning of the line of the second speech text. Afterwards, after the electronic device receives the deletion operation input by the user, since the cursor is located at the beginning of the line of the second speech text and there are no characters of the second speech text before the cursor, the electronic device can determine that the deletion operation is not intended to delete the characters before the cursor, but to merge the second speech text into the first speech text. The electronic device can then respond to the deletion operation and merge the second speech text into the first speech text to achieve cross-line merging of the speech texts. Further, when the speaker recognizes an error, the user believes that two adjacent speech texts are related, or the user wants to integrate the speech texts of the same speaker together, the electronic device can achieve this by merging the speech texts, thereby providing users with rich services, meeting users' usage needs, and improving user experience.

[0011] The first operation may be a click operation on the beginning of a line of the second speech text, such as the user clicking the beginning of a line of the second speech text with a finger or a mouse.

[0012] In one possible design, when the second recording card does not display the speaker ID, it indicates that the electronic device is not in the state of displaying the speaker. The electronic device can update the second recording card to the third recording card to achieve cross-segment merging of speech texts. If the second recording card displays a speaker ID, it indicates that the electronic device is in the state of displaying the speaker. The speech texts in different speech information, that is, the speech texts in different segments are separated by speaker IDs. In response to the deletion operation input by the user, the electronic device will add the second speech text to the previous segment (or describe it as the previous line) of the second speech text, that is, merge the second speech text into the line where the speaker ID corresponding to the second speech text is located, and cannot merge the second speech text into the first speech text, resulting in the failure of cross-line merging of speech texts. Therefore, the electronic device needs to merge the speech texts across lines when it is not in the speaker state.

[0013] In one possible design, in order to achieve cross-line merging of speech texts, when the electronic device displays the speaker identifier corresponding to the first speech text and the speaker identifier corresponding to the second speech text on the second recording card, it indicates that the electronic device is in a state of displaying the speaker, and the electronic device receives a second operation input by the user, and the second operation can trigger the electronic device to stop displaying the speaker identifier.

[0014] In response to the second operation, the electronic device updates the second recording card to the fourth recording card, the fourth recording card includes the first speech text and the second speech text, and does not include the speaker identifier corresponding to the first speech text and the speaker identifier corresponding to the second speech text, that is, the electronic device stops displaying the speaker identifier on the second recording card, and only displays the speech text, realizing the switching of the display speaker status. Correspondingly, after receiving the deletion operation, the electronic device can respond to the deletion operation and update the fourth recording card to the third recording card, that is, merge the cross-line speech texts.

[0015] Optionally, the second operation may be a click operation on stopping displaying the speaker control.

[0016] In another possible design, in order to ensure the merging of speech texts across lines, when the electronic device is in the display speaker state and receives a delete operation, it can automatically switch the display speaker state, that is, automatically update the above-mentioned second recording card to the fourth recording card, thereby realizing rapid switching of the display speaker state and enabling the merging of speech texts across lines.

[0017] In a possible design method, the first speech information and the second speech information are laid out through a sliding component (such as recycleview), the first speech information is carried by the first item in the sliding component, and the second speech information is carried by the second item in the sliding component, and the first item and the second item are different; wherein, the text component in the first item includes the first speech text, and the text component in the second item includes the second speech text.

[0018] In a possible design, the text component may be a textview, and the first item includes at least two textviews, one of which is used to carry the speaker ID, and the other is used to carry the speech text. The textview to which the speaker ID belongs (or corresponds) is generally located above the textview to which the speech text belongs.

[0019] Correspondingly, the above text merging process may include: the electronic device merges the second speech text in the text component in the second item into the text component in the first item, and deletes the second item.

[0020] In a possible design, the speaker identifier corresponding to the first speech text is different from the speaker identifier corresponding to the second speech text. When the voiceprint recognition is wrong, the second speech text is actually the speech content of the speaker corresponding to the first speech text. By merging the second speech text into the first speech text, the speaker's correction can be achieved to ensure the accuracy of the text.

[0021] In a possible design, the second recording card may further include fourth speech information, the fourth speech information includes a fourth speech text, the speech time corresponding to the fourth speech information is between the speech time corresponding to the first speech information and the speech time corresponding to the second speech information; the first speech text and the second speech text correspond to the first speaker identifier; the speaker identifier corresponding to the fourth speech text is different from the first speaker identifier;

[0022] In order to integrate the speech information of the same speaker, the electronic device can first filter out the speech information of the speaker and then merge across rows. Specifically, the electronic device can receive a third operation on the second recording card, and the third operation is used to trigger the electronic device to display the speech information corresponding to the first speaker identifier in the multiple speech information;

[0023] In response to the third operation, the electronic device displays the fifth recording card, which includes all speech information corresponding to the first speaker identifier but does not include the fourth speech information. That is, the electronic device stops displaying speech information on the second recording card except the speech information corresponding to the first speaker identifier, thereby implementing the screening of speech information.

[0024] Correspondingly, after receiving the deletion operation, the electronic device can respond to the deletion operation and update the fifth recording card to the third recording card, that is, merge the speech texts across lines.

[0025] Optionally, the fourth operation may be a selection operation of an option corresponding to the first speaker identifier.

[0026] In a possible design, after integrating multiple speech information of the same speaker, the electronic device can redisplay the speech information corresponding to all speaker identifiers. Specifically, the electronic device receives a fourth operation on the third recording card, and the fourth operation is used to trigger the electronic device to display all speech information. In response to the fourth operation, the electronic device displays a sixth recording card, and the sixth recording card displays the speech information corresponding to all speaker identifiers. For example, the sixth recording card includes the fourth speech information, and the fourth speech information is after the third speech information, so that the second speech text is displayed above the fourth speech information.

[0027] In one possible design, in response to the fifth operation, the electronic device saves all currently displayed speech information based on the first target format; the first target format represents a default file format or a selected file format. All currently displayed speech information corresponds to the same speaker identifier, thereby achieving targeted saving of the speech information.

[0028] In one possible design, the electronic device responds to the sixth operation, and based on the second target format, the electronic device shares all currently displayed speech information with the application of the electronic device; the second target format represents a default file format or a selected file format, wherein all currently displayed speech information corresponds to the same speaker identifier, thereby realizing targeted sharing of speech information.

[0029] In one possible design, the speech information obtained during recording is saved in a target data list file. When performing cross-text merging, the electronic device can also merge the second speech text in the target data list file into the first speech text and delete the second speech information. Specifically, the target data list file includes multiple records, each of the multiple records corresponds to a speech information, that is, the content in the speech information is stored through records; each record includes a speech text corresponding to a speech text field (or column name). Accordingly, after receiving a delete operation input by the user, the electronic device can respond to the delete operation by merging the second speech text corresponding to the speech text field in the second record in the target data list into the first speech text corresponding to the speech text field in the first record; the first record corresponds to the first speech information, and the second record corresponds to the second speech information.

[0030] In a second aspect, the present application provides a voice processing method, wherein the electronic device displays a first interface of a first note in a note application, the first interface includes a first recording card, the first recording card includes a first control; the first control is used to trigger the stop of recording;

[0031] When the electronic device displays the first interface of the first note in the note application, the electronic device converts the acquired latest voice data into corresponding latest speech information, the first interface includes a first recording card, the first recording card includes a first control; the first control is used to trigger the stop of recording;

[0032] The electronic device displays the latest speech information in the first recording card;

[0033] In response to the triggering operation of the first control, the electronic device displays a second interface of the first note, the second interface includes a second recording card; wherein the second recording card includes first speech information, second speech information and a second control; the first speech information includes a first speech text, and the second speech information includes a second speech text; the speech time corresponding to the first speech information is earlier than the speech time corresponding to the second speech information, and the first speech information and the second speech information are displayed adjacently; the second control is used to trigger recording;

[0034] In response to a seventh operation on the second speech text (such as clicking the second speech text), displaying a merge control;

[0035] In response to a user clicking operation on a merge control, the electronic device updates the second recording card to a third recording card, in which the second speech text and the first speech text are merged into the third speech information, and the second speech information is deleted; the speaker identifier corresponding to the third speech information is the same as the speaker identifier corresponding to the second speech text.

[0036] In a third aspect, the present application provides an electronic device, comprising a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, and the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes a speech processing method as described in any one of the above-mentioned first aspects.

[0037] In a fourth aspect, the present application provides a computer-readable storage medium, comprising computer instructions, which, when executed on an electronic device, enables the electronic device to execute a speech processing method as described in any one of the above-mentioned first aspects.

[0038] In a fifth aspect, the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the speech processing method as described in any one of the above-mentioned first aspects.

[0039] It can be understood that the beneficial effects that can be achieved by the speech processing method described in the second aspect, the electronic device described in the third aspect, the computer-readable storage medium described in the fourth aspect, and the computer program product described in the fifth aspect provided above can refer to the beneficial effects in the first aspect and any possible design method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1A A schematic diagram of an interface for recording notes provided in an embodiment of the present application;

[0041] Figure 1B A second schematic diagram of an interface for recording notes provided in an embodiment of the present application;

[0042] Figure 1C A third schematic diagram of an interface for recording notes provided in an embodiment of the present application;

[0043] Figure 2A A schematic diagram of an interface of a recording application provided in an embodiment of the present application;

[0044] Figure 2B A second schematic diagram of an interface of a recording application provided in an embodiment of the present application;

[0045] Figure 2C A third schematic diagram of an interface of a recording application provided in an embodiment of the present application;

[0046] Figure 2D A schematic diagram of an interface of a recording file provided in an embodiment of the present application;

[0047] Figure 3A A diagram of a call recording interface provided in an embodiment of the present application;

[0048] Figure 3B A second schematic diagram of a call recording interface provided in an embodiment of the present application;

[0049] Figure 3C A second schematic diagram of an interface of a recording file provided in an embodiment of the present application;

[0050] Figure 4A A schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0051] Figure 4B A second schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0052] Figure 4C A third schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0053] Figure 5 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0054] Figure 6 A schematic diagram of a software framework of an electronic device provided in an embodiment of the present application;

[0055] Figure 7 A flowchart of a speech processing method provided in an embodiment of the present application is shown in FIG1 ;

[0056] Fig. 8A A fourth schematic diagram of a speech-to-text interface provided in an embodiment of the present application;

[0057] Figure 8B A speech-to-text interface provided in an embodiment of the present application Figure 5 ;

[0058] Figure 8C A speech-to-text interface provided in an embodiment of the present application Figure 6 ;

[0059] Fig.8D A speech-to-text interface provided in an embodiment of the present application Figure 7 ;

[0060] Fig. 8E Schematic diagram 8 of a speech-to-text interface provided in an embodiment of the present application;

[0061] Figure 8F A speech-to-text interface provided in an embodiment of the present application Figure 9 ;

[0062] Figure 8G Schematic diagram 1 of a deletion control provided in an embodiment of the present application;

[0063] Figure 8H Schematic diagram 2 of a deletion control provided in an embodiment of the present application;

[0064] Figure 8I Schematic diagram 3 of a deletion control provided in an embodiment of the present application;

[0065] Figure 8J A schematic diagram of a text processing interface provided in an embodiment of the present application;

[0066] Fig. 9 A second schematic diagram of a text processing interface provided in an embodiment of the present application;

[0067] Fig. 10A A third diagram of a text processing interface provided in an embodiment of the present application;

[0068] Fig. 10B A fourth diagram of a text processing interface provided in an embodiment of the present application;

[0069] Fig.11 A schematic diagram of a prompt interface provided in an embodiment of the present application;

[0070] Fig.12 A text processing interface provided in an embodiment of the present application Figure 5 ;

[0071] Fig.13A A text processing interface provided in an embodiment of the present application Figure 6 ;

[0072] Fig. 13B A text processing interface provided in an embodiment of the present application Figure 7 ;

[0073] Fig. 13C Schematic diagram 8 of a text processing interface provided in an embodiment of the present application;

[0074] Fig.14A A text processing interface provided in an embodiment of the present application Figure 9 ;

[0075] Fig. 14B Schematic diagram 10 of a text processing interface provided in an embodiment of the present application;

[0076] Fig. 14C A text processing interface provided in an embodiment of the present application Figure 11 ;

[0077] Fig.15 A text processing interface provided in an embodiment of the present application Figure 12 ;

[0078] Fig.16A 13. Schematic diagram of a text processing interface provided in an embodiment of the present application;

[0079] Fig. 16B Schematic diagram 14 of a text processing interface provided in an embodiment of the present application;

[0080] Fig.17A Schematic diagram 1 of a text saving interface provided in an embodiment of the present application;

[0081] Fig. 17B Schematic diagram 2 of a text saving interface provided in an embodiment of the present application;

[0082] Fig. 17C Schematic diagram 3 of a text saving interface provided in an embodiment of the present application;

[0083] Fig.17D Schematic diagram 4 of a text saving interface provided in an embodiment of the present application;

[0084] Fig.17E Schematic diagram 1 of a text sharing interface provided in an embodiment of the present application;

[0085] Fig.17F Schematic diagram 2 of a text sharing interface provided in an embodiment of the present application;

[0086] Figure 17G Schematic diagram 3 of a text sharing interface provided in an embodiment of the present application;

[0087] Fig.17H A text saving interface provided in an embodiment of the present application Figure 5 ;

[0088] Fig.18 A second flowchart of a speech processing method provided in an embodiment of the present application;

[0089] Fig.19 A schematic diagram of data storage and display provided in an embodiment of the present application;

[0090] Fig. 20A data storage schematic diagram provided in an embodiment of the present application;

[0091] Fig.21 A schematic diagram of a speech processing process provided in an embodiment of the present application. DETAILED DESCRIPTION

[0092] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0093] Electronic devices (such as tablet computers) generally provide a recording function. Users can use the recording function of the tablet computer to record. For example, the tablet computer can support the function of recording notes. When the user uses the note application of the tablet computer to record notes, he can add a recording to the note, that is, add a recording card. For example, the user clicks on Figure 1A The tablet computer starts recording in response to a click operation of the start recording control 11 on the first note interface 10, and displays the following Figure 1B The tablet computer receives a click operation of the pause recording control (or stop recording control) 13 on the second note interface 12, indicating that the user wants to stop recording. The tablet computer can respond to the click operation of the pause recording control 13 by stopping recording and displaying the following Figure 1C The third note interface 14 is shown. Compared with the recording duration (i.e. 03:10) displayed on the first note interface 10, the recording duration (i.e. 04:10) displayed on the third note interface 14 is longer. The third note interface 14 may also include controls such as a recording playback control 15, which may be used to trigger the tablet computer to play the recording.

[0094] For another example, the tablet computer also includes a recording application, so that the user can record through the recording application. Figure 2A The tablet computer responds to the click operation of the recording application icon 20, starts the recording application, and displays the following Figure 2B The recording interface includes a start recording control 22, which can be used to trigger the tablet computer to start recording. Later, when the user wants to record, the user can click the start recording control 22. In response to the click operation of the start recording control 22, the tablet computer can start recording and display the following Figure 2CThe interface 23 shown in the figure includes a stop recording control 24 and a recording time prompt information 25. The stop recording control 24 can be used to trigger the tablet computer to stop recording, and the recording time prompt information indicates the elapsed recording time. Later, when the user wants to stop recording, the user can click the stop recording control 24. In response to the click operation of the stop recording control 24, the tablet computer can stop recording and generate a corresponding voice file (such as Figure 2D The audio file shown in 1).

[0095] For another example, during a call, the tablet supports the call recording function, that is, the user can use the recording function provided by the tablet to record the call content. The user can click Figure 3A In response to the click operation of the start recording control 30, the tablet computer can start recording and display the following Figure 3B When the user wants to stop recording the call content, the user can click the stop recording control 31. In response to the click operation of the stop recording control 31, the tablet computer can stop recording and generate a corresponding voice file (such as Figure 3C Alternatively, when the call ends, the tablet computer can automatically end the recording and generate a corresponding recording file without the user having to manually stop the recording.

[0096] It should be noted that the above-mentioned start recording control 11 and the above-mentioned pause recording control 13 can be different controls, or they can be the same control. Specifically, when the tablet computer is recording, the control is in the recording-on state, and the control can be used as the pause recording control 13. After receiving the user's click operation on the pause recording control 13, the tablet computer can stop recording, and the control is in the recording-stop state, and the control can be used as the start recording control 11. Similarly, the above-mentioned start recording control 22 and the above-mentioned stop recording control 24 can be different controls, or they can be the same control. The above-mentioned start recording control 30 and the above-mentioned stop recording control 31 can also be different controls, or they can be the same control, and this application does not limit them.

[0097] In some embodiments, the electronic device also supports a service for converting voice files to text. Figure 4A The electronic device starts playing the voice file 3 and displays the following Figure 4B The interface shown in FIG. 4 provides a text conversion control 40, which is used to trigger the electronic device to convert the voice file (or recording file) into text. After the electronic device receives the trigger operation (such as a click operation) of the text conversion control 40, the electronic device can convert the voice file 3 into text. Afterwards, after the conversion is successful, the electronic device can display the following information: Figure 4CThe interface shown in FIG. 1 shows the speaker identification (such as speaker 1, speaker 2) and the corresponding speech text, speech time and other speech information. The speech text represents the speaker's speech content, which is obtained by converting the voice file (such as Figure 4C The speech time corresponding to the speech text indicates the speech time of the speech content (such as "The weather is very good today, shall we go to the park together?"). Figure 4C 00:00, 00:20, etc. as shown).

[0098] However, users may have other usage requirements, such as the need to edit speech text across lines (or paragraphs), that is, to merge the next speech text into the previous speech text. For example, due to the possibility of conversion errors (such as voiceprint recognition errors) in speech-to-text services, the speech content of one speaker may be recognized as the speech content of another person. Figure 4C The speech text 41 of speaker 1 is actually the speech content of speaker 2. In order to improve the accuracy of the text, the user wants to merge speaker 1's speech text 41 into the previous speech text, that is, to turn it into the speech content of speaker 2. For another example, the user believes that there is a connection between two adjacent speech texts of speaker 1, and wants to merge the two adjacent speech texts into one speech text. For example, the user wants to merge speaker 1's speech text 42 into speaker 1's speech text 43. For another example, the user wants to integrate the speech text of one speaker together, and then display the speech content of other speakers. For example, the user wants to Figure 4C As shown, the speech text 41 of speaker 1 and the speech text 43 of speaker 1 are integrated together, and then the speech information of speaker 2 is displayed.

[0099] Therefore, in order to meet more user needs, the electronic device provides a voice processing method, and the electronic device displays the converted speech information after real-time text conversion of the received voice data. When the user wants to merge the speech text (i.e., speech text 1) in a certain speech information into the speech text (i.e., speech text 2) in the previous speech information displayed adjacent to the speech information, the user can perform a first operation on the speech text 1, and the electronic device responds to the first operation by displaying the cursor at the beginning of the line of the speech text 1. Afterwards, when a deletion operation is received for speech text 1, it indicates that the electronic device needs to perform cross-segment editing, that is, it needs to merge the speech text 1 into the previous speech text of speech text 1 (that is, speech text 2). The electronic device can add the speech text 1 to speech text 2 to obtain the updated speech text 2, and delete speech text 1, so that the electronic device can display the updated speech text 2 instead of speech text 1, thereby realizing the cross-line merging of speech texts. Further, when the speaker recognizes an error, the user believes that there is a connection between two adjacent speech texts, or the user wants to integrate the speech texts of the same speaker together, the electronic device can achieve this by merging the speech texts, thereby providing users with rich services, meeting users' usage needs, and improving user experience.

[0100] Exemplarily, the electronic device in the embodiments of the present application may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR)\virtual reality (VR) device, and other electronic devices with a recording function. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0101] For example, Figure 51 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195.

[0102] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0103] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0104] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0105] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0106] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0107] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0108] The charging management module 140 is used to receive charging input from a charger. While the charging management module 140 is charging the battery 142 , it can also power the electronic device through the power management module 141 .

[0109] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0110] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0111] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0112] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0113] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0114] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0115] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0116] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0117] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0118] The ISP is used to process data fed back by the camera 193 .

[0119] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0120] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0121] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0122] NPU is a neural-network (NN) computing processor. It can quickly process input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.

[0123] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .

[0124] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0125] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0126] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0127] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0128] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0129] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0130] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0131] Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0132] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0133] The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0134] The SIM card interface 195 is used to connect a SIM card.

[0135] The software system of the electronic device 200 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. TM Taking the system as an example, the software structure of the electronic device 200 is exemplified.

[0136] Figure 6 1 is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0137] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0138] The application layer can include a series of application packages.

[0139] like Figure 6 As shown, the application package may include applications such as camera, note, call, recording, WLAN, short message, gallery, etc.

[0140] Among them, the above-mentioned note application can provide an interface for user operation, and the interface can have a toolbar control panel, a sliding component (such as recycleview) and a text component (such as textview, EditText). Among them, the toolbar control panel can be a control for user operation, and the user can trigger the electronic device to perform relevant operations by triggering relevant controls. The text component can be arranged on the sliding component, and the text component can be used to display the information in the speech information. Among them, each item in the sliding component carries a speech information, and each item can include a text component to carry the information in its corresponding speech information.

[0141] Applications (such as notes, calls, recordings, etc.) can use the data management module (DataManager) to operate the data in the database, such as adding, deleting, modifying, and checking. In other words, the data management module can be used to manage the data in the database (such as the save path of the voice file or the data list file corresponding to the voice file).

[0142] Applications can display backend data on frontend controls by using data adapters. That is to say, data adapters are adapter interfaces that connect backend data and frontend display, establish an adaptation relationship between data sources and recycleview, and convert data sources into data formats that can be displayed by recycleview.

[0143] It should be understood that the above-mentioned data management module and data adapter may be internal implementations of the application program.

[0144] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0145] like Figure 6 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0146] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0147] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0148] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0149] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0150] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0151] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0152] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0153] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0154] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0155] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0156] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0157] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0158] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0159] A 2D graphics engine is a drawing engine for 2D drawings.

[0160] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0161] Understandably, Figure 6 The layers in the illustrated structure and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the structure may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0162] The present application provides a voice processing method. After starting recording, the electronic device can convert voice data into text in real time. After receiving the delete operation input by the user, the electronic device can judge the user's needs based on the position of the cursor in the speech text, and thus perform corresponding processing on the speech text where the cursor is located to meet the user's usage needs. Among them, the voice data can be the recording in the recording note scenario introduced above, the recording in the recording application scenario, the recording in the call recording scenario (or called a voice file), etc. Of course, the voice data can also be other recording data generated in a scenario. Below, taking the above-mentioned electronic device as a tablet computer and the application scenario as a recording note scenario, that is, a note application as an example, a voice processing method provided in an embodiment of the present application will be described in detail in conjunction with the accompanying drawings. Figure 7 As shown, the method may include steps S301-S310.

[0163] S301. During the recording process, the tablet computer receives the latest voice data.

[0164] S302: The tablet computer converts the latest voice data into text to obtain the latest speech information.

[0165] Among them, the above-mentioned latest speech information includes the latest speaker identification, and the latest speech text and the latest speech time corresponding to the latest speaker identification. The latest speech text includes at least one character, which can be a text, punctuation mark, letter, etc. The latest speech time indicates the time when the speaker starts speaking. For example, a speech information includes speaker 1, 00:40 and "Do you bring fruit?" Among them, speaker 1 is the speaker identification, 00:40 is the speech time, and "Do you bring fruit?" is the speech text. Accordingly, the speech information indicates the speaker's speech at 00:40, and the speech content is "Do you bring fruit?"

[0166] In an embodiment of the present application, the above-mentioned text conversion may include speech recognition and voiceprint recognition. In the process of editing notes (such as the first note), the tablet computer can record according to the user's usage needs. During the recording, after the tablet computer receives the user's voice data (i.e., the latest voice data), it performs speech recognition on the latest voice data to convert the voice into text and obtain the latest speech text. In addition, in order to better enable users to intuitively understand the speeches of different speakers, the tablet computer can perform voiceprint recognition on the voice data to distinguish the speeches of different speakers, thereby obtaining the latest speaker identification corresponding to the latest speech text. Of course, the tablet computer can also request the server to perform speech recognition and voiceprint recognition on the above-mentioned voice data, and the embodiment of the present application does not impose any restrictions on this.

[0167] In some embodiments, the information included in the latest speech information introduced above is only an example, and the content included in the latest speech information can be set according to actual needs. For example, the latest speech information can include the speaker identification and speech text, but not the speech time.

[0168] S303, the tablet computer displays the latest speech text on interface 1. Interface 1 also displays historical speech texts.

[0169] The historical speech text is obtained based on the voice data received before the latest voice data.

[0170] In the embodiments of the present application, after obtaining the latest speech information, the tablet computer can display the latest speech text in the latest speech information on Interface 1 (or referred to as the first interface). Interface 1 (that is, the recording card displayed on Interface 1, such as the first recording card) displays all the speech texts obtained during the recording, realizing real-time conversion and display of the speech content. Among them, the speech texts corresponding to different speaker identifiers are displayed in segments. For example, during the recording, the tablet computer first receives the word "今" spoken by Speaker 1, and this "今" is the latest voice data, and then "今" is displayed on Interface 1 (as shown in Fig. 8A ). After that, the tablet computer receives the word "天" spoken by Speaker 1 and displays "天" on Interface 1 (as shown in Figure 8B ). Here, the "今" shown in Fig. 8A can be considered as the historical speech text, and the "天" shown in Figure 8B can be considered as the latest speech text. As the recording time increases, the tablet computer sequentially converts the received voice data into text and displays it on Interface 1 (as shown in Figure 8C : "今天天气很好,咱们一起去公园玩吗").

[0171] After that, the tablet computer receives the latest voice data such as "可". The tablet computer performs text conversion on this latest voice data to obtain the latest speech text "可", and recognizes that the speaker identifier corresponding to the latest speech text is Speaker 2. The tablet computer can display the latest speech text "可" in the next paragraph below the speech text of Speaker 1 (as shown in Fig.8D ). Here, the "今天天气很好,咱们一起去公园玩吗" shown in Fig.8D can be considered as the historical speech text, and "可" is the latest speech text.

[0172] It should be understood that the above example of the tablet computer adding and displaying one character at a time for the real-time display of speech text is only an example. The tablet computer can also display multiple characters at a time, and the present application does not limit it.

[0173] In some embodiments, the speech texts displayed on the above Interface 1 are arranged in the order from earliest to latest speech time. For example, the speech time corresponding to "今天天气很好,咱们一起去公园玩吗" shown in Fig.8D is earlier than the speech time corresponding to "可".

[0174] In some embodiments, the above Interface 1 not only displays the speech text, but can also display the speaker identifier and / or speech time corresponding to the speech text. For example, 00:00, 00:20, 00:40, 00:50 shown in Fig. 8E are all speech times, and Speaker 1 and Speaker 2 are both speaker identifiers.

[0175] Optionally, if the tablet computer is not in the speaker display state (i.e., the speaker control is not selected), the tablet computer may only display the speech text in the speech information, but not display the content other than the speech text in the speech information. When the tablet computer is in the speaker display state (i.e., the speaker control is selected), the tablet computer may not only display the speech text, but also display the speaker identification and / or speech time (as described above). Fig. 8E As shown, the tablet displays the speech text, speaker ID and speech time).

[0176] In some embodiments, the tablet computer may not automatically display the speech content in real time, but after receiving the operation a input by the user, in response to the operation a, convert the voice data recorded before and / or after receiving the operation a into text. For example, the tablet computer may display the following Figure 8F The interface 50 shown in the figure includes a control 51, which can trigger the tablet computer to convert the voice data in the note into text. When the user wants to display the speech content corresponding to the voice data in text, the user can click the above Figure 8F The control 51 shown. Here, the click operation of the control 51 is the above-mentioned operation a.

[0177] Of course, the operation a described above is only an example, and the operation a can also be other types of operations. For example, the operation a can be a user inputting a first preset gesture on a relevant interface, such as inputting an S-shaped gesture on the above interface 50. The first preset gesture is used to trigger the tablet computer to convert voice data (or voice files) into text. The first preset gesture can be pre-configured in the tablet computer. In addition, the tablet computer can prompt the user on the relevant interface of the function triggered by the first preset gesture.

[0178] In some embodiments, if the start speech time corresponding to the latest speech text differs greatly from the start speech time corresponding to the previous speech text, the latest speech text may not be merged into the previous speech text regardless of whether the speaker identifier corresponding to the latest speech text is the same as the speaker identifier corresponding to the previous speech text. Of course, if the speaker identifier corresponding to the latest speech text is the same as the speaker identifier corresponding to the previous speech text, the tablet computer may directly merge the latest speech text into the previous speech text.

[0179] S304: The tablet computer receives a deletion operation.

[0180] S305 . In response to the above-mentioned deletion operation, the tablet computer uses the text where the cursor is currently located as speech text 1 .

[0181] In some embodiments, the above-mentioned deletion operation represents an input operation of a delete key of an input method. The user inputs a delete key (such as Figure 8G The delete key 52 in the virtual keyboard shown in the figure, where the speech text is speech text 1, and the input operation of the delete key is a delete operation. Figure 8G The delete key 52 shown is only an example. The tablet computer can also be connected to an external keyboard. The delete key can be, for example, Figure 8H The delete key 53 on the keyboard shown. Figure 8H The delete key 53 shown may also be referred to as a backspace key.

[0182] In other embodiments, the deletion operation may be a trigger operation (such as a click operation) of a deletion control. When a user wants to merge a speech text, such as speech text 1, into another speech text, such as speech text 2, when the cursor of the tablet computer is located at the location of speech text 1, the user may click the deletion control (such as a click operation) displayed on the tablet computer. Figure 8I The delete control 54 shown in the figure). The operation of the user clicking the delete control is a delete operation. It should be understood that if the cursor of the tablet computer is not in the speech text 1, the user can click a certain position (such as the initial position) in the speech text 1, and the tablet computer responds to the click operation and moves the cursor to the corresponding position.

[0183] Optionally, the deletion control may be displayed by the tablet computer in response to a specific trigger operation input by the user, such as the user long pressing the screen at the cursor position for more than a certain period of time, clicking the screen multiple times in a row, etc.

[0184] In some other embodiments, the deletion operation may be an input operation of a second preset gesture. When the user wants to merge a speech text into another speech text, the user may input the second preset gesture on the tablet computer, and the tablet computer responds to the second preset gesture and uses the speech text where the cursor is located as speech text 1.

[0185] The speech text 2 is a speech text that is adjacent to the speech text 1 and earlier than the speech text 1 currently displayed on the interface 1 .

[0186] In some embodiments, the above-mentioned deletion operation can be performed after the tablet computer stops recording. In response to the stop recording operation, the tablet computer stops recording and displays a second interface. The second interface displays the speech text and a start recording control (or referred to as a second control). The start recording control is used to trigger the tablet computer to continue recording.

[0187] The speech text displayed on the second interface includes all speech texts obtained during the current recording. The play control can trigger the tablet computer to play the voice data recorded during the recording.

[0188] In some embodiments, when the tablet computer is not in the speaker display state, the second interface displays the speech text in the speech information, but does not display other information in the speech information, such as the speaker identification and the speech start time.

[0189] When the tablet computer is in the speaker display state, the second interface not only displays the speech text in the speech information, but also displays the speaker identifier in the speech information.

[0190] Exemplarily, the above-mentioned stop recording operation may be a user clicking operation on a pause recording control (or referred to as a first control).

[0191] S306: The tablet computer determines whether the current position of the cursor is at the beginning position of speech text 1.

[0192] The starting position of speech text 1 refers to the position before the first character in speech text 1, such as Figure 8J The position of the cursor shown is at the beginning of the speech text (ie speech text 1) where the cursor is located, that is, the beginning of the line.

[0193] In the embodiment of the present application, after receiving the delete operation, the tablet computer determines whether to merge the speech text based on the current position of the cursor, that is, determines whether the delete operation actually triggers the speech text merger. In other words, the tablet computer determines which operation is triggered by the delete operation based on the current position of the cursor.

[0194] When the current position of the cursor is not at the beginning of speech text 1, it indicates that the user may want to delete a character before the current position of the cursor, rather than merging speech text 1 into speech text 2, which means that the deletion operation does not trigger speech text merging, and the tablet computer can execute S307.

[0195] When the current position of the cursor is at the beginning of speech text 1, it indicates that the cursor is currently before the first character in speech text 1, which means that there is no character in speech text 1 before the cursor. The user does not want to delete the character before the current position of the cursor, but wants to merge speech text 1 into speech text 2 (that is, the speech text that is adjacent to speech text 1 and earlier than speech text 1 in the current interface), which means that the deletion operation actually triggers the merging of speech texts, and the tablet computer can execute S308.

[0196] In some embodiments, the process of determining whether the current position of the cursor is at the start position of the speech text 1 may include: the tablet computer may determine whether there are characters of the speech text 1 before the current position of the cursor. If there are, it indicates that the current position of the cursor is not at the start position of the speech text 1. If there are not, it indicates that the current position of the cursor is not at the start position of the speech text 1.

[0197] S307. The tablet computer deletes the characters before the current position of the cursor.

[0198] Exemplarily, the tablet computer may delete one character that is before the current position of the cursor and adjacent to the cursor. After the deletion is completed, the latest speech text is displayed. For example, as Fig. 9 shown in (a) below, the cursor of the tablet computer is currently located in the middle of "can" in the speech text 60. "Ke" (which means "can" in Chinese) is one character that is before the current position of the cursor and adjacent to the cursor. Therefore, the tablet computer may delete "Ke" and display the speech text 61 as shown in Fig. 9 (b) below.

[0199] S308. The tablet computer merges the speech text 1 into the speech text 2 to obtain the updated speech text 2. The speech text 2 is the previous speech text of the speech text 1 displayed on the interface 1.

[0200] In some embodiments, the speech text and the speaker identifier in the above speech information may be displayed through different views (such as textview). When the tablet computer is in the speaker display state, there is also a view (such as the third textview) where the speaker identifier is located between the textview where the speech text 2 is located (i.e., the second textview) and the textview where the speech text 1 is located (i.e., the first textview). Assuming that in response to the above deletion operation, the speech text 1 is moved according to the method of step S307, it will only be added after the view where the speaker identifier is located, while the user's intention is to add the speech text 1 in the first textview to the second textview. Therefore, the tablet computer cannot directly merge the speech text 1 into the speech text 2.

[0201] Correspondingly, before executing the above S308, the tablet computer may determine whether the speech text can be merged, that is, it may execute as Figure 7As shown in S60, the tablet computer determines whether it is in the state of displaying the speaker. When in the state of displaying the speaker, it indicates that the tablet computer needs to display information such as the speaker ID. Therefore, the tablet computer cannot directly add the speech text 1 in the first textview to the second textview. The tablet computer can execute S61, that is, it does not respond to this deletion operation. When the tablet computer is in the state of not displaying the speaker, it indicates that there is no other view between the first textview and the second textview. Therefore, the tablet computer can add the speech text 1 to the speech text 2 to obtain the updated speech text 2, that is, to obtain the updated speech information 2. The tablet computer can execute the above S308 to support the rapid integration of speech texts across time periods.

[0202] The tablet computer is not in the display speaker state, which means that the tablet computer only displays the speech text in the speech information (such as Fig. 10A ), but does not display content other than the speech text, such as the speaker ID, speech time, etc. Correspondingly, the tablet computer in the display speaker state means that the tablet computer displays the speech text in the speech information and also displays the remaining content in the speech information, that is, displays the entire content of the speech information. For example, the speech information includes the speaker ID, speech time and speech text. When the tablet computer displays the speaker ID, speech time and speech text (as described above), Fig. 8E ), the tablet computer is in display speaker state.

[0203] In some embodiments, when the tablet computer is in the state of displaying a speaker, upon receiving a click operation (or referred to as a second operation) from a user on the control for stopping displaying a speaker on the interface 1, the tablet computer may, in response to the click operation, stop being in the state of displaying a speaker (or described as displaying a fourth recording card), that is, only displaying the speech text in the speech information, and canceling displaying information other than the speech text in the speech information, such as canceling displaying a speaker identifier (such as Fig. 10A When the tablet computer is not in the display speaker state, upon receiving a click operation of the user on the display speaker control, the tablet computer can switch to the display speaker state in response to the click operation, thereby implementing the switching of the speaker state.

[0204] It should be noted that the above-mentioned stop display speaker control and the above-mentioned display speaker control can be different controls or the same control. Specifically, the tablet computer displays the entire content of the speech information, and the control is in the display speaker state. The control can be used as a stop display speaker control, such as Fig. 9The display speaker control 62 shown in (a) is in the display speaker state, and the control can be used as a stop display speaker control. The tablet computer only displays the speech text in the speech information. The control is in the display speaker state, and the control can be used as a stop display speaker control, such as Fig. 10A The display speaker control 63 shown is in a state of stopping displaying speakers, and the control can be used as a display speaker control.

[0205] In some embodiments, the tablet computer merging speech text 1 into speech text 2 may mean adding speech text 1 to a specific position of speech text 2. In one example, generally speaking, the speech content has a sequence, and the speech time corresponding to speech text 1 is later than the speech time corresponding to speech text 2. Therefore, the tablet computer may add speech text 1 to the end position of speech text 2. The end position of speech text 2 indicates the position of the last character in speech text 2, that is, the end of the line, to match the order of the actual speech content. For example, the speech text 1 is as described above. Fig. 10A In the example, "OK, do you need to bring anything?", speech text 2 is "The weather is nice today, shall we go to the park together?", and the tablet computer adds speech text 1 to the end position of speech text 2 (such as Fig. 10B shown).

[0206] In another example, the tablet computer can add speech text 1 before the initial position of speech text 2 to meet the user's need to adjust the order of speech content. For example, the user finds that the speech content corresponding to speech text 1 should actually be before the speech content corresponding to speech text 2, so the user can input a deletion operation, and the tablet computer adds speech text 1 to the initial position of speech text 2 based on the deletion operation. Of course, the tablet computer can also add speech text 1 to other positions of speech text 2, for example, to the middle position of speech text 2, and this application does not limit it.

[0207] Among them, the above-mentioned specific position can be a default position, for example, the end position of the speech text is used as the default position. Of course, the tablet computer can also provide at least one position option, and the user can select the position option according to actual needs. After obtaining the position option (i.e., the target position option) selected by the user, the tablet computer adds speech text 1 to the position corresponding to the target position option of speech text 2. For example, the position option selected by the user is the end position option. Then the tablet computer adds speech text 1 to the end position of speech text 2.

[0208] S61. The tablet does not respond.

[0209] In the embodiment of the present application, when the tablet computer is in the state of displaying the speaker, the tablet computer may not merge speech text 1 into speech text 2. In some embodiments, in order to avoid the user's confusion that the tablet computer does not respond to the input of the deletion operation, the tablet computer may display a first prompt message, which is used to prompt the user to cancel the display of the speaker (such as the tablet computer displays Fig.11 The first prompt information 64 is shown).

[0210] It can be understood that, regardless of whether the tablet computer is in the speaker display state or not, various editing operations can be performed on a speech text, such as deletion, modification, and character addition.

[0211] In some embodiments, when the interface 1 displays the speaker identifier, it indicates that the tablet computer is in the speaker display state. When the user wants to merge the speech texts, the user can enter a second operation on the interface 1. In response to the second operation, the tablet computer can cancel the display of the speaker identifier to facilitate the user to merge different speech texts and meet the user's need to merge speech texts. Here, the interface 1 in which the speaker identifier is canceled can be used as the interface 3. Afterwards, the user can enter a delete operation, and the tablet computer responds to the delete operation, and when the current position of the cursor is at the beginning position of the speech text 1, the speech text 1 is added to the speech text 2.

[0212] In some embodiments, after the tablet computer receives the above-mentioned deletion operation, if the tablet computer is in the displaying speaker state, but the cursor is currently at the starting position of speech text 1, the tablet computer can automatically stop being in the displaying speaker state and merge speech text 1 into speech text 2 to realize the merging of speech texts and meet the user's operation needs.

[0213] In some embodiments, the above-mentioned speech text 2 and speech text 1 can be two speech texts with adjacent speech times, that is, speech text 1 and speech text 2 are directly adjacent. In one case, the second speaker identifier corresponding to speech text 2 is different from the first speaker identifier corresponding to speech text 1. When the user believes that speech text 1 is not actually the speech of speaker 1, but the speech of speaker 2 corresponding to speech text 2, that is, when the voiceprint recognition is wrong, the user can delete speech text 1. The tablet computer responds to the deletion operation. If the cursor is at the beginning of speech text 1, speech text 1 can be merged into speech text 2. The speaker identifier corresponding to speech text 2 merged with speech text 1 (i.e., the updated speech text 2) is the identifier of speaker 2, so as to realize the modification of the speaker, improve the accuracy of text conversion, and restore the voice more accurately.

[0214] In another case, the second speaker identifier corresponding to speech text 2 is the same as the first speaker identifier corresponding to speech text 1, that is, the tablet computer also supports merging two directly adjacent speech texts of the same speaker (such as Fig.12 In the example shown in FIG. 1 , the speech text 70 of speaker 1 and the speech text 71 of speaker 1 are directly adjacent to each other), after receiving the deletion operation, if the current position of the cursor is at the beginning of the speech text 71, indicating that the user wants to merge the speech text 71 into the speech text 70, the tablet computer can merge the speech text 71 into the speech text 70. Optionally, the tablet computer can merge the speech text 71 into the speech text 70 when the current position of the cursor is at the beginning of the speech text 71 and the speaker is not displayed, so that when the user believes that the two speech texts of the speaker are related, the two speech texts can be merged into one speech text.

[0215] In some other embodiments, the second speaker identifier corresponding to speech text 2 is the same as the first speaker identifier corresponding to speech text 1, but speech text 1 and speech text 2 are indirectly adjacent, that is, there is actually another speaker's speech text (such as speech text 3) between the two adjacent speech texts, that is, the speech time corresponding to speech text 3 is between speech text 1 and speech text 2. Fig.12 The speech text 70 and speech text 72 of speaker 1 are shown to be associated, and the user wants to merge speech text 70 into speech text 72. However, since there is a speech text 73 of speaker 2 between speech text 70 and speech text 72, the tablet computer cannot directly merge speech text 70 of speaker 1 into speech text 72 of speaker 1. The tablet computer can first filter the speakers and only display the speech text of speaker 1, so that the two indirectly adjacent speech texts of speaker 1 become directly adjacent speech texts, so as to merge the speech texts. Here, speech text 70 of speaker 1 can be considered as the above-mentioned speech text 1, speech text 72 of speaker 1 can be considered as the above-mentioned speech text 2, and speech text 73 of speaker 2 can be considered as the above-mentioned speech text 3 (or the third speech text).

[0216] Specifically, the tablet computer may receive an operation c (or a third operation) performed by the user on the interface 4, and the operation c is used to trigger the tablet computer to display the speech information of the target speaker identifier (such as the first speaker identifier) ​​selected by the user. Afterwards, in response to the operation c, the tablet computer may only display the speech information corresponding to the first speaker identifier (or describe updating the currently displayed recording card, the updated recording card only displays the speech information corresponding to the first speaker identifier, and the updated recording card may be the fifth recording card), and no longer display the speech information corresponding to speaker identifiers other than the first speaker identifier, so that the above-mentioned speech text 1 and speech text 2 become displayed adjacent to each other. For example, the user clicks on Fig.13A In response to a click operation on the filter speaker control, the tablet computer displays the following Fig. 13B After receiving the selection operation of the speaker 1 option in the speaker option 74, the tablet computer displays the following Fig. 13C The speech text corresponding to the speaker 1 shown is used to filter the speaker text. It should be understood that Fig. 13C The speech text shown is the speech text corresponding to the filtered speaker 1. Fig.13A As shown in the speech text, since the speech text corresponding to speaker 2 is no longer displayed, the speech text of speaker 1 displayed on the tablet increases, and the speech text corresponding to speaker 1 arranged at the bottom moves upward to be directly displayed without moving the scroll bar (such as Fig. 13C "See you later" as shown).

[0217] Afterwards, in response to the deletion operation input by the user, the tablet computer can merge the speech text 1 corresponding to speaker 1 into the speech text 2 corresponding to speaker 1, thereby merging the two indirectly adjacent speech texts corresponding to speaker 1 into one speech text. Afterwards, when the user inputs a fourth operation, such as a selection operation for all displayed speaker options, the tablet computer responds to the fourth operation and displays the speech information corresponding to all speaker identifiers corresponding to all voice data obtained during the recording period in order from small to large speech time, that is, displays the sixth recording card, which includes not only the speech text 2 (i.e., the updated speech text 2) merged with the speech text 1, but also the speech texts corresponding to other speaker identifiers (such as speech text 3), and the speech text 3 is displayed after the updated speech text 2.

[0218] In an embodiment of the present application, when a user believes that two indirectly adjacent speech texts of a speaker are related and wants to integrate the two speech texts, or wants to integrate the speech information of a speaker, such as first displaying all speech texts of a speaker and then displaying speech texts of other speakers, the user can first filter the speaker ID that needs to be integrated, and the tablet computer will respond by displaying all speech texts corresponding to the speaker ID, so that the user can integrate them according to needs, realize the merging of speech texts, and provide rich text processing functions so that the display of speech texts can meet the user's usage needs.

[0219] In some embodiments, the above FIG. 13A to FIG. 13C The present invention introduces a process of filtering the speech text of a speaker when the tablet computer is not in the display speaker state, that is, the process of displaying the speech text corresponding to the target speaker ID selected by the user. When the tablet computer is in the display speaker state, it also supports filtering the speaker and only displays the speech information corresponding to the target speaker ID. For example, when the tablet computer is in the display speaker state, the tablet computer responds to the user clicking on the following Fig.14A The filter speaker control operation is shown as follows Fig. 14B After receiving the selection operation of selecting the speaker 1 option in the speaker option 75, the tablet computer displays the following Fig. 14C The speech information corresponding to the speaker 1 shown is used to filter the speaker's speech information and meet the user's need to browse a certain person's speech information.

[0220] In this application, the tablet computer supports the speaker filtering function. Users can select the speaker's speech information they want to display according to their needs, and Ping An Computer can display the desired speaker's speech information, meeting the user's need to view only some of the speaker's speech information.

[0221] In some embodiments, the above-mentioned manner in which the tablet computer determines whether to merge speech texts based on the deletion operation and the current position of the cursor is only an example of triggering the tablet computer to merge speech texts. The tablet computer can also directly provide a merge control (such as Fig.15 ). When the user triggers (such as clicking) the merge control, the tablet computer responds to the triggering operation of the merge control and merges speech text 1 into speech text 2. Here, speech text 1 is the speech text where the cursor is located. Of course, the tablet computer can also provide other methods, such as setting corresponding gestures, so that the user triggers the tablet computer to perform the merge operation after performing the other method.

[0222] In other words, after receiving operation b, the tablet computer merges speech text 1 into speech text 2 based on operation b. The operation b represents an operation that may be able to trigger the tablet computer to perform a merge operation. For example, the operation b may be the above-mentioned deletion operation, a click operation of a merge control, etc. It should be understood that in the case where operation b is the above-mentioned deletion operation, the tablet computer may first determine whether to merge the speech texts based on the current position of the cursor, and then, in the case of merging the speech texts, the tablet computer may merge speech text 1 into speech text 2, that is, the tablet computer may execute the above-mentioned S304-S308. In the case where operation b is a click operation of a merge control, the tablet computer may directly merge speech text 1 into speech text 2.

[0223] Among them, optionally, the above-mentioned merge control can be displayed by the tablet computer in response to a specific trigger operation input by the user, such as the user long pressing the screen at the cursor position for more than a certain time, clicking the screen multiple times in a row, or clicking the beginning of a line of the speech text 1.

[0224] S309: The tablet computer deletes the speech information corresponding to the speech text 1 and obtains the latest speech information.

[0225] S310: The tablet computer displays an interface 2, which includes the latest speech information, wherein the latest speech information includes an updated speech text 2.

[0226] In some embodiments, the speech information corresponding to the voice data obtained during the above recording is stored in a preset storage location (such as a location that can store data, such as a database). After the tablet computer merges the speech text 1 into the speech text 2, it can delete the speech information belonging to the speech text 1 (that is, the speech information corresponding to the speech text 1) from the preset storage location, and obtain the latest speech information corresponding to the voice data obtained during the recording, that is, the latest speech information includes the updated speech information 2, but does not include the speech information belonging to the speech text 1. Afterwards, the tablet computer can display the latest speech information. For example, the above-mentioned interface 1 includes speech text 1 and speech text 2. After merging speech text 1 into speech text 2 to obtain the updated speech text 2, the tablet computer displays interface 2, which includes the updated speech text 2, but no longer includes speech text 1.

[0227] It should be understood that the above merging operation is performed when the tablet computer is not in the state of displaying the speaker, so the tablet computer displays the speech text in the latest speech information without displaying other information. Fig.16A After the operation of displaying the speaker control is performed, the tablet computer can display all the contents of the latest speech information (such as Fig. 16B shown).

[0228] In some embodiments, the storage format of the above speech information can be as shown in Table 1. After the tablet computer merges speech text 1 into speech text 2, speech text 1 becomes part of speech text 2, that is, the Content of speech text 1 is added to the Content of speech text 2. And the speech time corresponding to speech text 1 is the speech time corresponding to speech text 2, that is, the speech time corresponding to speech text 2 merged with speech text 1 will not change, and will continue to be the time recorded by Offset. As mentioned above Fig. 16B The speech time corresponding to the first speech text of speaker 1 is still 00:00.

[0229] Table 1

[0230] Column Name type Chinese description Data Description Uuid TEXT The id value of the speech information key value, unique id Offset TEXT Time offset, i.e. speaking time Content TEXT Speech text Speaker TEXT Speaker ID, such as the speaker's name

[0231] In some embodiments, after merging speech text 1 into speech text 2 , the tablet computer moves the cursor to the end position of speech text 2 merged with speech text 1 .

[0232] In some embodiments, the tablet computer supports the export function of voice data and speech information. The tablet computer receives operation d (i.e., the fifth operation), which is used to trigger the tablet computer to export the latest speech information. In response to operation d, the tablet computer exports the speech information currently displayed on the tablet computer, such as the latest speech information.

[0233] It should be understood that when the tablet computer is not in the state of displaying the speaker, the tablet computer currently displays the speech text in the speech information, then the tablet computer responds to operation d (or the fifth operation) to export the currently displayed speech text. When the tablet computer is in the state of displaying the speaker, the tablet computer currently displays the entire content of the speech information, then the tablet computer responds to operation d to export the entire currently displayed speech information. For example, assume that the speech information includes the speaker ID, speech text, and speech time. When the tablet computer is in the state of displaying the speaker, the speech information currently displayed by the tablet computer includes the speech text, the speaker ID, and the speech time, and the content exported by the tablet computer includes the speech text, the speaker ID, and the speech time. When the tablet computer is not in the state of displaying the speaker, the speech information currently displayed by the tablet computer includes the speech text, and the content exported by the tablet computer includes the speech text.

[0234] In addition, if the speech information currently displayed on the tablet computer is the speech information corresponding to some speakers, then the exported speech information is also the speech information corresponding to these speakers. If the speech information currently displayed on the tablet computer is the speech information corresponding to all speakers, then the exported speech information is also the speech information corresponding to all speakers, thereby meeting various export needs of users.

[0235] Optionally, the tablet computer can support exporting in multiple formats, that is, based on the first target format, the speech information currently displayed on the tablet computer can be saved, that is, the speech information currently displayed in the first target format is saved to a target location, which can be a default save location or a storage location selected by the user. Exemplarily, the first target format can be a document format or a picture format. The document format can include at least one of txt format, pdf format, doc format, docx format, and html.

[0236] In one example, the first target format may be a default format (or referred to as a default file format). Fig.17A The interface 90 shown in the figure includes a control 91, which is used to trigger the tablet computer to save the currently displayed speech information. In response to the user clicking the control 91, the tablet computer saves the currently displayed speech information in a default format (such as txt format) to a target location. In addition, after saving, the tablet computer can also display location prompt information (such as Fig. 17B The location prompt information 92 shown in the figure reminds the user of the location where the currently displayed speech information is saved, so as to facilitate the user to view it.

[0237] In another example, the first target format may be a format selected by the user (i.e., a file format). The tablet computer may display at least one first format option. After receiving a user's selection operation for a target format option in the at least one format option, in response to the selection operation for the target format option, the tablet computer may save the currently displayed speech information in a format corresponding to the target format option (i.e., the first target format). Fig.17A When the control 91 in the control is clicked, the tablet computer displays the following Fig. 17C The tablet computer can save the currently displayed speech information in doc format. The tablet computer can also display location prompt information (such as the location of the address, the address of the text file, the image file, the html file, and the docx file) after saving. Fig.17D The location prompt information 93 shown in the figure prompts the user where the currently displayed speech information is stored, so as to facilitate the user to view it.

[0238] In other embodiments, the tablet computer also supports sharing the speech information currently displayed on the tablet computer based on the second target format in response to operation e (or the sixth operation), such as the tablet computer shares the currently displayed speech information in the second target format to the application on the tablet computer.

[0239] The second target format is similar to the first target format, and can be a default format or a format selected by a user. The second target format will be described in detail below with reference to two examples.

[0240] In one example, the second target format is a default format. Exemplarily, in response to a sharing operation input by a user (such as a click operation on a sharing control), the tablet computer displays an interface including a third control, where the third control is used to trigger the tablet computer to display a first candidate application. Afterwards, in response to the user's selection operation of a first target application in the first candidate application, the currently displayed speech information in the second target format is shared to the first target application. The first candidate application refers to an application that can receive files in the second target format. For example, the tablet computer responds to a user's selection operation of Fig.17E The click operation of the sharing control 94 shown in FIG. Fig.17F The interface 95 displays the format of the currently displayed speech information (such as txt format), the speech information, the first candidate application 96, etc. The first candidate application 96 represents an application that can receive files in txt format, so that the user can select an application for sharing according to needs.

[0241] In another example, the second target format is selected by the user. When the user wants to share the currently displayed speech information in a picture format, the user can select the picture format sharing option displayed on the tablet computer (such as the above Fig.17A In response to the user selecting the picture format sharing option, the following is displayed: Figure 17G The interface shown includes the currently displayed speech information 97 in the picture format and the second candidate application 98. The second candidate application 98 represents an application that can receive files in the picture format for the user to select to share.

[0242] In some embodiments, Fig.17H As shown, the tablet computer can display the currently displayed speech information in the first target format or the second target format on the interface displaying the relevant controls of the above-mentioned first voice file (such as the play control, the first control, etc.), such as on the interface displaying the above-mentioned currently displayed information.

[0243] In some embodiments, the tablet computer may also export or share the speech information of all speakers or some speakers according to the user's choice. For example, in response to the above-mentioned control 91, the tablet computer may display an export speaker option, which includes an export all option and at least one export speaker option. The export all option is used to trigger the tablet computer to export the speech information of all speakers. The export speaker option corresponds to the speaker identifier one by one, and the export speaker option is used to trigger the tablet computer to export the speech information of the speaker corresponding to the speaker option. Similarly, the tablet computer may also export or share the speech information according to the user's choice to determine whether there is content other than the speech text, such as the speaker identifier and the speech time.

[0244] In some embodiments, the tablet computer can also share the currently displayed speech information with other devices in a default or user-selected file format.

[0245] It should be noted that the above-mentioned sharing and exporting operations can be performed after the tablet stops recording (such as the above Fig.17A During recording, the tablet generally does not export or share the first voice file or the speech information corresponding to the first voice file. However, operations such as displaying speaker status switching, merging speech texts, filtering speaker speech information, and displaying all speaker speech information can be performed during recording or after stopping recording. For example, as mentioned above FIG. 13A to FIG. 13C As shown, the tablet computer screens the speech text of speaker 1 after stopping recording.

[0246] The above describes the functions of electronic devices supporting display of speaker status switching, merging speech texts, filtering speaker speech information, and displaying all speaker speech information. Figure 6 The software framework shown in the figure introduces the specific implementation process of the electronic device to realize the functions of filtering the speaker's speech information, displaying the speaker's status switching, merging the speech text, and displaying the speech information of all speakers. Among them, filtering the speaker's speech information may include Fig.18 The implementation process of displaying the speaker status switching may include the following steps: Fig.18 The implementation process of merging speakers may include the following steps: Fig.18 As shown in S8-S12, the implementation process of displaying the speech information of all speakers may include the following steps: Fig.18 S13-S17 shown.

[0247] S1. The toolbar control panel receives a user's selection operation on a target speaker option.

[0248] The toolbar control panel may be a tool control in the recording card. Fig. 16B 80) is used to trigger the tablet computer to perform corresponding operations, such as recording, stopping recording, text conversion, displaying speaker status switching, exporting, sharing, filtering speakers, etc. Recording cards (such as the above Fig. 16B The recording card 81) shown may also include speech information and the like.

[0249] S2. In response to the selection operation of the target speaker option, the toolbar control panel calls the data management module to query the speech information corresponding to the target speaker in the target data list file.

[0250] In the embodiment of the present application, when the user wants to view the speech information of some speakers, the user can click on the above Fig.13A The filter speaker control shown. The tablet computer will display speaker options for the user to select one or more speaker options. When the toolbar control panel obtains the speaker option selected by the user, it can use the speaker option selected by the user as the target speaker option. Afterwards, the toolbar control panel can call the data management module and use the database (database, DB) to query the speech information corresponding to the target speaker corresponding to the target speaker option in the target data list file. If the target speaker is speaker 1, the speech information corresponding to the target speaker is the speech information corresponding to speaker 1.

[0251] Among them, the target data list file (such as Fig.19 (a) includes the above-mentioned speech information, that is, one speech information corresponds to one record in the target data list file, wherein Speaker (i.e., speaker field) indicates the speaker ID, which records the speaker ID in the speech information. Offset (i.e., speech time field) indicates the speech time, which records the speech time in the speech information. Content (i.e., speech text field) indicates the speech content, which records the speech text in the speech information.

[0252] In some embodiments, the above speech information is carried by recycleview, and each speech information is an item. An item includes multiple view components (such as textview components). Among them, one textview component among the multiple textview components is used to carry the speech text, that is, one textview component includes the speech text, and another textview component is used to carry the speaker identification.

[0253] Optionally, the speaker ID and speaking time can be in different view components or in one view component.

[0254] In some embodiments, the database may store the target data list file. Accordingly, the data management module may directly query the target data list file from the database to obtain the speech information corresponding to the target speaker.

[0255] In some other embodiments, the database may store a storage path corresponding to the target data list file. Accordingly, the data management module queries the storage path corresponding to the target data list file from the database, so as to query the target data list file using the storage path.

[0256] S3. The data management module sends the speech information corresponding to the target speaker to the data adapter.

[0257] S4. The data adapter performs an interface refresh operation.

[0258] S5. The recycleview component displays the speech information corresponding to the target speaker on the textview component.

[0259] For example, the textview component can be understood as being laid out on the recycleview component. Each item of information in the speech information is displayed through the corresponding textview. Fig.19 As shown in (b), the speaker logo and the speaker text are in different textviews. When the speaker is displayed, there is a textview between adjacent speech files.

[0260] In some embodiments, an imgview may also be arranged on the recycleview component, which may be used to display a speaker's avatar. For example, the speaker's avatar may be displayed on the left side of the speaking time.

[0261] The above describes the implementation process of filtering the speaker's speech information. The following will continue to introduce the implementation process of displaying the speaker status switch.

[0262] S6. When the tablet computer is in a state of displaying a speaker, the toolbar control panel receives a click operation of stopping displaying a speaker control.

[0263] S7. In response to the click operation of stopping displaying the speaker control, the toolbar control panel triggers the recycleview component to call the data adapter to hide the information in the speech information except the speech text.

[0264] For example, when the toolbar control panel receives a user click operation to stop displaying the speaker control, it indicates that it is necessary to cancel the display of the speaker (such as the speaker ID and speaking time) and only display the speech text. Therefore, it can trigger the recycleview component to call the data adapter to hide the textview used to display the speaking time and speaker ID, so as to display only the speech text and meet the user's need to cancel the display of the speaker.

[0265] The above introduces the implementation process of speaker status switching. The following will continue to introduce the implementation process of merging speech texts.

[0266] S8. When the textview component monitors the keyboard delete event, it determines whether the current position of the cursor is at the beginning position of the speech text 1.

[0267] Among them, the speech text displayed by the textview component that monitors the keyboard deletion event may be speech text 1.

[0268] For example, the user places the cursor in a speech text, the tablet enters the editing state, and displays the soft keyboard. Afterwards, when the user clicks the delete key on the soft keyboard, the textview component listens to the keyboard delete event, and the textview component needs to use the current position of the cursor to determine the user's usage needs.

[0269] S9. When in the above starting position, the textview component calls the data management module to add speech text 1 in the target data list file to the end position of speech text 2 in the target data list file, deletes the speech information where speech text 1 is located, and obtains the latest target data list file.

[0270] For example, suppose the tablet currently displays the speech texts of all speakers (as shown above Fig. 10A As shown in the figure, speech text 1 is "OK, do I need to bring anything?", and speech text 2 is "The weather is nice today, shall we go to the park together?" Then the data management module can splice speech text 1 in the target data list file to speech text 2 to obtain the updated speech text 2, delete the speech information of speech text 1 in the target data list file, that is, delete the record of speech text 1, and obtain the latest target data list file, such as Fig. 20 shown.

[0271] S10. The data management module sends the latest target data list file to the data adapter.

[0272] S11. The data adapter performs an interface refresh operation.

[0273] S12. The recycleview component displays the latest speech text on the textview component.

[0274] For example, the latest speech text includes the updated speech text 2, but does not include the speech text 1. When the tablet computer is in a state where the speaker is not displayed, the speech text in the latest target data list will be displayed (as described above). Fig.16A The speaker ID and speaking time will not be displayed.

[0275] When the tablet computer is in the state of displaying the speaker, the entire contents of the speech information in the latest target data list (such as the above Fig. 16B Not only the latest speech text but also the speaker ID and speech time will be displayed.

[0276] The above describes the implementation process of merging speech texts. The following will continue to introduce the implementation process of displaying the speech information of all speakers.

[0277] S13. The toolbar control panel receives the user's selection operation on all speaker options.

[0278] For example, when the user wants the tablet to display the speech information of all speakers, the user can select the All Speakers option (as described above). Fig. 13B The toolbar control panel queries the speech information of all speakers based on the selection operation of all speakers options.

[0279] S14. In response to the selection operation of the all speakers option, the toolbar control panel calls the data management module to query the speech information corresponding to all speakers in the target data list file.

[0280] S15. The data management module sends the speech information corresponding to all speakers to the data adapter.

[0281] S16. The data adapter performs an interface refresh operation.

[0282] S17. The recycleview component displays the speech information corresponding to all speakers on the textview component.

[0283] In some embodiments, the toolbar control panel is provided by a note taking application, and the toolbar control panel may also include a recording control. Fig.21As shown, when the user clicks the recording control, the toolbar control panel responds to the click operation of the recording control, triggers the recording module to record, so as to collect the corresponding voice data. Accordingly, the tablet computer supports automatic real-time voice-to-text conversion, so the recording module can send the voice data to the voice-to-text service. After that, the voice-to-text service can send it to the note application after the conversion is successful. After obtaining the speech information, the note application can display it on the corresponding textview component on the recycleview component, and perform data storage through the data management module to realize the storage of the speech information.

[0284] Among them, the speech-to-text service can be as described above Fig.21 As shown, the voice-to-text service is located in the cloud, or the speech-to-text service is located locally on the tablet computer, and this application does not limit it.

[0285] In some embodiments, the present application provides a computer-readable storage medium, including computer instructions, which, when executed on an electronic device, enable the electronic device to perform the speech processing method as described above.

[0286] In some embodiments, the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the speech processing method as described above.

[0287] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0288] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0289] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0290] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0291] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0292] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A speech processing method, characterized in that: include: When the electronic device displays the first interface of the first note in the note application, the electronic device converts the acquired latest voice data into corresponding latest speech information, the first interface includes a first recording card, the first recording card includes a first control; the first control is used to trigger the stop of recording; The electronic device displays the latest speech information in the first recording card; In response to the triggering operation of the first control, the electronic device displays a second interface of the first note, the second interface includes a second recording card; wherein the second recording card includes first speech information, second speech information and a second control; the first speech information includes a first speech text, and the second speech information includes a second speech text; the speech time corresponding to the first speech information is earlier than the speech time corresponding to the second speech information, and the first speech information and the second speech information are displayed adjacently; the second control is used to trigger recording; In response to a first operation on the second speech text, displaying a cursor at the beginning of a line of the second speech text; In response to a deletion operation input by the user, the electronic device updates the second recording card to a third recording card, in which the second speech text and the first speech text are merged into the third speech information, and the second speech information is deleted; the speaker identifier corresponding to the third speech information is the same as the speaker identifier corresponding to the second speech text.

2. The method according to claim 1, characterized in that The electronic device updates the second recording card to a third recording card, including: When the second recording card does not display the speaker identifier, the electronic device updates the second recording card to a third recording card.

3. The method according to claim 2, characterized in that The first speech information also includes a speaker identifier corresponding to the first speech text; the second speech information also includes a speaker identifier corresponding to the second speech text; The method further comprises: The electronic device receives a second operation input by the user; the second operation is used to trigger the electronic device to stop displaying the speaker identification; In response to the second operation, the electronic device updates the second recording card to a fourth recording card, wherein the fourth recording card includes the first speech text and the second speech text, but does not include a speaker identifier corresponding to the first speech text and a speaker identifier corresponding to the second speech text; The electronic device updates the second recording card to a third recording card, including: The electronic device updates the fourth recording card to the third recording card.

4. The method according to claim 2, characterized in that: The first speech information also includes a speaker identifier corresponding to the first speech text; the second speech information also includes a speaker identifier corresponding to the second speech text; In response to the deletion operation input by the user, the electronic device updates the second recording card to a third recording card, including: In response to a deletion operation input by the user, the electronic device updates the second recording card to a fourth recording card, wherein the fourth recording card includes the first speech text and the second speech text, but does not include a speaker identifier corresponding to the first speech text and a speaker identifier corresponding to the second speech text; The electronic device updates the fourth recording card to the third recording card.

5. The method according to any one of claims 1 to 4, characterized in that The second recording card further includes fourth speech information, the fourth speech information includes a fourth speech text, the speech time corresponding to the fourth speech information is between the speech time corresponding to the first speech information and the speech time corresponding to the second speech information; the first speech text and the second speech text correspond to the first speaker identifier; The speaker identifier corresponding to the fourth speech text is different from the first speaker identifier; The method further comprises: receiving a third operation on the second recording card; the third operation is used to trigger the electronic device to display all speech information corresponding to the first speaker identifier; In response to the third operation, the electronic device updates the second recording card to a fifth recording card; the fifth recording card includes all speech information corresponding to the first speaker identifier, but does not include the fourth speech information; The electronic device updates the second recording card to a third recording card, including: The electronic device updates the fifth recording card to a third recording card.

6. The method according to claim 5, characterized in that After the electronic device updates the fifth recording card to the third recording card, the method further includes: The electronic device receives a fourth operation on the third recording card, where the fourth operation is used to trigger the electronic device to display speech information corresponding to all speaker identifiers; In response to the fourth operation, the electronic device displays a sixth recording card; the sixth recording card includes the fourth speech information, and the fourth speech information is located after the third speech information.

7. The method according to any one of claims 1 to 4, characterized in that The speaker identifier corresponding to the first speech text is different from the speaker identifier corresponding to the second speech text.

8. The method according to any one of claims 1 to 7, characterized in that The first speech information and the second speech information are carried by a sliding component, the first speech information is carried by a first item in the sliding component, and the second speech information is carried by a second item in the sliding component, and the first item and the second item are different; wherein the text component in the first item includes the first speech text, and the text component in the second item includes the second speech text; The second speech text and the first speech text are merged into the third speech information, and the second speech information is deleted, including: the second speech text in the text component in the second item is merged into the text component in the first item, and the second item is deleted.

9. The method according to any one of claims 1 to 7, characterized in that The electronic device includes a target data list file, the target data list file includes a plurality of records, each of the plurality of records corresponds to a speech information; each record includes a speech text corresponding to a speech text field; The method further comprises: In response to the deletion operation, the electronic device merges the second speech text corresponding to the speech text field in the second record in the target data list into the first speech text corresponding to the speech text field in the first record; the first record corresponds to the first speech information, and the second record corresponds to the second speech information.

10. The method according to any one of claims 1 to 9, characterized in that In response to the fifth operation, the electronic device saves all currently displayed speech information based on a first target format; the first target format represents a default file format or a selected file format; or, In response to the sixth operation, the electronic device shares all the currently displayed speech information with an application of the electronic device based on a second target format; the second target format represents a default file format or a selected file format; All the currently displayed speech information corresponds to the same speaker identifier.

11. An electronic device, characterized in that: The electronic device includes a display screen, a memory and one or more processors; the display screen, the memory and the processor are coupled; the display screen is used to display an image generated by the processor, and the memory is used to store computer program code, and the computer program code includes computer instructions; when the processor executes the computer instructions, the electronic device executes the method described in any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 10.

Images