Note processing method and device and storage medium

Abstract

The invention provides a note processing method and device and a storage medium. According to the method, under the condition that the voice information exists in the note, the speaker display function associated with the voice-to-text function is introduced, so that the speaker information corresponding to each piece of converted text information can be displayed under the condition that the voice-to-text function is started, and a user can speak in a multi-person speaking scene. And the spokesman of each piece of text information can be quickly obtained.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a note processing method, device and storage medium. Background Art

[0002] As electronic devices become more and more functional, they have brought great convenience to people's daily life and work. For example, applications with note-taking functions (hereinafter referred to as note-taking applications) can facilitate users to record information anytime and anywhere, no longer relying on traditional paper recording methods, greatly improving the efficiency of information recording.

[0003] However, the current note-taking applications usually provide text and picture information recording methods. Even if there is a function to record voice information, it can only simply realize voice-to-text conversion of recorded voice information, which is applicable to a single scenario and has a poor user experience. Therefore, it is urgent to provide a more efficient and more functional note-taking method. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a note processing method, device and storage medium, aiming to achieve more processing of recorded voice information to meet the needs of different scenarios and enhance the user experience.

[0005] In a first aspect, the present application provides a note processing method. The method is applied to an electronic device, comprising: displaying a first interface of a first note in a note application, the first interface comprising a recording card, the recording card comprising a first area, a second area and a third area; at a first moment, the first area comprises a start recording control, a start playback control and a first playback progress bar, the second area comprises a conversion to text control and a display speaker control, and the third area is empty; wherein, at the first moment, the display speaker control cannot interact with the user; at a second moment, in response to the user's operation of the conversion to text control, a first text message is displayed in the third area, the first text message corresponding to the first voice message recorded in the first playback progress bar; wherein, after the first text message is displayed in the third area, the display speaker control can interact with the user; at the third moment, in response to the user's operation of the display speaker control, The filtered speaker capsule, the first speaker capsule, the second speaker capsule and the first text information are displayed in the third area; wherein the first speaker capsule corresponds to the first text content in the first text information, the second speaker capsule corresponds to the second text content in the first text information, the first speaker capsule includes the first speaker name and the first speaking time, and the second speaker capsule includes the second speaker name and the second speaking time; at the fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the filtered speaker capsule, the filtered speaker capsule, the first speaker capsule and the first text content are displayed in the third area; wherein the fourth moment is later than the third moment, the third moment is later than the second moment, the second moment is later than the first moment, and the second speaker time is later than the first speaker time.

[0006] Among them, the first note is as follows in the embodiment, by Figure 1A , Figure 1B and Figure 2A Corresponding to the method, create note 1.

[0007] The first region is, for example, the region 11 mentioned in the following embodiment, the second region is, for example, the region 12 mentioned in the following embodiment, and the third region is, for example, the region 13 mentioned in the following embodiment.

[0008] Among them, the text conversion control is such as the text conversion control 137a involved in the following embodiment, the display speaker control is such as the display speaker control 137b involved in the following embodiment, the start recording control is such as the start recording control 141a involved in the following embodiment, the start playback control is such as the start playback control 141b involved in the following embodiment, and the first playback progress bar is such as the playback progress bar 141c involved in the following embodiment.

[0009] Among them, at the first moment, the display speaker control that cannot interact with the user is, for example, the display speaker control 137b in the third state in the following embodiment. Figure 2B The display speaker control 137b shown in (1), that is, the corresponding text may be gray.

[0010] The first moment may be the moment of stopping recording, that is, the moment of clicking the stop recording control, or the moment when the user clicks the note of the recorded voice information. Based on this, the first interface mentioned above is, for example, the user interface 14 mentioned in the following embodiment.

[0011] Since the operation of voice-to-text conversion and the operation of displaying the speaker can be implemented in all scenarios (during recording, after recording, and during playback of recording), the first interface can be an interface corresponding to different scenarios. For example, during recording, the first interface can be the user interface 13b mentioned in the following content. For another example, after recording, the first interface can be the user interface 14 mentioned in the following content. For another example, during playback of recording, the first interface can be the user interface 15 mentioned in the following content.

[0012] Therefore, when there is voice information in the notes, by introducing the display speaker function associated with the speech-to-text function, the speaker information corresponding to each converted text message can be displayed when the speech-to-text function is turned on, so that the user can quickly know the speaker of each text message in a scenario where multiple people are speaking.

[0013] According to the first aspect, at the fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the filtering speaker capsule, the filtering speaker capsule, the first speaker capsule and the first text content are displayed in the third area, including: at the fourth moment, in response to the user's operation on the filtering speaker capsule, the filtering speaker window is displayed on the first interface, and the filtering speaker window includes the first speaker and the second speaker; in response to the user's selection operation on the first speaker in the filtering speaker window, the filtering speaker window is closed; and the filtering speaker capsule, the first speaker capsule and the first text content are displayed in the third area.

[0014] The speaker selection window is, for example, the speaker selection window 137g described in the following embodiment. For example, in some possible situations, all available speakers are displayed in the speaker selection window. In this aspect, the available speakers are the first speaker and the second speaker as an example.

[0015] For more information on selecting spokespersons, please refer to the following Figure 8 and Fig. 9 The description of is not repeated here.

[0016] According to the first aspect, or any implementation of the first aspect above, before the fourth moment, the screening speaker capsule displayed in the third area is of the first style, and the first style of the screening speaker capsule is used to indicate that all speakers available for screening are selected; after the fourth moment, the screening speaker capsule displayed in the third area is of the second style, and the second style of the screening speaker capsule is used to indicate that some of the speakers available for screening are selected.

[0017] Among them, the first style of screening spokesperson capsule, such as the screening spokesperson capsule 137e of state A mentioned in the following embodiment, is as follows: Fig. 9 The style shown in (1); the second style of the screening spokesperson capsule, such as the screening spokesperson capsule 137e of state B described in the following embodiment, such as Fig. 9 The style shown in (4).

[0018] For more information on selecting spokespersons, please refer to the following Figure 8 and Fig. 9 The description of is not repeated here.

[0019] According to the first aspect, or any implementation method of the first aspect above, a filtered spokesperson capsule, a first spokesperson capsule, a second spokesperson capsule and a first text information are displayed in a third area, including: displaying a filtered spokesperson capsule at the top of the third area; displaying the first spokesperson capsule below the displayed spokesperson capsule; displaying the first text content below the first spokesperson capsule; displaying the second spokesperson capsule below the first text content; and displaying the second text content below the second spokesperson capsule.

[0020] Regarding the positional relationship between the screening speaker capsule, the speaker capsule corresponding to each speaker, and the text information in the third region, it can be as follows: Figure 7 In region 13 shown in (3), the speaker capsule corresponding to speaker 1, the text content "Note 1 includes two parts, among which the first part mainly talks about XXX" corresponding to speaker 1, and the speaker capsule corresponding to speaker 2 are filtered out. They are not described here.

[0021] According to the first aspect, or any implementation of the first aspect above, the method also includes: at a fifth moment, in response to an operation of a user sliding from the bottom of the third area to the top of the third area, displaying a filter spokesperson capsule at the top of the third area; and, at a position below the display spokesperson capsule, displaying a first text content; at a position below the first text content, displaying a second spokesperson capsule; and at a position below the second spokesperson capsule, displaying the second text content; at a sixth moment, in response to an operation of a user sliding from the bottom of the third area to the top of the third area, displaying a filter spokesperson capsule at the top of the third area; and, at a position below the display spokesperson capsule, displaying a second spokesperson capsule; and at a position below the second spokesperson capsule, displaying the second text content; wherein the sixth moment is later than the fifth moment.

[0022] That is, the screening speaker capsule is fixedly displayed at the top of the third area and does not change with the change of the content displayed in the third area. Therefore, by fixing the screening speaker capsule, that is, setting the screening speaker capsule to a ceiling display effect (top function), it is possible to ensure that the user can operate the screening speaker capsule at any time to perform the screening operation of the speaker.

[0023] For more information about the screening speaker capsule ceiling setting, please refer to the following Fig.10 The description of is not repeated here.

[0024] According to the first aspect, or any implementation of the first aspect above, at a first moment, a text-to-text control displayed in the second area is in a first state, and a display speaker control is in a third state, the first state indicates that the function corresponding to the control is not enabled, and the third state indicates that the control cannot interact with the user; wherein the text-to-text control in the first state indicates that the speech-to-text function is not enabled, and the display speaker control in the third state indicates that the display speaker control cannot interact with the user; at a second moment, in response to the user's operation on the text-to-text control, the electronic device updates the state of the text-to-text control from the first state to the second state, and updates the state of the display speaker control from the third state to the first state, the second state indicating that the function corresponding to the control is enabled, the text-to-text control in the second state indicates that the speech-to-text function is enabled, and the display speaker control in the first state indicates that the display speaker function is not enabled; wherein, when the speech-to-text function is enabled, the electronic device can perform a text-to-text operation on the first voice information; at a third moment, in response to the user's operation on the display speaker control, the electronic device updates the state of the display speaker control from the first state to the second state, and the display speaker control in the second state indicates that the display speaker function is enabled.

[0025] Among them, the first state of the text conversion control is as follows: Figure 3 The style of the text conversion control 137a shown in (1); the text conversion control in the second state is for example Figure 3 The style of the converted text control 137a shown in (2).

[0026] Among them, the display speaker control in the third state is, for example, Figure 3 The display speaker control 137b shown in (1) is shown in FIG. 1 ; the display speaker control in the first state is shown in FIG. Figure 3 The display speaker control 137b shown in (2) is shown in FIG. 1 ; the display speaker control in the second state is shown in FIG. Figure 3 The style of displaying the speaker control 137b is shown in (3).

[0027] For information about the switching of the status of the text conversion control and the display speaker control, as well as their correlation, please refer to the following content for Figure 3 The description of is not repeated here.

[0028] According to the first aspect, or any implementation of the first aspect above, when the text-to-text control is in the second state and the display speaker control is in the second state, the method also includes: at a seventh moment, in response to the user's operation of the text-to-text control in the second state, updating the state of the text-to-text control from the second state to the first state; and, in the third area, still displaying the filter speaker capsule, the first speaker, the first text content, the second speaker, and the second text content; at an eighth moment, in response to the user's operation of the start recording control, replacing the start recording control and the start playing control with the stop recording control, recording the second voice information, and replacing the first playback progress bar with the recording status bar corresponding to the second voice information; and, in the third area, still displaying the filter speaker capsule, the first speaker, the first text content, the second speaker, and the second text content; wherein the eighth moment is later than the seventh moment.

[0029] Regarding the implementation of this aspect, for example, in the following Figure 6 In the scenario (4), the user clicks the text conversion control 137a, causing the user interface 14 to change from Figure 6 (4) Switch to Figure 7 The user then clicks the start recording control 141a. The corresponding user interface is as follows: Figure 4 The user interface 13b shown in (4) is shown in FIG. The specific implementation details are not described here.

[0030] According to the first aspect, or any implementation of the first aspect above, after the filter speaker capsule, the first speaker, the first text content, the second speaker, and the second text content are still displayed in the third area, the method also includes: at the ninth moment, in response to the operation of the stop recording control, the stop recording control is replaced with the start recording control, the start playing control, and the second playback progress bar, the second area includes a text conversion control in the first state and a display speaker control in the second state, and the third area displays the filter speaker capsule, the first speaker, the first text content, the second speaker, and the second text content; at the tenth moment, in response to the user's operation of the start playing control, the start playing control is replaced with the pause playing control, and the second voice recorded by the second playback progress bar is played. Information; and, the third area still displays the filtered spokesperson capsule, the first spokesperson, the first text content, the second spokesperson, and the second text content; at the eleventh moment, in response to the user's operation of the first state of the text conversion control, the state of the text conversion control is updated from the first state to the second state, and the third area displays the filtered spokesperson capsule, the first spokesperson capsule, the first text content, the second spokesperson, the second text content, the third spokesperson capsule, and the second text information, the second text information corresponds to the second voice information recorded in the recording status bar, the third spokesperson capsule corresponds to the second text information, and the third spokesperson capsule includes the third spokesperson name and the third speaking time; wherein, the eleventh moment is later than the tenth moment, the tenth moment is later than the ninth moment, and the ninth moment is later than the eighth moment.

[0031] Regarding the implementation of this aspect, for example, in the following Figure 6 In the scenario (4), the user clicks the text conversion control 137a, causing the user interface 14 to change from Figure 6 (4) Switch to Figure 7 The user then clicks the start recording control 141a. The corresponding user interface is as follows: Figure 4 The user interface 13b shown in (4) is shown in FIG. The specific implementation details are not described here.

[0032] For the implementation of this aspect, please refer to the following Figure 7 The description of is not repeated here.

[0033] According to the first aspect, or any implementation of the first aspect above, when the text conversion control is in the second state and the display speaker control is in the second state, the method also includes: at the ninth moment, in response to the user's operation of the start recording control, the start recording control and the start playing control are replaced with the stop recording control, the second voice information is recorded, and the first playback progress bar is replaced with the recording status bar corresponding to the second voice information; and, in the third area, the filtered speaker capsule, the first speaker capsule, the first text content, the second speaker, the second text content, the third speaker capsule and the second text information are displayed, the second text information corresponds to the second voice information recorded in the recording status bar, the third speaker capsule corresponds to the second text information, and the third speaker capsule includes the third speaker name and the third speaking time.

[0034] Regarding the implementation of this aspect, Figure 5 The scenario shown is similar, see the following Figure 5 The description of is not repeated here.

[0035] According to the first aspect, or any implementation of the first aspect above, after displaying the filtered speaker capsule, the first speaker capsule and the first text content in the third area, the method also includes: in response to the user's operation of the display speaker control in the second state, updating the state of the display speaker control from the second state to the first state; and displaying the first text content in the third area, without displaying the filtered speaker capsule and the first speaker capsule.

[0036] For the implementation of this aspect, please refer to the following Figure 3 , Figure 5 The description of is not repeated here.

[0037] According to the first aspect, or any implementation of the first aspect above, after displaying any speaker capsule in the third area, the method also includes: in the process of displaying the stop recording control in the first area, not responding to the user's operation on any speaker capsule displayed in the third area; in the process of displaying the start recording control and the start playing control in the first area, in response to the user's operation on any speaker capsule in the third area, displaying a rename window corresponding to the operated speaker capsule on the first interface; in the process of displaying the start recording control and the pause playing control in the first area, in response to the user's operation on any speaker capsule in the third area, moving the recording playback progress control in the first playback progress bar to the target position, and the time corresponding to the target position is the speech time displayed in the operated speaker capsule.

[0038] The rename window is, for example, the rename window 137h described in the following embodiment.

[0039] For details about operating the speaker capsule during recording (while the stop recording control is displayed in the first area), after recording is finished (while the start recording control and the start playing control are displayed in the first area), and during recording playback (while the start recording control and the pause playing control are displayed in the first area), please refer to the following Fig.11 The description of is not repeated here.

[0040] According to the first aspect, or any implementation of the first aspect above, after displaying the renaming window corresponding to the operated speaker capsule on the first interface, the method also includes: in response to the renaming operation performed by the user in the renaming window, closing the renaming window, and updating the speaker name displayed in the speaker capsule to a name based on the renaming window.

[0041] For details about renaming the speaker, please refer to the following Fig.11 Middle (2)~ Fig.11 The description of (4) will not be repeated here.

[0042] According to the first aspect, or any implementation method of the first aspect above, the first voice information belongs to a first recording segment, the first recording segment belongs to a first voice file, and the first voice file also includes a second recording segment; the speaker name displayed in the speaker capsule is updated to a name named based on the renaming window, including: the speaker names displayed in all speaker capsules corresponding to the same speaker in the text information converted from the first voice segment displayed in the third area are updated to a name named based on the renaming window.

[0043] According to the first aspect, or any implementation method of the first aspect above, the first voice information belongs to a first recording segment, the first recording segment belongs to a first voice file, and the first voice file also includes a second recording segment; the speaker name displayed in the speaker capsule is updated to a name named based on the renaming window, including: the speaker names displayed in all speaker capsules corresponding to the same speaker in the first recording segment and the second recording segment displayed in the third area are updated to a name named based on the renaming window.

[0044] According to the first aspect, or any implementation of the first aspect above, the second area also includes a mark control, and the mark control is used to add a label to the recorded voice information.

[0045] Among them, the marking control is, for example, the marking control 137c mentioned in the following embodiment.

[0046] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the stop recording control in the first area, in response to the user's operation of the mark control, adding a label in the recording status bar corresponding to the recorded voice information, and displaying the added label at the corresponding time position in the recording status bar displayed in the first area.

[0047] For details about adding tags during voice recording, please refer to the following Fig.12 and Fig.13 The description of is not repeated here.

[0048] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the start recording control and the start playing control in the first area, in response to the user's dragging operation of the recording playing progress control in the first playing progress bar, the recording playing progress control is moved to the first position corresponding to the first playing time point; in response to the user's operation of the mark control, a first label is added at the first position; in response to the user's dragging operation of the recording playing progress control, the recording playing progress control is moved to the second position corresponding to the second playing time point, and the time difference between the first playing time point and the second playing time point is not less than the set time threshold; in response to the user's operation of the mark control, a second label is added at the second position.

[0049] After the voice message is recorded, the relevant contents of adding tags can be found in the following Fig.14 and Fig.15 The description of is not repeated here.

[0050] The time threshold is, for example, 5 ms as described in the following embodiment.

[0051] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the start recording control and the pause playback control in the first area, in response to the user's operation of the mark control, adding a label to the playback time currently corresponding to the first playback progress bar.

[0052] In the process of playing voice information, the relevant content of adding tags can be found in the following Fig.16 The description of is not repeated here.

[0053] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the start recording control and the pause playback control in the first area, in response to the user's dragging operation of the recording playback progress control in the first playback progress bar, moving the recording playback progress control to a third position corresponding to a third playback time point; in response to the user's operation of the mark control, adding a third label at the third position; and continuing to play the voice information from the third position.

[0054] In the process of playing voice information, the relevant content of adding tags can be found in the following Fig.16 The description of is not repeated here.

[0055] According to the first aspect, or any implementation of the first aspect above, a start recording control and a start playing control are displayed in the first area, or in the process of displaying the start recording control and the pause playing control in the first area, a voice menu control is also displayed in the first area; the method also includes: in response to the user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a tag option; in response to the user's operation on the tag option, displaying all recorded audio segments included in the first note in the voice menu window, and displaying all tags included in the recording segment under each recording segment; in response to the user's deletion operation on any tag displayed in the voice menu window, deleting the tag.

[0056] Among them, the voice menu control is, for example, the voice menu control 141e mentioned in the following embodiment.

[0057] Among them, the voice menu window is, for example, the voice menu window 139c mentioned in the following embodiment.

[0058] For information on deleting tags through the tag option window in the voice menu window 139c, see the following Fig.19 The description of is not repeated here.

[0059] According to the first aspect, or any implementation of the first aspect above, the second area also includes a mark control, which is used to add a label to the recorded voice information; when the start recording control and the start playing control are displayed in the first area, or when the start recording control and the pause playing control are displayed in the first area, the first area also displays a voice menu control; the method also includes: in response to the user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a label option; in response to the user's operation on the recording option, displaying all the recorded audio segments included in the first note and the editing control in the voice menu window; in response to the user's operation on the editing control, displaying the second interface corresponding to the first note, the second interface displays all the recorded audio segments included in the first note, and displays all the labels included in the recording segment under each recording segment; in response to the user's deletion operation on any label displayed in the second interface, deleting the label.

[0060] The second interface is, for example, the user interface 16 mentioned in the following embodiment.

[0061] Among them, by operating the controls in the second interface to delete the relevant content of the label, you can refer to the following Fig. 20 The description of is not repeated here.

[0062] According to the first aspect, or any implementation of the first aspect above, in response to a user's deletion operation on any recording segment displayed in the second interface, the recording segment and all tags included in the recording segment are deleted.

[0063] Among them, by operating the controls in the second interface to delete the relevant content of the label, you can refer to the following Fig. 20 The description of is not repeated here.

[0064] According to the first aspect, or any implementation of the first aspect above, the second area also displays the first control; the method also includes: in response to the user's operation on the first control, displaying a management window on the first interface, and displaying a tag management entrance in the management window; in response to the user's operation on the tag management entrance, displaying a tag management window, and displaying all tags included in the current recording segment in the tag management window; in response to the user's deletion operation on any tag displayed in the tag management window, deleting the tag.

[0065] The control for swapping out the management window is, for example, the “more” control 137d described in the following embodiment.

[0066] The management window is, for example, the management window 139a described in the following embodiment.

[0067] Among them, the label management entry is, for example, the label management entry 139a-2 mentioned in the following embodiment.

[0068] The label management window is, for example, the label management window 139b described in the following embodiment.

[0069] For more information about deleting tags through the tag management window, see the following Fig.18 The description of is not repeated here.

[0070] According to the first aspect, or any implementation of the first aspect above, the second area also includes a first control; the method also includes: in response to an operation on the first control, a management window is displayed on the first interface, and a sharing entrance is displayed in the management window; when the third area includes a screening spokesperson capsule, a first spokesperson capsule, a second spokesperson capsule and a first text message, after detecting the user's operation on the sharing entrance, the name of the first note, the name of the first speaker displayed in the first spokesperson capsule, the name of the second speaker displayed in the second spokesperson capsule, and the first text message sent are shared to the first application in text form; when the third area includes a screening spokesperson capsule, a first spokesperson capsule, and a first text content, after detecting the user's operation on the sharing entrance, the name of the first note, the name of the first speaker displayed in the first spokesperson capsule, and the first text content are shared to the first application in text form.

[0071] Among them, the sharing entrance is, for example, the sharing entrance 139a-3 mentioned in the following embodiment.

[0072] The third interface is, for example, the user interface 17 mentioned in the following embodiment.

[0073] For relevant contents in this regard, please refer to the following Fig.21 and Fig. 22 The description of is not repeated here.

[0074] According to the first aspect, or any implementation method of the first aspect above, after detecting the user's operation on the sharing portal, the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, and the first text message sent are shared to the first application in text form, including: after detecting the user's operation on the sharing portal, displaying the sharing method in the management window, the sharing method including the first sharing method, the second sharing method, and the third sharing method; when detecting the user's selection operation on the first sharing method, displaying the third interface; and, displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the first text message sent, and the first application in the third interface; in response to the user's operation on the first application, sharing the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content to the first application in text form.

[0075] Among them, the first sharing method is, for example, sharing method 1 for sharing only text information as described below; the second sharing method is, for example, sharing method 2 for sharing only voice information as described below; the third sharing method is, for example, sharing method 3 for sharing both text information and voice information corresponding to the text information as described below.

[0076] According to the first aspect, or any implementation of the first aspect above, the method also includes: when detecting that the user selects the second sharing method, displaying a third interface; and displaying the first voice information corresponding to the first text information and the first application in the third interface; in response to the user's operation on the first application, sharing the first voice information to the first application in the form of voice.

[0077] According to the first aspect, or any implementation of the first aspect above, the method also includes: when detecting that the user has selected a third sharing method, displaying a third interface; and, displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the first text message sent, the first voice message corresponding to the first text message, and the first application in the third interface; in response to the user's operation on the first application, sharing the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content to the first application in text form; and sharing the first voice message to the first application in voice form.

[0078] According to the first aspect, or any implementation of the first aspect above, a radio setting entrance is also displayed in the management window, and the radio setting entrance is in a folded state; the method also includes: in response to a user's operation on the radio setting entrance in the folded state, updating the state of the radio setting entrance from the folded state to the expanded state, displaying the radio mode in the management window, the radio mode including internal radio, external radio, and internal and external radio; in response to a user's operation on any radio mode, setting the radio mode of the electronic device to the selected radio mode.

[0079] Among them, the radio setting entrance is, for example, the radio setting entrance 139a-1 mentioned in the following embodiment.

[0080] For relevant contents in this regard, please refer to the following Fig.23 The description of is not repeated here.

[0081] In a second aspect, the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes instructions of the method in the first aspect or any possible implementation of the first aspect.

[0082] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0083] In a third aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0084] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.

[0085] In a fourth aspect, the present application provides a computer program, comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0086] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0087] In a fifth aspect, the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive a signal and control the sending pin to send a signal.

[0088] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0089] Figure 1A as well as Figure 1B A schematic diagram of a user interface for creating a new note on an electronic device is shown as an example;

[0090] Figure 2A A schematic diagram of an exemplary user interface for recording text information and voice information in a newly created note is shown;

[0091] Figure 2B An exemplary user interface diagram showing different states of area 13;

[0092] Figure 3 An exemplary user interface diagram showing the styles of the text conversion control 137a and the display speaker control 137b in different states;

[0093] Figure 4 An exemplary user interface diagram showing speaker information during recording is shown;

[0094] Figure 5 A schematic diagram of an exemplary user interface showing the speaker after recording is finished is shown;

[0095] Figure 6 Another exemplary user interface schematic diagram for displaying the speaker after recording is completed is shown;

[0096] Figure 7 A schematic diagram of an exemplary user interface for displaying the speaker during playback of a recording is shown;

[0097] Figure 8 An exemplary user interface diagram for screening speakers is shown;

[0098] Fig. 9 A schematic diagram of an exemplary user interface for screening speakers after recording is completed is shown;

[0099] Fig.10 A schematic diagram of an exemplary user interface for screening the ceiling effect of speakers after recording is completed is shown;

[0100] Fig.11 An exemplary user interface diagram for editing a spokesperson is shown;

[0101] Fig.12 A schematic diagram of an exemplary user interface for adding tags during recording is shown;

[0102] Fig.13 Another exemplary user interface diagram for adding tags during recording is shown;

[0103] Fig.14 A schematic diagram of an exemplary user interface for adding tags after recording is completed is shown;

[0104] Fig.15 Another exemplary user interface diagram for adding tags after recording is completed is shown;

[0105] Fig.16 A schematic diagram of an exemplary user interface for adding tags during playback of a recording is shown;

[0106] Fig.17 A schematic diagram of an exemplary user interface for deleting a tag is shown;

[0107] Fig.18 A schematic diagram of another exemplary user interface for deleting a tag is shown;

[0108] Fig.19 A schematic diagram of another exemplary user interface for deleting a tag is shown;

[0109] Fig. 20 A schematic diagram of another exemplary user interface for deleting a tag is shown;

[0110] Fig.21 A schematic diagram of an exemplary user interface for sharing the contents in a recording card is shown;

[0111] Fig. 22 Another exemplary user interface diagram for sharing the contents in a recording card is shown;

[0112] Fig.23 An exemplary user interface schematic diagram for setting a sound receiving mode is shown;

[0113] Fig.24 Another exemplary user interface schematic diagram for setting a sound receiving mode is shown;

[0114] Fig.25A as well as Fig.25B A schematic diagram of an exemplary user interface involved in segmented recording is shown;

[0115] Fig.26 A schematic diagram of an exemplary user interface for audio-text synchronization is shown;

[0116] Fig. 27 An exemplary flow chart of a note processing method is shown;

[0117] Fig.28 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application is shown;

[0118] Fig.29 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0119] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0120] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0121] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0122] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0123] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0124] In one solution, the electronic device may be installed with a note application. The user may use the note application to record voice information in the form of recording. While recording, other information input by the user may also be received, such as one or more of text information (hereinafter referred to as text), picture information (hereinafter referred to as picture), etc.

[0125] However, in this way of recording information, the electronic device can only simply realize the voice-to-text conversion of the recorded voice information. It does not support which speaker the text information converted from the label comes from, nor does it support the screening of the text information of the specified speaker, nor does it support the editing of the specified speaker (such as renaming), nor does it support the addition and deletion of labels for the recording content in the specified location, nor does it support the sharing of the recorded voice information and the text information converted from the voice information, nor does it support the modification of the sound reception method. Therefore, the applicable scenarios are relatively single, and it cannot meet the different usage needs of users, and the user experience is poor.

[0126] In view of this, the present application provides a note processing method. The note processing method can be applied to notes generated by an electronic device using a note application, aiming to achieve more processing of voice information recorded in the notes to meet different scenario requirements and improve user experience.

[0127] It should be noted that the processing of recorded voice information performed by this application may be, for example, the display, screening, and editing of speakers mentioned above, as well as the adding and deleting of tags, the sharing of voice information, the processing of text information converted from voice information, and the modification of the reception method.

[0128] Specifically in practical applications, by implementing the note processing method provided in this application, the electronic device can realize one or more of the following functions, but is not limited to the following functions.

[0129] Function 1:

[0130] When the voice-to-text function is turned on or there is converted text information, the electronic device can display the speaker, filter the speaker, edit the speaker, etc. for the text information converted from the voice information during recording, recording, and playback. In addition, it is possible to switch between turning on the display speaker function and turning off the display speaker function. In addition, when the display speaker function is turned on, the speaker filtering and speaker editing processes can be realized at any time.

[0131] In this way, it can be better applied to multi-person conference scenarios, so that users can know the speaker corresponding to each text message converted from voice information. Moreover, according to user needs, only the text information corresponding to the speaker selected by the speaker screening process can be displayed. In addition, by providing the function of editing speakers, users can rename the designated speakers as needed, which further facilitates users to know the actual speaker corresponding to each text message.

[0132] It should be understood that in the process of implementing function 1, other functions may also be implemented, such as any one or more of functions 2 to 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note application and process notes. Figures 4 to 11 The description of is not repeated here.

[0133] Function 2:

[0134] The electronic device can add tags at specified positions (time points) in the voice information and delete the added tags during recording, at the end of recording, and during the playback of the recording.

[0135] In this way, users can mark the voice content they want to focus on according to their needs, so that they can quickly locate the marked position for playback later.

[0136] It should be understood that in the process of implementing function 2, other functions may also be implemented, such as function 1 listed above, and any one or more of functions 3 to 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note application and process notes. For the relevant content in this scenario of implementing function 2, please refer to the following description of the Figures 12 to 20 The description of is not repeated here.

[0137] Function 3:

[0138] When the voice-to-text function is turned on or text information has been converted, the electronic device can share the text information converted from the voice information during recording, recording, and playback. In addition, the user can also choose to share the voice information corresponding to the text information, or share the text information and the corresponding voice information at the same time.

[0139] The sharing methods include but are not limited to one or more of the following sharing methods:

[0140] Sharing method 1: Share text information only.

[0141] Sharing method 2: Share voice messages only.

[0142] Sharing method 3: Share the text message and the voice message corresponding to the text message at the same time.

[0143] In addition, sharing method 1 includes but is not limited to any one or more of the following:

[0144] Sharing method 11: directly share the text to be shared to the application or device selected by the user in the form of text. That is, the text shared to the application or device selected by the user is directly displayed in the form of text information.

[0145] Sharing method 12: Convert the text to be shared into a document of a specified format, such as TXT format, PDF format, Word format, image format, etc., and share it in the form of a document to the application or device selected by the user.

[0146] Sharing method 13: The text information to be shared is still shared in the form of a note to the application or device selected by the user.

[0147] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation to this embodiment. For the sake of convenience, the sharing method 11 is used as an example in the subsequent embodiments for specific description, and the specific implementation details are not repeated here.

[0148] In this way, the user can share the notes recorded on the current electronic device with other applications or other electronic devices, so that the user can continue to view the content of the notes using other devices.

[0149] It should also be understood that in the process of implementing function 3, other functions can also be implemented, such as function 1 and function 2 listed above, and any one or more of functions 4 to 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note application and process notes. For the relevant content in this scenario of implementing function 3, please refer to the following description of the Fig.21 and Fig. 22 The description of is not repeated here.

[0150] Function 4:

[0151] The electronic device can modify the receiving method during recording, so that different receiving methods can be used for recording according to needs, thereby better ensuring the recording effect.

[0152] In addition, when recording is finished and the recording is played, the recording mode can also be modified, so that the next time you start recording, you can record according to the recording mode set by the user before starting recording.

[0153] The sound receiving method includes but is not limited to one or more of the following sound receiving methods:

[0154] Radio reception method 1: Internal radio reception (internal recording). The condition for internal radio reception is that the electronic device has a radio function, and the sound signal received is directly transmitted to the recording system and recorded to the storage medium. This recording method is not subject to external interference, the audio signal is not lost, and the recording quality is better.

[0155] Sound collection method 2: External sound collection (external recording). External sound collection is to transmit the external sound signal to the recording system through the microphone of the electronic device or the external sound pickup device, and then record the sound signal in the storage medium. This recording method is easily affected by external interference and the sound signal is easily distorted. Its advantage is that it can easily record various sound signals such as human voice.

[0156] Recording method 3: Internal and external sound recording (full-scene recording), that is, recording internal and external sounds at the same time.

[0157] It should be understood that the above description is only an example listed for a better understanding of the technical solution of this embodiment, and is not the only limitation to this embodiment. For the sake of convenience, the subsequent embodiments are specifically described by taking the radio reception mode 1 and the radio reception mode 2 listed above as an example, and the specific implementation details are not repeated here.

[0158] It should also be understood that in the process of implementing function 4, other functions may also be implemented, such as functions 1, 2, and 3 listed above, and any one or more of functions 5 and 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note application and process notes. For the relevant content in this scenario of implementing function 4, please refer to the following description of the Fig.23 and Fig.24 The description of is not repeated here.

[0159] Function 5:

[0160] When recording information, the electronic device can record multiple voice messages (voice segments) separately, and make the multiple voice messages into a long voice (voice file), so that the multiple voices can be played continuously when playing the long voice.

[0161] For example, take Q segments of voice to represent that the electronic device has made Q recordings. Specifically, after a recording starts, the electronic device can collect sound signals, and after the recording ends, a segment of voice information can be obtained based on the collected sound signals. That is, the electronic device can record at different times (Q separate time periods) to obtain Q segments of voice. Then, the electronic device can integrate the Q segments of voice to obtain a long voice. In this way, when playing a long voice, the Q segments of voice recorded separately can be played continuously. Wherein, Q is an integer greater than or equal to 2.

[0162] In some possible cases, after the Q-th recording stops, the electronic device can display the playback progress bar corresponding to the long voice. The playback progress bar includes Q-1 nodes, and the playback progress bar is divided into Q segments (which can be called Q segment sub-progress bars). Among them, the i-th sub-progress bar in the Q segment sub-progress bar corresponds to the i-th voice. The length of the i-th sub-progress in the playback progress bar is proportional to the ratio of the total duration of the i-th voice segment to the total duration of the long voice: the larger the ratio of the total duration of the i-th voice segment to the total duration of the long voice, the greater the proportion of the i-th voice segment in the long voice, and the longer the length of the i-th sub-progress bar in the playback progress bar.

[0163] It should be understood that the long speech involved here means that the speech includes more content than any of the multiple voice messages, and can be regarded as a collection of the multiple voice messages. It does not refer to the length of the long speech. The total duration of the long speech is not limited in the embodiments of the present application.

[0164] It should also be understood that in the process of implementing function 5, other functions may also be implemented, such as any one or more of functions 1 to 4 listed above, and function 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note application and process notes. For the relevant content in this scenario of implementing function 5, please refer to the following description of the Fig.25A and Fig.25B The description of is not repeated here.

[0165] Function 6:

[0166] When playing a recording, the electronic device can achieve audio-text synchronization. Audio-text synchronization includes displaying the text information corresponding to the played voice information in state A (such as bold font) and displaying the text information corresponding to the unplayed voice information in state B (such as gray font) when playing a recording. In this way, the user can quickly know the text information corresponding to the currently played voice information.

[0167] In addition, during the playback of the recording, the user can also edit the text information converted from the voice information, such as adding, modifying or deleting part of the content. For modified scenarios, such as replacing some typos, the audio-text synchronization can continue to be saved; for deleted scenarios, during the audio-text synchronization process, the content before the deletion can be stayed, and after the voice information corresponding to the deleted text information is played, the subsequent text information can be synchronized with the voice information; for newly added scenarios, during the audio-text synchronization process, the text information corresponding to the voice information can keep pace with the playback of the voice information, such as switching from state A to state B, and the newly added text information is always in state C (such as font setting underline, or background color, displayed in different colors, etc.). It further facilitates user operations and improves user experience.

[0168] It should be understood that in the process of playing the recording, in addition to function 6, other functions may also be included, such as any one or more of functions 1 to 5 listed above, as well as other functions not listed. These functions can make it easier for users to use the note application and process the notes. For the relevant content in this scenario of implementing function 6, please refer to the following Fig.26 The description of is not repeated here.

[0169] In order to better understand the six functions listed above, the following describes the relevant contents involved in implementing these functions in combination with the user interface diagrams involved in practice.

[0170] Before describing the relevant contents of the above 6 functions, first combine Figure 1A and Figure 1B Create a new note in the electronic device, and combine Figure 2A and Figure 2B An exemplary description is given of the contents related to recording text information and voice information in a newly created note.

[0171] See also Figure 1A In the user interface 10 shown in (1), in response to an operation (e.g., a click operation) on a note-taking application (e.g., note 101), the electronic device can open the note-taking application. At this time, the electronic device can display the following Figure 1A The user interface 11a shown in (2) .

[0172] like Figure 1A As shown in (2), the user interface 11a is an exemplary user interface involved in creating a new note. The user interface 11a may include a control 111 corresponding to viewing all notes. In response to the operation on the control 111, the electronic device may display Figure 1A The user interface 11b shown in (3) .

[0173] like Figure 1A As shown in (3), the user interface 11b may include a control 1131, and the control 1131 may trigger the electronic device to display the folder involved in saving the note.

[0174] In response to the operation on control 1131, the electronic device can display all folders. Among them, all folders include folders created by the user through the electronic device (for example, they can be collectively referred to as new folders), and also include default folders in the system. Any non-empty folder can include at least one file, each of which can be called a note. Empty folders do not include files. For example, Figure 1A As shown in the user interface 11c shown in (4), the newly created folder may include folder 1, and the default folder may be independent of the newly created folder. In response to the operation of the icon 112 corresponding to folder 1, the electronic device may display all the notes included in file 1. For example, at this time, the electronic device may display Figure 1B The user interface 11d shown in (1) .

[0175] like Figure 1B As shown in (1), the user interface 11d includes notes involved in the file 1, such as note A and note B.

[0176] In addition, the user interface 11a, the user interface 11b, and the user interface 11c may further include a new control 113. The new control 113 may be used to trigger the creation of a new note.

[0177] Taking the example of a user triggering an operation on a new control 113 in the user interface 11c, the electronic device will create a new note in response to the user's operation (such as a click operation) on the new control 113 in the user interface 11c, and the new note belongs to the currently opened folder, which is file 1 here.

[0178] It should be understood here that Figure 1A In the user interface 11a shown in (2), since no folder is opened now, but all notes are displayed, in response to the user's operation (e.g., click operation) on the new control 113 in the user interface 11a, the newly created note of the electronic device does not belong to the folder created by the user through the electronic device, such as the file 1 mentioned above, but belongs to the default folder included in the system. Subsequently, the user can set the newly created note to other folders.

[0179] In response to the operation on the new control 113, the electronic device can create a new note. At this time, the electronic device can display Figure 1B The user interface 12 shown in (2).

[0180] like Figure 1BAs shown in (2), the user interface 12 is an initialization interface involved after creating a new note. In response to the operation of the title input control 121, the electronic device can set the name of the new note. For example, the new note is named Note 1 here.

[0181] It should be understood that Figure 1A as well as Figure 1B The method of creating a new note shown in is an exemplary description. In practical applications, the process of creating a new note may involve more or fewer interfaces and controls, which should not constitute a limitation on the embodiments of the present application.

[0182] The aforementioned Note 1 has not recorded the information input by the user. After the electronic device enters Note 1, the recording function can be triggered through the recording control. After the recording function is turned on, the electronic device can divide the user interface into two areas (area 1 and area 2). Area 1 is used to present recording cards (displaying content, options / controls related to recording, etc.), and area 1 can also be called a recording area. Area 2 is used to present other information input by the user (such as text, pictures, etc.). The other information can be called non-recording information, and area 2 can also be called an editing area.

[0183] The recording card located in the recording area (area 1) may include three sub-areas: a voice recording area (recorded as area 11), a voice processing tool area (recorded as area 12), and a text area (recorded as area 13). For a description of area 11, area 12, and area 13, please refer to the following description. Figure 2A and Figure 2B The description of is not repeated here.

[0184] For more information about Area 1, Area 2, and recording text and voice messages in notes, please refer to the following: Figure 2A and Figure 2B An exemplary description of .

[0185] See also Figure 2A In (1), user interface 13 is the corresponding user interface after the user names the newly created note as Note 1. At this time, the electronic device may provide a default input tool, such as keyboard 131. When the keyboard is displayed, the electronic device may also display a note toolbar (such as note toolbar 132).

[0186] The note toolbar can provide a convenient function (such as a recording function) entrance when the user records information. The note toolbar 132 may include an insert control 132a, a recording control 132b, and a handwriting control 132c. Among them, the insert control 132a can be used to trigger the insertion of information such as pictures and videos into the user interface 13 for display. The recording control 132b can be used to trigger the start of the recording function. The handwriting control 132c can be used to trigger the switching of the input tool from the keyboard 131 to the stylus toolbar. In addition to the insert control 132a, the recording control 132b and the handwriting control 132c, the note toolbar may also include other controls, for example, it may also include a list creation control 132d and a style setting control 132e.

[0187] Exemplarily, in response to an operation (eg, a click operation) on the handwriting control 132c, the electronic device switches the input tool from the keyboard 131 to the stylus toolbar. Figure 2A As shown in (2), the stylus toolbar may be a stylus toolbar 134 displayed in the user interface 13a. The stylus toolbar 134 may include different styluses, such as styluses 134a to 134f. The stylus can be used to mark in the editing area, for example, to add an underline, draw a circle, write text information, etc. The user interface 13a may also include a keyboard switching control 135. The keyboard switching control 135 can be used to trigger the electronic device to switch the input tool from the stylus toolbar to the keyboard. Exemplarily, in some possible cases, the keyboard switching control 135 can be used as a shortcut control in the stylus toolbar 134.

[0188] Continue to see Figure 2A In (1), for example, in response to an operation (such as a click operation) on the recording control 132b, the electronic device can start the recording function, and divide the aforementioned area 1 and area 2 in the user interface, such as Figure 2A As shown in the user interface 13b shown in (3).

[0189] See also Figure 2A In (3), illustratively, the user interface 13b includes area 1 and area 2. Area 1 includes area 11, area 12 and area 13.

[0190] Exemplarily, area 11 may include functional controls involved in recording or broadcasting (recording or playing) voice, such as a recording bar. The recording bar can be used to trigger functions such as recording voice, pausing recording voice, playing voice, pausing playing voice, etc. The recording bar has different states, and the recording bar in different states is composed of different components. The state of the recording bar is different, and the function of the recording bar is different.

[0191] For example, Figure 2A The recording bar included in the area 11 shown in (3) is a recording bar in state 1 (also referred to as recording bar 1). The recording bar 1 may include a stop recording control 136a, a recording state bar 136b, and a recording duration 136c corresponding to the voice recording.

[0192] The stop recording control 136a is used to indicate that the current electronic device has started recording. When the user clicks the control, the electronic device will stop recording, and the recording bar 1 will switch to the recording bar in state 2 (also referred to as recording bar 2). Figure 2A The user interface 14 is shown in (4).

[0193] The recording status bar 136b can reflect the energy of the sound signal collected by the electronic device. The greater the energy, the greater the change of the recording status bar 136b; the smaller the energy, the smaller the change of the recording status bar 136b.

[0194] In some possible cases, the recording duration 136c may be used to represent the total duration of all recorded voices. In other possible cases, the recording duration 136c may not be used to represent the total duration of all recorded voices, but may be used to represent the total duration of the voice being recorded.

[0195] See also Figure 2A In (4), the user interface 14 is an exemplary user interface involved after pausing recording. In some possible cases, the recording bar 2 in state 2 may include a start recording control 141a, a start playing control 141b, a play progress bar 141c, a play time indicator 141d, and a voice menu control 141e.

[0196] Among them, the start recording control 141a can be used to trigger the electronic device to start recording again (restart recording a voice segment). The start playing control 141b can be used to trigger the electronic device to play the recorded voice (voice segment). The play progress bar 141c can be used to indicate the progress of the currently played voice. The play time indicator 141d is used to indicate the current play time and the total duration of all voices. The voice menu control 141e is used to trigger the electronic device to display and manage all recorded voices, which include all voice segments recorded in Note 1. When all the voices recorded in Note 1 are Q (an integer greater than or equal to 2) segments of voice, the electronic device can integrate the Q segments of voice into a long voice, and the total duration of the Q segments of voice is the total duration of the long voice. At this time, the play progress bar 141c can also include Q-1 nodes, dividing the play progress bar 141c into Q segments (which can be called Q segment sub-progress bars). Among them, the i-th sub-progress bar in the Q segment sub-progress bar corresponds to the i-th segment of voice. For the description of the nodes and their related contents, please refer to the following Fig.25B The description of (2) will not be repeated here.

[0197] In addition, the play progress bar 141c may include a recording play progress control 1411. The recording play progress control 1411 is at position A1 of the play progress bar 141c, indicating the voice information corresponding to the play position A1.

[0198] Continue to see Figure 2A In (3), exemplarily, regarding area 12, in some possible cases, it may include a text conversion control 137a (speech-to-text control), a display speaker control 137b, a label control 137c, and a "more" control 137d that hides some functions.

[0199] Among them, the display speaker control 137b in area 12 may include three states, such as a first state indicating that the display speaker function is not turned on (off), a second state indicating that the display speaker function is turned on, and a third state indicating that the display speaker function is unavailable. When the display speaker control 137b is in the first state or the second state, when the user clicks on the display speaker control 137b, the switching of these two states can be achieved. For example, when the user clicks on the display speaker control 137b in the first state, the electronic device will switch the display speaker control 137b from the first state to the second state in response to the operation; when the user clicks on the display speaker control 137b in the second state, the electronic device will switch the display speaker control 137b from the second state to the first state in response to the operation.

[0200] In addition, it should be noted that the display speaker control 137b can be in the first state or the second state only when the text conversion control 137a is in the second state, that is, the user turns on the voice-to-text function, or the text area (area 13) has displayed text information converted from the voice information. Otherwise, the display speaker control 137b will be in the third state.

[0201] Among them, in the label control 137c in area 12, all scenes (during recording, when recording ends, and during playback of recording) are available. Specifically, each time the user clicks, a label will be added to the specified position (time point) in the recording bar. For the relevant content involved in the label control, please refer to the description of the relevant content of adding and deleting labels below, which will not be repeated here.

[0202] Among them, the "More" control 137d in area 12 is available in all scenarios. Specifically, each time the user clicks on the control, the corresponding window will be displayed, which displays hidden function controls, such as sharing controls, radio mode modification (radio settings) controls, and management tag controls. For the relevant content involved in these controls, please refer to the following description of the radio mode settings and the relevant content of deleting tags, which will not be repeated here.

[0203] The following describes the styles of the text conversion control 137a and the display speaker control 137b in different states, as well as the relationship between the two. Figure 3 The user interface is shown as an example for explanation.

[0204] Exemplarily, when the text-to-text control 137a is in the first state, that is, the state indicating that the speech-to-text function is not turned on, and there is no text information converted from the speech information in the area 13, according to the above description, in this case, the display speaker function is unavailable, that is, the display speaker control 137b is in the third state. In this case, the text-to-text control 137a in the first state can be as follows: Figure 3 In the style shown in (1), the display speaker control 137b in the third state can be as shown in Figure 3 The style shown in (1) (the font is gray).

[0205] For example, when the user clicks on Figure 3 After the text conversion control 137a is in the first state, the electronic device responds to the operation behavior, and the text conversion control 137a switches from the first state to the second state, that is, the state indicating that the voice conversion function is turned on, and the style of the text conversion control 137a also changes from Figure 3 The style shown in (1) is switched to Figure 3 The icons and text shown in (2) are all in black.

[0206] According to the above description, when the text conversion control 137a is in the second state, regardless of whether there is text information converted from the voice information in area 13, the display speaker control 137b can be selected by the user, that is, it can be switched from the third state to the non-third state (the first state or the second state). In actual applications, when switching from the third state to the non-third state, whether to switch to the first state or the second state can be set according to business needs, and this application does not limit this. For ease of explanation, the embodiment of the present application takes the non-third state switched from the third state to the first state as an example. The style of the display speaker control 137b in the first state can be as follows: Figure 3 The style shown in (2) (the font changes from gray to black).

[0207] Exemplarily, when the text conversion control 137a is in the second state ( Figure 3 ), showing that the speaker control 137b is in the first state ( Figure 3 When the user clicks on the display speaker control 137b in the first state, the electronic device responds to the operation behavior, and the display speaker control 137b switches from the first state to the second state, that is, the state indicating that the display speaker function is turned on, and the style of the display speaker control 137b also changes from Figure 3 The style shown in (2) is switched to Figure 3 The icons and text shown in (3) are all in black.

[0208] Understandably, when the text conversion control 137a is in the second state ( Figure 3 ), the speaker control 137b is also in the second state ( Figure 3 When the text information converted by the electronic device according to the voice information is displayed in area 13, such as "Note 1 includes two parts, wherein the first part mainly talks about XXX. The second part mainly talks about XX.", a control for filtering the specified speaker will be displayed in area 13, such as Figure 3 The filter speaker capsule 137e shown in (6) and the control for displaying the speaker information corresponding to each text message, such as Figure 3 The spokesperson capsule 137f is shown in (6).

[0209] In some possible cases, when the speaker display function is turned on, all speakers may be displayed by default. Accordingly, all text information converted from the voice information will also be displayed in area 13.

[0210] In some other possible cases, the user can filter the speakers by operating the speaker filter capsule 137e, such as selecting one or more speakers as needed. Accordingly, only the text information corresponding to the filtered speakers will be displayed in area 13. Figures 8 to 10 The description of is not repeated here.

[0211] For ease of explanation, the embodiments of the present application take the example of displaying all speakers by default after the display speaker function is turned on.

[0212] Among them, the spokesperson capsule 137f corresponding to each text message may include the spokesperson avatar, spokesperson time, and spokesperson name corresponding to the text message. In some possible cases, the spokesperson avatar and spokesperson name displayed in the spokesperson capsule 137f may be the default avatar and name set by the system. In other possible cases, the spokesperson avatar and spokesperson name displayed in the spokesperson capsule 137f may be synchronized with the avatar and name of the relevant contact in applications such as contacts. In other possible cases, the user can modify the spokesperson avatar and spokesperson name by operating the spokesperson capsule 137f. For the content involved in this operation, please refer to the following description. Fig.11 The description of is not repeated here.

[0213] Exemplarily, when the text-to-text control 137a is in the first state, that is, the state indicating that the speech-to-text function is not turned on, but there is text information converted from the voice information in area 13, such as "Note 1 includes two parts, among which the first part mainly talks about XXX. The second part mainly talks about XX." According to the above description, in this case, the display speaker function is available, that is, the display speaker control 137b is in a non-third state (the embodiment of the present application takes the first state as an example by default). In this case, the text-to-text control 137a in the first state can be used as follows: Figure 3 Zhong (1) and Figure 3 In the style shown in (4), the display speaker control 137b in the first state can be as shown in Figure 3 The style shown in (4) (the font is black).

[0214] Exemplarily, when the display speaker control 137b is in the first state ( Figure 3 When the user clicks on the display speaker control 137b in the first state, the electronic device responds to the operation behavior, and the display speaker control 137b switches from the first state to the second state, that is, the state indicating that the display speaker function is turned on, and the style of the display speaker control 137b also changes from Figure 3 The style shown in (4) is switched to Figure 3The icons and text shown in (5) are all in black.

[0215] Understandably, since area 13 displays text information converted by the electronic device based on the voice information, such as "Note 1 includes two parts, wherein the first part mainly talks about XXX. The second part mainly talks about XX.", after the speaker display function is turned on, area 13 will display a control for filtering designated speakers, such as Figure 3 The filter speaker capsule 137e shown in (5) and the control for displaying the speaker information corresponding to each text message, such as Figure 3 The spokesperson capsule 137f is shown in (5).

[0216] about Figure 3 The screening spokesperson capsule 137e and spokesperson capsule 137f shown in (5) are the same as those mentioned above. Figure 3 The screening spokesperson capsule 137e shown in (6) is the same as the spokesperson capsule 137f and will not be described again here.

[0217] In addition, for the contents related to the screening of the spokesperson capsule 137e and the spokesperson capsule 137f, reference can be made to the following Figures 8 to 10 ,as well as Fig.11 The description of is not repeated here.

[0218] It should be understood that the above description is only an example listed for a better understanding of the technical solution of this embodiment, and is not the only limitation to this embodiment. In practical applications, different styles can be set according to business needs to represent the first state and the second state of the text conversion control 137a, and different styles can be set to represent the first state, the second state and the third state of the display speaker control 137b, and this application does not limit this.

[0219] Continue to see Figure 2A In (3), illustratively, area 13 is used to display text information converted from voice information when the user turns on the voice-to-text function, that is, when the text-to-text control 137a is in the second state. The displayed text information is specifically obtained by the electronic device processing the collected sound signal to obtain voice, and converting the voice, and then displaying the converted text in area 13.

[0220] In addition, in some implementations, when the voice-to-text function is turned on, in the process of converting the voice information into text information, a prompt message may be displayed in area 13, and the prompt message may be used to prompt that the electronic device has turned on the voice-to-text function. For example, the prompt message may be a prompt text: "Converting voice to text...".

[0221] In addition, it can be seen from the above description that when the user turns on the speech-to-text function, that is, the text-to-text control 137a is in the second state, or the area 13 has already displayed text information converted from the speech information, when the user turns on the display speaker function, that is, the display speaker control 137b is in the second state, the area 13 will not only display the text information converted from the speech information, but also display the control for filtering the specified speaker, such as Figure 3 Zhong (5) and Figure 3 The screening spokesperson capsule 137e shown in (6) in FIG. 1 and the spokesperson information corresponding to each text message, such as Figure 3 Zhong (5) and Figure 3 The speaker capsule 137f shown in (6) shows the speaker's head portrait, speaker time, and speaker name corresponding to the text information.

[0222] In addition, in some possible cases, a control for user operation may be provided in area 13, such as Figure 2B 150a shown in (1), or Figure 2B 150b shown in (2).

[0223] When the control 150a is displayed in the area 13, it indicates that the area 13 is in the expanded state. Specifically, when the area 13 is in the expanded state and there is text information converted from the voice information, the user can see the text information converted from the voice information in the area 13.

[0224] Understandably, when the control displayed in area 13 is 150a, when the user clicks on control 150a, the electronic device responds to the operation behavior and area 13 changes from Figure 2B The expanded state shown in (1) is switched to Figure 2B The collapsed state shown in (2) is shown in FIG. 150 , and control 150a is updated to control 150b.

[0225] When the control 150b is displayed in the area 13, it indicates that the area 13 is in a folded state. Specifically, when the area 13 is in a folded state, the area 13 will be folded, and even if there is text information converted from the voice information, the user cannot see it.

[0226] Understandably, when the control 150b is displayed in the area 13, when the user clicks the control 150b, the electronic device responds to the operation behavior and the area 13 changes from Figure 2B The folded state shown in (2) is switched to Figure 2B The expanded state shown in (1) and control 150b will be updated to control 150a.

[0227] Exemplarily, in some possible cases, the state of area 13 may be bound to the state of the text conversion control 137 a in area 12 .

[0228] For example, when the text conversion control 137a is in the second state, the region 13 may be in an expanded state. Correspondingly, when the text conversion control 137a is in the first state, the region 13 may be in a collapsed state.

[0229] For another example, when the text conversion control 137a switches from the second state mentioned above to the first state mentioned above, if there is already text information converted from the voice information, the area 13 may still be in the expanded state.

[0230] Exemplarily, in some other possible situations, the area 13 may be set to be in the expanded state by default, that is, no matter what state the text conversion control 137a is in, and no matter whether there is text information converted from the voice information, the area 13 is in the expanded state.

[0231] Exemplarily, in this implementation, the change in the state of area 13 depends only on the user's operation on control 150a.

[0232] Accordingly, when the user clicks 150a, the region 13 switches from the expanded state to the collapsed state, and the control 150a is updated to 150b, the change in the state of the region 13 depends only on the user's operation on the control 150b.

[0233] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment, and is not intended to be the only limitation to this embodiment. For ease of description, the following embodiments are described by taking the region 13 being in the unfolded state by default as an example.

[0234] It should also be understood that, here, the area 11, area 12, and area 13 are displayed in one area (area 1) as an example for description, and in other possible situations, the area 11, area 12, and area 13 may be separated.

[0235] Continue to see Figure 2A In (3), for example, area 2 is used to present input non-recording information, such as text, pictures, etc. When non-recording information is not displayed in area 2, a prompt message may be displayed, and the prompt message may be used to remind the user that recording is currently in progress, and may also remind the user that information may be currently input in area 2. For example, the prompt message may be a text prompt: "Recording is in progress, you may write or doodle in the blank...".

[0236] In addition, the electronic device may provide an input tool for inputting information, wherein the input tool may include a keyboard and a stylus tool bar.

[0237] In some possible cases, the electronic device may display an input tool in a user interface, and when the input tool is displayed, a shortcut control for switching to other input tools may be provided.

[0238] In this way, in some possible cases, during recording, after recording, and during the playback of the recording, the user can view the recording status through the recording bar in area 11. At the same time, the electronic device can also process the recorded voice information by operating various options in area 12 during the above process. At the same time, in the above process, when the voice-to-text function is turned on, the electronic device can display the converted text information in area 13 for the user to view and edit after realizing the voice-to-text conversion. At the same time, in the above process, the user can also implement manual input through the input tool, and the input information is displayed in area 2 for the user to view. Manual input includes entering text, inserting pictures, etc.

[0239] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0240] The following is based on Figures 4 to 11 Taking the three scenarios of recording, recording end and recording playback as examples, the relevant contents involved in displaying speakers, screening speakers and editing speakers in the above function 1 are described in an exemplary manner.

[0241] The following is the relevant content of the speaker:

[0242] For more information about displaying the speaker during recording, please refer to the following Figure 4 An exemplary description of .

[0243] like Figure 4 In the user interface 13b shown in (1), in response to an operation (e.g., a click operation) on the text conversion control 137a (first state), the electronic device (e.g., a mobile phone) can start the speech-to-text function and change the state of the text conversion control 137a from the first state ( Figure 4 (1) is updated to the second state ( Figure 4 The style shown in (2)).

[0244] Through the above description of the association between the text conversion control 137a and the display speaker control 137b, it can be seen that when the state of the text conversion control 137a is the second state ( Figure 4When the speaker control 137b is displayed in the style shown in (2), the state of the speaker control 137b may be a state other than the third state, that is, the first state ( Figure 4 (2)), or the second state ( Figure 4 (3)). The present application embodiment takes the non-third state as the first state as an example. Therefore, the electronic device responds to the state being the first state ( Figure 4 The text conversion control 137a of the style shown in (1) is operated to turn on the speech-to-text function and change the state of the text conversion control 137a from the first state ( Figure 4 (1) is updated to the second state ( Figure 4 (2)), the state of the speaker control 137b will also be displayed from the third state ( Figure 4 (1) is updated to the first state ( Figure 4 The style shown in (2)).

[0245] See also Figure 4 In (2), illustratively, after the voice-to-text function is turned on, the electronic device processes the collected sound signal to obtain voice, converts the voice, and displays the converted text in area 13. In order to improve the user experience, while waiting for the electronic device to convert the collected sound signal into text and display it in area 13, a prompt message such as "voice-to-text conversion..." can be displayed in area 13, thereby preventing the user from mistakenly thinking that the voice-to-text function is not turned on, and repeatedly clicking the text conversion control 137a, causing the voice-to-text function to switch between on and off.

[0246] Continue to see Figure 4 In (2), for example, when the speech-to-text function is turned on, when the user clicks the display speaker control 137b in the first state, the electronic device responds to the operation behavior, turns on the display speaker function, and changes the state of the display speaker control 137b from the first state ( Figure 4 (2)) is updated to the second state ( Figure 4 (the style shown in (3)).

[0247] It can be seen from the above description that after the display speaker function is turned on, a filter speaker capsule 137e will be displayed in area 13. After the electronic device converts the received voice information into text information, at least one speaker capsule 137f can also be displayed in area 13. Among them, the above text information may contain multiple sentences. In some possible cases, the multiple sentences in the text information may come from the same speaker or from different speakers. Regarding the identification of the speaker corresponding to each sentence, for example, the voice information that needs to be converted into text can be identified based on voiceprint recognition technology, and then determined. Regarding the determination of relevant content of different speakers based on voiceprint recognition technology, please refer to voiceprint recognition technology, which will not be repeated here.

[0248] In addition, regarding the division of multiple sentences contained in the text information mentioned above, in some possible cases, it can be divided according to the pause duration when the speaker speaks in the voice information. For example, when the pause duration between the first speech content and the second speech content in the voice information is greater than a set duration threshold, such as 1s, the text converted from the first speech content is divided into one sentence, and the text converted from the second speech content is divided into another sentence.

[0249] In another possible situation, the division may also be based on the switching of speakers, that is, the text converted from the speech content corresponding to each speaker is divided into one sentence.

[0250] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0251] For example, in some possible cases, the speaker avatar and speaker name displayed in each speaker capsule 137f may be system default settings. In other possible cases, the speaker avatar and speaker name displayed in each speaker capsule 137f may also be modified by editing the speaker. For details about modifying the speaker avatar and name displayed in the speaker capsule by editing the speaker, please refer to the following description. Fig.11 The description of is not repeated here.

[0252] It should also be understood that when the voice-to-text function and the speaker display function are turned on during recording, the content displayed in area 13 will change according to the text information converted from the real-time recorded voice information. Figure 4In (3), when the text information 1 converted from the voice information 1 is "Note 1 includes two parts, among which the first part mainly talks about XXX.", and it is determined through the voiceprint recognition technology that the currently converted text information 1 all come from the same speaker (the first speaker is speaker 1 by default), when the text information 1 is displayed in area 13, the speaker capsule 137f corresponding to speaker 1 will be displayed before the text information 1, and the default speaker avatar will be displayed in the speaker capsule 137b, as well as the speaker time when speaker 1 starts to say "Note 1 includes two parts, among which the first part mainly talks about XXX.", such as "00:00:10".

[0253] For example, if the voice-to-text function and the speaker display function are turned on, the electronic device collects another voice message, such as voice message 2. The electronic device determines based on the voiceprint recognition technology that the voiceprint corresponding to voice message 2 is different from the voiceprint corresponding to voice message 1, that is, voice message 2 is not the speech of speaker 1. At this time, the electronic device can determine the speaker corresponding to voice message 2 as speaker 2, and display the speaker capsule corresponding to speaker 2 in area 13, as well as the corresponding text information, such as "The second part mainly talks about XXX." ( Figure 4 (3) is not shown).

[0254] It should be noted that in some possible cases, area 13 may be fixed to avoid blocking area 2 and affecting the user's input of non-voice information during recording. In this case, area 13 may be set as a sliding panel, that is, the user slides his finger up and down in area 13 to slide the content of area 13, thereby displaying text information that is not displayed in the current area.

[0255] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0256] Continue to see Figure 4 In (3), illustratively, when the user clicks the text conversion control 137a in the second state, the electronic device responds to the operation behavior, turns off the speech-to-text function, and changes the state of the text conversion control 137a from the second state ( Figure 4 (3)) is updated to the first state ( Figure 4 (4)). It is understandable that after the voice-to-text function is turned off, the electronic device no longer converts the voice information into text information. Specifically in this embodiment, no new text information will be displayed in area 13, but the text information converted from the voice information before the voice-to-text function is turned off can be retained.

[0257] From the above description, it can be seen that when there is text information in area 13, even if the voice-to-text function is not turned on, the display speaker function can still be used. Figure 4 In the case of the scenario shown in (4), that is, when the text conversion control 137a is in the first state, the display speaker control 137b can still be in the second state. The text information already displayed in the area 13 still retains the previous corresponding speaker capsule.

[0258] Exemplarily, in other possible situations, if the speech-to-text function is turned off and the text information converted from the voice information has not yet been displayed in area 13, then when the speech-to-text function is turned off, that is, after the state of the text conversion control 137a is updated from the second state to the first state, the state of the display speaker control 137b will be updated from the non-third state to the third state, that is, no matter whether the display speaker control 137b is in the first state or the second state at this time, it will be updated to the third state.

[0259] For information about displaying the speaker after recording, please refer to the following Figure 5 and Figure 6 An exemplary description of .

[0260] Scenario 1:

[0261] For example, the voice-to-text function is turned on during recording (the text-to-text control 137a is in the second state, such as Figure 5 (1) shown in the style), and display speaker function (display speaker control 137b is in the second state, such as Figure 5 1), and area 13 displays a filter speaker capsule 137e, text information converted from voice information, and speaker capsules 137f corresponding to different speakers as an example. When the user clicks the stop recording control 136a, the electronic device responds to the operation behavior, pauses the recording, and displays Figure 5 The user interface 14 shown in (2) in FIG. 11 will be changed from Figure 5 The style of the recording strip 1 shown in (1) is updated to Figure 5 The style of the recording strip 2 shown in (2).

[0262] In some possible cases, it can be set that when the user clicks the stop recording control 136a to pause the recording, the voice-to-text function is turned off at the same time, that is, when the recording bar is turned off from Figure 5 The style of the recording strip 1 shown in (1) is updated to Figure 5 When the style of the recording strip 2 shown in (2) is changed, the state of the text conversion control 137a displayed in the area 12 will also change from the second state ( Figure 5(1) is updated to the first state ( Figure 5 The style shown in (2)).

[0263] Continue to see Figure 5 In (1), for example, since the speech-to-text function and the speaker display function are turned on during recording, the text information converted from the speech information is already displayed in area 13, and the speaker selection capsule 137e and the speaker capsule 137f corresponding to each text information are displayed. Therefore, when the recording is paused and the speech-to-text function is turned off, the speaker display function can still be used, that is, the previous second state ( Figure 5 2). Accordingly, the text information already displayed in area 13 will still be displayed, and a filter spokesperson capsule 137e and a spokesperson capsule 137f corresponding to each text information currently displayed will be displayed.

[0264] For example, in Figure 5 In the user interface 14 shown in (2), in response to the second state ( Figure 5 In response to an operation (such as a click operation) of the display speaker control 137b of the electronic device, the electronic device turns off the display speaker function and changes the state of the display speaker control 137b from the second state ( Figure 5 (2)) is updated to the first state ( Figure 5 (the style shown in (3)).

[0265] See also Figure 5 In (3), for example, when both the speech-to-text function and the speaker display function are turned off, the text information converted from the new speech information will no longer be displayed in area 13, but the text information that has been converted and displayed in area 13 can continue to be displayed. In addition, since the speaker display function is also turned off, the speaker filter capsule and speaker capsule will no longer be displayed in area 13, but the text information previously converted from the speech information will be directly displayed, such as "Note 1 includes two parts, of which the first part mainly talks about XXX. The second part mainly talks about XXX.".

[0266] In addition, it can be seen from the above description that when there is text information in area 13, the display speaker function can be used, that is, the display speaker control 137b is in a non-third state. Figure 5 In (3), the speaker control 137b is shown in the first state as an example.

[0267] Scenario 2:

[0268] For example, the voice-to-text function is not enabled during recording (the voice-to-text control 137a is in the first state, such as Figure 6 (1) shown in the style), and display speaker function (display speaker control 137b is in the third state, such as Figure 6 When the user clicks the stop recording control 136a, the electronic device responds to the operation behavior, pauses the recording, and displays Figure 6 The user interface 14 shown in (2) in FIG. 11 will be changed from Figure 6 The style of the recording strip 1 shown in (1) is updated to Figure 6 The style of the recording strip 2 shown in (2).

[0269] Because the speech-to-text function and the display speaker function are not enabled before the recording is paused, the text information converted from the speech information is not displayed in the area 13. Therefore, after the recording is paused, the text-to-text control 137a will continue to maintain the first state, and the display speaker control 137b will continue to maintain the third state.

[0270] In addition, it should be noted that Figure 6 In the user interface 14 shown in (2), when the user clicks the first state ( Figure 6 After the text conversion control 137a is turned on in the style shown in (1) or (2), the electronic device updates the state of the text conversion control 137a from the first state to the second state ( Figure 6 The state of the display speaker control 137b will also change from the third state ( Figure 6 (1) or (2) shown in the figure) is updated to a non-third state (this embodiment takes the first state as an example, such as Figure 6 In this case, when the user clicks the display speaker control 137b in the first state, the electronic device updates the state of the display speaker control 137b from the first state to the second state in response to the operation behavior ( Figure 6 (4)), and speaker capsules indicating different speakers are displayed in area 13. In this way, when text information converted from voice information is displayed in area 13, the selected speaker capsule and the speaker capsule are also displayed.

[0271] For information about displaying the speaker's content during recording playback, please refer to the following Figure 7 An exemplary description of .

[0272] For example, area 13 displays text information converted from voice information, such as "Note 1 includes two parts. The first part mainly talks about XXX." After the recording is finished (or the recording is paused), the user turns off the voice-to-text function, that is, the style of the recording bar in area 11 is as follows: Figure 7 As shown in (1), the styles of the controls in area 12 are as follows Figure 7 In this case, the display speaker function is available, if the display speaker function has not been turned off by the user, that is, the display speaker control 137b has been in Figure 7 If the style shown in (1) is the same as that shown in (2), the filter speaker capsule will be displayed in area 13, such as Figure 7 The filtered spokesperson capsule 137e shown in (1) and the spokesperson capsule corresponding to the text information "Note 1 includes two parts. The first part mainly talks about XXX."

[0273] For example, if the speaker corresponding to the text message "Note 1 includes two parts. The first part mainly talks about XXX" is the speaker 1 mentioned above, and the speech time corresponding to the text message is "00:00:10", the area 13 will display the following: Figure 7 The spokesperson capsule 137f is shown in (1).

[0274] In addition, it should be noted that if the currently recorded voice information includes speeches of multiple speakers, for example, the text information that can be converted from the entire voice segment includes "Note 1 includes two parts. The first part mainly talks about XXX." corresponding to speaker 1, and "The second part mainly talks about XXX." corresponding to speaker 2. In some possible scenarios, such as Figure 7 In (1), after the user converts the text information corresponding to speaker 1 on the electronic device, the user turns off the voice-to-text function. Then, the electronic device will stop converting the voice information to text information, and thus the text information corresponding to speaker 2 will not be converted. In this case, the text information corresponding to speaker 2 and the speaker capsule corresponding to speaker 2 will not be displayed in area 13. Figure 7 The pattern of area 13 shown in (1).

[0275] Continue to see Figure 7 In (1), for example, when the user clicks the start play control 141b in the user interface 14, the electronic device responds to the operation and starts playing the recorded voice clip. Figure 7 The start play control 141b in the recording strip 2 shown in (1) will be replaced by Figure 7The pause play control 141f shown in (2) is used to obtain the recording bar in state 3, such as Figure 7 The recording strip 3 shown in (2).

[0276] See also Figure 7 In (2), for example, the recording bar 3 may also include other controls, such as a start recording control 141a, a play progress bar 141c, a recording play progress control 1411, a play time indicator 141d, and a voice menu control 141e. In the process of playing the recorded voice clip, the recording play progress control 1411 will continue to change with the play progress, and the play time displayed in the play time indicator 141d will also change accordingly. For example, when playing 7s, the recording play progress control 1411 may be located at Figure 7 The content displayed in the play time indicator 141d will also be changed from the position in the user interface 15 shown in (2) Figure 7 The "00:00:00 / 00:01:05" shown in (1) is updated to "00:00:07 / 00:01:05".

[0277] Continue to see Figure 7 In (2), for example, since the voice-to-text function is not currently enabled, the text information displayed in area 13 will not change during the playback of the recorded voice clip (voice duration is "00:01:05"). That is, only the text information corresponding to speaker 1, "Note 1 includes two parts. The first part mainly talks about XXX.", and the speaker capsule corresponding to speaker 1 are still displayed. In this case, when the user clicks the first state ( Figure 7 In response to the operation, the electronic device turns on the speech-to-text function and changes the state of the text-to-text control 137a from the first state ( Figure 7 (2)) is updated to the second state ( Figure 7 In this way, the electronic device can continue to perform speech-to-text processing and display the new text information converted from the speech information, such as the text information corresponding to speaker 2, "The second part mainly talks about XXX.", and the speaker capsule corresponding to speaker 2, in area 13. That is, after the text information corresponding to speaker 1, such as Figure 7 As shown in area 13 shown in (3).

[0278] In addition, it should be noted that, in some possible cases, the content displayed in area 13 may be associated with the playing progress of the recording bar in area 11. That is, when the corresponding voice information is played, the content corresponding to the voice information is synchronously displayed in area 13.

[0279] In addition, it should be noted that in some other possible situations, when the voice-to-text function is turned on during playback, the entire recording is directly converted into corresponding text information and displayed in area 13, and the corresponding speaker capsule is displayed. When the corresponding voice information is played, the content displayed in area 13 is switched to the state, which is the function of audio-text synchronization mentioned below. For specific implementation, please refer to Fig.26 The description part will not be repeated here.

[0280] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation to this embodiment. The implementation process of the above scenario is described in detail below.

[0281] Continue to see Figure 7 In (3), for example, Figure 7 In the user interface 15 shown in (3), when the user clicks the display speaker control 137b in the second state, the electronic device responds to the operation behavior and turns off the display speaker function, and the state of the display speaker control 137b changes from the second state ( Figure 7 (3)) is updated to the first state ( Figure 7 (the style shown in (4)).

[0282] See also Figure 7 In (4), for example, after the display speaker function is turned off, area 13 will no longer display the speaker capsule for filtering, as well as the speaker capsules corresponding to speaker 1 and speaker 2. Instead, it will directly display text information converted from the currently playing voice clip, such as "Note 1 includes two parts, among which the first part mainly talks about XXX. The second part mainly talks about XXX."

[0283] Through the above Figures 4 to 7 From the description, it can be seen that the operation of displaying the speaker can occur during recording, after recording is completed, and at any stage of playing the recording, that is, the function of displaying the speaker in function 1 can be realized in all scenarios.

[0284] The following are the relevant contents involved in the screening of speakers:

[0285] Since the function of displaying the speaker can be realized in all scenarios, after the displaying the speaker function is turned on, the filter speaker capsule will be displayed when the text information is displayed in area 13. Therefore, the function of filtering the speaker can also be realized in all scenarios.

[0286] See also Figure 8For example, for the speaker filter capsule 137e displayed in area 13 in any scenario, when the user clicks on the speaker filter capsule 137e, the electronic device may pop up a speaker filter window 137g on the current user interface, such as the user interface 13b corresponding to during recording, or the user interface 14 corresponding to after the recording is completed, or the user interface 15 corresponding to when playing the recording, in response to the operation.

[0287] For example, the speaker filter window 137g may include a selection control 137g-1 corresponding to the "all" option, and a selection control 137g-1 corresponding to each speaker option currently identified (such as Figure 8 The display shows a selection control 137g-1 corresponding to speaker 1, a selection control 137g-1 corresponding to speaker 2, and so on), as well as a "Cancel" option 137g-2 and an "OK" option 137g-3.

[0288] Among them, when the user clicks the "Cancel" option, the electronic device does not save the user's operation made in the speaker screening window 137g this time, continues to use the selection made when screening speakers last time, and closes the speaker screening window 137g.

[0289] When the user clicks the "OK" option, the electronic device will save the operation made by the user in the speaker screening window 137g this time. For example, when the user selected all the identified speakers last time, and only selected speaker 2 this time, after clicking the "OK" option, the electronic device will close the speaker screening window 137g, and only the text information corresponding to speaker 2 will be displayed in area 13 (such as Fig. 9 as shown in (4)).

[0290] Exemplarily, the user can also select multiple or all speakers through the speaker filtering window 137g. For example, after the user sets to display only the text information corresponding to speaker 2 in the above manner, the user clicks the speaker filtering capsule again, and through the pop-up speaker filtering window 137g, the selection of speaker 1 is added, that is, while speaker 2 is still selected, speaker 1 is also selected. After completing the selection of the designated speaker, after clicking the "OK" option, the electronic device closes the speaker filtering window 137g, and the speaker capsule and text information corresponding to speaker 1, as well as the speaker capsule and text information corresponding to speaker 2 (such as Fig. 9 as shown in (1)).

[0291] The specific user interface changes involved in this process, such as Fig. 9 For the specific implementation of this operation, please refer to the following Fig. 9 The relevant description is not repeated here.

[0292] Among them, the selection control 137g-1 corresponding to the "All" option is selected, that is, it is in Figure 8 When the style shown is displayed, the selection controls corresponding to all speakers displayed in the speaker filter window 137g will be selected by default. Figure 8 In the case of a style shown in FIG. 137 , the electronic device, in response to the operation behavior, will cancel the selection of the selection controls corresponding to all speakers, that is, the states of all selection controls 137g-1 shown in the speaker screening window 137g will be updated from the selected state to the unselected state (such as Fig. 9 ) The style of the selection control 137g-1 corresponding to the "All" option and the "Speaker 1" option shown in (3).

[0293] It should be noted that in some possible situations, it can be set that after the display speaker function is turned on, all identified speakers are displayed by default. That is, in the filter speaker window 137g that pops up after clicking the filter speaker capsule 137e, the selection controls corresponding to all displayed speakers will be selected by default, such as Figure 8 shown.

[0294] In order to facilitate the user to know whether the speaker has been filtered, in this embodiment, when the selection controls corresponding to all speakers are selected, the filter speaker capsule 137e is in state A, such as Fig. 9 When the user reselects a speaker through the speaker filter window 137g, that is, when not all the selection controls corresponding to the speakers are selected, the speaker filter capsule 137e will be in state B, such as Fig. 9 The style shown in (4).

[0295] It should be understood that the above description is only an example for better understanding of the technical solution of this embodiment, and is not the only limitation to this embodiment. The style given is also for ease of understanding, and the specific implementation is not limited to the form shown in this embodiment.

[0296] The following is based on Fig. 9 , taking the scenario where the user triggers the speaker screening capsule displayed in area 13 to implement the speaker screening function after the recording is completed as an example, the relevant contents involved in speaker screening are described exemplarily.

[0297] like Fig. 9 As shown in the user interface 14 of (1), in response to an operation (such as a click operation) on the screening speaker capsule 137e in state A, the electronic device pops up a screening speaker window 137g on the user interface 14 in response to the operation behavior, as shown in FIG. Fig. 9 As shown in (2).

[0298] Exemplarily, since the speech-to-text function is currently turned off, if the converted text information displayed in area 13 includes text information corresponding to speaker 1 and speaker 2, the speakers displayed in the speaker filtering window 137g for the user to select will include speaker 1 and speaker 2.

[0299] For example, if the user only wants to display the text information corresponding to speaker 2 in area 13, a feasible operation method is to first click the option control 137g-1 corresponding to the "All" option, so that the status of all selection controls 137g-1 shown in the speaker filtering window 137g can be updated from the selected state to the unselected state. At this time, click the selection control 137g-1 corresponding to speaker 2, and the status of the selection control 137g-1 corresponding to speaker 2 can be updated from the unselected state to the selected state. Fig. 9 The style shown in (3).

[0300] For example, another feasible operation method is to directly click the selection control 137g-1 corresponding to the selected speaker 1, and the state of the selection control will be updated from the selected state to the unselected state. At the same time, the selection control corresponding to the "All" option will also be automatically updated from the selected state to the unselected state. In this way, only the selection control 137g-1 corresponding to the speaker 2 can be kept in the selected state.

[0301] For example, when a user clicks Fig. 9 After selecting the "OK" option in the speaker screening window 137g in the user interface 14 shown in (3), the electronic device will save the user's selection for speaker screening in response to the operation and close the speaker screening window 137g.

[0302] Exemplarily, after closing the filter speaker window 137g, the state of the filter speaker capsule 137e displayed in area 13 is updated from state A to state B (e.g. Fig. 9 (4) in bold black font). Accordingly, after the speaker screening operation, if only speaker 2 is selected, the text information displayed in area 13 will only include the text information corresponding to speaker 2, and the speaker capsules displayed in area 13 will only include the speaker capsules corresponding to speaker 2 (for example, speaker capsule 137f). Fig. 9 As shown in (4).

[0303] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0304] Thus, the speaker selection is realized, so that the user can quickly select the text information corresponding to the designated speaker according to actual needs. In addition, since the speaker capsule also displays the start time of each text message, the user can also quickly locate the voice information of the designated speaker.

[0305] In addition, it should be noted that in some possible cases, the screening spokesperson capsule 137e displayed in the area 13 can be set to a ceiling effect, that is, the screening spokesperson capsule 137e is always fixed at a designated position in the area 13, such as Fig.10 When the user is in Fig.10 When sliding upward in the direction of the arrow in the area 13 shown in (1), the screening spokesperson capsule 137e will not disappear as the sliding progresses. Fig.10 In this way, the user can easily re-select the speakers at any time through the speaker selection capsule 137e.

[0306] The following is the relevant content involved by the editor’s spokesperson:

[0307] Since the function of displaying the spokesperson can be realized in all scenes, after the function of displaying the spokesperson is turned on, the spokesperson capsule 137f corresponding to each identified text message will be displayed when the text message is displayed in the area 13. Therefore, each spokesperson capsule 137f can also be clicked in all scenes, but the response after clicking is different.

[0308] The following is based on Fig.11 , an exemplary description is given of the response made by the electronic device after the user clicks the speaker capsule 137f during recording, at the end of recording, and during the playback of the recording.

[0309] See also Fig.11 In (1), a recording card (hereinafter referred to as recording card 1) during recording is exemplified. In order to avoid modifying the speaker-related information during recording, thereby affecting the speaker information corresponding to the text information converted later. In this embodiment, when any speaker capsule 137f is clicked during recording, the electronic device does not respond. That is, after the user clicks any speaker capsule 137f, the current user interface will not pop up as shown in the following figure. Fig.11 In the rename window 137h shown in (3), the recording card 1 in state 1 will not be changed. That is, the style of the recording card 1 is still maintained.

[0310] See also Fig.11(2) shows an example of a recording card (hereinafter referred to as recording card 2) after the recording is completed. When the user clicks on any speaker capsule in recording card 2, such as speaker capsule 137f corresponding to speaker 1, the electronic device responds to the operation and pops up a pop-up window in the current user interface, such as the user interface 14 mentioned above. Fig.11 The rename window 137h is shown in (3).

[0311] See also Fig.11 In (3), the rename window 137h may include a speaker editing area 137h-1. When the rename window 137h pops up, the speaker name assigned by the system by default, such as speaker 1, is displayed in the speaker editing area 137h-1. When the user clicks on the speaker editing area 137h-1, the "speaker 1" can be deleted through the delete option in the pop-up system keyboard, and a new name can be edited for the speaker 1, such as "Zhang San".

[0312] Continue to see Fig.11 In (3), the rename window 137h may further include a selection control 137h-2. After the selection control 137h-2 is selected, the name of the speaker 1 in all speaker capsules 137f corresponding to the speaker 1 displayed in the area 13 will be changed to "Zhang San".

[0313] Continue to see Fig.11 In (2), illustratively, the rename window 137h may further include a "Cancel" option and a "Confirm" option.

[0314] When the user clicks the "Cancel" option, the electronic device responds to the operation and closes the rename window 137h, but does not save the operation performed by the user in the rename window 137h. In this case, the speaker name displayed in the speaker capsule corresponding to the speaker 1 displayed in the area 13 of the recording card 2 is still speaker 1, not "Zhang San". Fig.11 The recording card 2 shown in (2).

[0315] When the user clicks the "OK" option, the electronic device responds to the operation by closing the rename window 137h and saving the operation performed by the user in the rename window 137h. In this case, the speaker name displayed in the speaker capsule corresponding to the speaker 1 displayed in the area 13 of the recording card 2 will be updated to "Zhang San". Fig.11 The recording card 2 shown in (4).

[0316] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0317] See also Fig.11 In (5), a recording card (hereinafter referred to as recording card 3) is shown as an example in the process of playing a recording. When the user clicks on any speaker capsule in area 13, such as speaker capsule 137f corresponding to "Zhang San", the electronic device will jump to the time point "00:00:10" in response to the operation. For example, the time displayed in the play time indicator 141d is "00:00:27 / 00:01:05", and the recording play progress control 1411 is in Fig.11 When the user clicks the speaker capsule 137f corresponding to "Zhang San", the electronic device will jump to the time point "00:00:07" in response to the operation. At this time, the time displayed in the play time indicator 141d will change to "00:00:07 / 00:01:05", and the recording play progress control 1411 is in Fig.11 The position shown in (6).

[0318] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0319] Therefore, by binding the spokesperson capsule to different scenes, when the spokesperson capsule is clicked in different scenes, the electronic device can make a response suitable for the current scene, which is better suited to actual usage needs.

[0320] The following is based on Figures 12 to 20 Taking the three scenarios of recording, recording end and recording playback as examples, the relevant contents involved in adding tags and deleting tags in the above function 2 are described exemplarily.

[0321] The following are the relevant contents involved in adding tags:

[0322] For more information about adding tags during recording, see the following Fig.12 and Fig.13 An exemplary description of .

[0323] like Fig.12 In the recording card shown in (1), the user can click the mark control 137c in area 12 at any time during the recording of the voice message.

[0324] Continue to see Fig.12 In (1), for example, assuming that the user clicks the mark control 137c at the time of recording the voice message "00:00:05", the electronic device will add a label at the position corresponding to "00:00:05" on the recording status bar 136b in response to the operation, for example Fig.12Label 136d-1 shown in (2).

[0325] For example, when the user clicks the stop recording control 136a to continue recording the voice message, for example, Fig.12 At the moment of "00:00:11" shown in (2), the mark control 137c is clicked again. In response to this operation, the electronic device adds a label at the position corresponding to "00:00:11" on the recording status bar 136b, for example Fig.12 Label 136d-2 shown in (4).

[0326] Therefore, during recording, the user can click the mark control 137c at any time as needed, and then add a corresponding label at the specified position, so as to quickly locate the specified position according to the added label later.

[0327] In addition, it should be noted that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation to this embodiment. Fig.12 As shown in , it is not limited to the voice-to-text function and the speaker display function being turned on. In other words, when the voice-to-text function or the speaker display function is not turned on, the user can also trigger the electronic device to add tags to the recording content according to the above method.

[0328] In addition, it should be noted that in some possible cases, it can be set that after the recording status bar 136b or the designated area of ​​the area 11 is clicked by the user, the electronic device responds to the operation behavior and jumps to the Fig.13 The user interface 13c shown in (1) .

[0329] See also Fig.13 In (1), the user interface 13c may include one or more controls. The one or more controls include but are not limited to a control for returning Fig.12 The user interface where the recording card is located shows a return control 138a, a recording status bar 138b (corresponding to the recording status bar 136b), a recording progress control 138c indicating the current recording progress, a recording duration control 138d (corresponding to the recording duration 136c) displaying the current recording duration, a mark control 138e (corresponding to the mark control 137c), a stop recording control 138f (corresponding to the stop recording control 136a), and a pause recording control 138g.

[0330] For example, when the user clicks the stop recording control 138f or the stop recording control 136a, the electronic device responds to the operation and ends the recording of the current recording segment. That is, after the user clicks the stop recording control 138f or the stop recording control 136a, the electronic device ends the recording of the current recording segment. Fig.15 When the start recording control 142e is pressed, the electronic device will start recording a new recording segment in response to the operation.

[0331] Exemplarily, when the user clicks the pause recording control 138g, the electronic device will pause the recording of the current recording segment in response to the operation, and switch the pause recording control 138g to the set restart recording style (not shown in the figure). Exemplarily, when the user clicks the pause recording control 138g in the set restart recording style, the electronic device will continue recording the recording segment in response to the operation. That is, the voice information that is restarted still belongs to the recording segment, not a new recording segment.

[0332] In addition, it is understandable that during recording, when the user adds a tag through the tag control 137c or the tag control 138e, the user interface 13c may also include a tag detail control corresponding to each tag, such as Fig.13 The label detail control 138h is shown in (2).

[0333] See also Fig.13 In (2), for example, the tag details control 138h may include the tag name of the corresponding tag (which may be named by default according to the order of addition) and the specific recording time corresponding to the tag.

[0334] For example, in some possible implementations, when the user clicks the tag details control 138h, a window for renaming the tag can be popped up, so that the user can rename the tag name as needed. The window for renaming the tag and the related content of renaming the tag name are not described in detail in this embodiment of the application.

[0335] For more information about adding tags after recording, please refer to the following Fig.14 and Fig.15 An exemplary description of .

[0336] like Fig.14 In the recording card shown in (1), after the recording is finished, the user can drag the recording playback progress control 1411 to the desired position as needed, and then click the mark control 137c to add a label at the time point corresponding to the current position of the recording playback progress control 1411. For example, the user drags the recording playback progress control 1411 from Figure 4 Drag to the position shown in (1) Fig.14 When the mark control 137c is clicked at the position corresponding to the time "00:00:06 / 00:01:05" shown in (2), the electronic device responds to the operation by adding a label at the position corresponding to "00:00:06 / 00:01:05" on the playback progress bar 141c, for example Fig.14 Label 141 shown in (3).

[0337] Therefore, after the recording is finished, the user can drag the recording playback progress control 1411 to the specified position of the playback progress bar 141c, and then click the mark control 137c to add a corresponding label at the specified position, so as to quickly locate the specified position according to the added label.

[0338] In addition, it should be noted that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation to this embodiment. Fig.14 As shown in , it is not limited to the voice-to-text function and the speaker display function being turned on.

[0339] In addition, it should be noted that in some possible cases, it can be set that after the play progress bar 141c or the designated area of ​​the area 11 is clicked by the user, the electronic device responds to the operation behavior and jumps to the Fig.15 User interface 14a is shown.

[0340] See also Fig.15 , exemplarily, the user interface 14a may include one or more controls. The one or more controls include but are not limited to a control for returning Fig.14 The return control 142a of the user interface where the recording card is located, the name of the recording segment (such as Fig.15 The "20230421_133449" shown, which can be generated based on the timestamp) 142b, added labels, such as 143a-1, 143a-2, 143a-3, etc., a play time indicator 142c, a label detail control 142d corresponding to each label, a start play control 142e (corresponding to the start play control 141b), a text-to-text control 143a corresponding to the speech-to-text function (corresponding to the text-to-text control 137a), an edit control 143b, a skip mute control 143c, a multiple play control 143d, a mark control 143e (corresponding to the mark control 137c), etc.

[0341] Continue to see Fig.15 For example, each tag detail control 142d may include a tag name of the corresponding tag (which may be named by default according to the order of addition) and a specific recording time corresponding to the tag.

[0342] For example, in some possible implementations, when the user clicks the tag details control 142d, a window for renaming the tag can be popped up, so that the user can rename the tag name as needed. The window for renaming the tag and the related content of renaming the tag name are not described in detail in the present embodiment.

[0343] Furthermore, it should be understood that Fig.14 The recording cards shown in Fig.15 The added labels displayed in the user interface 14a include not only the labels added when the user clicks the mark control 137c after the recording is completed, but also the labels added when the user clicks the mark control 137c during the recording.

[0344] For more information about adding tags during recording playback, please refer to the following Fig.16 An exemplary description of .

[0345] like Fig.16 In the recording card shown in (1), during the recording playback, the user can click the mark control 137c in area 12 at any time.

[0346] Continue to see Fig.16 In (1), for example, assuming that the user clicks the mark control 137c when the voice information is played to "00:00:10", the electronic device will add a label at the position corresponding to "00:00:10" on the playback progress bar 141c in response to the operation behavior, for example Fig.16 Label 141g-1 shown in (2).

[0347] Therefore, during the playback of the recording, the user can click the mark control 137c at any time as needed, and then add a corresponding label at the specified position, so as to quickly locate the specified position according to the added label later.

[0348] In addition, it should be noted that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation to this embodiment. Fig.16 As shown in , it is not limited to the voice-to-text function and the speaker display function being turned on.

[0349] In addition, it should be noted that in some possible cases, during the playback of a recording, the user can also drag the recording playback progress control 1411 to a specified position of the playback progress bar 141c, and then click the mark control 137c to add a corresponding label to the specified position, so that the user can quickly locate the specified position based on the added label.

[0350] In addition, it should be noted that in some other possible cases, in order to avoid label redundancy, it can be set that no label is allowed to be added again within a set time before and after each label, such as 5ms. That is, the time interval between any two adjacent labels is not less than 5ms.

[0351] In addition, it should be noted that Fig.16 The added tags displayed in the recording card shown in the figure include not only the tags added when the user clicks the mark control 137c during the recording playback, but also the tags added when the user clicks the mark control 137c during the recording and after the recording is completed.

[0352] The following are the relevant contents involved in deleting tags:

[0353] Deletion method 1:

[0354] For example, in some possible situations, for example, Fig.13 The user interface 13c shown in (2) or Fig.15 When the user interface 14a shown in FIG. 1 is displayed, the user can slide the tag detail control to the right to be deleted, and then a tag deletion control for deleting the current tag is displayed in the current user interface.

[0355] by Fig.15 Taking the user interface 14a shown in FIG. 1 as an example, if the user wants to delete tag 3, the user can slide the tag detail control 142d corresponding to tag 3 to the left. In response to the operation, the electronic device will display the following Fig.17 A tag delete control 142f is shown.

[0356] For example, when the tag deletion control 142f corresponding to tag 3 is displayed in the user interface 14a, the user clicks the tag deletion control 142f, and the electronic device deletes tag 3 in response to the operation, and deletes tag 143a-3 from the current recording. Thus, the specified tag is deleted.

[0357] Deletion method 2:

[0358] For example, in some other possible situations, the user can click on the "more" control 137d in the area 12 of the recording card corresponding to any scene (during recording, after recording is finished, during playback of recording), such as Fig.18 Chinese (1).

[0359] For example, when the user clicks the "more" control 137d, the electronic device responds to the operation behavior and displays Fig.18 The user interface shown in (1) shows Fig.18 The management window 139a shown in (2) .

[0360] For example, in some possible situations, such as when the above-mentioned functions 2, 3, and 4 are implemented, the management window 139a may include a radio setting entry 139a-1, a tag management entry 139a-2, and a sharing entry 139a-3. For the relevant content of the sharing entry 139a-3, please refer to the following description. Fig.21 and Fig. 22 For the relevant contents of the sound setting entry 139a-1, please refer to the following Fig.23 and Fig.24 The description of is not repeated here.

[0361] See also Fig.18 In (2), for example, when the user clicks on the tag management entry 139a-2, the electronic device responds to the operation behavior and may pop up a pop-up window on the current user interface such as Fig.18 The label management window 139b shown in (3) in FIG.

[0362] See also Fig.18 In (3), illustratively, the tag management window 139b can display the tag names of all tags included in the current recording segment, as well as the time corresponding to each tag, and a control for deleting the corresponding tag, such as the "×" shown in the figure.

[0363] Thus, the user can delete the tag from the tag management window 139b by clicking the "×" corresponding to each tag to be deleted. After completing the operation, if the user clicks the "OK" option shown in the tag management window 139b, the electronic device will respond to the operation and delete the tag just deleted in the recording segment, such as the tag corresponding to tag 3, as described in 143a-3 in the above embodiment.

[0364] Exemplarily, if the user clicks the “×” corresponding to each tag to be deleted and does not click the “OK” option shown in the tag management window 139 b but clicks the “Cancel” option, the electronic device will not delete the tag corresponding to tag 3 .

[0365] In addition, it should be understood that in some possible situations, when the user clicks the "OK" option or the "Cancel" option shown in the tag management window 139b, the electronic device can close the tag management window 139b in response to the operation.

[0366] Exemplarily, in some possible cases, for the management window 139a, when the user clicks any entry in the management window 139a, the response made by the electronic device may also include closing the management window 139a. For example, when the user clicks the tag management entry 139a-2 and the tag management window 139b pops up, the management window 139a displayed in the current interface may be automatically cancelled.

[0367] For example, in other possible situations, in order to facilitate the user to click the "Cancel" option in the tag management window 139b and then exit the tag management window 139b, and then select other entrances from the management window 139a again, such as the radio setting entrance 139a-1, or the sharing entrance 139a-3, it can be set that when the user clicks the tag management entrance 139a-2 and the tag management window 139b pops up, the management window 139a continues to be displayed on the current interface, but can be covered by the tag management window 139b.

[0368] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0369] Deletion method 3:

[0370] It can be seen from the above description of the corresponding recording card after the recording is completed and during the playback of the recording that in the scene after the recording is completed and during the playback of the recording, the voice menu control 141e will be displayed in the area 11 of the recording card.

[0371] After the recording is finished, the corresponding recording card is used, such as Fig.19 For example, when the user clicks the voice menu control 141e, the electronic device may display the following in the user interface 14 in response to the operation: Fig.19 The voice menu window 139c shown in (2) of FIG. 139c may be a slidable panel window, that is, the size of the window displayed on the user interface 14 is fixed, but the content displayed therein may be slidably displayed.

[0372] See also Fig.19 In (2), the voice menu window 139c may include one or more controls, for example. The one or more controls include, but are not limited to, a close control 139c-1 for closing the voice menu window 139c, an edit control 139c-2 for editing a recorded audio segment, a save control 139 for saving the operation in the voice menu window 139c, a recording option for viewing the audio segment included in the long voice, a tag option for viewing tags, etc.

[0373] For example, in some possible situations, after the voice menu window 139c is displayed, the recording option can be selected by default, that is, the voice menu window 139c displays the relevant information of all voice segments included in the long voice by default. For example, when the long voice includes 4 recording segments, the voice menu window 139c that pops up after the user clicks the voice menu control 141e can be as follows: Fig.19 As shown in (2), the name of each recording segment included is displayed, such as recording 1 to recording 4, and the recording duration corresponding to each recording segment.

[0374] It should be noted that, for the four recording segments mentioned in the above embodiment, recording 1 may be, for example, Fig.19 The voice information between the position of the recording playback progress control 1411 and the recording segment mark 144a shown in (1), recording 2, for example, can be the voice information between the recording segment mark 144a and the recording segment mark 144b, recording 3, for example, can be the voice information between the recording segment mark 144b and the recording segment mark 144c, and recording 4, for example, can be the voice information between the recording segment 144c and the end time indicated by the playback time indicator.

[0375] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment, and is not the only limitation to this embodiment. Fig.25A and Fig.25B The description of is not repeated here.

[0376] Continue to see Fig.19 In (2), illustratively, when the user clicks on the tag option in the voice menu window 139c, the electronic device switches the voice menu window 139c from the relevant information of the recording segment to the relevant information of the tag in response to the operation, such as Fig.19 As shown in (3).

[0377] For example, in a long voice recording, recording 1 includes two labels, label 1 and label 2, recording 2 includes one label, label 3, recording 3 includes one label, label 4, and recording 4 does not include any label. Fig.19 The voice menu window 139c shown in (3) slides upward in the direction of the arrow, thereby sliding to display the obscured related information about tag 4.

[0378] See also Fig.19 Neutralize (3) Fig.19 In (4), illustratively, the tag information corresponding to each tag may include the tag name, the time point corresponding to the tag, and a delete control “×” for deleting the tag.

[0379] For example, the user can click Fig.19 Neutralize (3) Fig.19 The "×" corresponding to different tags in the voice menu window 139c shown in (4) can be used to delete the tag.

[0380] Therefore, after the user selects the tag option, the tag information included is displayed under each recording segment, so that the user can easily know the relationship between each tag and each recording segment.

[0381] Deletion method 4:

[0382] Still Fig.19 For example, the voice menu window 139c shown in (2) is used as an example. For example, when the voice menu window 139c displays a recording segment of a long voice, when the user clicks the edit control 139c-2, the electronic device responds to the operation behavior and may display the following: Fig. 20 The user interface 16 is shown.

[0383] See also Fig. 20 , for example, since the user interface 16 is a user clicking Fig.19 After the recording is finished, the voice menu control 141 displayed on the corresponding user interface 14 is displayed, and then the voice menu window 139c is swapped out, and then the edit control 139c-2 in the voice menu window 139c is swapped out by clicking. Therefore, the user interface 16 includes the control of the recording bar 2 included in the area 11 in the recording card in the user interface 14, and each control in the recording bar 2 displayed in the user interface 16 corresponds to the control of the recording 2 displayed in the user interface 14.

[0384] Continue to see Fig. 20 , exemplarily, the user interface 16 will also display all the recording segments included in the current long speech, such as Fig. 20 Recordings 1 to 5 shown in FIG. 1 , selection controls 161 a for selecting each recording segment, and labels included in each recording segment.

[0385] Continue to see Fig. 20 Exemplarily, the label under each recording segment displayed in the user interface 16 will include the name of the label, the time point corresponding to the label, and a selection control 161b for selecting the label.

[0386] Continue to see Fig. 20Exemplarily, the user interface 16 may also include a sharing control for sharing the voice information at the location of the recording segment selected by the user through the selection control 161a and / or the tag selected by the user through the selection control 161b, a renaming control for triggering the renaming operation of the recording segment and the tag, a delete control for deleting the recording segment selected by the user through the selection control 161a and / or the tag selected by the user through the selection control 161b, and a select all control for indicating the selection of all selection controls in the user interface 16.

[0387] For example, the user can move the cursor to the place where renaming is required, such as the recording name corresponding to a recording segment, or the label name, and then click the rename control, and then use the system keyboard to modify and rename the content of the cursor area. The specific implementation is not limited in this application.

[0388] Thus, the user can select the selection control 161b corresponding to any one or more tags to be deleted in the user interface 16, and then click the delete control to delete the selected tags. Alternatively, the user can directly select the selection control 161a corresponding to the recording segment where the tag is located, and then click the delete control to delete all tags included in the recording segment.

[0389] From the above description of the four deletion methods, it can be seen that by using any of the above methods of deleting tags, it is possible to delete the added tags in different scenarios through different entrances, so that it can be better applied to various usage scenarios.

[0390] The following is based on Fig.21 and Fig. 22 , an exemplary description is given of the relevant contents involved in the shared notes in the above function 3.

[0391] Still take the example of integrating the sharing portal into the management window 139a. Fig.21 For example, when the user clicks the sharing entry 139a-3 in the management window 139a, the electronic device responds to the operation behavior and can fold the shared device in the folded state ( Fig.21 The sharing entry 139a-3 of the style shown in (1) is updated to the expanded state ( Fig.21 The sharing options that can be selected are displayed under the sharing entrance 139a-3 in the management window 139a, such as Fig.21 (2) shows the "text" option, "voice" option and "text + voice" option. The sharing method corresponding to the "text" option is the sharing method 1 mentioned above, the sharing method corresponding to the "voice" option is the sharing method 2 mentioned above, and the sharing method corresponding to the "text + voice" option is the sharing method 3 mentioned above.

[0392] Exemplarily, when the user selects sharing mode 1, the electronic device uses the text information currently displayed in area 13 of the recording card as the shared content.

[0393] Exemplarily, when the user selects sharing mode 2, the electronic device will share all the voice information currently recorded in the recording card area 11, or the voice information corresponding to the text information displayed in area 13 as the sharing content.

[0394] Exemplarily, when the user selects sharing mode 3, the electronic device will use the text information currently displayed in area 13 of the recording card and the corresponding voice information / all voice information as the shared content.

[0395] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0396] For the sake of convenience, this embodiment takes the example that when the user selects sharing mode 1, the sharing is performed in the form of sharing mode 11 mentioned above by default. Fig.21 After selecting the "text" option in the management window 139a shown, the electronic device may display the following in response to the operation: Fig. 22 User interface 17 is shown.

[0397] See also Fig. 22 For example, the user interface 17 may display the shared content in text form to be shared, as well as icons of applications to be shared that can be selected by the user.

[0398] It is understandable that the applications available for user selection mentioned here are specifically applications currently installed on the electronic device, such as Fig. 22 WeChat, Sina Weibo, email, etc. shown.

[0399] Continue to see Fig. 22 For example, a "copy text" control for copying the currently displayed text information may also be displayed in the user interface 17. In this way, the user can copy the text information to be shared displayed in the user interface 17 by operating the "copy text" control, and then the user can paste the copied text information into a designated application for sharing.

[0400] In addition, it should be noted that the sharing of voice information related content, such as the voice information itself and the text information corresponding to the voice information, can be realized in all scenarios. That is, as long as there is text information that can be shared in area 13, or voice information that can be shared is recorded in area 11, in any scenario, the user can share the content in the note in real time as needed.

[0401] In addition, it should be understood that in this embodiment, the display speaker function is turned on, that is, the state of the display speaker control 137b is the second state (eg Figure 4 In the case of the user sharing the text information in area 13 in the style of (3), the user explains the scenario of sharing the text information in area 13, so the user interface 17 will not only display the text information converted from the voice information, but also display the speaker information corresponding to each text information, such as the speaker name. If, in actual use, the user turns off the display speaker function, that is, the state of the display speaker control 137b is the first state (such as Figure 4 If the sharing operation is triggered in the case of the style (2) in the figure, the user interface 17 only displays the text information converted from the voice information, and does not display the speaker information corresponding to each text information.

[0402] The following is based on Fig.23 and Fig.24 , an exemplary description is given of the relevant contents involved in the reception method in the above function 4.

[0403] Entrance 1:

[0404] Still take the example of integrating the radio setting entrance into the management window 139a. Fig.23 For example, when the user clicks the sound setting entry 139a-1 in the management window 139a, the electronic device responds to the operation behavior and can be in the folded state ( Fig.23 The sound setting entry 139a-1 of the style shown in (1) is updated to the expanded state ( Fig.23 The style shown in (2) in the management window 139a is displayed, and the selectable radio setting options are displayed under the radio setting entry 139a-1 in the management window 139a, such as Fig.23 In (2), there are the "internal sound reception" option, the "external sound reception" option and the "internal + external sound reception" option. The "internal sound reception" option corresponds to the above-mentioned reception mode 1, the "external sound reception" option corresponds to the above-mentioned reception mode 2, and the "internal + external sound reception" option corresponds to the above-mentioned reception mode 3.

[0405] Therefore, the user can click the "internal sound reception" option, or the "external sound reception" option, or the "internal + external sound reception" option as needed to achieve flexible switching of the reception mode.

[0406] Entrance 2:

[0407] Understandably, the applications installed in the electronic device usually have their own settings interface. Therefore, in some possible cases, the sound setting entrance can be set in the setting interface corresponding to the note application. Fig.24, exemplifies the setting interface of the note-taking application Honor Note. In this interface, the user can click on the radio mode option, and then display the radio modes available for the user to choose, such as Radio Mode 1, Radio Mode 2 and Radio Mode 3 mentioned above. Fig.24 The currently set radio reception mode is external radio reception, that is, the radio reception mode 2 mentioned above is taken as an example.

[0408] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0409] In addition, it should be noted that the radio setting entries for setting the radio mode provided in the above-mentioned entry 1 and entry 2 are bound to each other, that is, the radio mode set through any entry is synchronized.

[0410] In addition, it should be noted that the setting of the sound reception mode can be implemented in all scenarios (during recording, after recording, and during playback of recording). Therefore, through any of the above sound reception setting methods, it is possible to dynamically switch between different sound reception modes in different scenarios (during recording, after recording, and during playback of recording) through different entrances according to business needs, so that it can be better applied to various usage scenarios.

[0411] The following is based on Fig.25A and Fig.25B , an exemplary description is given of the relevant contents involved in the segmented recording in the above function 5.

[0412] like Fig.25A As shown in (1), user interface 13b is a user interface during recording. When recording the duration of "00:01:01", if the user clicks the stop recording control 136a, the electronic device will stop recording the voice information in response to the operation behavior. At this time, the style of the recording bar in area 11 of the recording card will change from Fig.25A The style (sound bar 1) shown in (1) is updated to Fig.25A The style shown in (2) (strip 2).

[0413] See also Fig.25A In (2), for example, since the user clicks the stop recording control 136a, the recording of the voice information of the current voice segment ends, and the duration "00:01:01" of the voice file displayed in the play time indicator 141d in the recording bar 2 is Fig.25A (1) When recording is stopped, the recording duration of the recording segment.

[0414] Continue to see Fig.25AIn (2), for example, when the user clicks the start recording control 141a shown in the user interface 14, the electronic device will start recording a new audio segment in response to the operation. At this time, the user interface 14 will be updated to Fig.25B The recording time of a newly started recording segment will continue from the end of the previous recording segment. Fig.25A In (1), when the recording of the first audio segment ends at "00:01:01", the recording start time of the second audio segment will be "00:01:02".

[0415] See also Fig.25B In (1), for example, when the user records the second recording segment to "00:02:21", the user clicks the stop recording control 136a, and the electronic device responds to the operation behavior and stops recording the voice information. At this time, the style of the recording bar in area 11 of the recording card changes from Fig.25B The style (sound bar 1) shown in (1) is updated to Fig.25B The style shown in (2) (strip 2).

[0416] See also Fig.25B In (2), for example, since the user clicks the stop recording control 136a, the recording of the voice information of the current voice segment ends, and the duration "00:02:21" of the voice file displayed in the play time indicator 141d in the recording bar 2 is Fig.25B (1) When recording is stopped, the recording duration of the recording segment.

[0417] For example, since Fig.25A The user interface shown in (1) starts at Fig.25B The user interface shown in (2) ends. The user recorded two audio clips. Fig.25B The recording bar 2 shown in (2) also includes nodes that divide the playback progress bar 141c into two segments, such as the recording segment mark 144a. The time after the " / " recorded in the playback time indicator 141d is the time sum of all the recording segments, and the time before the " / " is the current playback time progress.

[0418] In this way, segmented recording is achieved to avoid the loss or damage of voice information due to abnormalities in directly recording long voices.

[0419] The following is based on Fig.26 , an exemplary description is given of the relevant contents involved in the audio-text synchronization in the above function 6.

[0420] like Fig.26As shown in (1), in the recording card displayed in the user interface 14, the user has turned on the speech-to-text function and the speaker display function, and the text information converted from the speech information and the corresponding speaker information are displayed in area 13.

[0421] For example, when the user clicks the start play control 141b, the electronic device responds to the operation and starts playing the recorded voice information, and the recording bar displayed in the area 11 changes from Fig.26 The style of (1) is updated to Fig.26 The style of (2), for example, the start play control 141b is updated to the pause play control 141f.

[0422] Continue to see Fig.26 In (2), for example, during the process of playing the recording, as the voice information is played, the text information converted from the voice information displayed in area 13 on the recording card will change synchronously. Specifically, in some possible situations, the text information font corresponding to the unplayed voice information can be set to be gray, such as Fig.26 In the style of (1), during the process of playing the voice message, the font of the text message corresponding to the played voice message will be updated to black, such as Fig.26 Chinese (2).

[0423] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0424] Therefore, during the recording playback process, the voice information and text information are synchronized, making it easier for the user to know the current playback progress.

[0425] Based on the above functions, Fig. 27 An exemplary flow chart of the application note processing method is shown.

[0426] In some possible cases, the exemplary process involved in recording notes by an electronic device can refer to the following description of steps S101 to S105.

[0427] S101, displaying a first interface of a first note in a note application, wherein the first interface includes a recording card, and the recording card includes a first area, a second area, and a third area.

[0428] S102, at a first moment, the first area includes a start recording control, a start playing control and a first playing progress bar, the second area includes a text conversion control and a display speaker control, and the third area is empty; wherein, at the first moment, the display speaker control cannot interact with the user.

[0429] S103, at a second moment, in response to the user's operation on the text conversion control, displaying the first text information in the third area, the first text information corresponds to the first voice information recorded by the playback progress bar; wherein, after the first text information is displayed in the third area, the speaker control is displayed to interact with the user.

[0430] S104, at a third moment, in response to the user's operation on the display speaker control, a filtered speaker capsule, a first speaker capsule, a second speaker capsule and a first text message are displayed in a third area; wherein the first speaker capsule corresponds to the first text content in the first text message, the second speaker capsule corresponds to the second text content in the first text message, the first speaker capsule includes the first speaker name and the first speaking time, and the second speaker capsule includes the second speaker name and the second speaking time.

[0431] S105 , at a fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the screening speaker capsule, displaying the screening speaker capsule, the first speaker capsule and the first text content in the third area.

[0432] In some possible cases, the text conversion control is, for example, the text conversion control 137a mentioned in the foregoing content, and the display speaker control is, for example, the display speaker control 137b mentioned in the foregoing content.

[0433] Among them, the text conversion control at the first moment is as follows Figure 3 The style of the text conversion control 137a shown in (1) is the text conversion control in the first state mentioned above; at the second moment, the state of the text conversion control after being clicked by the user is, for example, the second state mentioned above. Figure 3 The style of the converted text control 137a shown in (2).

[0434] The display speaker control that cannot be interacted with by the user at the first moment is, for example, the display speaker control in the third state mentioned above. Figure 3 The style of displaying the speaker control 137b is shown in (1).

[0435] After the first text message is displayed in the third area, a display speaker control that can interact with the user is displayed, such as the display speaker control in the first state mentioned above. Figure 3 The style of displaying the speaker control 137b is shown in (2).

[0436] At the third moment, in response to the user's operation on the display speaker control in the first state, the display speaker state may be switched to the second state mentioned above. Figure 3 The style of displaying the speaker control 137b is shown in (3).

[0437] For information about the switching of the status of the text conversion control and the display speaker control, as well as their correlation, please refer to the following content for Figure 3 The description of is not repeated here.

[0438] In addition, regarding the first speaker capsule mentioned above, for example, the speaker capsule corresponding to speaker 1 mentioned in the above embodiment. Accordingly, the name of the first speaker displayed in the speaker capsule is the name of speaker 1 mentioned in the above embodiment. The first speaker time is the time when the speaker speaks the first text content (such as text information 1 above).

[0439] Accordingly, the second speaker capsule is, for example, the speaker capsule corresponding to speaker 2 mentioned in the above embodiment. Accordingly, the second speaker name displayed in the speaker capsule is the name of speaker 2 mentioned in the above embodiment. The second speaker time is the time when the speaker speaks the second text content (such as text information 2 above).

[0440] Since the operation of voice-to-text conversion and the operation of displaying the speaker can be implemented in all scenarios (during recording, after recording, and during playback of recording), the first interface can be an interface corresponding to different scenarios. For example, during recording, the first interface can be the user interface 13b mentioned in the following content. For another example, after recording, the first interface can be the user interface 14 mentioned in the following content. For another example, during playback of recording, the first interface can be the user interface 15 mentioned in the following content.

[0441] Therefore, when there is voice information in the notes, by introducing the display speaker function associated with the speech-to-text function, the speaker information corresponding to each converted text message can be displayed when the speech-to-text function is turned on, so that the user can quickly know the speaker of each text message in a scenario where multiple people are speaking.

[0442] For more information about the note handling solution, see the previous section on Figures 4 to 7 The description is not repeated here.

[0443] In addition, in some other possible cases, in the process of realizing the above-mentioned voice-to-text function and speaker display function, it is also possible to realize the functions of screening speakers, editing speakers, adding tags, deleting tags, sharing note content, setting the reception mode, recording voice messages in segments, and playing audio and text synchronously. For the realization of these functions, please refer to the above description of each part of function 1 to function 6, which will not be repeated here.

[0444] In order to better understand the technical solution provided by the embodiment of the present application, the hardware structure of the electronic device (such as a mobile phone, a tablet computer, a touch-screen PC, etc.) to which the embodiment of the present application is applicable is described below in conjunction with the accompanying drawings. Fig.28 Let's take a mobile phone as an example.

[0445] See also Fig.28 The mobile phone 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0446] Among them, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor (Modem), a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc., which are not listed one by one here and the present application does not limit this.

[0447] The controller as the processing unit mentioned above may be the nerve center and command center of the mobile phone 100. In practical applications, the controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0448] In addition, it should be noted that regarding the processor 110 including the above-mentioned processing units, in some implementations, different processing units may be independent devices. That is, each processing unit may be regarded as a processor. In other implementations, different processing units may also be integrated into one or more processors. For example, in some implementations, the modem processor may be an independent device. In other implementations, the modem processor may be independent of the processor 110 and be arranged in the same device as the mobile communication module 150 or other functional modules.

[0449] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.

[0450] In addition, the processor 110 may further include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc., which are not listed here one by one, and the present application does not limit this.

[0451] In addition, the processor 110 may also be provided with a memory for storing instructions and data. In some implementations, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0452] Continue to see Fig.28The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0453] Continue to see Fig.28 , the internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, and the stereo recording function mentioned in the embodiment of the present application, etc.). The data storage area may store data created during the use of the mobile phone 100 (such as stereo audio data recorded based on the technical solution provided in the embodiment of the present application), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0454] Continue to see Fig.28 , the charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger. In some wired charging implementations, the charging management module 140 can receive charging input from the wired charger through the USB interface 130. In some wireless charging implementations, the charging management module 140 can receive wireless charging input through the wireless charging coil of the mobile phone 100. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141.

[0455] Continue to see Fig.28 , the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other implementations, the power management module 141 can also be set in the processor 110. In some other implementations, the power management module 141 and the charging management module 140 can also be set in the same device.

[0456] Continue to see Fig.28 The wireless communication function of the mobile phone 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0457] It should be noted that antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other implementations, the antenna can be used in combination with a tuning switch.

[0458] Continue to see Fig.28 , the mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the mobile phone 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some implementations, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some implementations, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0459] Continue to see Fig.28The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0460] Continue to see Fig.28 The audio module 170 may include a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, etc. For example, the mobile phone 100 may implement audio functions through the application processor and the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, etc. in the audio module 170, such as recording and video recording functions.

[0461] In the process of implementing the audio function through the application processor and the audio module 170, the audio module 170 can be used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some implementations, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0462] Continue to see Fig.28 The sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are not listed here one by one and are not limited in this application.

[0463] Continue to see Fig.28The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The mobile phone 100 may receive key input and generate key signal input related to user settings and function control of the mobile phone 100.

[0464] Continue to see Fig.28 , the motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.

[0465] Continue to see Fig.28 The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0466] Continue to see Fig.28 , the camera 193 is used to capture still images or videos. The mobile phone 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor. Specifically, the object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some implementations, the mobile phone 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0467] Continue to see Fig.28 , the display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some implementations, the mobile phone 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. The mobile phone 100 can implement a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0468] The hardware structure of the mobile phone 100 is introduced here. It should be understood that: Fig.28The illustrated mobile phone 100 is merely an example, and in a specific implementation, the mobile phone 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Fig.28 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0469] To better understand Fig.28 The software structure of the electronic device 100 is shown, and the software structure of the electronic device 100 is described below. Before describing the software structure of the electronic device 100, the architecture that can be adopted by the software system of the electronic device 100 is first described.

[0470] Specifically, in actual applications, the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0471] In addition, it is understandable that the software systems used by the current mainstream electronic devices include but are not limited to Windows systems, Android systems and iOS systems. For ease of explanation, the present application embodiment takes the layered Android system as an example to exemplify the software structure of the electronic device 100.

[0472] In addition, the note processing solution provided in the subsequent embodiments of the present application is also applicable to other systems in specific implementations.

[0473] See also Fig.29 , which is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0474] like Fig.29 As shown, the layered architecture of the electronic device 100 divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0475] The application layer may include a series of application packages. Fig.29 As shown, the application package may include notes, settings, WIFI and other applications, which are not listed here one by one, and this application does not limit this. Specifically in the embodiment of this application, the note processing method is implemented after the user starts the note application.

[0476] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. In some implementations, these programming interfaces and programming frameworks can be described as functions. Fig.29 As shown, the application framework layer may include functions such as content provider, resource manager, window manager, etc., which are not listed here one by one and are not limited in this application.

[0477] The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc., which are not listed here and are not limited by this application.

[0478] The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, etc., which are not listed here one by one and are not limited in this application.

[0479] The notification manager enables applications to display notification information in the status bar, which can be used to convey informational messages and disappear automatically after a short stay without user interaction.

[0480] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0481] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0482] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0483] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0484] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0485] The media library supports the playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0486] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0487] It can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0488] In addition, it is understandable that the kernel layer in the Android system is a layer between hardware and software. The kernel layer at least includes a display driver, an audio driver, a sensor driver, etc. Exemplarily, the audio driver can drive the audio module to realize the recording and playback of voice information.

[0489] The software structure of the electronic device 100 is introduced here. It can be understood that: Fig.29 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0490] In addition, it is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0491] In addition, it should be noted that the note processing method provided by the above embodiments implemented by the electronic device in the actual application scenario can also be executed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to the memory so that when the chip system is running, the computer program stored in the memory is called to implement the steps executed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0492] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the note processing method in the above-mentioned embodiment.

[0493] In addition, an embodiment of the present application also provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the note processing method in the above-mentioned embodiment.

[0494] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the note processing method in the above-mentioned embodiment, so as to control the receiving pin to receive the signal, so as to control the sending pin to send the signal.

[0495] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0496] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A note processing method, characterized in that: Used in electronic equipment, including: Display a first interface of a first note in the note application, wherein the first interface includes a recording card, and the recording card includes a first area, a second area, and a third area; At a first moment, the first area includes a start recording control, a start playing control, and a first playing progress bar, the second area includes a text conversion control and a display speaker control, and the third area is empty; wherein, at the first moment, the display speaker control cannot interact with the user; At a second moment, in response to the user's operation on the text conversion control, first text information is displayed in the third area, and the first text information corresponds to the first voice information recorded by the first playback progress bar; wherein after the first text information is displayed in the third area, the display speaker control can interact with the user; At a third moment, in response to the user's operation on the display speaker control, a filter speaker capsule, a first speaker capsule, a second speaker capsule, and the first text information are displayed in the third area; wherein the first speaker capsule corresponds to the first text content in the first text information, the second speaker capsule corresponds to the second text content in the first text information, the first speaker capsule includes the first speaker name and the first speaking time, and the second speaker capsule includes the second speaker name and the second speaking time; At a fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the speaker selection capsule, displaying the speaker selection capsule, the first speaker capsule, and the first text content in the third area; The fourth moment is later than the third moment, the third moment is later than the second moment, the second moment is later than the first moment, and the second speaker time is later than the first speaker time.

2. The method according to claim 1, characterized in that: The method of, at the fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the speaker selection capsule, displaying the speaker selection capsule, the first speaker capsule, and the first text content in the third area includes: At the fourth moment, in response to the user's operation on the speaker screening capsule, a speaker screening window is displayed on the first interface, wherein the speaker screening window includes the first speaker and the second speaker; In response to a user selecting the first speaker in the speaker screening window, the speaker screening window is closed; and the speaker screening capsule, the first speaker capsule and the first text content are displayed in the third area.

3. The method according to claim 1, characterized in that Before the fourth moment, the screening speaker capsule displayed in the third area is in a first style, and the screening speaker capsule in the first style is used to indicate that all the speakers available for screening are selected; After the fourth moment, the screening speaker capsule displayed in the third area is in a second style, and the second style of the screening speaker capsule is used to indicate that some of the speakers available for screening are selected.

4. The method according to claim 1, characterized in that: Displaying the screening spokesperson capsule, the first spokesperson capsule, the second spokesperson capsule, and the first text information in the third area includes: At the top of the third area, displaying the screening spokesperson capsule; Displaying the first speaker capsule at a position below the display speaker capsule; Displaying the first text content below the first speaker capsule; Displaying the second speaker capsule below the first text content; The second text content is displayed below the second speaker capsule.

5. The method according to claim 4, characterized in that The method further comprises: At a fifth moment, in response to a user sliding operation from the bottom of the third area to the top of the third area, the screening spokesperson capsule is displayed at the top of the third area; and the first text content is displayed below the display spokesperson capsule; the second spokesperson capsule is displayed below the first text content; and the second text content is displayed below the second spokesperson capsule; At a sixth moment, in response to a user sliding operation from the bottom of the third area to the top of the third area, the screening spokesperson capsule is displayed at the top of the third area; and the second spokesperson capsule is displayed below the display spokesperson capsule; and the second text content is displayed below the second spokesperson capsule; The sixth moment is later than the fifth moment.

6. The method according to claim 1, characterized in that At the first moment, the text-to-text control displayed in the second area is in a first state, and the display speaker control is in a third state, the first state indicates that the function corresponding to the control is not enabled, and the third state indicates that the control cannot interact with the user; wherein the text-to-text control in the first state indicates that the speech-to-text function is not enabled, and the display speaker control in the third state indicates that the display speaker control cannot interact with the user; At the second moment, in response to the user's operation of the text-to-text control, the electronic device updates the state of the text-to-text control from the first state to the second state, and updates the state of the display speaker control from the third state to the first state, the second state indicating that the function corresponding to the control is turned on, the text-to-text control in the second state indicates that the speech-to-text function is turned on, and the display speaker control in the first state indicates that the display speaker function is not turned on; wherein, when the speech-to-text function is turned on, the electronic device can perform text-to-text operations on the first voice information. At the third moment, in response to the user's operation on the display speaker control, the electronic device updates the state of the display speaker control from the first state to the second state, and the display speaker control in the second state indicates that the display speaker function is turned on.

7. The method according to claim 6, characterized in that When the text conversion control is in the second state and the display speaker control is in the second state, the method further includes: At a seventh moment, in response to a user operation on the text conversion control in the second state, the state of the text conversion control is updated from the second state to the first state; and the screening speaker capsule, the first speaker, the first text content, the second speaker, and the second text content are still displayed in the third area; At an eighth moment, in response to the user's operation on the start recording control, the start recording control and the start playing control are replaced with a stop recording control, a second voice message is recorded, and the first playing progress bar is replaced with a recording status bar corresponding to the second voice message; and the screening speaker capsule, the first speaker, the first text content, the second speaker, and the second text content are still displayed in the third area; Among them, the eighth moment is later than the seventh moment.

8. The method according to claim 7, characterized in that After the screening spokesperson capsule, the first spokesperson, the first text content, the second spokesperson, and the second text content are still displayed in the third area, the method further includes: At a ninth moment, in response to an operation on the stop recording control, the stop recording control is replaced with the start recording control, the start playing control, and the second playing progress bar, the second area includes the text conversion control in the first state and the display speaker control in the second state, and the third area displays the screening speaker capsule, the first speaker, the first text content, the second speaker, and the second text content; At the tenth moment, in response to the user's operation on the start play control, the start play control is replaced with a pause play control, and the second voice information recorded by the second play progress bar is played; and the screening speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area; At the eleventh moment, in response to the user's operation on the text conversion control in the first state, the state of the text conversion control is updated from the first state to the second state, and the screening speaker capsule, the first speaker capsule, the first text content, the second speaker, the second text content, the third speaker capsule, and the second text information are displayed in the third area, the second text information corresponds to the second voice information recorded in the recording status bar, the third speaker capsule corresponds to the second text information, and the third speaker capsule includes the name of the third speaker and the third speaking time; Among them, the eleventh moment is later than the tenth moment, the tenth moment is later than the ninth moment, and the ninth moment is later than the eighth moment.

9. The method according to claim 6, characterized in that When the text conversion control is in the second state and the display speaker control is in the second state, the method further includes: At the ninth moment, in response to the user's operation of the start recording control, the start recording control and the start playing control are replaced with the stop recording control, the second voice message is recorded, and the first playback progress bar is replaced with the recording status bar corresponding to the second voice message; and the filtered spokesperson capsule, the first spokesperson capsule, the first text content, the second spokesperson, the second text content, the third spokesperson capsule and the second text message are displayed in the third area, the second text information corresponds to the second voice message recorded in the recording status bar, the third spokesperson capsule corresponds to the second text information, and the third spokesperson capsule includes the third spokesperson name and the third speaking time.

10. The method according to claim 6, characterized in that After displaying the screening spokesperson capsule, the first spokesperson capsule, and the first text content in the third area, the method further includes: In response to a user operation on the display speaker control in the second state, the state of the display speaker control is updated from the second state to the first state; and the first text content is displayed in the third area, and the filter speaker capsule and the first speaker capsule are not displayed.

11. The method according to any one of claims 1 to 10, characterized in that: After displaying any speaker capsule in the third area, the method further includes: In the process of displaying the stop recording control in the first area, not responding to the user's operation on any speaker capsule displayed in the third area; In the process of displaying the start recording control and the start playing control in the first area, in response to a user's operation on any speaker capsule in the third area, displaying a rename window corresponding to the operated speaker capsule on the first interface; During the process of displaying the start recording control and the pause playback control in the first area, in response to the user's operation on any speaker capsule in the third area, the recording playback progress control in the first playback progress bar is moved to a target position, and the time corresponding to the target position is the speech time displayed in the operated speaker capsule.

12. The method according to claim 11, characterized in that After displaying a rename window corresponding to the operated spokesperson capsule on the first interface, the method further includes: In response to a renaming operation performed by the user in the renaming window, the renaming window is closed, and the speaker name displayed in the speaker capsule is updated to a name named based on the renaming window.

13. The method according to any one of claims 1 to 10, characterized in that: The second area also includes a tag control, and the tag control is used to add a tag to the recorded voice information.

14. The method according to claim 13, characterized in that The method further comprises: During the process of displaying the stop recording control in the first area, in response to the user's operation of the mark control, a label is added to the recording status bar corresponding to the recorded voice information, and the added label is displayed at the corresponding time position in the recording status bar displayed in the first area.

15. The method according to claim 13, characterized in that The method further comprises: In the process of displaying the start recording control and the start playing control in the first area, in response to a user dragging operation on the recording playing progress control in the first playing progress bar, the recording playing progress control is moved to a first position corresponding to a first playing time point; In response to a user operation on the mark control, adding a first label at the first position; In response to a user dragging operation on the recording playback progress control, the recording playback progress control is moved to a second position corresponding to a second playback time point, and a time difference between the first playback time point and the second playback time point is not less than a set time threshold; In response to a user operation on the mark control, a second label is added at the second position.

16. The method according to claim 13, characterized in that The method further comprises: During the process of displaying the start recording control and the pause playback control in the first area, in response to the user's operation on the mark control, a label is added to the playback time currently corresponding to the first playback progress bar.

17. The method according to claim 16, characterized in that The method further comprises: In the process of displaying the start recording control and the pause playback control in the first area, in response to a user dragging operation on the recording playback progress control in the first playback progress bar, moving the recording playback progress control to a third position corresponding to a third playback time point; In response to a user's operation on the mark control, adding a third label at the third position; The voice information continues to be played from the third position.

18. The method according to any one of claims 1 to 10, characterized in that Displaying the start recording control and the start playing control in the first area, or in the process of displaying the start recording control and the pause playing control in the first area, the first area also displays a voice menu control; The method further comprises: In response to a user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a label option; In response to the user's operation on the tag option, displaying all the audio recording segments included in the first note in the voice menu window, and displaying all the tags included in each audio recording segment; In response to a user's deletion operation on any label displayed in the voice menu window, the label is deleted.

19. The method according to any one of claims 1 to 10, characterized in that: The second area also includes a tag control, and the tag control is used to add a tag to the recorded voice information; the start recording control and the start playing control are displayed in the first area, or in the process of displaying the start recording control and the pause playing control in the first area, the first area also displays a voice menu control; The method further comprises: In response to a user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a label option; In response to a user's operation on the recording option, displaying all recorded audio segments included in the first note and editing controls in the voice menu window; In response to the user's operation on the editing control, displaying a second interface corresponding to the first note, wherein the second interface displays all the audio clips included in the first note and displays all the tags included in each audio clip under each audio clip; In response to a user's deletion operation on any label displayed in the second interface, the label is deleted.

20. The method according to claim 19, characterized in that The method further comprises: In response to a user's deletion operation on any recording segment displayed in the second interface, the recording segment and all tags included in the recording segment are deleted.

21. The method according to any one of claims 1 to 10, characterized in that The second area also includes a first control; The method further comprises: In response to an operation on the first control, a management window is displayed on the first interface, wherein a sharing entrance is displayed in the management window; When the third area includes the filtered spokesperson capsule, the first spokesperson capsule, the second spokesperson capsule, and the first text message, after detecting the user's operation on the sharing portal, the name of the first note, the name of the first spokesperson displayed in the first spokesperson capsule, the name of the second spokesperson displayed in the second spokesperson capsule, and the sent first text message are shared to the first application in text form; When the third area includes the filtered spokesperson capsule, the first spokesperson capsule, and the first text content, after detecting the user's operation on the sharing entrance, the name of the first note, the first spokesperson name displayed in the first spokesperson capsule, and the first text content are shared to the first application in text form.

22. The method according to claim 21, characterized in that After detecting the user's operation on the sharing portal, sharing the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, and the sent first text message to the first application in text form, including: After detecting the user's operation on the sharing entrance, displaying the sharing method in the management window, the sharing method includes a first sharing method, a second sharing method, and a third sharing method; When detecting that the user has selected the first sharing method, displaying the third interface; and displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the sent first text message, and the first application in the third interface; In response to the user's operation on the first application, the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content are shared to the first application in text form.

23. The method according to claim 22, characterized in that The method further comprises: When detecting that the user selects the second sharing mode, displaying the third interface; and displaying the first voice information corresponding to the first text information and the first application in the third interface; In response to the user's operation on the first application, the first voice information is shared with the first application in the form of voice.

24. The method according to claim 22, characterized in that The method further comprises: When detecting that the user has selected the third sharing method, displaying the third interface; and displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the sent first text message, the first voice message corresponding to the first text message, and the first application in the third interface; In response to the user's operation on the first application, the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content are shared to the first application in text form; and the first voice information is shared to the first application in voice form.

25. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the note processing method as described in any one of claims 1 to 24.

26. A computer-readable storage medium, characterized in that: It comprises a computer program, which, when executed on an electronic device, enables the electronic device to execute the note processing method as claimed in any one of claims 1 to 24.

Images