Note processing method, and device and storage medium

Abstract

Provided in the present application are a note processing method, and a device and a storage medium. In the method, when there is voice information in a note, by means of introducing a speaker display function associated with a voice-to-text function, speaker information corresponding to each piece of converted text information can be displayed where the voice-to-text function is enabled, such that a user can quickly learn about a speaker of each piece of text information in a multi-person speaking scenario.

Description

Note processing method, device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on June 8, 2023, with application number 202310675832.2 and invention name “Note processing method, device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a note processing method, device and storage medium. Background Art

[0003] As electronic devices become more versatile, they have brought significant convenience to our daily lives and work. For example, note-taking applications (hereinafter referred to as note-taking applications) allow users to record information anytime, anywhere, eliminating the need for traditional paper-based recording methods and significantly improving information recording efficiency.

[0004] However, current note-taking apps typically provide text and image recording. Even those with voice recording capabilities often simply convert recorded voice messages to text, limiting their applicability to limited scenarios and resulting in a poor user experience. Therefore, a more efficient and comprehensive note-taking method is urgently needed.

[0005] Summary of the Invention

[0006] In order to solve the above technical problems, this application provides a note processing method, device and storage medium, aiming to achieve more processing of recorded voice information to meet the needs of different scenarios and enhance the user experience.

[0007] In the first aspect, the present application provides a note processing method. The method is applied to an electronic device, comprising: displaying a first interface of a first note in a note application, the first interface including a recording card, the recording card including a first area, a second area, and a third area; at a first moment, the first area includes a start recording control, a start playback control, and a first playback progress bar, the second area includes a text conversion control and a display speaker control, and the third area is empty; wherein, at the first moment, the display speaker control cannot interact with the user; at a second moment, in response to the user's operation on the text conversion control, a first text message is displayed in the third area, the first text message corresponding to the first voice message recorded in the first playback progress bar; wherein, after the first text message is displayed in the third area, the display speaker control can interact with the user; at the third moment, in response to the user's operation on the display speaker control, The filtered speaker capsule, the first speaker capsule, the second speaker capsule and the first text information are displayed in the third area; wherein, the first speaker capsule corresponds to the first text content in the first text information, the second speaker capsule corresponds to the second text content in the first text information, the first speaker capsule includes the first speaker name and the first speaking time, and the second speaker capsule includes the second speaker name and the second speaking time; at the fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the filtered speaker capsule, the filtered speaker capsule, the first speaker capsule and the first text content are displayed in the third area; wherein, the fourth moment is later than the third moment, the third moment is later than the second moment, the second moment is later than the first moment, and the second speaker time is later than the first speaker time.

[0008] Among them, the first note is, for example, Note 1 created in the following embodiment by the method corresponding to Figures 1A, 1B and 2A.

[0009] The first region is, for example, the region 11 in the following embodiment, the second region is, for example, the region 12 in the following embodiment, and the third region is, for example, the region 13 in the following embodiment.

[0010] Among them, the text conversion control is such as the text conversion control 137a involved in the following embodiment, the display speaker control is such as the display speaker control 137b involved in the following embodiment, the start recording control is such as the start recording control 141a involved in the following embodiment, the start playback control is such as the start playback control 141b involved in the following embodiment, and the first playback progress bar is such as the playback progress bar 141c involved in the following embodiment.

[0011] Among them, at the first moment, the display speaker control that cannot interact with the user is, for example, the display speaker control 137b in the third state described in the following embodiment. For the style of the display speaker control that cannot interact with the user, such as the display speaker control 137b shown in (1) of Figure 2B, the corresponding text can be gray.

[0012] The first moment may be the moment when the recording is stopped, that is, the moment when the stop recording control is clicked, or the moment when the user clicks the note of the recorded voice message. Based on this, the first interface mentioned above is, for example, the user interface 14 mentioned in the following embodiment.

[0013] Since the voice-to-text conversion and speaker display operations can be implemented in all scenarios (during recording, after recording, and during playback), the first interface can be an interface corresponding to different scenarios. For example, during recording, the first interface can be the user interface 13b mentioned below. For another example, after recording, the first interface can be the user interface 14 mentioned below. For another example, during playback, the first interface can be the user interface 15 mentioned below.

[0014] Therefore, when there is voice information in the notes, by introducing the display speaker function associated with the voice-to-text function, the speaker information corresponding to each converted text message can be displayed when the voice-to-text function is turned on, so that the user can quickly know the speaker of each text message in a scenario where multiple people are speaking.

[0015] According to the first aspect, at the fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the filtering speaker capsule, the filtering speaker capsule, the first speaker capsule and the first text content are displayed in the third area, including: at the fourth moment, in response to the user's operation on the filtering speaker capsule, the filtering speaker window is displayed on the first interface, and the filtering speaker window includes the first speaker and the second speaker; in response to the user's selection operation on the first speaker in the filtering speaker window, the filtering speaker window is closed; and the filtering speaker capsule, the first speaker capsule and the first text content are displayed in the third area.

[0016] The speaker selection window is, for example, the speaker selection window 137g described in the following embodiment. For example, in some possible cases, the speaker selection window displays all available speakers. In this aspect, the available speakers are the first speaker and the second speaker as an example.

[0017] For the relevant content about screening speakers, please refer to the description of Figures 8 and 9 below, which will not be repeated here.

[0018] According to the first aspect, or any implementation of the first aspect above, before the fourth moment, the screening speaker capsule displayed in the third area is of the first style, and the first style screening speaker capsule is used to indicate that all speakers available for screening are selected; after the fourth moment, the screening speaker capsule displayed in the third area is of the second style, and the second style screening speaker capsule is used to indicate that some of the speakers available for screening are selected.

[0019] Among them, the first style of screening spokesperson capsule, such as the screening spokesperson capsule 137e of state A mentioned in the following embodiment, is shown in the style (1) in Figure 9; the second style of screening spokesperson capsule, such as the screening spokesperson capsule 137e of state B mentioned in the following embodiment, is shown in the style (4) in Figure 9.

[0020] For the relevant content about screening speakers, please refer to the description of Figures 8 and 9 below, which will not be repeated here.

[0021] According to the first aspect, or any implementation method of the first aspect above, the filtered speaker capsule, the first speaker capsule, the second speaker capsule and the first text information are displayed in the third area, including: displaying the filtered speaker capsule at the top of the third area; displaying the first speaker capsule at a position below the displayed speaker capsule; displaying the first text content at a position below the first speaker capsule; displaying the second speaker capsule at a position below the first text content; and displaying the second text content at a position below the second speaker capsule.

[0022] Regarding the positional relationship between the speaker capsules, the speaker capsules corresponding to each speaker, and the text information in the third area, the speaker capsules, the speaker capsules corresponding to speaker 1, and the text content corresponding to speaker 1, "Note 1 includes two parts, of which the first part mainly talks about XXX," can be filtered in area 13 as shown in (3) in FIG7 . The speaker capsule corresponding to speaker 2 is not described here.

[0023] According to the first aspect, or any implementation of the first aspect above, the method also includes: at a fifth moment, in response to the user sliding from the bottom of the third area to the top of the third area, displaying a filter spokesperson capsule at the top of the third area; and displaying the first text content at a position below the displayed spokesperson capsule; displaying the second spokesperson capsule at a position below the first text content; and displaying the second text content at a position below the second spokesperson capsule; at a sixth moment, in response to the user sliding from the bottom of the third area to the top of the third area, displaying the filter spokesperson capsule at the top of the third area; and displaying the second spokesperson capsule at a position below the displayed spokesperson capsule; and displaying the second text content at a position below the second spokesperson capsule; wherein the sixth moment is later than the fifth moment.

[0024] In other words, the Speaker Selection Capsule is fixedly displayed at the top of the third area and does not change with changes in the content displayed in the third area. Therefore, by fixing the Speaker Selection Capsule, i.e., setting the Speaker Selection Capsule to a ceiling-mounted display effect (a sticky function), the user can operate the Speaker Selection Capsule at any time to perform speaker selection operations.

[0025] For the relevant content about the ceiling-mounted setting of the screening spokesperson capsule, please refer to the description of Figure 10 below, which will not be repeated here.

[0026] According to the first aspect, or any implementation of the first aspect above, at a first moment, the text-to-text control displayed in the second area is in a first state, and the speaker display control is in a third state, the first state indicates that the function corresponding to the control is not enabled, and the third state indicates that the control cannot interact with the user; wherein, the text-to-text control in the first state indicates that the speech-to-text function is not enabled, and the speaker display control in the third state indicates that the speaker display control cannot interact with the user; at a second moment, in response to the user's operation on the text-to-text control, the electronic device updates the state of the text-to-text control from the first state to the second state, and updates the state of the speaker display control from the third state to the first state, the second state indicating that the function corresponding to the control is enabled, the text-to-text control in the second state indicates that the speech-to-text function is enabled, and the speaker display control in the first state indicates that the speaker display function is not enabled; wherein, when the speech-to-text function is enabled, the electronic device can perform text-to-text operations on the first voice information; at a third moment, in response to the user's operation on the speaker display control, the electronic device updates the state of the speaker display control from the first state to the second state, and the speaker display control in the second state indicates that the speaker display function is enabled.

[0027] Among them, the text conversion control in the first state is, for example, the style of the text conversion control 137a shown in (1) in Figure 3; the text conversion control in the second state is, for example, the style of the text conversion control 137a shown in (2) in Figure 3.

[0028] Among them, the display speaker control in the third state is, for example, the style of the display speaker control 137b shown in (1) in Figure 3; the display speaker control in the first state is, for example, the style of the display speaker control 137b shown in (2) in Figure 3; and the display speaker control in the second state is, for example, the style of the display speaker control 137b shown in (3) in Figure 3.

[0029] Regarding the switching of the status of the text conversion control and the display speaker control, as well as their correlation, please refer to the description of Figure 3 in the following content, which will not be repeated here.

[0030] According to the first aspect, or any implementation of the first aspect above, when the text-to-text control is in the second state and the display speaker control is in the second state, the method also includes: at the seventh moment, in response to the user's operation of the text-to-text control in the second state, the state of the text-to-text control is updated from the second state to the first state; and the filter speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area; at the eighth moment, in response to the user's operation of the start recording control, the start recording control and the start playing control are replaced with the stop recording control, the second voice message is recorded, and the first playback progress bar is replaced with the recording status bar corresponding to the second voice message; and the filter speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area; wherein the eighth moment is later than the seventh moment.

[0031] Regarding the implementation of this aspect, for example, in the scenario shown in (4) of FIG6 , the user clicks the text conversion control 137a, causing the user interface 14 to switch from (4) of FIG6 to (1) of FIG7 , and then clicks the start recording control 141a. At this time, the corresponding user interface is, for example, the user interface 13b shown in (4) of FIG4 . The specific implementation details are not repeated here.

[0032] According to the first aspect, or any implementation of the first aspect above, after the screening speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area, the method also includes: at the ninth moment, in response to the operation of the stop recording control, the stop recording control is replaced with the start recording control, the start playing control and the second playback progress bar, the second area includes a text conversion control in the first state and a display speaker control in the second state, and the third area displays the screening speaker capsule, the first speaker, the first text content, the second speaker and the second text content; at the tenth moment, in response to the user's operation of the start playing control, the start playing control is replaced with the pause playing control, and the second voice recorded by the second playback progress bar is played. Information; and, the filtered speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area; at the eleventh moment, in response to the user's operation of the text-to-text control in the first state, the state of the text-to-text control is updated from the first state to the second state, and the filtered speaker capsule, the first speaker capsule, the first text content, the second speaker, the second text content, the third speaker capsule and the second text information are displayed in the third area, the second text information corresponds to the second voice information recorded in the recording status bar, the third speaker capsule corresponds to the second text information, and the third speaker capsule includes the name of the third speaker and the third speaking time; among them, the eleventh moment is later than the tenth moment, the tenth moment is later than the ninth moment, and the ninth moment is later than the eighth moment.

[0033] Regarding the implementation of this aspect, for example, in the scenario shown in (4) of FIG6 , the user clicks the text conversion control 137a, causing the user interface 14 to switch from (4) of FIG6 to (1) of FIG7 , and then clicks the start recording control 141a. At this time, the corresponding user interface is, for example, the user interface 13b shown in (4) of FIG4 . The specific implementation details are not repeated here.

[0034] Regarding the implementation of this aspect, please refer to the following description of Figure 7, which will not be repeated here.

[0035] According to the first aspect, or any implementation of the first aspect above, when the text conversion control is in the second state and the display speaker control is in the second state, the method also includes: at the ninth moment, in response to the user's operation of the start recording control, the start recording control and the start playback control are replaced with the stop recording control, the second voice message is recorded, and the first playback progress bar is replaced with the recording status bar corresponding to the second voice message; and, in the third area, the filtered speaker capsule, the first speaker capsule, the first text content, the second speaker, the second text content, the third speaker capsule and the second text message are displayed, the second text message corresponds to the second voice message recorded in the recording status bar, the third speaker capsule corresponds to the second text message, and the third speaker capsule includes the name of the third speaker and the third speaking time.

[0036] Regarding the implementation of this aspect, it is similar to the scenario shown in Figure 5. Please refer to the following description of Figure 5 and will not be repeated here.

[0037] According to the first aspect, or any implementation of the first aspect above, after displaying the filtered speaker capsule, the first speaker capsule and the first text content in the third area, the method also includes: in response to the user's operation of the display speaker control in the second state, updating the state of the display speaker control from the second state to the first state; and, displaying the first text content in the third area, without displaying the filtered speaker capsule and the first speaker capsule.

[0038] Regarding the implementation of this aspect, please refer to the following description of Figures 3 and 5, which will not be repeated here.

[0039] According to the first aspect, or any implementation of the first aspect above, after displaying any speaker capsule in the third area, the method also includes: in the process of displaying the stop recording control in the first area, not responding to the user's operation on any speaker capsule displayed in the third area; in the process of displaying the start recording control and the start playing control in the first area, in response to the user's operation on any speaker capsule in the third area, displaying the rename window corresponding to the operated speaker capsule on the first interface; in the process of displaying the start recording control and the pause playing control in the first area, in response to the user's operation on any speaker capsule in the third area, moving the recording playback progress control in the first playback progress bar to the target position, and the time corresponding to the target position is the speech time displayed in the operated speaker capsule.

[0040] The rename window is, for example, the rename window 137h mentioned in the following embodiment.

[0041] Regarding the period of recording (while the stop recording control is displayed in the first area), after the recording is completed (while the start recording control and the start playing control are displayed in the first area), and during the playback of the recording (while the start recording control and the pause playing control are displayed in the first area), the relevant content involved in operating the speaker capsule can be found in the following description of Figure 11 and will not be repeated here.

[0042] According to the first aspect, or any implementation of the first aspect above, after displaying the renaming window corresponding to the operated speaker capsule on the first interface, the method also includes: in response to the renaming operation performed by the user in the renaming window, closing the renaming window, and updating the speaker name displayed in the speaker capsule to a name based on the renaming window.

[0043] For the relevant content related to renaming the speaker name, please refer to the following description of Figure 11 (2) to Figure 11 (4), which will not be repeated here.

[0044] According to the first aspect, or any implementation method of the first aspect above, the first voice information belongs to a first recording segment, the first recording segment belongs to a first voice file, and the first voice file also includes a second recording segment; the speaker name displayed in the speaker capsule is updated to a name named based on the renaming window, including: in the text information converted from the first voice segment displayed in the third area, the speaker names displayed in all speaker capsules corresponding to the same speaker are updated to a name named based on the renaming window.

[0045] According to the first aspect, or any implementation method of the first aspect above, the first voice information belongs to the first recording segment, the first recording segment belongs to the first voice file, and the first voice file also includes the second recording segment; the speaker name displayed in the speaker capsule is updated to a name named based on the renaming window, including: updating the speaker names displayed in all speaker capsules corresponding to the same speaker in the first recording segment and the second recording segment displayed in the third area to a name named based on the renaming window.

[0046] According to the first aspect, or any implementation of the first aspect above, the second area further includes a tag control, and the tag control is used to add a tag to the recorded voice information.

[0047] Among them, the marking control is, for example, the marking control 137c mentioned in the following embodiment.

[0048] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the stop recording control in the first area, in response to the user's operation of the mark control, adding a label in the recording status bar corresponding to the recorded voice information, and displaying the added label at the corresponding time position in the recording status bar displayed in the first area.

[0049] Among them, the relevant content of adding tags during the process of recording voice information can be found in the following description of Figures 12 and 13, which will not be repeated here.

[0050] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the start recording control and the start playing control in the first area, in response to the user's dragging operation of the recording playing progress control in the first playing progress bar, the recording playing progress control is moved to the first position corresponding to the first playing time point; in response to the user's operation of the mark control, a first label is added at the first position; in response to the user's dragging operation of the recording playing progress control, the recording playing progress control is moved to the second position corresponding to the second playing time point, and the time difference between the first playing time point and the second playing time point is not less than the set time threshold; in response to the user's operation of the mark control, a second label is added at the second position.

[0051] Among them, after finishing recording the voice information, the relevant content of adding tags can be found in the following description of Figures 14 and 15, which will not be repeated here.

[0052] The time threshold is, for example, 5 ms as mentioned in the following embodiment.

[0053] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the start recording control and the pause playback control in the first area, in response to the user's operation of the mark control, adding a label to the current playback time corresponding to the first playback progress bar.

[0054] In the process of playing the voice information, the relevant content of adding tags can be found in the following description of Figure 16, which will not be repeated here.

[0055] According to the first aspect, or any implementation of the first aspect above, the method also includes: in the process of displaying the start recording control and the pause playback control in the first area, in response to the user's dragging operation of the recording playback progress control in the first playback progress bar, moving the recording playback progress control to a third position corresponding to a third playback time point; in response to the user's operation of the mark control, adding a third label at the third position; and continuing to play the voice information from the third position.

[0056] In the process of playing the voice information, the relevant content of adding tags can be found in the following description of Figure 16, which will not be repeated here.

[0057] According to the first aspect, or any implementation of the first aspect above, a start recording control and a start playing control are displayed in the first area, or in the process of displaying the start recording control and the pause playing control in the first area, a voice menu control is also displayed in the first area; the method also includes: in response to the user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a tag option; in response to the user's operation on the tag option, displaying all recorded audio segments included in the first note in the voice menu window, and displaying all tags included in the recording segment under each recording segment; in response to the user's deletion operation on any tag displayed in the voice menu window, deleting the tag.

[0058] Among them, the voice menu control is, for example, the voice menu control 141e mentioned in the following embodiment.

[0059] The voice menu window is, for example, the voice menu window 139c described in the following embodiment.

[0060] For the relevant content about deleting labels through the corresponding window of the label option in the voice menu window 139c, please refer to the description of Figure 19 below, which will not be repeated here.

[0061] According to the first aspect, or any implementation of the first aspect above, the second area also includes a mark control, which is used to add a label to the recorded voice information; when the start recording control and the start playing control are displayed in the first area, or when the start recording control and the pause playing control are displayed in the first area, the first area also displays a voice menu control; the method also includes: in response to the user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a label option; in response to the user's operation on the recording option, displaying all the recorded audio segments included in the first note and the editing control in the voice menu window; in response to the user's operation on the editing control, displaying the second interface corresponding to the first note, the second interface displays all the recorded audio segments included in the first note, and displays all the labels included in the recording segment under each recording segment; in response to the user's deletion operation on any label displayed in the second interface, deleting the label.

[0062] The second interface is, for example, the user interface 16 mentioned in the following embodiment.

[0063] Among them, by operating the controls in the second interface to delete the relevant content of the label, please refer to the description of Figure 20 below, which will not be repeated here.

[0064] According to the first aspect, or any implementation of the first aspect above, in response to a user's deletion operation on any recording segment displayed in the second interface, the recording segment and all tags included in the recording segment are deleted.

[0065] Among them, by operating the controls in the second interface to delete the relevant content of the label, please refer to the description of Figure 20 below, which will not be repeated here.

[0066] According to the first aspect, or any implementation of the first aspect above, the second area also displays a first control; the method also includes: in response to the user's operation on the first control, displaying a management window on the first interface, displaying a tag management entrance in the management window; in response to the user's operation on the tag management entrance, displaying a tag management window, displaying all tags included in the current recording segment in the tag management window; in response to the user's deletion operation on any tag displayed in the tag management window, deleting the tag.

[0067] Among them, the control for calling out the management window is, for example, the “more” control 137d mentioned in the following embodiment.

[0068] The management window is, for example, the management window 139a described in the following embodiment.

[0069] The tag management entry is, for example, the tag management entry 139a-2 described in the following embodiment.

[0070] The tag management window is, for example, the tag management window 139b described in the following embodiment.

[0071] For information on deleting tags through the tag management window, please refer to the description in Figure 18 below, which will not be repeated here.

[0072] According to the first aspect, or any implementation of the first aspect above, the second area also includes a first control; the method also includes: in response to an operation on the first control, a management window is displayed on the first interface, and a sharing entrance is displayed in the management window; when the third area includes a screening spokesperson capsule, a first spokesperson capsule, a second spokesperson capsule and a first text message, after detecting the user's operation on the sharing entrance, the name of the first note, the name of the first spokesperson displayed in the first spokesperson capsule, the name of the second spokesperson displayed in the second spokesperson capsule, and the first text message sent are shared to the first application in text form; when the third area includes a screening spokesperson capsule, a first spokesperson capsule, and the first text content, after detecting the user's operation on the sharing entrance, the name of the first note, the name of the first spokesperson displayed in the first spokesperson capsule, and the first text content are shared to the first application in text form.

[0073] The sharing entrance is, for example, the sharing entrance 139a-3 mentioned in the following embodiment.

[0074] The third interface is, for example, the user interface 17 mentioned in the following embodiment.

[0075] For the relevant content involved in this aspect, please refer to the description of Figures 21 and 22 below, which will not be repeated here.

[0076] According to the first aspect, or any implementation method of the first aspect above, after detecting the user's operation on the sharing entrance, the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, and the first text message sent are shared to the first application in text form, including: after detecting the user's operation on the sharing entrance, displaying the sharing method in the management window, the sharing method includes the first sharing method, the second sharing method, and the third sharing method; when detecting the user's selection operation on the first sharing method, displaying the third interface; and, displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the first text message sent, and the first application in the third interface; in response to the user's operation on the first application, sharing the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content to the first application in text form.

[0077] Among them, the first sharing method is, for example, the sharing method 1 for sharing only text information mentioned below; the second sharing method is, for example, the sharing method 2 for sharing only voice information mentioned below; the third sharing method is, for example, the sharing method 3 for sharing both text information and voice information corresponding to the text information at the same time mentioned below.

[0078] According to the first aspect, or any implementation of the first aspect above, the method also includes: displaying a third interface when detecting a user selection operation on the second sharing method; and displaying the first voice information corresponding to the first text information and the first application in the third interface; and sharing the first voice information to the first application in the form of voice in response to the user's operation on the first application.

[0079] According to the first aspect, or any implementation of the first aspect above, the method also includes: when detecting that the user has selected the third sharing method, displaying a third interface; and, displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the first text message sent, the first voice message corresponding to the first text message, and the first application in the third interface; in response to the user's operation on the first application, sharing the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content to the first application in text form; and sharing the first voice message to the first application in voice form.

[0080] According to the first aspect, or any implementation method of the first aspect above, a radio setting entrance is also displayed in the management window, and the radio setting entrance is in a folded state; the method also includes: in response to the user's operation on the radio setting entrance in the folded state, updating the state of the radio setting entrance from the folded state to the expanded state, and displaying the radio mode in the management window, the radio mode including internal radio, external radio, and internal and external radio; in response to the user's operation on any radio mode, setting the radio mode of the electronic device to the selected radio mode.

[0081] The radio setting entry is, for example, the radio setting entry 139a-1 described in the following embodiment.

[0082] For the relevant content involved in this aspect, please refer to the description of Figure 23 below, which will not be repeated here.

[0083] In a second aspect, the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor being coupled; the memory storing program instructions, which, when executed by the processor, cause the electronic device to execute instructions of the method of the first aspect or any possible implementation of the first aspect.

[0084] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.

[0085] In a third aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0086] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.

[0087] In a fourth aspect, the present application provides a computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0088] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.

[0089] In a fifth aspect, the present application provides a chip comprising a processing circuit and a transceiver pin. The transceiver pin and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the method of the first aspect or any possible implementation of the first aspect to control the receive pin to receive a signal and to control the transmit pin to send a signal.

[0090] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0091] FIG1A and FIG1B exemplarily show a user interface diagram of an electronic device for creating a new note;

[0092] FIG2A shows an exemplary user interface diagram for recording text information and voice information in a newly created note;

[0093] FIG2B shows an exemplary user interface diagram of area 13 in different states;

[0094] FIG3 shows an exemplary user interface diagram of the styles of the text conversion control 137 a and the display speaker control 137 b in different states;

[0095] FIG4 is a schematic diagram showing an exemplary user interface for displaying speaker information during recording;

[0096] FIG5 is a schematic diagram showing an exemplary user interface for displaying speaker information after recording is completed;

[0097] FIG6 shows another exemplary user interface diagram for displaying the speaker after recording is completed;

[0098] FIG7 is a schematic diagram showing an exemplary user interface for displaying the speaker during playback of a recording;

[0099] FIG8 shows a schematic diagram of an exemplary user interface involved in screening speakers;

[0100] FIG9 shows a schematic diagram of an exemplary user interface for screening speakers after recording is completed;

[0101] FIG10 shows an exemplary user interface diagram for screening the speaker ceiling effect after recording is completed;

[0102] FIG11 shows an exemplary user interface diagram for editing a spokesperson;

[0103] FIG12 shows an exemplary user interface diagram for adding tags during recording;

[0104] FIG13 shows another exemplary user interface diagram for adding tags during recording;

[0105] FIG14 shows a schematic diagram of an exemplary user interface for adding tags after recording is completed;

[0106] FIG15 shows another exemplary user interface diagram for adding tags after recording is completed;

[0107] FIG16 shows an exemplary user interface diagram for adding tags during playback of a recording;

[0108] FIG17 shows a schematic diagram of an exemplary user interface for deleting a tag;

[0109] FIG18 shows another exemplary user interface diagram for deleting a tag;

[0110] FIG19 shows another exemplary user interface diagram for deleting a tag;

[0111] FIG20 shows another exemplary user interface diagram for deleting a tag;

[0112] FIG21 shows a schematic diagram of an exemplary user interface for sharing the contents of a recording card;

[0113] FIG22 shows another exemplary user interface diagram for sharing the contents of a recording card;

[0114] FIG23 shows a schematic diagram of an exemplary user interface for setting a sound reception mode;

[0115] FIG24 shows another exemplary user interface diagram for setting a sound reception mode;

[0116] 25A and 25B are schematic diagrams showing exemplary user interfaces involved in segmented recording;

[0117] FIG26 shows an exemplary user interface diagram of audio-text synchronization;

[0118] FIG27 shows an exemplary flow chart of a note processing method;

[0119] FIG28 shows a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0120] FIG29 shows a schematic diagram of the software structure of the electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0121] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0122] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0123] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.

[0124] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0125] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.

[0126] In one solution, the electronic device may be installed with a note-taking application. The user may use the note-taking application to record voice information in the form of an audio recording. While recording, the electronic device may also receive other information input by the user, such as one or more of text information (hereinafter referred to as text), image information (hereinafter referred to as image), etc.

[0127] However, in this method of recording information, the electronic device can only simply convert the recorded voice information into text. It does not support labeling the speaker from which the text information is converted, nor does it support filtering the text information of a specified speaker, nor does it support editing (such as renaming) a specified speaker, nor does it support adding or removing tags for the recording content in a specified location, nor does it support sharing of recorded voice information and text information converted from voice information, nor does it support modifying the reception method. Therefore, the applicable scenarios are relatively limited, and it cannot meet the different usage needs of users, resulting in a poor user experience.

[0128] In view of this, the present application provides a note processing method. This note processing method can be applied to notes generated by electronic devices using note applications, aiming to achieve more processing of the voice information recorded in the notes to meet the needs of different scenarios and enhance the user experience.

[0129] It should be noted that the processing of recorded voice information performed by this application may include, for example, the display, screening, and editing of speakers mentioned above, as well as the processing of adding and deleting tags, the processing of sharing voice information, the processing of text information converted from voice information, and the processing of modifying the reception method, etc.

[0130] Specifically in practical applications, by implementing the note processing method provided in this application, the electronic device can realize one or more of the following functions, and is not limited to the following functions.

[0131] Function 1:

[0132] When the speech-to-text function is enabled, or when a converted text message is available, the electronic device can display the speaker, filter the speakers, edit the speakers, and perform other operations on the text message converted from the speech message during recording, after recording, and during playback. Furthermore, the speaker display function can be switched on and off. Furthermore, when the speaker display function is enabled, speaker filtering and speaker editing can be performed at any time.

[0133] This makes it more suitable for multi-person conference scenarios, allowing users to know the speaker corresponding to each text message converted from voice information. Furthermore, based on user needs, only the text information corresponding to the speakers selected through the speaker filtering process can be displayed. Furthermore, by providing the function of editing speakers, users can rename designated speakers as needed, further facilitating users to know the actual speaker corresponding to each text message.

[0134] It should be understood that in the process of implementing Function 1, other functions may also be implemented, such as any one or more of Functions 2 to 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note-taking application and process notes. For the relevant content in this scenario of implementing Function 1, please refer to the description of Figures 4 to 11 below, which will not be repeated here.

[0135] Function 2:

[0136] The electronic device can add tags at specified locations (time points) in the voice information and delete the added tags during recording, after recording, and during playback of the recording.

[0137] In this way, users can tag the voice content they want to focus on according to their needs, so that they can quickly locate the tagged position for playback later.

[0138] It should be understood that in the process of implementing Function 2, other functions may also be implemented, such as Function 1 listed above, and any one or more of Functions 3 to 6 listed below, as well as other functions not listed. These functions can make it more convenient for users to use the note application and process notes. For the relevant content in this scenario of implementing Function 2, please refer to the description of Figures 12 to 20 below, which will not be repeated here.

[0139] Function 3:

[0140] When the voice-to-text function is enabled, or a converted text message has been generated, the electronic device can share the text message converted from the voice message during recording, after recording, and during playback. Furthermore, users can choose to share the voice message corresponding to the text message, or share both the text message and the corresponding voice message simultaneously.

[0141] The sharing methods include but are not limited to one or more of the following:

[0142] Sharing method 1: Share text messages only.

[0143] Sharing method 2: Share only the voice message.

[0144] Sharing method 3: Share the text message and the corresponding voice message at the same time.

[0145] In addition, sharing method 1 includes but is not limited to any one or more of the following:

[0146] Sharing method 11: Share the text directly to the user's selected app or device. The text shared to the user's selected app or device will be displayed directly as a text message.

[0147] Sharing method 12: Convert the text to be shared into a document in a specified format, such as TXT, PDF, Word, or image format, and share it as a document to the user's selected application or device.

[0148] Sharing method 13: The text information to be shared is still shared in the form of a note to the application or device selected by the user.

[0149] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. For ease of explanation, the following embodiments will be specifically described using sharing method 11 as an example, and the specific implementation details will not be repeated here.

[0150] In this way, the user can share the notes recorded on the current electronic device with other applications or other electronic devices, making it convenient for the user to continue to view the content of the note using other devices.

[0151] It should also be understood that in the process of implementing Function 3, other functions may also be implemented, such as Function 1 and Function 2 listed above, and any one or more of Functions 4 to 6 listed below, as well as other functions not listed. These functions can make it more convenient for users to use the note application and process notes. For the relevant content in this scenario of implementing Function 3, please refer to the description of Figures 21 and 22 below, which will not be repeated here.

[0152] Function 4:

[0153] The electronic device can modify the receiving method during recording, so that different receiving methods can be used for recording according to needs, thereby better ensuring the recording effect.

[0154] In addition, when recording is finished and playing, the reception mode can also be modified, so that the next time you start recording, you can record according to the reception mode set by the user before starting recording.

[0155] The receiving methods include but are not limited to one or more of the following:

[0156] Audio reception method 1: Internal audio reception (internal recording). Internal audio reception requires that the electronic device has a radio function. The received sound signal is directly transmitted to the recording system and recorded on the storage medium. This recording method is not subject to external interference, the audio signal is not lost, and the recording quality is better.

[0157] Audio recording method 2: External audio recording. External audio recording is the process of transmitting external sound signals to a recording system through the built-in microphone of an electronic device or an external pickup device, and then recording the sound signals on a storage medium. This recording method is susceptible to external interference and sound signal distortion, but its advantage is that it can easily record a variety of sound signals, including human voices.

[0158] Recording method 3: Internal and external recording (full-scene recording), that is, recording internal and external sounds at the same time.

[0159] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. For ease of explanation, the subsequent embodiments will be specifically described using the above-mentioned radio reception modes 1 and 2 as examples, and the specific implementation details will not be elaborated here.

[0160] It should also be understood that in the process of implementing Function 4, other functions may also be implemented, such as Function 1, Function 2, and Function 3 listed above, as well as any one or more of Function 5 and Function 6 listed below, and other functions not listed. These functions can make it more convenient for users to use the note application and process notes. For the relevant content in this scenario of implementing Function 4, please refer to the description of Figures 23 and 24 below, which will not be repeated here.

[0161] Function 5:

[0162] When recording information, the electronic device can record multiple voice messages (voice segments) separately, and make the multiple voice messages into a long voice message (voice file). When playing the long voice message, the multiple voice messages can be played continuously.

[0163] For example, let's take Q segments of voice as an example to indicate that an electronic device has made Q recordings. Specifically, after a recording starts, the electronic device can collect sound signals, and after the recording ends, a segment of voice information can be obtained based on the collected sound signals. That is, the electronic device can record at different times (separate Q time periods) to obtain Q segments of voice. Then, the electronic device can integrate the Q segments of voice to obtain a long voice. In this way, when playing a long voice, the Q segments of voice recorded separately can be played continuously. Wherein, Q is an integer greater than or equal to 2.

[0164] In some possible cases, after the Q-th recording stops, the electronic device can display the playback progress bar corresponding to the long voice. The playback progress bar includes Q-1 nodes, which divides the playback progress bar into Q segments (which can be called Q segment sub-progress bars). Among them, the i-th sub-progress bar in the Q segment sub-progress bar corresponds to the i-th voice. The length of the i-th sub-progress in the playback progress bar is proportional to the ratio of the total duration of the i-th voice segment to the total duration of the long voice: the larger the ratio of the total duration of the i-th voice segment to the total duration of the long voice, the greater the proportion of the i-th voice segment in the long voice, and the longer the length of the i-th sub-progress bar in the playback progress bar.

[0165] It should be understood that the long speech mentioned here refers to the speech that includes more content than any of the multiple speech messages and can be regarded as a collection of the multiple speech messages. It does not refer to the length of the long speech. The total duration of the long speech is not limited in this embodiment of the application.

[0166] It should also be understood that in the process of implementing Function 5, other functions may also be implemented, such as any one or more of Functions 1 to 4 listed above, and Function 6 listed below, as well as other functions not listed. These functions can make it easier for users to use the note application and process notes. For the relevant content of implementing Function 5 in this scenario, please refer to the description of Figures 25A and 25B below, which will not be repeated here.

[0167] Function 6:

[0168] When playing a recording, an electronic device can synchronize audio and text. This synchronization involves displaying the text corresponding to the currently played audio message in state A (e.g., bold font), and the text corresponding to the unplayed audio message in state B (e.g., gray font). This allows the user to quickly access the text corresponding to the currently playing audio message.

[0169] In addition, during the playback of the recording, the user can also edit the text information converted from the voice information, such as adding, modifying or deleting part of the content. For modified scenarios, such as replacing some typos, the audio-text synchronization can continue to be saved; for deleted scenarios, during the audio-text synchronization process, you can stay at the content before deletion, and after the voice information corresponding to the deleted text information is played, the subsequent text information will be synchronized with the voice information; for newly added scenarios, during the audio-text synchronization process, the text information corresponding to the voice information can keep pace with the playback of the voice information, such as switching from state A to state B, and the newly added text information will always be in state C (such as the font is underlined, or the background color is displayed in a different color, etc.). This further facilitates user operations and improves the user experience.

[0170] It should be understood that, in addition to function 6, other functions may be included during the playback of a recording, such as any one or more of functions 1 to 5 listed above, as well as other functions not listed. These functions can make it easier for users to use the note-taking application and process notes. For the relevant content in this scenario of implementing function 6, please refer to the description of Figure 26 below, which will not be repeated here.

[0171] To better understand the six functions listed above, the following describes the relevant content involved in implementing these functions in combination with the user interface diagram involved in practice.

[0172] Before describing the relevant contents involved in the above 6 functions, we first provide an exemplary description of the relevant contents of creating a new note in an electronic device in conjunction with Figures 1A and 1B, and the relevant contents of recording text information and voice information in a newly created note in conjunction with Figures 2A and 2B.

[0173] Referring to the user interface 10 shown in (1) of FIG1A , in response to an operation (e.g., a click operation) on a note-taking application (e.g., note 101), the electronic device may open the note-taking application. At this time, the electronic device may display the user interface 11a shown in (2) of FIG1A .

[0174] As shown in (2) of FIG1A , user interface 11a is an exemplary user interface involved in creating a new note. The user interface 11a may include a control 111 corresponding to viewing all notes. In response to an operation on the control 111, the electronic device may display the user interface 11b shown in (3) of FIG1A .

[0175] As shown in (3) of FIG. 1A , the user interface 11b may include a control 1131 , which may trigger the electronic device to display the folder in which the note is saved.

[0176] In response to the operation on control 1131, the electronic device can display all folders. Among them, all folders include folders created by the user through the electronic device (for example, they can be collectively referred to as new folders), and also include default folders in the system. Any non-empty folder can include at least one file, each of which can be called a note. Empty folders do not include files. For example, as shown in the user interface 11c shown in (4) in Figure 1A, the new folder can include folder 1, and the default folder can be independent of the new folder. In response to the operation on the icon 112 corresponding to folder 1, the electronic device can display all notes included in file 1. For example, at this time, the electronic device can display the user interface 11d shown in (1) in Figure 1B.

[0177] As shown in (1) in FIG. 1B , the user interface 11d includes notes related to the file 1, such as Note A and Note B.

[0178] In addition, the user interface 11a, the user interface 11b, and the user interface 11c may further include a new control 113. The new control 113 may be used to trigger the creation of a new note.

[0179] Taking the example of the user triggering the operation of the new control 113 in the user interface 11c, the electronic device will create a new note in response to the user's operation (such as a click operation) on the new control 113 in the user interface 11c, and the new note belongs to the currently opened folder, which here belongs to file 1.

[0180] It should be understood that in the user interface 11a shown in FIG1A (2), since no folder is currently opened but all notes are displayed, in response to the user's operation (e.g., a click operation) on the new control 113 in the user interface 11a, the newly created note of the electronic device does not belong to the folder created by the user through the electronic device, such as the file 1 mentioned above, but belongs to the default folder included in the system. Subsequently, the user can set the newly created note to another folder.

[0181] In response to the operation on the new control 113, the electronic device can create a new note. At this time, the electronic device can display the user interface 12 shown in (2) in Figure 1B.

[0182] As shown in (2) in FIG1B , the user interface 12 is an initialization interface involved after creating a new note. In response to an operation on the title input control 121, the electronic device can set the name of the new note. For example, the new note is named Note 1 here.

[0183] It should be understood that the method of creating a new note shown in Figures 1A and 1B is an exemplary description. In actual applications, the process of creating a new note may involve more or fewer interfaces and controls, and should not constitute a limitation on the embodiments of the present application.

[0184] The aforementioned Note 1 has not recorded any information input by the user. After the electronic device enters Note 1, the recording function can be triggered through the recording control. After the recording function is turned on, the electronic device can divide the user interface into two areas (area 1 and area 2). Area 1 is used to present recording cards (displaying content, options / controls related to recording, etc.), and area 1 can also be called a recording area. Area 2 is used to present other information input by the user (such as text, pictures, etc.). The other information can be called non-recording information, and area 2 can also be called an editing area.

[0185] The recording card in the recording area (area 1) may include three subareas: a voice recording area (denoted as area 11), a voice processing tool area (denoted as area 12), and a text area (denoted as area 13). For a description of area 11, area 12, and area 13, please refer to the description of Figures 2A and 2B below and will not be repeated here.

[0186] For information about area 1, area 2, and recording text information and voice information in notes, please refer to the following exemplary description of Figures 2A and 2B.

[0187] Referring to (1) in FIG2A , user interface 13 is the user interface corresponding to when the user names a new note as Note 1. At this time, the electronic device may provide a default input tool, such as a keyboard 131. When the keyboard is displayed, the electronic device may also display a note toolbar (e.g., note toolbar 132).

[0188] The note toolbar can provide an entry to convenient functions (such as a recording function) when the user records information. The note toolbar 132 may include an insert control 132a, a recording control 132b, and a handwriting control 132c. Among them, the insert control 132a can be used to trigger the insertion of information such as pictures and videos into the user interface 13 for display. The recording control 132b can be used to trigger the start of the recording function. The handwriting control 132c can be used to trigger the switching of the input tool from the keyboard 131 to the stylus toolbar. In addition to the insert control 132a, the recording control 132b, and the handwriting control 132c, the note toolbar may also include other controls, for example, a list creation control 132d and a style setting control 132e.

[0189] Exemplarily, in response to an operation on the handwriting control 132c (e.g., a click operation), the electronic device switches the input tool from the keyboard 131 to the stylus toolbar. As shown in (2) in FIG. 2A , the stylus toolbar may be the stylus toolbar 134 displayed in the user interface 13a. The stylus toolbar 134 may include different styluses, such as styluses 134a to 134f. The stylus can be used to mark in the editing area, for example, to add an underline, draw a circle, write text information, etc. The user interface 13a may also include a keyboard switching control 135. The keyboard switching control 135 can be used to trigger the electronic device to switch the input tool from the stylus toolbar to the keyboard. Exemplarily, in some possible cases, the keyboard switching control 135 can serve as a shortcut control in the stylus toolbar 134.

[0190] Continuing to refer to (1) in FIG. 2A , illustratively, in response to an operation on the recording control 132b (e.g., a click operation), the electronic device can turn on the recording function, and divide the aforementioned area 1 and area 2 in the user interface, as shown in the user interface 13b shown in (3) in FIG. 2A .

[0191] Referring to (3) in FIG2A , illustratively, the user interface 13b includes area 1 and area 2. Area 1 includes area 11, area 12, and area 13.

[0192] For example, area 11 may include functional controls related to recording or playing voice, such as a recording bar. The recording bar can be used to trigger functions such as recording voice, pausing voice recording, playing voice, and pausing voice playback. The recording bar has different states, and the recording bar in different states is composed of different components. Different states of the recording bar have different functions.

[0193] For example, the recording bar included in area 11 shown in (3) in FIG2A is a recording bar in state 1 (also referred to as recording bar 1). The recording bar 1 may include a stop recording control 136a, a recording status bar 136b, and a recording duration 136c corresponding to the voice recording.

[0194] Among them, the stop recording control 136a is used to indicate that the current electronic device has started recording. When the user clicks the control, the electronic device will stop recording, and the recording bar 1 will switch to the recording bar in state 2 (also called recording bar 2), as shown in the user interface 14 (4) in Figure 2A.

[0195] The recording status bar 136b may reflect the energy of the sound signal collected by the electronic device. The greater the energy, the greater the change in the recording status bar 136b; the smaller the energy, the smaller the change in the recording status bar 136b.

[0196] In some possible cases, the recording duration 136c may be used to represent the total duration of all recorded voices. In other possible cases, the recording duration 136c may not be used to represent the total duration of all recorded voices, but may be used to represent the total duration of the voice being recorded.

[0197] Referring to (4) in FIG2A , the user interface 14 is an exemplary user interface involved after pausing recording. In some possible cases, the recording bar 2 in state 2 may include a start recording control 141a, a start playing control 141b, a play progress bar 141c, a play time indicator 141d, and a voice menu control 141e.

[0198] Among them, the start recording control 141a can be used to trigger the electronic device to start recording again (restart the recording of a voice clip). The start playing control 141b can be used to trigger the electronic device to play the recorded voice (voice clip). The play progress bar 141c can be used to indicate the progress of the currently playing voice. The play time indicator 141d is used to indicate the current play time and the total duration of all voices. The voice menu control 141e is used to trigger the electronic device to display and manage all recorded voices, which include all voice clips recorded in Note 1. When all the voices recorded in Note 1 are Q (an integer greater than or equal to 2) segments of voice, the electronic device can integrate the Q segments of voice into a long voice, and the total duration of the Q segments of voice is the total duration of the long voice. At this time, the play progress bar 141c can also include Q-1 nodes, dividing the play progress bar 141c into Q segments (which can be called Q segment sub-progress bars). Among them, the i-th sub-progress bar in the Q segment sub-progress bar corresponds to the i-th segment of voice. For the description of the node and its related content, please refer to the following description of (2) in Figure 25B, which will not be repeated here.

[0199] In addition, the play progress bar 141c may include a recording play progress control 1411. If the recording play progress control 1411 is at position A1 of the play progress bar 141c, it indicates that the voice information corresponding to the position A1 is played.

[0200] Continuing to refer to (3) in FIG. 2A , for example, regarding area 12, in some possible cases, it may include a text conversion control 137a (speech-to-text control), a display speaker control 137b, a label control 137c, and a "more" control 137d that hides some functions.

[0201] Among them, the display speaker control 137b in area 12 may include three states, such as a first state indicating that the display speaker function is not turned on (off), a second state indicating that the display speaker function is turned on, and a third state indicating that the display speaker function is unavailable. When the display speaker control 137b is in the first state or the second state, when the user clicks on the display speaker control 137b, the switching between the two states can be achieved. For example, when the user clicks on the display speaker control 137b in the first state, the electronic device will switch the display speaker control 137b from the first state to the second state in response to the operation; when the user clicks on the display speaker control 137b in the second state, the electronic device will switch the display speaker control 137b from the second state to the first state in response to the operation.

[0202] Furthermore, it should be noted that the display speaker control 137b can be in the first or second state only when the text-to-text control 137a is in the second state, that is, the user has enabled the speech-to-text function, or the text area (area 13) has displayed text information converted from the speech information. Otherwise, the display speaker control 137b will be in the third state.

[0203] Among them, the label control 137c in area 12 is available in all scenarios (during recording, after recording, and during playback). Specifically, each time the user clicks, a label is added to the specified location (time point) in the recording bar. For details about the relevant content related to the label control, please refer to the description of adding and deleting labels below, which will not be repeated here.

[0204] Among them, the "More" control 137d in area 12 is fully available. Specifically, each time the user clicks on this control, a corresponding window will be displayed, which displays hidden functional controls such as sharing controls, radio mode modification (radio settings) controls, and tag management controls. For details about the relevant content of these controls, please refer to the description of the radio mode settings and the related content of deleting tags below, which will not be repeated here.

[0205] The styles of the text conversion control 137a and the display speaker control 137b in different states, as well as the relationship between the two, are described below in conjunction with the user interface exemplarily shown in FIG. 3 .

[0206] For example, when the text-to-text control 137a is in the first state, i.e., indicating that the speech-to-text function is not enabled, and there is no text information converted from the speech information in area 13, according to the above description, in this case, the display speaker function is unavailable, i.e., the display speaker control 137b is in the third state. In this case, the text-to-text control 137a in the first state may be in the style shown in FIG. 3 (1), and the display speaker control 137b in the third state may be in the style shown in FIG. 3 (1) (with gray font).

[0207] Exemplarily, when the user clicks on the text conversion control 137a in the first state in FIG3 (1), the electronic device responds to the operation and the text conversion control 137a switches from the first state to the second state, i.e., the state indicating that the voice conversion function is turned on. The style of the text conversion control 137a also switches from the style shown in FIG3 (1) to the style shown in FIG3 (2) in which both the icon and text are in black.

[0208] According to the above description, when the text conversion control 137a is in the second state, regardless of whether there is text information converted from the voice information in the area 13, the display speaker control 137b can be selected by the user, that is, it can be switched from the third state to the non-third state (the first state or the second state). In actual application, when switching from the third state to the non-third state, whether to switch to the first state or the second state can be set according to business needs, and this application does not impose any restrictions on this. For ease of explanation, the embodiment of this application takes the non-third state switched from the third state as the first state by default as an example. The style of the display speaker control 137b in the first state can be as shown in (2) in Figure 3 (the font switches from gray to black).

[0209] Exemplarily, when the text conversion control 137a is in the second state (the style shown in (2) in Figure 3) and the display speaker control 137b is in the first state (the style shown in (2) in Figure 3), when the user clicks on the display speaker control 137b in the first state, the electronic device responds to the operation and the display speaker control 137b will switch from the first state to the second state, indicating that the display speaker function is turned on, and the style of the display speaker control 137b will also switch from the style shown in (2) in Figure 3 to the style shown in (3) in Figure 3 in which the icon and text are both black.

[0210] It is understandable that when the text conversion control 137a is in the second state (the style shown in (3) in Figure 3) and the display speaker control 137b is also in the second state (the style shown in (3) in Figure 3), when the text information converted by the electronic device based on the voice information is displayed in area 13, such as "Note 1 includes two parts, among which the first part mainly talks about XXX. The second part mainly talks about XX.", area 13 will display a control for filtering specified speakers, such as the filtering speaker capsule 137e shown in (6) in Figure 3, and a control for displaying the speaker information corresponding to each text message, such as the speaker capsule 137f shown in (6) in Figure 3.

[0211] Wherein, in some possible cases, when the speaker display function is turned on, all speakers may be displayed by default. Accordingly, all text information converted from the voice information will also be displayed in area 13.

[0212] In other possible cases, the user can filter the speakers by operating the speaker filter capsule 137e, such as selecting one or more speakers as needed. Accordingly, area 13 will only display the text information corresponding to the filtered speakers. For details about filtering speakers, please refer to the description of Figures 8 to 10 below and will not be repeated here.

[0213] For ease of explanation, the embodiments of the present application take the example of displaying all speakers by default after the display speaker function is turned on.

[0214] Among them, the speaker capsule 137f corresponding to each text message may include the speaker avatar, speaker time, and speaker name corresponding to the text message. In some possible cases, the speaker avatar and speaker name displayed in the speaker capsule 137f may be the default avatar and name set by the system. In other possible cases, the speaker avatar and speaker name displayed in the speaker capsule 137f may be synchronized with the avatar and name of the relevant contact in the application such as contacts. In other possible cases, the user can modify the speaker avatar and speaker name by operating the speaker capsule 137f. For the content involved in this operation, please refer to the following description of Figure 11, which will not be repeated here.

[0215] For example, when the text-to-text control 137a is in the first state, that is, the state indicating that the speech-to-text function is not turned on, but there is text information converted from the voice information in area 13, such as "Note 1 includes two parts, of which the first part mainly talks about XXX. The second part mainly talks about XX." According to the above description, in this case, the display speaker function is available, that is, the display speaker control 137b is in a non-third state (the embodiment of the present application takes the first state as an example by default). In this case, the text-to-text control 137a in the first state can be in the style shown in Figure 3 (1) and Figure 3 (4), and the display speaker control 137b in the first state can be in the style shown in Figure 3 (4) (the font is black).

[0216] For example, when the display speaker control 137b is in the first state (the style shown in (4) in Figure 3), when the user clicks on the display speaker control 137b in the first state, the electronic device will respond to the operation, and the display speaker control 137b will switch from the first state to the second state, that is, the state indicating that the display speaker function is turned on, and the style of the display speaker control 137b will also switch from the style shown in (4) in Figure 3 to the style shown in (5) in Figure 3 where the icon and text are both black.

[0217] Understandably, since the text information converted by the electronic device based on the voice information is displayed in area 13, such as "Note 1 includes two parts, wherein the first part mainly talks about XXX. The second part mainly talks about XX.", after the speaker display function is turned on, a control for filtering designated speakers, such as the speaker filtering capsule 137e shown in (5) of FIG3 , and a control for displaying the speaker information corresponding to each text message, such as the speaker capsule 137f shown in (5) of FIG3 , will be displayed in area 13.

[0218] Regarding the screening spokesperson capsule 137e and spokesperson capsule 137f shown in (5) of FIG. 3 , they are the same as the screening spokesperson capsule 137e and spokesperson capsule 137f shown in (6) of FIG. 3 mentioned above, and are not described again here.

[0219] In addition, for details on screening the spokesperson capsule 137e and the spokesperson capsule 137f, reference may be made to the following descriptions of FIG8 to FIG10 and FIG11, which will not be repeated here.

[0220] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual applications, different styles can be set to represent the first and second states of the text conversion control 137a, and different styles can be set to represent the first, second, and third states of the display speaker control 137b, depending on business needs. This application does not impose any restrictions on this.

[0221] Continuing with (3) in FIG. 2A , illustratively, area 13 is used to display text information converted from voice information when the user turns on the voice-to-text function, i.e., when the text-to-text control 137a is in the second state. The displayed text information is specifically generated by the electronic device processing the collected sound signal to obtain voice, converting the voice, and then displaying the converted text in area 13.

[0222] Furthermore, in some implementations, when the voice-to-text function is enabled, a prompt message may be displayed in area 13 during the process of converting voice information into text information. This prompt message may be used to indicate that the electronic device has enabled the voice-to-text function. For example, the prompt message may be a text message: "Converting voice to text..."

[0223] In addition, it can be seen from the above description that when the user turns on the speech-to-text function, that is, the text-to-text control 137a is in the second state, or the text information converted from the speech information is already displayed in area 13, when the user turns on the display speaker function, that is, the display speaker control 137b is in the second state, area 13 will not only display the text information converted from the speech information, but also display the control for filtering the designated speaker, such as the filter speaker capsule 137e shown in Figure 3 (5) and Figure 3 (6). And the speaker information corresponding to each text message, such as the speaker avatar, speaker time, and speaker name corresponding to the text message displayed in the speaker capsule 137f shown in Figure 3 (5) and Figure 3 (6).

[0224] In addition, in some possible cases, a control for user operation may be provided in area 13, such as 150a shown in (1) of FIG. 2B or 150b shown in (2) of FIG. 2B.

[0225] Among them, when the control displayed in area 13 is 150a, it indicates that area 13 is in the expanded state. Specifically, when area 13 is in the expanded state and there is text information converted from the voice information, the user can see the text information converted from the voice information in area 13.

[0226] It can be understood that when the control displayed in area 13 is 150a, when the user clicks on control 150a, the electronic device responds to the operation behavior, and area 13 will switch from the expanded state shown in (1) in Figure 2B to the folded state shown in (2) in Figure 2B, and control 150a will be updated to control 150b.

[0227] Among them, when the control displayed in the area 13 is 150b, it indicates that the area 13 is in a folded state. Specifically, when the area 13 is in a folded state, the area 13 will be put away. Even if there is text information converted from the voice information, the user cannot see it.

[0228] It can be understood that when the control displayed in area 13 is 150b, when the user clicks on control 150b, the electronic device responds to the operation behavior, and area 13 will switch from the folded state shown in (2) in Figure 2B to the expanded state shown in (1) in Figure 2B, and control 150b will be updated to control 150a.

[0229] For example, in some possible cases, the state of area 13 may be bound to the state of the text-to-text control 137 a in area 12 .

[0230] For example, when the text conversion control 137a is in the second state, the region 13 may be in the expanded state. Correspondingly, when the text conversion control 137a is in the first state, the region 13 may be in the collapsed state.

[0231] For another example, when the text conversion control 137a switches from the second state mentioned above to the first state mentioned above, if text information converted from the voice information already exists, the area 13 may still be in the expanded state.

[0232] For example, in some other possible situations, the area 13 may be set to be in the expanded state by default, that is, no matter what state the text conversion control 137a is in, and no matter whether there is text information converted from the voice information, the area 13 is in the expanded state.

[0233] Exemplarily, in this implementation, the change in the state of region 13 depends only on the user's operation on control 150a.

[0234] Accordingly, when the user clicks 150a, the region 13 switches from the expanded state to the collapsed state, and the control 150a is updated to 150b, the change in the state of the region 13 depends only on the user's operation on the control 150b.

[0235] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. For ease of description, the following embodiments are all described with the region 13 being in the unfolded state by default.

[0236] It should also be understood that, here, the area 11, area 12, and area 13 are displayed in one area (area 1) as an example for description. In other possible cases, the area 11, area 12, and area 13 may be separated.

[0237] Continuing to refer to (3) in FIG2A , illustratively, area 2 is used to present input non-recording information, such as text, pictures, etc. When non-recording information is not displayed in area 2, a prompt message may be displayed, which may be used to remind the user that recording is currently in progress and may also remind the user that information can be input in area 2. For example, the prompt message may be a text prompt: "Recording is in progress. You can write or doodle in the blank space..."

[0238] In addition, the electronic device may provide an input tool for inputting information, wherein the input tool may include a keyboard and a stylus tool bar.

[0239] In some possible cases, the electronic device may display an input tool in a user interface, and when the input tool is displayed, a quick control for switching to another input tool may be provided.

[0240] In this way, in some possible cases, during the recording, after the recording, and during the playback of the recording, the user can view the recording status through the recording bar in area 11. At the same time, the electronic device can also process the recorded voice information by operating the various options in area 12 during the above process. At the same time, in the above process, when the speech-to-text function is turned on, the electronic device can display the converted text information in area 13 for the user to view and edit after realizing the speech-to-text conversion. At the same time, in the above process, the user can also use the input tool to implement manual input, and the input information will be displayed in area 2 for the user to view. Manual input includes entering text, inserting pictures, etc.

[0241] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0242] Based on Figures 4 to 11, the following describes the relevant contents of displaying speakers, screening speakers and editing speakers in the above function 1 by taking the three scenarios of during recording, end of recording and playback of recording as examples.

[0243] The following is the relevant content of the speaker:

[0244] For information on displaying speaker-related content during recording, please refer to the following exemplary description of FIG. 4 .

[0245] As shown in the user interface 13b in FIG4 (1), in response to an operation (e.g., a click operation) on the text conversion control 137a (first state), the electronic device (e.g., a mobile phone) can turn on the speech-to-text function and update the state of the text conversion control 137a from the first state (the style shown in FIG4 (1)) to the second state (the style shown in FIG4 (2)).

[0246] Through the above description of the association between the text conversion control 137a and the display speaker control 137b, it can be known that when the state of the text conversion control 137a is the second state (the style shown in (2) in Figure 4), the state of the display speaker control 137b can be a non-third state, that is, the first state (the style shown in (2) in Figure 4), or the second state (the style shown in (3) in Figure 4). The embodiment of the present application takes the non-third state as the first state as an example. Therefore, in response to the operation of the text conversion control 137a in the first state (the style shown in (1) in Figure 4), the electronic device turns on the speech-to-text function, and updates the state of the text conversion control 137a from the first state (the style shown in (1) in Figure 4) to the second state (the style shown in (2) in Figure 4), and also updates the state of the display speaker control 137b from the third state (the style shown in (1) in Figure 4) to the first state (the style shown in (2) in Figure 4).

[0247] Referring to (2) in FIG4 , for example, after the voice-to-text function is turned on, the electronic device processes the collected sound signal to obtain voice, converts the voice, and displays the converted text in area 13. In order to improve the user experience, while waiting for the electronic device to convert the collected sound signal into text and display it in area 13, a prompt message such as "Voice-to-text conversion..." can be displayed in area 13, thereby preventing the user from mistakenly believing that the voice-to-text function is not turned on and repeatedly clicking the text conversion control 137a, causing the voice-to-text function to switch between on and off.

[0248] Continuing to refer to (2) in Figure 4, for example, when the speech-to-text function is turned on, when the user clicks on the display speaker control 137b in the first state, the electronic device responds to the operation behavior, turns on the display speaker function, and updates the state of the display speaker control 137b from the first state (the style shown in (2) in Figure 4) to the second state (the style shown in (3) in Figure 4).

[0249] It can be seen from the above description that after the speaker display function is turned on, a speaker screening capsule 137e will be displayed in area 13. After the electronic device converts the received voice information into text information, it can also display at least one speaker capsule 137f in area 13. The above text information may contain multiple sentences. In some possible cases, the multiple sentences in the text information may come from the same speaker or from different speakers. Regarding the identification of the speaker corresponding to each sentence, for example, the voice information that needs to be converted into text can be identified based on voiceprint recognition technology, and then determined. Regarding the determination of relevant content of different speakers based on voiceprint recognition technology, please refer to voiceprint recognition technology, which will not be elaborated here.

[0250] Furthermore, regarding the aforementioned division of multiple sentences in text information, in some possible scenarios, division can be based on the duration of pauses between speakers in voice information. For example, if the pause between the first and second speech content in a voice information message is greater than a set duration threshold, such as 1 second, the text converted from the first speech content is divided into one sentence, and the text converted from the second speech content is divided into another sentence.

[0251] In another possible scenario, the division may be based on the switching of speakers, that is, the text converted from the speech content corresponding to each speaker is divided into a sentence.

[0252] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0253] For example, in some possible cases, the speaker avatar and speaker name displayed in each speaker capsule 137f may be system default settings. In other possible cases, the speaker avatar and speaker name displayed in each speaker capsule 137f may also be modified by editing the speaker. For details about modifying the speaker avatar and name displayed in the speaker capsule by editing the speaker, please refer to the description of Figure 11 below, which will not be repeated here.

[0254] It should also be understood that when the voice-to-text function and the speaker display function are enabled during recording, the content displayed in area 13 will change according to the text information converted from the real-time recorded voice information. For example, in Figure 4 (3), when the text information 1 converted from the voice information 1 is "Note 1 includes two parts, of which the first part mainly talks about XXX.", and the voiceprint recognition technology determines that the currently converted text information 1 all come from the same speaker (the first speaker is speaker 1 by default), then when the text information 1 is displayed in area 13, the speaker capsule 137f corresponding to speaker 1 will be displayed before the text information 1, and the default speaker avatar will be displayed in the speaker capsule 137b, as well as the speaker time when speaker 1 starts to say "Note 1 includes two parts, of which the first part mainly talks about XXX.", such as "00:00:10".

[0255] For example, if the voice-to-text function and the speaker display function are turned on, the electronic device collects another voice message, such as voice message 2. The electronic device determines based on the voiceprint recognition technology that the voiceprint corresponding to voice message 2 is different from the voiceprint corresponding to voice message 1, that is, voice message 2 is not the speech of speaker 1. At this time, the electronic device can determine the speaker corresponding to voice message 2 as speaker 2, and display the speaker capsule corresponding to speaker 2 in area 13, as well as the corresponding text information, such as "The second part mainly talks about XXX." converted from voice message 2 (not shown in (3) in Figure 4).

[0256] It should be noted that in some possible situations, area 13 can be fixed to avoid blocking area 2 and affecting the user's input of non-voice information during recording. In this case, area 13 can be set as a sliding panel, that is, the user can slide their finger up and down in area 13 to slide the content of area 13, thereby displaying text information not displayed in the current area.

[0257] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0258] Continuing to refer to (3) in FIG4 , illustratively, when the user clicks on the text-to-text control 137a in the second state, the electronic device, in response to the operation, turns off the voice-to-text function and updates the state of the text-to-text control 137a from the second state (the style shown in (3) in FIG4 ) to the first state (the style shown in (4) in FIG4 ). It can be understood that after turning off the voice-to-text function, the electronic device no longer converts the voice information into text information. Specifically in this embodiment, new text information will no longer be displayed in area 13, but the text information converted from the voice information before turning off the voice-to-text function can be retained.

[0259] As can be seen from the above description, when there is text information in area 13, the display speaker function can still be used even if the speech-to-text function is not turned on. Therefore, when the speech-to-text function is turned off and the electronic device is in the scenario shown in (4) in Figure 4, that is, when the text conversion control 137a is in the first state, the display speaker control 137b can still be in the second state. The text information already displayed in area 13 still retains the previous corresponding speaker capsule.

[0260] For example, in other possible situations, if the speech-to-text function is turned off and the text information converted from the voice information is not displayed in area 13, then when the speech-to-text function is turned off, that is, after the state of the text conversion control 137a is updated from the second state to the first state, the state of the display speaker control 137b will be updated from the non-third state to the third state, that is, regardless of whether the display speaker control 137b is in the first state or the second state at this time, it will be updated to the third state.

[0261] For information on displaying the speaker's related content after recording is completed, please refer to the following exemplary description of FIG. 5 and FIG. 6 .

[0262] Scenario 1:

[0263] For example, during recording, the voice-to-text function is turned on (the voice-to-text control 137a is in the second state, as shown in the style of (1) in FIG5 ), and the speaker display function is turned on (the speaker display control 137b is in the second state, as shown in the style of (1) in FIG5 ), and the speaker filter capsule 137e, the text information converted from the voice information, and the speaker capsules 137f corresponding to different speakers are displayed in area 13. When the user clicks the stop recording control 136a, the electronic device will pause the recording in response to the operation and display the user interface 14 shown in (2) in FIG5 . That is, the recording bar displayed in area 11 will be updated from the style of the recording bar 1 shown in (1) in FIG5 to the style of the recording bar 2 shown in (2) in FIG5 .

[0264] Among them, in some possible cases, it can be set that when the user clicks the stop recording control 136a to pause the recording, the speech-to-text function is turned off at the same time, that is, when the recording bar is updated from the style of the recording bar 1 shown in (1) in Figure 5 to the style of the recording bar 2 shown in (2) in Figure 5, the state of the text-to-text control 137a displayed in area 12 will also be updated from the second state (the style shown in (1) in Figure 5) to the first state (the style shown in (2) in Figure 5).

[0265] Continuing to refer to (1) in FIG5 , for example, since the speech-to-text function and the display speaker function are turned on during recording, the text information converted from the speech information has been displayed in area 13, and the filter speaker capsule 137e and the speaker capsule 137f corresponding to each text message are displayed. Therefore, when the recording is paused and the speech-to-text function is turned off, the display speaker function can still be used, that is, the previous second state (the style shown in (2) in FIG5 ) can still be maintained. Accordingly, the text information already displayed in area 13 will still be displayed, and the filter speaker capsule 137e and the speaker capsule 137f corresponding to each currently displayed text message will be displayed.

[0266] Exemplarily, in the user interface 14 shown in (2) in Figure 5, in response to an operation (such as a click operation) on the display speaker control 137b for the second state (the style shown in (2) in Figure 5), the electronic device responds to the operation behavior, turns off the display speaker function, and updates the state of the display speaker control 137b from the second state (the style shown in (2) in Figure 5) to the first state (the style shown in (3) in Figure 5).

[0267] Referring to (3) in FIG5 , for example, when both the speech-to-text function and the speaker display function are turned off, the text information converted from the new speech information will no longer be displayed in area 13, but the text information that has already been converted and displayed in area 13 can continue to be displayed. In addition, since the speaker display function is also turned off, the speaker filter capsule and the speaker capsule will no longer be displayed in area 13. Instead, the text information previously converted from the speech information will be directly displayed, such as "Note 1 includes two parts, of which the first part mainly talks about XXX. The second part mainly talks about XXX."

[0268] In addition, it can be seen from the above description that when there is text information in area 13, the display speaker function can be used, that is, the display speaker control 137b is in a non-third state. Figure 5 (3) takes the display speaker control 137b in the first state as an example.

[0269] Scenario 2:

[0270] For example, during recording, the voice-to-text function is not turned on (the voice-to-text control 137a is in the first state, as shown in FIG6 (1)), and the speaker function is displayed (the speaker display control 137b is in the third state, as shown in FIG6 (1)). When the user clicks the stop recording control 136a, the electronic device will pause the recording in response to the operation and display the user interface 14 shown in FIG6 (2). That is, the recording bar displayed in the area 11 will be updated from the recording bar 1 shown in FIG6 (1) to the recording bar 2 shown in FIG6 (2).

[0271] Because the speech-to-text function and the speaker display function were not enabled before the recording was paused, the text information converted from the speech information is not displayed in area 13. Therefore, after the recording is paused, the text-to-text control 137a will continue to remain in the first state, and the speaker display control 137b will continue to remain in the third state.

[0272] In addition, it should be noted that, in the user interface 14 shown in FIG6 (2), when the user clicks on the text conversion control 137a in the first state (the style shown in FIG6 (1) or (2)), the electronic device will respond to the operation behavior and update the state of the text conversion control 137a from the first state to the second state (the style shown in FIG6 (3)), and display the text information converted from the recorded voice information in area 13, such as "Note 1 includes two parts, of which the first part mainly talks about XXX. The second part mainly talks about XXX.". Since the voice-to-text function is turned on, the state of the display speaker control 137b will also be updated from the third state (the style shown in FIG6 (1) or (2)) to the non-third state (this embodiment takes the first state as an example, as shown in FIG6 (3)). In this case, when the user clicks on the display speaker control 137b in the first state, the electronic device will respond to the operation behavior and update the state of the display speaker control 137b from the first state to the second state (the style shown in FIG6 (4)), and display speaker capsules indicating different speakers in area 13. In this way, when the text information converted from the voice information is displayed in area 13 , the selected speaker capsule and the speaker capsule are also displayed.

[0273] Regarding displaying speaker-related content during playback of a recording, reference may be made to the following exemplary description of FIG. 7 .

[0274] For example, text information converted from voice information is displayed in area 13, such as "Note 1 includes two parts. Among them, the first part mainly talks about XXX." After the recording is completed (or after the recording is paused), the user turns off the voice-to-text function, that is, the style of the recording bar in area 11 is shown in (1) in Figure 7, and the style of each control in area 12 is shown in (1) in Figure 7. In this case, the display speaker function is available. If the display speaker function has not been turned off by the user, that is, the display speaker control 137b is always in the style shown in (1) in Figure 7, then the filter speaker capsule will be displayed in area 13, such as the filter speaker capsule 137e shown in (1) in Figure 7, and the speaker capsule corresponding to the text information "Note 1 includes two parts. Among them, the first part mainly talks about XXX."

[0275] For example, let's take "Note 1 includes two parts. The first part mainly talks about XXX." The speaker corresponding to this text message is the speaker 1 mentioned above, and the speech time corresponding to this text message is "00:00:10". Then, the speaker capsule 137f shown in (1) in Figure 7 will be displayed in area 13.

[0276] In addition, it should be noted that if the currently recorded voice information includes speeches of multiple speakers, for example, the text information that can be converted from the entire voice clip includes "Note 1 includes two parts. Among them, the first part mainly talks about XXX." corresponding to speaker 1, and "The second part mainly talks about XXX." corresponding to speaker 2. In some possible scenarios, such as (1) in Figure 7, after the user converts the text information corresponding to speaker 1 on the electronic device, he turns off the voice-to-text function, then the electronic device will stop converting the voice information into text information, so the text information corresponding to speaker 2 will not be converted. In this case, the text information corresponding to speaker 2 and the speaker capsule corresponding to speaker 2 will not be displayed in area 13, as shown in the style of area 13 in (1) in Figure 7.

[0277] Continuing to refer to (1) in Figure 7, for example, when the user clicks the start play control 141b in the user interface 14, the electronic device will start playing the recorded voice clip in response to the operation, and at the same time, the start play control 141b in the recording bar 2 shown in (1) in Figure 7 will be replaced by the pause play control 141f shown in (2) in Figure 7, thereby obtaining a recording bar in state 3, such as the recording bar 3 shown in (2) in Figure 7.

[0278] Referring to (2) in FIG7 , for example, the recording bar 3 may further include other controls, such as a start recording control 141a, a play progress bar 141c, a recording play progress control 1411, a play time indicator 141d, and a voice menu control 141e. During playback of the recorded voice clip, the recording play progress control 1411 will continuously change with the playback progress, and the playback time displayed in the play time indicator 141d will also change accordingly. For example, when playing for 7 seconds, the recording play progress control 1411 may be located at the position in the user interface 15 shown in (2) in FIG7 , and the content displayed in the play time indicator 141d will also be updated from "00:00:00 / 00:01:05" shown in (1) in FIG7 to "00:00:07 / 00:01:05".

[0279] Continuing to refer to (2) in FIG7 , for example, since the speech-to-text function is not currently turned on, the text information displayed in area 13 will not change during the playback of the recorded speech segment (the speech duration is "00:01:05"). That is, only the text information corresponding to speaker 1, "Note 1 includes two parts. Among them, the first part mainly talks about XXX.", and the speaker capsule corresponding to speaker 1 are still displayed. In this case, when the user clicks on the text-to-text control 137a in the first state (the style shown in (2) in FIG7 ), the electronic device responds to the operation behavior, turns on the speech-to-text function, and updates the state of the text-to-text control 137a from the first state (the style shown in (2) in FIG7 ) to the second state (the style shown in (3) in FIG7 ). In this way, the electronic device can continue to perform speech-to-text processing and display the new text information converted according to the speech information, such as the text information corresponding to speaker 2, "The second part mainly talks about XXX.", and the speaker capsule corresponding to speaker 2, in area 13. That is, it is displayed after the text information corresponding to speaker 1, as shown in area 13 shown by (3) in FIG. 7 .

[0280] In addition, it should be noted that, in some possible cases, the content displayed in area 13 may be associated with the playback progress of the recording bar in area 11. That is, when the corresponding voice information is played, the content corresponding to the voice information is synchronously displayed in area 13.

[0281] It should also be noted that in other possible scenarios, when the speech-to-text function is enabled during playback, the entire recording can be directly converted into corresponding text information and displayed in area 13, along with the corresponding speaker capsule. When the corresponding voice message is played, the content displayed in area 13 is switched. This is the audio-text synchronization function mentioned below. The specific implementation can be seen in the description of Figure 26 and is not detailed here.

[0282] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment.

[0283] Continuing to refer to (3) in Figure 7, for example, in the user interface 15 shown in (3) in Figure 7, when the user clicks on the display speaker control 137b in the second state, the electronic device responds to the operation behavior and turns off the display speaker function. At the same time, the state of the display speaker control 137b will be updated from the second state (the style shown in (3) in Figure 7) to the first state (the style shown in (4) in Figure 7).

[0284] See (4) in Figure 7. For example, after the speaker display function is turned off, area 13 will no longer display the speaker screening capsule and the speaker capsules corresponding to speaker 1 and speaker 2. Instead, it will directly display the text information converted from the currently playing voice clip, such as "Note 1 includes two parts, among which the first part mainly talks about XXX. The second part mainly talks about XXX."

[0285] From the above description of Figures 4 to 7, it can be seen that the operation of displaying the speaker can occur during recording, after recording is completed, and at any stage of playing the recording, that is, the function of displaying the speaker in Function 1 can be implemented in all scenarios.

[0286] The following are the relevant contents involved in screening speakers:

[0287] Since the function of displaying speakers can be implemented in all scenarios, after the displaying speakers function is turned on, the filter speaker capsule will be displayed when the text information is displayed in area 13. Therefore, the function of filtering speakers can also be implemented in all scenarios.

[0288] Referring to Figure 8, for example, for the filter speaker capsule 137e displayed in area 13 in any scenario, when the user clicks the filter speaker capsule 137e, the electronic device responds to the operation and can pop up a filter speaker window 137g on the current user interface, such as the corresponding user interface 13b during recording, or the corresponding user interface 14 after the recording is completed, or the corresponding user interface 15 when playing the recording.

[0289] Exemplarily, the speaker filtering window 137g may include a selection control 137g-1 corresponding to the "All" option, a selection control 137g-1 corresponding to each currently identified speaker option (such as the selection control 137g-1 corresponding to speaker 1 in Figure 8, the selection control 137g-1 corresponding to speaker 2, etc.), as well as a "Cancel" option 137g-2 and an "OK" option 137g-3.

[0290] Among them, when the user clicks the "Cancel" option, the electronic device does not save the user's operations made in the speaker screening window 137g this time, continues to use the selection made when screening speakers last time, and closes the speaker screening window 137g.

[0291] Among them, when the user clicks the "OK" option, the electronic device will save the operation made by the user in the speaker screening window 137g this time. For example, when the last speaker screening was performed, all the identified speakers were selected, and this time only speaker 2 is selected, after clicking the "OK" option, the electronic device will close the speaker screening window 137g, and only the text information corresponding to speaker 2 will be displayed in area 13 (as shown in (4) in Figure 9).

[0292] Exemplarily, the user can also select multiple or all speakers through the speaker filtering window 137g. For example, after the user sets the display of only the text information corresponding to speaker 2 in the above manner, the user clicks the speaker filtering capsule again, and through the pop-up speaker filtering window 137g, the selection of speaker 1 is added, that is, while speaker 2 is kept selected, speaker 1 is also selected. After completing the selection of the designated speaker, after clicking the "OK" option, the electronic device closes the speaker filtering window 137g, and the speaker capsule and text information corresponding to speaker 1, as well as the speaker capsule and text information corresponding to speaker 2, are displayed in area 13 (as shown in (1) in Figure 9).

[0293] The specific changes in the user interface involved in this process are shown in FIG9 . For the specific implementation of this operation, please refer to the following description of FIG9 .

[0294] Among them, the selection control 137g-1 corresponding to the "All" option is selected, that is, in the style shown in Figure 8, the selection controls corresponding to all speakers displayed in the speaker screening window 137g will be selected by default. Correspondingly, when the user clicks the selection control 137g-1 corresponding to the "All" option again (in the selected state, the style shown in Figure 8), the electronic device will cancel the selection of the selection controls corresponding to all speakers in response to this operation behavior, that is, the status of all selection controls 137g-1 shown in the speaker screening window 137g will be updated from the selected state to the unselected state (as shown in Figure 9 (3) for the selection controls 137g-1 corresponding to the "All" option and the "Speaker 1" option).

[0295] It should be noted that in some possible cases, it can be set that after the display speaker function is turned on, all identified speakers are displayed by default. That is, in the filter speaker window 137g that pops up after clicking the filter speaker capsule 137e, the selection controls corresponding to all displayed speakers will be selected by default, as shown in Figure 8.

[0296] In order to facilitate the user to know whether the speaker has been filtered, in this embodiment, when the selection controls corresponding to all speakers are selected, the filter speaker capsule 137e is in state A, as shown in the style (1) in Figure 9. When the user reselects a speaker through the filter speaker window 137g, that is, when the selection controls corresponding to not all speakers are selected, the filter speaker capsule 137e will be in state B, as shown in the style (4) in Figure 9.

[0297] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. The styles given are also for ease of understanding, and the specific implementation is not limited to the form shown in this embodiment.

[0298] 9 , the following describes the contents related to speaker screening by taking the scenario where the user triggers the speaker screening capsule displayed in area 13 to implement the speaker screening function after the recording is completed as an example.

[0299] As shown in the user interface 14 of Figure 9 (1), in response to an operation (such as a click operation) on the filtering speaker capsule 137e in state A, the electronic device responds to the operation behavior and pops up a filtering speaker window 137g on the user interface 14, as shown in (2) of Figure 9.

[0300] For example, since the speech-to-text function is currently turned off, if the converted text information displayed in area 13 includes text information corresponding to Speaker 1 and Speaker 2, the speakers available for user selection displayed in the speaker filtering window 137g will include Speaker 1 and Speaker 2.

[0301] For example, if the user only wants to display the text information corresponding to speaker 2 in area 13, a feasible operation method is to first click the option control 137g-1 corresponding to the "All" option, so that the status of all selection controls 137g-1 shown in the speaker filtering window 137g can be updated from the selected state to the unselected state. At this time, click the selection control 137g-1 corresponding to speaker 2 to update the status of the selection control 137g-1 corresponding to speaker 2 from the unselected state to the selected state, as shown in the style (3) in Figure 9.

[0302] For example, another possible operation is to directly click the selection control 137g-1 corresponding to the selected Speaker 1. This will change the state of the selection control from selected to unselected. Simultaneously, the selection control corresponding to the "All" option will also automatically change from selected to unselected. This way, only the selection control 137g-1 corresponding to Speaker 2 will remain selected.

[0303] Exemplarily, when the user clicks the "OK" option in the speaker screening window 137g in the user interface 14 shown in Figure 9 (3), the electronic device will save the user's selection for speaker screening in response to the operation and close the speaker screening window 137g.

[0304] For example, after closing the speaker selection window 137g, the state of the speaker selection capsule 137e displayed in area 13 will be updated from state A to state B (as shown in bold black font in (4) in FIG9). Accordingly, after the speaker selection operation, if only speaker 2 is selected, the text information displayed in area 13 will only include the text information corresponding to speaker 2, and the speaker capsules displayed in area 13 will only include the speaker capsule corresponding to speaker 2 (such as speaker capsule 137f), as shown in (4) in FIG9.

[0305] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0306] This allows users to filter speakers, allowing them to quickly find the text messages corresponding to a specific speaker based on their needs. Furthermore, since the speaker capsule also displays the start time of each text message, users can quickly locate the voice message of the specific speaker.

[0307] In addition, it should be noted that, in some possible cases, the screening speaker capsule 137e displayed in area 13 can be set to a ceiling effect, that is, the screening speaker capsule 137e is always fixed at a specified position in area 13, such as the position shown in (1) in Figure 10. When the user slides upward in the direction of the arrow in area 13 shown in (1) in Figure 10, the screening speaker capsule 137e will not disappear with the sliding, such as (2) in Figure 10. In this way, the user can easily use the screening speaker capsule 137e to re-perform the operation of screening speakers at any time.

[0308] The following is the relevant content involved by the editor spokesperson:

[0309] Since the speaker display function can be implemented in all scenarios, when the speaker display function is enabled, the speaker capsule 137f corresponding to each identified text message will be displayed when the text message is displayed in area 13. Therefore, each speaker capsule 137f can also be clicked in all scenarios, but the response after clicking is different.

[0310] 11 , the following exemplary description is given of the responses made by the electronic device after the user clicks the speaker capsule 137 f during recording, after recording, and during playback of the recording.

[0311] Refer to (1) in Figure 11, which exemplifies a recording card during recording (hereinafter referred to as recording card 1). In order to avoid modifying the speaker-related information during recording, thereby affecting the speaker information corresponding to the text information subsequently converted. In this embodiment, it is set that when any speaker capsule 137f is clicked during recording, the electronic device does not respond. That is, after the user clicks any speaker capsule 137f, the current user interface will not pop up the rename window 137h shown in (3) in Figure 11, and the recording bar 1 in state 1 will not change. That is, the style of recording card 1 is still maintained.

[0312] Referring to FIG. 11 ( 2 ), a recording card (hereinafter referred to as recording card 2 ) is shown after the recording is completed. When the user clicks on any speaker capsule in recording card 2 , such as speaker capsule 137 f corresponding to speaker 1 , the electronic device responds to the operation by popping up a rename window 137 h as shown in FIG. 11 ( 3 ) in the current user interface, such as the aforementioned user interface 14 .

[0313] Referring to (3) in FIG11 , the rename window 137h may include a speaker editing area 137h-1. When the rename window 137h pops up, the speaker name assigned by the system by default, such as Speaker 1, is displayed in the speaker editing area 137h-1. When the user clicks on the speaker editing area 137h-1, the user can delete "Speaker 1" by using the delete option in the pop-up system keyboard and edit a new name for Speaker 1, such as "Zhang San".

[0314] Continuing with (3) in FIG11 , illustratively, the rename window 137h may further include a selection control 137h-2. When the selection control 137h-2 is selected, the name of the speaker 1 in all speaker capsules 137f corresponding to the speaker 1 displayed in the area 13 will be changed to "Zhang San".

[0315] Continuing to refer to (2) in FIG. 11 , illustratively, the rename window 137h may further include a “Cancel” option and an “OK” option.

[0316] When the user clicks the "Cancel" option, the electronic device responds to the operation by closing the rename window 137h, but does not save the operation performed by the user in the rename window 137h. In this case, the speaker name displayed in the speaker capsule corresponding to the speaker 1 displayed in area 13 of the recording card 2 is still "Speaker 1", not "Zhang San", as shown in the recording card 2 (2) in Figure 11.

[0317] When the user clicks the "OK" option, the electronic device responds to the operation by closing the rename window 137h and saving the operation made by the user in the rename window 137h. In this case, the speaker name displayed in the speaker capsule corresponding to the speaker 1 displayed in the area 13 of the recording card 2 will be updated to "Zhang San", as shown in the recording card 2 (4) in Figure 11.

[0318] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0319] Referring to (5) in FIG11 , an example of a recording card (hereinafter referred to as recording card 3) during the recording playback process is shown. When the user clicks on any speaker capsule in area 13, such as the speaker capsule 137f corresponding to "Zhang San", the electronic device will jump to the time point "00:00:10" in response to the operation. For example, when the time displayed in the play time indicator 141d is "00:00:27 / 00:01:05" and the recording playback progress control 1411 is at the position shown in (5) in FIG11 , when the user clicks on the speaker capsule 137f corresponding to "Zhang San", the electronic device will jump to the time point "00:00:07" in response to the operation. At this time, the time displayed in the play time indicator 141d will change to "00:00:07 / 00:01:05" and the recording playback progress control 1411 is at the position shown in (6) in FIG11 .

[0320] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0321] Therefore, by binding the spokesperson capsule to different scenarios, when the spokesperson capsule is clicked in different scenarios, the electronic device can make a response suitable for the current scenario, which is better suited to actual usage needs.

[0322] Based on Figures 12 to 20, the following describes the relevant contents involved in adding and deleting tags in the above function 2 by taking the three scenarios of recording, recording end and recording playback as examples.

[0323] The following are the relevant contents involved in adding tags:

[0324] For relevant content about adding labels (also called adding tags) during recording, please refer to the following exemplary description of Figures 12 and 13.

[0325] As shown in the recording card in FIG12 (1), during the recording of the voice message, the user can click the mark control 137c in the area 12 at any time.

[0326] Continuing to refer to (1) in Figure 12, for example, assuming that the user clicks the mark control 137c at the moment when the voice information is recorded at "00:00:05", the electronic device will respond to this operation by adding a label at the position corresponding to "00:00:05" on the recording status bar 136b, such as the label 136d-1 shown in (2) in Figure 12.

[0327] For example, when the user clicks the stop recording control 136a and continues to record the voice message, for example, at the moment of "00:00:11" shown in (2) of Figure 12, the user clicks the mark control 137c again. In response to this operation, the electronic device will add a label at the position corresponding to "00:00:11" on the recording status bar 136b, such as the label 136d-2 shown in (4) of Figure 12.

[0328] Therefore, during the recording, the user can click the mark control 137c at any time as needed, and then add a corresponding label at the specified location, so that the user can quickly locate the specified location based on the added label later.

[0329] In addition, it should be noted that the above description is merely an example for a better understanding of the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual applications, the corresponding recording card style during recording is not limited to that shown in Figure 12, that is, it is not limited to whether the speech-to-text function and the display speaker function are enabled. In other words, when the speech-to-text function or the display speaker function is not enabled, the user can also trigger the electronic device to add tags to the recording content according to the above method.

[0330] In addition, it should be noted that, in some possible cases, it can be set that after the recording status bar 136b or the designated area of ​​area 11 is clicked by the user, the electronic device responds to the operation behavior and jumps to the user interface 13c shown in (1) in Figure 13.

[0331] Referring to (1) in FIG13 , the user interface 13c may include one or more controls, for example. The one or more controls include, but are not limited to, a return control 138a for returning to the user interface where the recording card shown in FIG12 is located, a recording status bar 138b (corresponding to the recording status bar 136b), a recording progress control 138c indicating the current recording progress, a recording duration control 138d (corresponding to the recording duration 136c) displaying the current recording duration, a mark control 138e (corresponding to the mark control 137c), a stop recording control 138f (corresponding to the stop recording control 136a), and a pause recording control 138g.

[0332] For example, when the user clicks the stop recording control 138f or the stop recording control 136a, the electronic device will end the recording of the current recording segment in response to the operation. That is, after the user clicks the stop recording control 138f or the stop recording control 136a, if the user clicks the start recording control 141a (or the start recording control 142e shown in Figure 15) again, the electronic device will start recording a new recording segment in response to the operation.

[0333] Exemplarily, when the user clicks the pause recording control 138g, the electronic device, in response to the operation, pauses the recording of the current recording segment and switches the pause recording control 138g to a set restart recording mode (not shown in the figure). Exemplarily, when the user clicks the pause recording control 138g in the set restart recording mode, the electronic device, in response to the operation, continues recording the recording segment. That is, the voice information that is restarted still belongs to the recording segment, not a new recording segment.

[0334] In addition, it is understandable that during recording, when the user adds a tag through the tag control 137c or the tag control 138e, the user interface 13c can also include a tag detail control corresponding to each tag, such as the tag detail control 138h shown in (2) in Figure 13.

[0335] Referring to (2) in FIG. 13 , for example, the tag details control 138h may include the tag name of the corresponding tag (which may be named by default according to the order of addition) and the specific recording time corresponding to the tag.

[0336] For example, in some possible implementations, when a user clicks the tag details control 138h, a window for renaming the tag pops up, allowing the user to rename the tag name as needed. The window for renaming the tag and the related content of renaming the tag name are not described in detail in this embodiment of the application.

[0337] For details on adding tags after recording is completed, please refer to the following exemplary descriptions of Figures 14 and 15.

[0338] As shown in the recording card in (1) of FIG14 , after the recording is finished, the user can drag the recording playback progress control 1411 to the desired position as needed, and then click the mark control 137c to add a label at the time point corresponding to the current position of the recording playback progress control 1411. For example, when the user drags the recording playback progress control 1411 from the position shown in (1) of FIG4 to the position corresponding to the time "00:00:06 / 00:01:05" shown in (2) of FIG14 and clicks the mark control 137c, the electronic device responds to this operation and adds a label at the position corresponding to "00:00:06 / 00:01:05" on the playback progress bar 141c, such as the label 141 shown in (3) of FIG14 .

[0339] Therefore, after the recording is completed, the user can drag the recording playback progress control 1411 to the specified position of the playback progress bar 141c, and then click the mark control 137c to add a corresponding label at the specified position, so that the user can quickly locate the specified position according to the added label.

[0340] In addition, it should be noted that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual application, the recording card style corresponding to the recording period is not limited to that shown in Figure 14, that is, it is not limited to the voice-to-text function and the speaker display function being enabled.

[0341] In addition, it should be noted that, in some possible cases, it can be set that after the play progress bar 141c or the designated area of ​​area 11 is clicked by the user, the electronic device jumps to the user interface 14a shown in Figure 15 in response to the operation behavior.

[0342] 15 , the user interface 14a may include one or more controls, including but not limited to a return control 142a for returning to the user interface of the recording card shown in FIG14 , a name of the recording segment (such as “20230421_133449” shown in FIG15 , which may be generated based on a timestamp) 142b, added tags such as 143a-1, 143a-2, and 143a-3, a play time indicator 142c, a tag detail control 142d corresponding to each tag, a start play control 142e (corresponding to the start play control 141b), a speech-to-text conversion control 143a (corresponding to the speech-to-text conversion control 137a), an edit control 143b, a skip mute control 143c, a multiple play control 143d, a mark control 143e (corresponding to the mark control 137c), and the like.

[0343] Continuing to refer to FIG. 15 , illustratively, each tag detail control 142 d may include a tag name of the corresponding tag (which may be named by default according to the order of addition) and a specific recording time corresponding to the tag.

[0344] For example, in some possible implementations, when a user clicks the tag details control 142d, a window for renaming the tag pops up, allowing the user to rename the tag name as needed. The window for renaming the tag and the related content of renaming the tag name are not described in detail in this embodiment of the application.

[0345] In addition, it should be understood that the recording card shown in Figure 14 and the added labels displayed in the user interface 14a in Figure 15 include not only the labels added when the user clicks the mark control 137c after the recording is completed, but also the labels added when the user clicks the mark control 137c during the recording.

[0346] For details on adding tags during recording playback, please refer to the following exemplary description of FIG. 16 .

[0347] As shown in the recording card (1) in Figure 16, during the playback of the recording, the user can click the mark control 137c in area 12 at any time.

[0348] Continuing to refer to (1) in Figure 16, for example, assuming that the user clicks the mark control 137c when the voice information is played to "00:00:10", the electronic device will respond to this operation by adding a label at the position corresponding to "00:00:10" on the playback progress bar 141c, such as the label 141g-1 shown in (2) in Figure 16.

[0349] Therefore, during the playback of the recording, the user can click the mark control 137c at any time as needed, and then add a corresponding label at the specified position, so as to quickly locate the specified position according to the added label later.

[0350] In addition, it should be noted that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual application, the recording card style corresponding to the recording period is not limited to that shown in Figure 16, that is, it is not limited to the voice-to-text function and the speaker display function being enabled.

[0351] In addition, it should be noted that in some possible cases, during the playback of a recording, the user can also drag the recording playback progress control 1411 to a specified position of the playback progress bar 141c, and then click the mark control 137c to add a corresponding label at the specified position, so that the user can quickly locate the specified position based on the added label.

[0352] In addition, it should be noted that in some other possible cases, in order to avoid label redundancy, it can be set that no more labels are allowed to be added within a set time before and after each label, such as 5ms. That is, the time interval between any two adjacent labels is not less than 5ms.

[0353] In addition, it should be noted that the added labels displayed in the recording card shown in Figure 16 not only include the labels added when the user clicks the mark control 137c during the recording playback process, but also include the labels added when the user clicks the mark control 137c during the recording and after the recording is completed.

[0354] The following are the relevant contents involved in deleting tags:

[0355] Deletion method 1:

[0356] For example, in some possible situations, such as when in the user interface 13c shown in (2) in Figure 13 or the user interface 14a shown in Figure 15, the user can slide the tag detail control to the right to be deleted, and then display the tag deletion control for deleting the current tag in the current user interface.

[0357] Taking the user interface 14a shown in FIG15 as an example, if the user wants to delete tag 3, the user can slide the tag detail control 142d corresponding to tag 3 to the left. In response to this operation, the electronic device will display the tag deletion control 142f shown in FIG17.

[0358] For example, when the tag deletion control 142f corresponding to tag 3 is displayed in the user interface 14a, the user clicks the tag deletion control 142f. In response to the operation, the electronic device deletes tag 3 and deletes tag 143a-3 from the current recording. Thus, the specified tag is deleted.

[0359] Deletion method 2:

[0360] For example, in some other possible situations, the user can click the "More" control 137d in area 12 of the recording card corresponding to any scene (during recording, after recording is completed, during playback of recording), as shown in (1) in Figure 18.

[0361] Exemplarily, when the user clicks the "more" control 137d, the electronic device responds to the operation and may display the management window 139a shown in FIG18 (2) on the user interface shown in FIG18 (1).

[0362] For example, in some possible situations, such as when the above-mentioned functions 2, 3, and 4 are implemented, the management window 139a may include a radio settings entry 139a-1, a tag management entry 139a-2, and a sharing entry 139a-3. For details about the sharing entry 139a-3, please refer to the following descriptions of Figures 21 and 22, which will not be repeated here. For details about the radio settings entry 139a-1, please refer to the following descriptions of Figures 23 and 24, which will not be repeated here.

[0363] Referring to (2) in FIG. 18 , illustratively, when the user clicks on the tag management entry 139a - 2 , the electronic device may pop up a tag management window 139b as shown in (3) in FIG. 18 on the current user interface in response to the operation.

[0364] Referring to (3) in FIG. 18 , illustratively, the tag management window 139b may display the tag names of all tags included in the current recording segment, as well as the time corresponding to each tag, and a control for deleting the corresponding tag, such as the “×” shown in the figure.

[0365] Thus, the user can delete the tag from the tag management window 139b by clicking the "×" corresponding to each tag to be deleted. After completing this operation, if the user clicks the "OK" option shown in the tag management window 139b, the electronic device will respond to this operation and delete the tag just deleted in the recording segment, such as the tag corresponding to tag 3, as shown in 143a-3 in the above embodiment.

[0366] For example, if the user clicks the “×” corresponding to each tag to be deleted and does not click the “OK” option shown in the tag management window 139 b but clicks the “Cancel” option, the electronic device will not delete the tag corresponding to tag 3 .

[0367] In addition, it should be understood that in some possible situations, when the user clicks the "OK" option or the "Cancel" option shown in the tag management window 139b, the electronic device can close the tag management window 139b in response to the operation.

[0368] For example, in some possible situations, when a user clicks on any entry in management window 139a, the electronic device may respond by closing management window 139a. For example, when a user clicks on tag management entry 139a-2 and tag management window 139b pops up, management window 139a displayed on the current interface may be automatically canceled.

[0369] For example, in other possible situations, in order to facilitate the user to click the "Cancel" option in the tag management window 139b and then exit the tag management window 139b, and then select other entrances from the management window 139a again, such as the radio setting entrance 139a-1, or the sharing entrance 139a-3, it can be set that when the user clicks the tag management entrance 139a-2 and the tag management window 139b pops up, the management window 139a continues to be displayed on the current interface, but can be covered by the tag management window 139b.

[0370] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0371] Deletion method 3:

[0372] It can be seen from the above description of the corresponding recording cards after the recording is completed and during the playback of the recording that in the scenarios after the recording is completed and during the playback of the recording, the voice menu control 141e will be displayed in the area 11 of the recording card.

[0373] Take the corresponding recording card after the recording is completed, such as the recording card in the user interface 14 shown in (1) in Figure 19 as an example. For example, when the user clicks the voice menu control 141e, the electronic device can respond to the operation behavior and display the voice menu window 139c shown in (2) in Figure 19 in the user interface 14. The voice menu window 139c can be a slidable panel window, that is, the size of the window displayed in the user interface 14 is fixed, but the content displayed therein can be slidably displayed.

[0374] Referring to (2) in FIG. 19 , the voice menu window 139c may include one or more controls, for example. The one or more controls include, but are not limited to, a close control 139c-1 for closing the voice menu window 139c, an edit control 139c-2 for editing a recorded audio segment, a save control 139 for saving operations in the voice menu window 139c, a recording option for viewing the audio segments included in the long voice, a tag option for viewing tags, and the like.

[0375] For example, in some possible situations, after the voice menu window 139c is displayed, the recording option can be selected by default, that is, the voice menu window 139c displays the relevant information of all voice segments included in the long speech by default. For example, when the long speech includes four recording segments, the voice menu window 139c that pops up after the user clicks the voice menu control 141e can display the name of each recording segment included, such as recording 1 to recording 4, and the recording duration corresponding to each recording segment, as shown in (2) in Figure 19.

[0376] It should be noted that, for the four recording segments mentioned in the above embodiment, recording 1 can be, for example, the voice information between the position of the recording playback progress control 1411 shown in Figure 19 (1) and the recording segment mark 144a, recording 2 can be, for example, the voice information between the recording segment mark 144a and the recording segment mark 144b, recording 3 can be, for example, the voice information between the recording segment mark 144b and the recording segment mark 144c, and recording 4 can be, for example, the voice information between the recording segment 144c and the end time indicated by the playback time indicator.

[0377] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. For details about segmented recording, please refer to the following description of Figures 25A and 25B, which will not be repeated here.

[0378] Continuing to refer to (2) in Figure 19, illustratively, when the user clicks the tag option in the voice menu window 139c, the electronic device responds to the operation and switches the voice menu window 139c from the relevant information of the recording segment to the relevant information of the tag, as shown in (3) in Figure 19.

[0379] For example, in a long speech, recording 1 includes two labels, label 1 and label 2, recording 2 includes one label, label 3, recording 3 includes one label, label 4, and recording 4 does not include any label. The user can slide upward in the direction of the arrow in the voice menu window 139c shown in (3) of Figure 19 to slide and display the obscured related information about label 4.

[0380] Referring to (3) and (4) in FIG. 19 , illustratively, the tag information corresponding to each tag may include the tag name, the time point corresponding to the tag, and a delete control “×” for deleting the tag.

[0381] For example, the user can click the “×” corresponding to different labels in the voice menu window 139c shown in FIG. 19 (3) and FIG. 19 (4) as needed to delete the label.

[0382] Therefore, after the user selects the tag option, the tag information included is displayed under each recording segment, so that the user can easily know the relationship between each tag and each recording segment.

[0383] Deletion method 4:

[0384] Still taking the voice menu window 139c shown in (2) of Figure 19 as an example, for example, when the voice menu window 139c displays a recording segment of a long voice, when the user clicks the edit control 139c-2, the electronic device may display the user interface 16 shown in Figure 20 in response to the operation.

[0385] Referring to FIG20 , illustratively, since the user interface 16 is displayed by the user by clicking the voice menu control 141 displayed on the corresponding user interface 14 after the recording shown in FIG19 (1) is completed, and then the voice menu window 139c is swapped out, and then the editing control 139c-2 in the voice menu window 139c is swapped out, the user interface 16 includes controls corresponding to the recording bar 2 included in the area 11 of the recording card in the user interface 14, and each control in the recording bar 2 displayed in the user interface 16 corresponds to a control of the recording 2 displayed in the user interface 14.

[0386] Continuing to refer to FIG. 20 , illustratively, the user interface 16 will also display all the recording segments included in the current long speech, such as recordings 1 to 5 shown in FIG. 20 , a selection control 161 a for selecting each recording segment, and labels included in each recording segment.

[0387] Continuing to refer to FIG. 20 , illustratively, the label under each recording segment displayed in the user interface 16 includes the name of the label, the time point corresponding to the label, and a selection control 161 b for selecting the label.

[0388] Continuing to refer to Figure 20, illustratively, the user interface 16 may also include a sharing control for sharing the voice information of the recording segment selected by the user through the selection control 161a and / or the location of the tag selected by the user through the selection control 161b, a renaming control for triggering the renaming operation of the recording segment and tag, a delete control for deleting the recording segment selected by the user through the selection control 161a and / or the tag selected by the user through the selection control 161b, and a select all control for indicating the selection of all selection controls in the user interface 16.

[0389] For example, the user can move the cursor to the area to be renamed, such as the recording name or label name corresponding to a certain recording segment, and then click the rename control to modify and rename the content of the cursor area using the system keyboard. The specific implementation is not limited in this application.

[0390] Thus, the user can select the selection control 161b corresponding to any one or more tags to be deleted in the user interface 16, and then click the delete control to delete the selected tags. Alternatively, the user can directly select the selection control 161a corresponding to the recording segment containing the tag and then click the delete control to delete all tags included in the recording segment.

[0391] From the above description of the four deletion methods, it can be seen that by using any of the above methods of deleting tags, it is possible to delete the added tags in different scenarios through different entrances, thereby being better applicable to various usage scenarios.

[0392] Based on Figures 21 and 22, the following is an exemplary description of the relevant content involved in the shared notes in the above function 3.

[0393] Still taking the sharing entry integrated into the management window 139a as an example. Referring to Figure 21, illustratively, when the user clicks on the sharing entry 139a-3 in the management window 139a, the electronic device, in response to the operation, can update the sharing entry 139a-3 in the folded state (the style shown in (1) in Figure 21) to the expanded state (the style shown in (2) in Figure 21), and display the selectable sharing options under the sharing entry 139a-3 in the management window 139a, such as the "text" option, the "voice" option and the "text + voice" option shown in (2) in Figure 21. Among them, the sharing method corresponding to the "text" option is the sharing method 1 mentioned above, the sharing method corresponding to the "voice" option is the sharing method 2 mentioned above, and the sharing method corresponding to the "text + voice" option is the sharing method 3 mentioned above.

[0394] For example, when the user selects sharing mode 1, the electronic device uses the text information currently displayed in area 13 of the recording card as the shared content.

[0395] For example, when the user selects sharing mode 2, the electronic device will share all the voice information currently recorded in the recording card area 11, or the voice information corresponding to the text information displayed in area 13 as the sharing content.

[0396] For example, when the user selects sharing mode 3, the electronic device will use the text information currently displayed in area 13 of the recording card and the corresponding voice information / all voice information as the shared content.

[0397] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0398] For ease of explanation, this embodiment uses the example of sharing in the form of sharing method 11 as the default when the user selects sharing method 1. For example, when the user clicks the "Text" option in the management window 139a shown in Figure 21, the electronic device can respond to this operation by displaying the user interface 17 shown in Figure 22.

[0399] 22 , illustratively, the user interface 17 may display the textual content to be shared, as well as icons of applications to be shared that can be selected by the user.

[0400] It is understandable that the applications available for user selection mentioned here are specifically application programs currently installed on the electronic device, such as WeChat, Sina Weibo, email, etc. shown in Figure 22.

[0401] 22 , illustratively, a “Copy Text” control for copying the currently displayed text message may also be displayed in the user interface 17. Thus, by operating the “Copy Text” control, the user can copy the text message to be shared displayed in the user interface 17, and then paste the copied text message into a designated application for sharing.

[0402] Furthermore, it should be noted that sharing of voice-related content, such as the voice message itself and the corresponding text information, can be achieved in all scenarios. That is, as long as there is shareable text information in area 13 or a shareable voice message recorded in area 11, users can share the content of their notes in real time as needed in any scenario.

[0403] In addition, it should be understood that in this embodiment, the scenario in which the user shares the text information in area 13 is described with the display speaker function turned on, that is, the state of the display speaker control 137b is the second state (such as the style (3) in Figure 4). Therefore, the user interface 17 will not only display the text information converted from the voice information, but also the speaker information corresponding to each text information, such as the speaker name. If, in actual use, the user triggers the sharing operation with the display speaker function turned off, that is, the state of the display speaker control 137b is the first state (such as the style (2) in Figure 4), then the user interface 17 will only display the text information converted from the voice information, and will not display the speaker information corresponding to each text information.

[0404] The following is an exemplary description of the relevant contents related to the reception method in the above-mentioned function 4 based on Figures 23 and 24.

[0405] Entry 1:

[0406] Still taking the example of the radio setting entry integrated into the management window 139a. Referring to FIG23, illustratively, when the user clicks on the radio setting entry 139a-1 in the management window 139a, the electronic device, in response to the operation, can update the radio setting entry 139a-1 in the folded state (the style shown in (1) in FIG23) to the expanded state (the style shown in (2) in FIG23), and display the selectable radio setting options under the radio setting entry 139a-1 in the management window 139a, such as the "internal radio" option, the "external radio" option and the "internal + external radio" option shown in (2) in FIG23. Among them, the radio mode corresponding to the "internal radio" option is the radio mode 1 mentioned above, the radio mode corresponding to the "external radio" option is the radio mode 2 mentioned above, and the radio mode corresponding to the "internal + external radio" option is the radio mode 3 mentioned above.

[0407] Therefore, the user can click the "internal radio" option, the "external radio" option, or the "internal + external radio" option as needed to achieve flexible switching of the radio reception mode.

[0408] Entry 2:

[0409] Understandably, applications installed in electronic devices usually have their own settings interface. Therefore, in some possible cases, the radio settings entrance can be set in the settings interface corresponding to the note application. Referring to Figure 24, an example of the settings interface corresponding to the note application Honor Notes is shown. In this interface, the user can click on the radio mode option to display the radio modes available to the user, such as the radio mode 1, radio mode 2 and radio mode 3 mentioned above. In Figure 24, the currently set radio mode is external radio, that is, the radio mode 2 mentioned above is taken as an example.

[0410] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0411] In addition, it should be noted that the radio setting entries for setting the radio mode provided in the above-mentioned entry 1 and entry 2 are bound to each other, that is, the radio mode set through any entry is synchronized.

[0412] Furthermore, it should be noted that the radio mode settings can be implemented in all scenarios (during recording, after recording, and during playback). Therefore, by using any of the above radio settings, it is possible to dynamically switch between different radio modes in different scenarios (during recording, after recording, and during playback) through different entrances according to business needs, thereby better adapting to various usage scenarios.

[0413] The following is an exemplary description of the relevant content involved in the segmented recording in the above-mentioned function 5 based on Figures 25A and 25B.

[0414] As shown in (1) in FIG25A , user interface 13b is a user interface during recording. When recording for a duration of "00:01:01", if the user clicks the stop recording control 136a, the electronic device will stop recording the voice message in response to the operation. At this time, the style of the recording bar in area 11 of the recording card will be updated from the style shown in (1) in FIG25A (recording bar 1) to the style shown in (2) in FIG25A (recording bar 2).

[0415] Refer to (2) in Figure 25A. For example, since the user clicks the stop recording control 136a, the recording of the voice information of the current voice segment is completed. The duration of the voice file "00:01:01" displayed in the play time indicator 141d in the recording bar 2 is the recording duration of the recording segment when the recording is stopped in (1) in Figure 25A.

[0416] Continuing to refer to (2) in FIG. 25A , illustratively, when the user clicks the start recording control 141a shown in the user interface 14, the electronic device will start recording a new recording segment in response to the operation. At this time, the user interface 14 will be updated to the user interface 13b shown in (1) in FIG. 25B . The recording time of a newly started recording segment will continue from the end of the previous recording segment. For example, in FIG. 25A (1), when the recording of the first recording segment ends at "00:01:01", the recording start time of the second recording segment will be "00:01:02".

[0417] Refer to (1) in Figure 25B. For example, when the user records the second recording segment to "00:02:21", the user clicks the stop recording control 136a. In response to this operation, the electronic device will stop recording the voice information. At this time, the style of the recording bar in area 11 in the recording card will be updated from the style shown in (1) in Figure 25B (recording bar 1) to the style shown in (2) in Figure 25B (recording bar 2).

[0418] Refer to (2) in Figure 25B. For example, since the user clicks the stop recording control 136a, the recording of the voice information of the current voice segment is completed. The duration of the voice file "00:02:21" displayed in the play time indicator 141d in the recording bar 2 is the recording duration of the recording segment when the recording is stopped in (1) in Figure 25B.

[0419] For example, since the user starts from the user interface shown in (1) in FIG25A and ends at the user interface shown in (2) in FIG25B , the user records two audio segments. Therefore, the recording bar 2 shown in (2) in FIG25B also includes a node that divides the playback progress bar 141c into two segments, such as the recording segment mark 144a. The time after the “ / ” recorded in the playback time indicator 141d is the time sum of all the recording segments, and the time before the “ / ” is the time progress of the current playback.

[0420] In this way, segmented recording is achieved, avoiding the loss and damage of voice information due to abnormalities in directly recording long voices.

[0421] The following is an exemplary description of the relevant contents involved in the audio-text synchronization in the above-mentioned function 6 based on FIG. 26 .

[0422] As shown in (1) in FIG. 26 , in the recording card displayed in the user interface 14 , the user has turned on the speech-to-text function and the speaker display function, and the text information converted from the speech information and the corresponding speaker information are displayed in area 13 .

[0423] Exemplarily, when the user clicks the start play control 141b, the electronic device responds to the operation and starts playing the recorded voice information. At the same time, the recording bar displayed in area 11 will be updated from the style (1) in Figure 26 to the style (2) in Figure 26, for example, the start play control 141b is updated to the pause play control 141f.

[0424] Continuing to refer to (2) in FIG. 26 , for example, during the playback of a recording, as the voice information is played, the text information converted from the voice information displayed in area 13 on the recording card will change synchronously. Specifically, in some possible situations, the font of the text information corresponding to the unplayed voice information can be set to gray, as in the style of (1) in FIG. 26 . During the playback of the voice information, the font of the text information corresponding to the played voice information will be updated to black, as in (2) in FIG. 26 .

[0425] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0426] Therefore, during the playback of the recording, the voice information and text information are synchronized, making it easier for the user to know the current playback progress.

[0427] Based on the above functions, FIG27 shows an exemplary flowchart of the note processing method of this application.

[0428] In some possible cases, the exemplary process involved in recording notes by an electronic device can refer to the following description of steps S101 to S105.

[0429] S101, displaying a first interface of a first note in a note application, where the first interface includes a recording card, and the recording card includes a first area, a second area, and a third area.

[0430] S102, at a first moment, the first area includes a start recording control, a start playing control, and a first playing progress bar, the second area includes a text conversion control and a display speaker control, and the third area is empty; wherein, at the first moment, the display speaker control cannot interact with the user.

[0431] S103, at the second moment, in response to the user's operation of the text-to-text control, the first text information is displayed in the third area, and the first text information corresponds to the first voice information recorded by the playback progress bar; wherein, after the first text information is displayed in the third area, the speaker control is displayed to interact with the user.

[0432] S104. At a third moment, in response to the user's operation on the display speaker control, a filtered speaker capsule, a first speaker capsule, a second speaker capsule, and a first text message are displayed in a third area; wherein the first speaker capsule corresponds to the first text content in the first text message, the second speaker capsule corresponds to the second text content in the first text message, the first speaker capsule includes the first speaker name and the first speaking time, and the second speaker capsule includes the second speaker name and the second speaking time.

[0433] S105 , at a fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the screening speaker capsule, the screening speaker capsule, the first speaker capsule, and the first text content are displayed in the third area.

[0434] In some possible cases, the text conversion control is such as the text conversion control 137a involved in the aforementioned content, and the display speaker control is such as the display speaker control 137b involved in the aforementioned content.

[0435] The text conversion control at the first moment is, for example, the style of the text conversion control 137a shown in FIG3 (1), that is, the state mentioned above is the text conversion control in the first state; at the second moment, the state of the text conversion control after being clicked by the user is, for example, the second state mentioned above. Exemplarily, the text conversion control in the second state is, for example, the style of the text conversion control 137a shown in FIG3 (2).

[0436] The speaker control that is not interactive with the user and is displayed at the first moment is, for example, the speaker control in the third state mentioned above. For example, the speaker control in the third state is in the form of the speaker control 137b shown in FIG3 (1).

[0437] After the first text message is displayed in the third area, a display speaker control that can interact with the user is displayed, such as the display speaker control in the first state mentioned above. Exemplarily, the display speaker control in the first state is in the style of the display speaker control 137b shown in (2) of Figure 3.

[0438] At the third moment, in response to the user's operation on the display speaker control in the first state, the display speaker state may be switched to the second state mentioned above. For example, the display speaker control in the second state may be in the form of the display speaker control 137b shown in (3) of FIG. 3 .

[0439] Regarding the switching of the status of the text conversion control and the display speaker control, as well as their correlation, please refer to the description of Figure 3 in the following content, which will not be repeated here.

[0440] Furthermore, regarding the first speaker capsule mentioned above, for example, the speaker capsule corresponding to speaker 1 in the aforementioned embodiment, the first speaker name displayed in the speaker capsule is the name of speaker 1 in the aforementioned embodiment. The first speaker time is the time when the speaker utters the first text content (such as text message 1 above).

[0441] Accordingly, the second speaker capsule, such as the speaker capsule corresponding to speaker 2 in the aforementioned embodiment, displays the second speaker name in the speaker capsule, which is the name of speaker 2 in the aforementioned embodiment. The second speaker time is the time when the speaker speaks the second text content (such as text message 2 above).

[0442] Since the voice-to-text conversion and speaker display operations can be implemented in all scenarios (during recording, after recording, and during playback), the first interface can be an interface corresponding to different scenarios. For example, during recording, the first interface can be the user interface 13b mentioned below. For another example, after recording, the first interface can be the user interface 14 mentioned below. For another example, during playback, the first interface can be the user interface 15 mentioned below.

[0443] Therefore, when there is voice information in the notes, by introducing the display speaker function associated with the voice-to-text function, the speaker information corresponding to each converted text message can be displayed when the voice-to-text function is turned on, so that the user can quickly know the speaker of each text message in a scenario where multiple people are speaking.

[0444] For the relevant content about the obvious speaker involved in the note processing solution, please refer to the above description of Figures 4 to 7, which will not be repeated here.

[0445] In addition, in other possible cases, while implementing the above-mentioned voice-to-text function and speaker display function, you can also implement the functions of filtering speakers, editing speakers, adding tags, removing tags, sharing note content, setting the reception method, recording voice messages in segments, and playing audio and text synchronously. For the implementation of these functions, please refer to the descriptions of the above-mentioned functions 1 to 6, and will not be repeated here.

[0446] In order to better understand the technical solutions provided by the embodiments of the present application, the hardware structure of the electronic devices (such as mobile phones, tablet computers, touch-screen PCs, etc.) to which the embodiments of the present application are applicable is described below in conjunction with the accompanying drawings. For ease of explanation, FIG28 takes a mobile phone as an example for illustration.

[0447] 28 , the mobile phone 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0448] Among them, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor (Modem), a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc., which are not listed one by one here and are not limited in this application.

[0449] The controller as the processing unit mentioned above can be the nerve center and command center of the mobile phone 100. In actual applications, the controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of instruction fetching and execution.

[0450] Furthermore, it should be noted that regarding the processor 110 including the aforementioned processing units, in some implementations, the different processing units may be independent devices. That is, each processing unit may be considered a processor. In other implementations, the different processing units may be integrated into one or more processors. For example, in some implementations, the modem processor may be an independent device. In other implementations, the modem processor may be independent of the processor 110 and provided in the same device as the mobile communication module 150 or other functional modules.

[0451] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0452] In addition, the processor 110 may further include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc., which are not listed here one by one and are not limited in this application.

[0453] In addition, processor 110 may also include a memory for storing instructions and data. In some implementations, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces processor 110 latency, and thus improves system efficiency.

[0454] Continuing with FIG28 , the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored on the external memory card.

[0455] Continuing to refer to Figure 28, the internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, and the stereo recording function mentioned in the embodiment of the present application, etc.). The data storage area can store data created during the use of the mobile phone 100 (such as stereo audio data recorded based on the technical solution provided in the embodiment of the present application), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0456] Continuing with FIG28 , the charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging implementations, the charging management module 140 may receive charging input from the wired charger via the USB interface 130. In some wireless charging implementations, the charging management module 140 may receive wireless charging input via the wireless charging coil of the mobile phone 100. While charging the battery 142, the charging management module 140 may also power the electronic device via the power management module 141.

[0457] Continuing to refer to Figure 28, the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other implementations, the power management module 141 can also be set in the processor 110. In other implementations, the power management module 141 and the charging management module 140 can also be set in the same device.

[0458] Continuing to refer to FIG. 28 , the wireless communication function of the mobile phone 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor.

[0459] It should be noted that antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other implementations, the antennas can be used in conjunction with a tuning switch.

[0460] Continuing with FIG28 , the mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the mobile phone 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter, amplify, and perform other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some implementations, at least some of the functional modules of the mobile communication module 150 can be provided in the processor 110. In some implementations, at least some of the functional modules of the mobile communication module 150 can be provided in the same device as at least some of the modules of the processor 110.

[0461] Continuing to refer to Figure 28, the wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0462] 28 , the audio module 170 may include a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, etc. For example, the mobile phone 100 may implement audio functions, such as audio recording and video recording, through the application processor and the speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, etc. in the audio module 170.

[0463] In the process of implementing audio functions through the application processor and audio module 170, the audio module 170 can be used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some implementations, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110.

[0464] Continuing to refer to Figure 28, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are not listed here one by one and are not limited in this application.

[0465] Continuing with FIG28 , buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The mobile phone 100 may receive key inputs and generate key signal inputs related to user settings and function control of the mobile phone 100.

[0466] 28 , the motor 191 can generate a vibration prompt. The motor 191 can be used for an incoming call vibration prompt or for touch vibration feedback.

[0467] Continuing to refer to FIG. 28 , the indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, and the like.

[0468] Continuing to refer to Figure 28, the camera 193 is used to capture still images or videos. The mobile phone 100 can implement the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor. Specifically, the object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some implementations, the mobile phone 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0469] Continuing with FIG28 , the display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. In some implementations, the mobile phone 100 may include one or N display screens 194 , where N is a positive integer greater than 1. The mobile phone 100 may implement display functions using a GPU, the display screen 194 , and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0470] This concludes the introduction to the hardware structure of the mobile phone 100. It should be understood that the mobile phone 100 shown in FIG28 is merely an example. In a specific implementation, the mobile phone 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in FIG28 may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0471] 28 , the software structure of the electronic device 100 is described below. Before describing the software structure of the electronic device 100 , the architecture that the software system of the electronic device 100 can adopt is first described.

[0472] Specifically, in actual applications, the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0473] In addition, it is understandable that the software systems used by current mainstream electronic devices include but are not limited to Windows systems, Android systems, and iOS systems. For ease of explanation, the embodiment of the present application takes the layered architecture Android system as an example to exemplify the software structure of the electronic device 100.

[0474] In addition, the note processing solution provided in the subsequent embodiments of this application is also applicable to other systems in specific implementations.

[0475] See Figure 29, which is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0476] As shown in Figure 29, the layered architecture of electronic device 100 divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0477] The application layer can include a series of application packages. As shown in Figure 29, the application package can include applications such as notes, settings, and WIFI. These applications are not listed here one by one, and this application does not limit this. Specifically in the embodiment of this application, the note processing method is implemented after the user starts the note application.

[0478] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. In some implementations, these programming interfaces and programming frameworks can be described as functions. As shown in Figure 29, the application framework layer may include functions such as content providers, resource managers, and window managers. These functions are not listed here and are not limited to these functions in this application.

[0479] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc., which are not listed here and are not limited by this application.

[0480] The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, etc., which are not listed here one by one and are not limited in this application.

[0481] The notification manager enables applications to display notification information in the status bar, which can be used to convey informational messages and disappear automatically after a short stay without user interaction.

[0482] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for scheduling and management of the Android system.

[0483] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0484] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0485] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL).

[0486] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0487] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0488] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0489] It can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0490] In addition, it is understandable that the kernel layer in the Android system is the layer between hardware and software. The kernel layer includes at least display drivers, audio drivers, sensor drivers, etc. For example, the audio driver can drive the audio module to realize the recording and playback of voice information.

[0491] This concludes the introduction to the software structure of the electronic device 100. It should be understood that the layers in the software structure shown in FIG29 and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, and this application does not limit this.

[0492] In addition, it is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0493] In addition, it should be noted that the note processing methods provided in the above embodiments implemented by electronic devices in actual application scenarios can also be performed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to a memory so that when the chip system is running, it calls the computer program stored in the memory to implement the steps performed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0494] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the note processing method in the above-mentioned embodiment.

[0495] In addition, an embodiment of the present application also provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the note processing method in the above-mentioned embodiment.

[0496] In addition, an embodiment of the present application also provides a chip (which can also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the note processing method in the above-mentioned embodiment to control the receiving pin to receive signals, so as to control the sending pin to send signals.

[0497] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0498] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A note processing method, characterized in that: Used in electronic equipment, including: Display a first interface of a first note in the note application, wherein the first interface includes a recording card, and the recording card includes a first area, a second area, and a third area; At a first moment, the first area includes a start recording control, a start playing control, and a first playing progress bar, the second area includes a text conversion control and a display speaker control, and the third area is empty; wherein, at the first moment, the display speaker control cannot interact with the user; At a second moment, in response to the user's operation on the text conversion control, first text information is displayed in the third area, and the first text information corresponds to the first voice information recorded by the first playback progress bar; wherein after the first text information is displayed in the third area, the display speaker control can interact with the user; At a third moment, in response to the user's operation on the display speaker control, a filter speaker capsule, a first speaker capsule, a second speaker capsule, and the first text information are displayed in the third area; wherein the first speaker capsule corresponds to the first text content in the first text information, the second speaker capsule corresponds to the second text content in the first text information, the first speaker capsule includes the first speaker name and the first speaking time, and the second speaker capsule includes the second speaker name and the second speaking time; At a fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the speaker selection capsule, displaying the speaker selection capsule, the first speaker capsule, and the first text content in the third area; The fourth moment is later than the third moment, the third moment is later than the second moment, the second moment is later than the first moment, and the second speaker time is later than the first speaker time.

2. The method according to claim 1, characterized in that The method of, at the fourth moment, after detecting that the user selects the first speaker from the first speaker and the second speaker through the speaker selection capsule, displaying the speaker selection capsule, the first speaker capsule, and the first text content in the third area includes: At the fourth moment, in response to the user's operation on the speaker screening capsule, a speaker screening window is displayed on the first interface, wherein the speaker screening window includes the first speaker and the second speaker; In response to a user selecting the first speaker in the speaker screening window, the speaker screening window is closed; and the speaker screening capsule, the first speaker capsule and the first text content are displayed in the third area.

3. The method according to claim 1, characterized in that Before the fourth moment, the screening speaker capsule displayed in the third area is in a first style, and the screening speaker capsule in the first style is used to indicate that all the speakers available for screening are selected; After the fourth moment, the screening speaker capsule displayed in the third area is in a second style, and the second style of the screening speaker capsule is used to indicate that some of the speakers available for screening are selected.

4. The method according to claim 1, characterized in that Displaying the screening spokesperson capsule, the first spokesperson capsule, the second spokesperson capsule, and the first text information in the third area includes: At the top of the third area, displaying the screening spokesperson capsule; Displaying the first speaker capsule at a position below the display speaker capsule; Displaying the first text content below the first speaker capsule; Displaying the second speaker capsule below the first text content; The second text content is displayed below the second speaker capsule.

5. The method according to claim 4, characterized in that The method further comprises: At a fifth moment, in response to a user sliding operation from the bottom of the third area to the top of the third area, the screening spokesperson capsule is displayed at the top of the third area; and the first text content is displayed below the display spokesperson capsule; the second spokesperson capsule is displayed below the first text content; and the second text content is displayed below the second spokesperson capsule; At a sixth moment, in response to a user sliding operation from the bottom of the third area to the top of the third area, the screening spokesperson capsule is displayed at the top of the third area; and the second spokesperson capsule is displayed below the display spokesperson capsule; and the second text content is displayed below the second spokesperson capsule; The sixth moment is later than the fifth moment.

6. The method according to claim 1, characterized in that At the first moment, the text-to-text control displayed in the second area is in a first state, and the display speaker control is in a third state, the first state indicates that the function corresponding to the control is not enabled, and the third state indicates that the control cannot interact with the user; wherein the text-to-text control in the first state indicates that the speech-to-text function is not enabled, and the display speaker control in the third state indicates that the display speaker control cannot interact with the user; At the second moment, in response to the user's operation on the text-to-text control, the electronic device updates the state of the text-to-text control from the first state to the second state, and updates the state of the display speaker control from the third state to the first state, wherein the second state indicates that a function corresponding to the control is turned on, the text-to-text control in the second state indicates that a speech-to-text function is turned on, and the display speaker control in the first state indicates that a display speaker function is not turned on; wherein, when the speech-to-text function is turned on, the electronic device may perform a text-to-text operation on the first voice information; At the third moment, in response to the user's operation on the display speaker control, the electronic device updates the state of the display speaker control from the first state to the second state, and the display speaker control in the second state indicates that the display speaker function is turned on.

7. The method according to claim 6, characterized in that When the text conversion control is in the second state and the display speaker control is in the second state, the method further includes: At a seventh moment, in response to a user operation on the text conversion control in the second state, the state of the text conversion control is updated from the second state to the first state; and the screening speaker capsule, the first speaker, the first text content, the second speaker, and the second text content are still displayed in the third area; At the eighth moment, in response to the user's operation on the start recording control, the start recording control and the start playing control are replaced with a stop recording control, a second voice message is recorded, and the first playing progress bar is replaced with the The recording status bar corresponding to the second voice information; and the screening speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area; Among them, the eighth moment is later than the seventh moment.

8. The method according to claim 7, characterized in that After the screening spokesperson capsule, the first spokesperson, the first text content, the second spokesperson, and the second text content are still displayed in the third area, the method further includes: At a ninth moment, in response to an operation on the stop recording control, the stop recording control is replaced with the start recording control, the start playing control, and the second playing progress bar, the second area includes the text conversion control in the first state and the display speaker control in the second state, and the third area displays the screening speaker capsule, the first speaker, the first text content, the second speaker, and the second text content; At the tenth moment, in response to the user's operation on the start play control, the start play control is replaced with a pause play control, and the second voice information recorded by the second play progress bar is played; and the screening speaker capsule, the first speaker, the first text content, the second speaker and the second text content are still displayed in the third area; At the eleventh moment, in response to the user's operation on the text conversion control in the first state, the state of the text conversion control is updated from the first state to the second state, and the screening speaker capsule, the first speaker capsule, the first text content, the second speaker, the second text content, the third speaker capsule, and the second text information are displayed in the third area, the second text information corresponds to the second voice information recorded in the recording status bar, the third speaker capsule corresponds to the second text information, and the third speaker capsule includes the name of the third speaker and the third speaking time; Among them, the eleventh moment is later than the tenth moment, the tenth moment is later than the ninth moment, and the ninth moment is later than the eighth moment.

9. The method according to claim 6, characterized in that When the text conversion control is in the second state and the display speaker control is in the second state, the method further includes: At the ninth moment, in response to the user's operation of the start recording control, the start recording control and the start playing control are replaced with the stop recording control, the second voice message is recorded, and the first playback progress bar is replaced with the recording status bar corresponding to the second voice message; and the filtered spokesperson capsule, the first spokesperson capsule, the first text content, the second spokesperson, the second text content, the third spokesperson capsule and the second text message are displayed in the third area, the second text information corresponds to the second voice message recorded in the recording status bar, the third spokesperson capsule corresponds to the second text information, and the third spokesperson capsule includes the third spokesperson name and the third speaking time.

10. The method according to claim 6, characterized in that After displaying the screening spokesperson capsule, the first spokesperson capsule, and the first text content in the third area, the method further includes: In response to a user operation on the display speaker control in the second state, the state of the display speaker control is updated from the second state to the first state; and the first text content is displayed in the third area, and the filter speaker capsule and the first speaker capsule are not displayed.

11. The method according to any one of claims 1 to 10, characterized in that: After displaying any speaker capsule in the third area, the method further includes: In the process of displaying the stop recording control in the first area, not responding to the user's operation on any speaker capsule displayed in the third area; In the process of displaying the start recording control and the start playing control in the first area, in response to a user's operation on any speaker capsule in the third area, displaying a rename window corresponding to the operated speaker capsule on the first interface; During the process of displaying the start recording control and the pause playback control in the first area, in response to the user's operation on any speaker capsule in the third area, the recording playback progress control in the first playback progress bar is moved to a target position, and the time corresponding to the target position is the speech time displayed in the operated speaker capsule.

12. The method according to claim 11, characterized in that After displaying a rename window corresponding to the operated spokesperson capsule on the first interface, the method further includes: In response to a renaming operation performed by the user in the renaming window, the renaming window is closed, and the speaker name displayed in the speaker capsule is updated to a name named based on the renaming window.

13. The method according to any one of claims 1 to 10, characterized in that: The second area also includes a tag control, and the tag control is used to add a tag to the recorded voice information.

14. The method according to claim 13, characterized in that The method further comprises: During the process of displaying the stop recording control in the first area, in response to the user's operation of the mark control, a label is added to the recording status bar corresponding to the recorded voice information, and the added label is displayed at the corresponding time position in the recording status bar displayed in the first area.

15. The method according to claim 13, characterized in that The method further comprises: In the process of displaying the start recording control and the start playing control in the first area, in response to a user dragging operation on the recording playing progress control in the first playing progress bar, the recording playing progress control is moved to a first position corresponding to a first playing time point; In response to a user operation on the mark control, adding a first label at the first position; In response to a user dragging operation on the recording playback progress control, the recording playback progress control is moved to a second position corresponding to a second playback time point, and a time difference between the first playback time point and the second playback time point is not less than a set time threshold; In response to a user operation on the mark control, a second label is added at the second position.

16. The method according to claim 13, characterized in that The method further comprises: During the process of displaying the start recording control and the pause playback control in the first area, in response to the user's operation on the mark control, a label is added to the playback time currently corresponding to the first playback progress bar.

17. The method according to claim 16, characterized in that The method further comprises: In the process of displaying the start recording control and the pause playback control in the first area, in response to a user dragging operation on the recording playback progress control in the first playback progress bar, moving the recording playback progress control to a third position corresponding to a third playback time point; In response to a user's operation on the mark control, adding a third label at the third position; The voice information continues to be played from the third position.

18. The method according to any one of claims 1 to 10, characterized in that Displaying the start recording control and the start playing control in the first area, or in the process of displaying the start recording control and the pause playing control in the first area, the first area also displays a voice menu control; The method further comprises: In response to a user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a label option; In response to the user's operation on the tag option, displaying all the audio recording segments included in the first note in the voice menu window, and displaying all the tags included in each audio recording segment; In response to a user's deletion operation on any label displayed in the voice menu window, the label is deleted.

19. The method according to any one of claims 1 to 10, characterized in that: The second area also includes a tag control, and the tag control is used to add a tag to the recorded voice information; the start recording control and the start playing control are displayed in the first area, or in the process of displaying the start recording control and the pause playing control in the first area, the first area also displays a voice menu control; The method further comprises: In response to a user's operation on the voice menu control, displaying a voice menu window on the first interface, the voice menu window including a recording option and a label option; In response to a user's operation on the recording option, displaying all recorded audio segments included in the first note and editing controls in the voice menu window; In response to the user's operation on the editing control, displaying a second interface corresponding to the first note, the second interface displaying all the audio clips included in the first note, and displaying all the tags included in each audio clip under each audio clip; In response to a user's deletion operation on any label displayed in the second interface, the label is deleted.

20. The method according to claim 19, characterized in that The method further comprises: In response to a user's deletion operation on any recording segment displayed in the second interface, the recording segment and all tags included in the recording segment are deleted.

21. The method according to any one of claims 1 to 10, characterized in that The second area also includes a first control; The method further comprises: In response to an operation on the first control, a management window is displayed on the first interface, wherein a sharing entrance is displayed in the management window; When the third area includes the filtered spokesperson capsule, the first spokesperson capsule, the second spokesperson capsule, and the first text message, after detecting the user's operation on the sharing portal, the name of the first note, the name of the first spokesperson displayed in the first spokesperson capsule, the name of the second spokesperson displayed in the second spokesperson capsule, and the sent first text message are shared to the first application in text form; When the third area includes the filtered spokesperson capsule, the first spokesperson capsule, and the first text content, after detecting the user's operation on the sharing entrance, the name of the first note, the first spokesperson name displayed in the first spokesperson capsule, and the first text content are shared to the first application in text form.

22. The method according to claim 21, characterized in that After detecting the user's operation on the sharing portal, sharing the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, and the sent first text message to the first application in text form, including: After detecting the user's operation on the sharing entrance, displaying the sharing method in the management window, the sharing method includes a first sharing method, a second sharing method, and a third sharing method; When detecting that the user has selected the first sharing method, displaying the third interface; and displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the sent first text message, and the first application in the third interface; In response to the user's operation on the first application, the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content are shared to the first application in text form.

23. The method according to claim 22, characterized in that The method further comprises: When detecting that the user selects the second sharing mode, displaying the third interface; and displaying the first voice information corresponding to the first text information and the first application in the third interface; In response to the user's operation on the first application, the first voice information is shared with the first application in the form of voice.

24. The method according to claim 22, characterized in that The method further comprises: When detecting that the user has selected the third sharing method, displaying the third interface; and displaying the name of the first note, the name of the first speaker displayed in the first speaker capsule, the name of the second speaker displayed in the second speaker capsule, the sent first text message, the first voice message corresponding to the first text message, and the first application in the third interface; In response to the user's operation on the first application, the name of the first note, the name of the first speaker displayed in the first speaker capsule, and the first text content are shared to the first application in text form; and the first voice information is shared to the first application in voice form.

25. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the note processing method as described in any one of claims 1 to 24.

26. A computer-readable storage medium, characterized in that: It comprises a computer program, which, when executed on an electronic device, enables the electronic device to execute the note processing method as claimed in any one of claims 1 to 24.

Images