Information processing method and electronic equipment

Abstract

The embodiment of the invention provides an information processing method and electronic equipment. The method can be used for the electronic equipment to generate the note, record the information in the note and process the recorded information. The related information includes but is not limited to voice information, text information or picture information and the like. The related information processing includes but is not limited to one or more of the following contents: recording information, viewing information and management information. Wherein the record information comprises input information, and processing based on the input information and taking the processing result as the content in the note. For example, input voice information is converted into character information, and the input character information is edited or marked. Management information may also include deletion information, transmission (sharing) information, and the like.

Description

Information processing method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 4, 2022, with application number 202211379551.4 and application name “Information Processing Method and Electronic Device”, the entire contents of which are incorporated by reference in this application.

[0002] The present application relates to the field of terminal technology, and in particular to an information processing method and an electronic device.

[0003] As the functions of electronic devices are gradually improved, more and more electronic devices can record and save information. For example, the "Memo" application can record and save input text information. In this way, users can use electronic devices to record information instead of relying on traditional paper recording methods, which improves the efficiency of information recording.

[0004] The electronic device can integrate the user's recorded information into a text, and such a text can also be called a note. At present, the information recorded by the user through the electronic device can include text information, picture information, etc.

[0005]

[0006] The present application provides an information processing method and electronic device, which can record voice while recording non-voice information, and convert the recorded voice into text for recording at the same time, and can also turn off the voice-to-text function, thereby improving the efficiency of recording information and the flexibility of voice-to-text conversion.

[0007] In a first aspect, the present application provides an information processing method, which includes: an electronic device displays a first interface, the first interface includes a first area, a second area and a first control in a first state; at a first moment, when the electronic device displays the second control and the first control in the first state, the electronic device records a first voice and displays text obtained by converting the first voice in the first area; the second control is used to indicate that recording is in progress, and the first control in the first state is used to indicate that the recorded voice is converted into text during recording; when the electronic device displays the second control and the first control in the first state, it receives first information input by a user and displays the first information in the second area; in response to an operation on the first control in the first state, when the second control is displayed, the electronic device switches the state of the first control to the second state, stops converting the recorded voice into text, and the first control in the second state is used to indicate pausing the conversion of the recorded voice into text; the electronic device records the first voice, the text obtained by converting the first voice and the first information into a first file.

[0008] In the above embodiment, the first area may be area 1 involved in the embodiment, the second area may be area 2 involved in the embodiment, the first control may be a conversion control involved in the embodiment, the conversion control in the first state may be a conversion control in state C, and the conversion control in the second state may be a conversion control in state D. The second control may be a pause recording control involved in the embodiment, and the first voice may be the voice recorded for the first time involved in the embodiment.

[0009] The electronic device can support voice-to-text while recording, and accept other information (such as text, pictures, etc.) input by the user, and display the other information in the second area. In addition, it is possible to switch between turning on the voice-to-text function and turning off the voice-to-text function. That is, while recording, the voice-to-text function can be turned on to convert the recording into text information, and the converted text information is displayed in the first area. In this way, when the voice-to-text function is turned on, it is possible to accept other information input by the user while recording. The voice-to-text function can also be turned off, and the recorded voice can be converted into text information while recording. In this way, when the voice-to-text function is turned off, it is possible to accept other information input by the user while recording. Among them, the other information can also be called non-recording information. The efficiency of recording information and the flexibility of voice-to-text are improved.

[0010] In combination with the first aspect, in some embodiments, the first area includes a first sub-area and a second sub-area, the first sub-area is used to display the second control; the second sub-area is used to display the text obtained by voice conversion; when the electronic device displays the second control, the method also includes: in response to the operation on the second control, the electronic device replaces the second control with a third control; the third control is used to instruct the electronic device to end recording the voice; after ending the voice recording, when the electronic device has not obtained the text obtained by the voice conversion, the first area does not include the second sub-area.

[0011] In the above embodiment, the first area can be divided into two sub-areas, wherein the first sub-area can be the area 11 involved in the embodiment, and the second sub-area can be the area 12 involved in the embodiment. The first sub-area can be used to display content related to the recording process, such as controls related to recording, etc. The second sub-area can display speech-to-text content.

[0012] If the text converted from speech is not displayed in the second sub-area, the second sub-area can be closed and not displayed when the speech recording is paused, so that the user interface can be simplified.

[0013] In combination with the first aspect, in some embodiments, the method also includes: when playing the first voice, the electronic device displays a progress bar, which is used to indicate the progress of playing the voice; when the first identifier is displayed at the first position of the progress bar, the electronic device displays the first information in a third state, and displays the second information in the second area in a fourth state; wherein the first identifier is used at the first position to indicate that the electronic device is playing the voice recorded at the first moment; the input time of the second information is a second moment, and the second moment is later than the first moment.

[0014] In the above embodiment, the progress bar may be the play progress bar involved in the embodiment, the first mark may be the mark 1411 involved in the embodiment, the first position may be the position corresponding to the currently played audio on the play progress bar, and the third state is different from the fourth state. For example, in the embodiment, the third state may be not adding a mask layer, and the fourth state may be adding a mask layer. The second information may be the non-recording information involved in the embodiment.

[0015] The electronic device can achieve audio-text synchronization during the process of playing voice. No mask is added to non-recording information that is recorded in the note earlier than the currently played voice. A mask is added to non-recording information that is recorded in the note later than the currently played voice, so that it is displayed separately to remind the user that the non-recording information with the mask has not been recorded in the note when the currently played voice is recorded in the note.

[0016] In combination with the first aspect, in some embodiments, when the first mark is displayed at the first position of the progress bar, the method further includes: the electronic device displays text converted from the voice recorded at the first moment in the first area.

[0017] In the above embodiment, the electronic device can also achieve audio-text synchronization based on the speech-to-text content in the first area, that is, the text information converted from the voice being played can be displayed in the first area for user preview.

[0018] In combination with the first aspect, in some embodiments, after displaying the second information in the second area in the fourth state, the method further includes: in response to an operation on a fourth control, the electronic device displays the second information in the third state.

[0019] In the above embodiment, the fourth control may be a control for stopping the note playback animation involved in the embodiment, for example, it may include: note reply animation setting item 381 and stop note playback animation control 351. The electronic device may turn off the audio-text synchronization function through the fourth control, providing the user with more options.

[0020] In combination with the first aspect, in some embodiments, when a first identifier is displayed at a first position of the progress bar, the method further includes: in response to a first operation on a second position in the progress bar, the electronic device displays third information in the second area in a fifth state; wherein the input time of the third information is a third moment, and the voice recorded by the electronic device at the third moment is indicated at the second position.

[0021] In the above embodiment, an example of the second position may be the position T involved in the embodiment, and the fifth state may be the highlighting involved in the embodiment. The electronic device can also realize advance preview during the voice playback process. When a certain position on the progress bar is long pressed, the text inputted at the same time can be highlighted when the voice corresponding to the position is input, so as to facilitate user preview.

[0022] In combination with the first aspect, in some embodiments, the method also includes: when Q segments of speech are recorded after the first file is established, the electronic device displays Q-1 nodes in the progress bar; the Q-1 nodes divide the progress bar into Q sub-progress bars; the i-th sub-progress bar in the Q sub-progress bars is used to indicate the i-th segment of speech in the Q segments of speech; Q is an integer greater than or equal to 2; after detecting an operation on the fifth control, when the first identifier is in the i-th sub-progress bar, the electronic device plays the i-th segment of speech.

[0023] In the above embodiment, the fifth control may be the start play control involved in the embodiment. The electronic device may record multiple segments of voice information (voice) separately, and make the multiple segments of voice information into a long voice, and the multiple segments of voice may be played continuously when the long voice is played. Q segments of voice means that the electronic device has made Q recordings. After a recording starts, the electronic device may collect sound signals. After the recording ends, a segment of voice information may be obtained based on the collected sound signals. That is, the electronic device may record at different times (separate Q time periods) to obtain Q segments of voice. Then, the electronic device may integrate the Q segments of voice to obtain a long voice. In this way, when playing a long voice, the Q segments of voice recorded separately may be played continuously.

[0024] In combination with the first aspect, in some embodiments, the method also includes: the electronic device selects L segments of speech from Q segments of speech; L is an integer less than or equal to Q; when the sixth control is in the sixth state, in response to the operation of the seventh control, the electronic device deletes the L segments of speech, and deletes the text converted from the L segments of speech; when the sixth control is not in the sixth state, in response to the operation of the seventh control, the electronic device deletes the L segments of speech, and retains the text converted from the L segments of speech.

[0025] In the above embodiment, the sixth control may be the selection control 581b involved in the embodiment, and the seventh control may be the deletion control 581c involved in the embodiment. The electronic device may provide a function of whether to delete the text converted from the voice when deleting the voice, so that the user can have multiple choices when deleting the voice.

[0026] In combination with the first aspect, in some embodiments, the method also includes: when the eighth control is in the eighth state, in response to the operation of the ninth control, the electronic device transmits the content in the second area and the text converted from the Q-segment speech to other devices; when the eighth control is not in the eighth state, in response to the operation of the ninth control, the electronic device transmits the content in the second area to other devices.

[0027] In the above embodiment, the eighth control may be a selection control involved in the embodiment (e.g., selection control 521b), and the ninth control may be a sharing control involved in the embodiment (e.g., sharing control). The electronic device may provide a function of whether to share text converted from voice in the note when sharing non-recording information recorded in the note, so that the user can have multiple choices when sharing information.

[0028] In combination with the first aspect, in some embodiments, receiving first input information specifically includes: the electronic device displays a first input tool in the first interface; the electronic device receives the first input information through the first input tool; the method also includes: when displaying the first input tool, also displaying a tenth control; in response to an operation on the tenth control, the electronic device switches the first input tool to a second input tool; when displaying the second input tool, also displaying an eleventh control; the eleventh control is used to trigger switching from the second input tool to the first input tool.

[0029] In the above embodiment, the first input tool may be the keyboard involved in the embodiment, the tenth control may be the handwriting control involved in the embodiment, the second input tool may be the stylus toolbar involved in the embodiment, and the eleventh control may be the keyboard switching control involved in the embodiment. The electronic device may enable the keyboard to be quickly switched to the stylus toolbar based on the tenth control. The switching from the stylus toolbar to the keyboard may also be implemented based on the eleventh control. In this way, it is convenient for users to use different input tools to input non-recording information.

[0030] In combination with the first aspect, in some embodiments, the method further includes: in response to an operation on a twelfth control; the electronic device changes the size of the second sub-area from the first size to the second size.

[0031] In the above embodiment, the twelfth control may be an expansion control or a collapse control involved in the embodiment. The electronic device may make the size of the second sub-area adjustable to provide more choices for the user.

[0032] In a second aspect, the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method described in the first aspect or any one of the embodiments of the first aspect.

[0033] In the above embodiment, the electronic device can support voice-to-text while recording, and accept other information (such as text, pictures, etc.) input by the user, and display the other information in the second area. In addition, it is possible to switch between turning on the voice-to-text function and turning off the voice-to-text function. That is, while recording, the voice-to-text function can be turned on to convert the recording into text information, and the converted text information is displayed in the first area. In this way, when the voice-to-text function is turned on, it is possible to accept other information input by the user while recording. The voice-to-text function can also be turned off, and the recorded voice can be converted into text information while recording. In this way, when the voice-to-text function is turned off, it is possible to accept other information input by the user while recording. Among them, the other information can also be called non-recording information. The efficiency of recording information and the flexibility of voice-to-text are improved.

[0034] In a third aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, which are used to call computer instructions so that the electronic device executes the method described in the first aspect or any one of the embodiments of the first aspect.

[0035] In the above embodiment, the electronic device can support voice-to-text while recording, and accept other information (such as text, pictures, etc.) input by the user, and display the other information in the second area. In addition, it is possible to switch between turning on the voice-to-text function and turning off the voice-to-text function. That is, while recording, the voice-to-text function can be turned on to convert the recording into text information, and the converted text information is displayed in the first area. In this way, when the voice-to-text function is turned on, it is possible to accept other information input by the user while recording. The voice-to-text function can also be turned off, and the recorded voice can be converted into text information while recording. In this way, when the voice-to-text function is turned off, it is possible to accept other information input by the user while recording. Among them, the other information can also be called non-recording information. The efficiency of recording information and the flexibility of voice-to-text are improved.

[0036] In a fourth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0037] In the above embodiment, the electronic device can support voice-to-text while recording, and accept other information (such as text, pictures, etc.) input by the user, and display the other information in the second area. In addition, it is possible to switch between turning on the voice-to-text function and turning off the voice-to-text function. That is, while recording, the voice-to-text function can be turned on to convert the recording into text information, and the converted text information is displayed in the first area. In this way, when the voice-to-text function is turned on, it is possible to accept other information input by the user while recording. The voice-to-text function can also be turned off, and the recorded voice can be converted into text information while recording. In this way, when the voice-to-text function is turned off, it is possible to accept other information input by the user while recording. Among them, the other information can also be called non-recording information. The efficiency of recording information and the flexibility of voice-to-text are improved.

[0038] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute the method described in the first aspect or any one of the implementations of the first aspect.

[0039] In the above embodiment, the electronic device can support voice-to-text while recording, and accept other information (such as text, pictures, etc.) input by the user, and display the other information in the second area. In addition, it is possible to switch between turning on the voice-to-text function and turning off the voice-to-text function. That is, while recording, the voice-to-text function can be turned on to convert the recording into text information, and the converted text information is displayed in the first area. In this way, when the voice-to-text function is turned on, it is possible to accept other information input by the user while recording. The voice-to-text function can also be turned off, and the recorded voice can be converted into text information while recording. In this way, when the voice-to-text function is turned off, it is possible to accept other information input by the user while recording. Among them, the other information can also be called non-recording information. The efficiency of recording information and the flexibility of voice-to-text are improved.

[0040] 1A and 1B show an exemplary user interface for creating a new note on an electronic device;

[0041] 2-7 illustrate a first recording and an exemplary user interface involved therein;

[0042] FIG8 shows an exemplary user interface involved in editing speech-to-text content after the first recording is completed;

[0043] 9-12 show a second recording and an exemplary user interface involved therein;

[0044] 13-17 illustrate a set of exemplary user interfaces involved in viewing information;

[0045] 18-24 are a set of exemplary user interfaces involved in deleting information in an electronic device;

[0046] 25-26, 27A-27B and 28-29 are a set of exemplary user interfaces involved in sharing information by an electronic device;

[0047] FIG30 is a flowchart of an exemplary information processing method in the present application;

[0048] FIG31 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0049] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.

[0050] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0051] In one solution, the electronic device can record voice information by recording. While recording, it can also receive other information input by the user, such as one or more of text information (hereinafter referred to as text), picture information (hereinafter referred to as picture), etc.

[0052] However, in this way of recording information, while the electronic device supports inputting other information while recording, it does not support converting the recording into corresponding text information at the same time.

[0053] In an embodiment of the present application, an information processing method is provided. The information processing method can be used to generate notes in an electronic device. The information involved here includes but is not limited to voice information, text information or picture information, etc. The information processing involved includes but is not limited to one or more of the following: recording information, viewing information and managing information. Among them, the recorded information includes input information, and processing based on the input information and using the processing results as the content in the notes. For example, converting the input voice information into text information, editing or marking the input text information, etc. Management information may also include deleting information, transmitting (sharing) information, etc.

[0054] By implementing the information processing method, the electronic device can realize one or more of the following functions, but is not limited to the following functions.

[0055] Function 1. When recording information, the electronic device can support voice-to-text while recording, and accept other information (such as text, pictures, etc.) input by the user. In addition, you can switch between turning on the voice-to-text function and turning off the voice-to-text function. That is, while recording, you can turn on the voice-to-text function to convert the recording into text information. In this way, when the voice-to-text function is turned on, it is possible to accept other information input by the user while recording. You can also turn off the voice-to-text function, and the recorded voice can be converted into text information while recording. In this way, when the voice-to-text function is turned off, it is possible to accept other information input by the user while recording. Among them, this other information can also be called non-recording information.

[0056] Function 2. When recording information, the electronic device can record multiple segments of voice information (voice) separately, and make the multiple segments of voice information into a long voice, so that the multiple segments of voice can be played continuously when the long voice is played. Q segments of voice means that the electronic device has made Q recordings. After a recording starts, the electronic device can collect sound signals. After the recording ends, a segment of voice information can be obtained based on the collected sound signals. That is, the electronic device can record at different times (Q separate time periods) to obtain Q segments of voice. Then, the electronic device can integrate the Q segments of voice to obtain a long voice. In this way, when playing a long voice, the Q segments of voice recorded separately can be played continuously. Wherein, Q is an integer greater than or equal to 2.

[0057] In some possible cases, after the Q-th recording stops, the electronic device can display the playback progress bar corresponding to the long voice. The playback progress bar includes Q-1 nodes, and the playback progress bar is divided into Q segments (which can be called Q segment sub-progress bars). Among them, the i-th sub-progress bar in the Q segment sub-progress bar corresponds to the i-th voice. The length of the i-th sub-progress in the playback progress bar is proportional to the ratio of the total duration of the i-th voice segment to the total duration of the long voice: the larger the ratio of the total duration of the i-th voice segment to the total duration of the long voice, the greater the proportion of the i-th voice segment in the long voice, and the longer the length of the i-th sub-progress bar in the playback progress bar.

[0058] It should be understood that the long speech involved here means that the speech includes more content than any of the multiple voice messages and can be regarded as a collection of the multiple voice messages. It does not mean that the long speech is long. The total duration of the long speech is not limited in the embodiment of the present application.

[0059] It should also be understood that in the process of recording information to generate notes, in addition to function 1 and function 2, other functions are also included. Function 1 and function 2 can make electronic devices more convenient to record information. For the relevant content in the scenario of recording information, please refer to the following description of Figures 1A, 1B, and Figures 3-12, which will not be repeated here.

[0060] Function 3. When viewing information, the electronic device can achieve audio-text synchronization when playing a recording. Audio-text synchronization includes: when playing a recording, the non-recorded information corresponding to the played voice is displayed in state A (recorded as information A), and the non-recorded information corresponding to the unplayed voice is displayed in state B (recorded as information B). Here, information A and information B are described by taking the electronic device playing voice A (recording time is time A) as an example:

[0061] It should be understood that the time A may indicate a moment or a time range.

[0062] In the case where time A indicates a moment, information A refers to information inputted at a time earlier than or equal to time A. Information B refers to information inputted at a time later than time A.

[0063] In the case where time A indicates a time range, information A refers to information inputted earlier than the start time of time A, or inputted earlier than the end time of time A. Information B refers to information inputted later than the end time of time A.

[0064] The time A may also be referred to as the timestamp corresponding to the voice A. The input time of the information A may be referred to as the timestamp corresponding to the information A. The input time of the information B may be referred to as the timestamp corresponding to the information B.

[0065] It should be understood that when viewing information, in addition to function 3, other functions are also included. Function 3 allows users to view information more conveniently through electronic devices. For the relevant content in the scenario of viewing information, please refer to the following description of Figures 14 to 17, which will not be repeated here.

[0066] Function 4. When managing information, the electronic device can delete information, share information, etc. Among them, deleting information includes: choosing to delete part or all of the voice information recorded in a note. For example, you can choose to delete the voice information. When deleting the voice information, you can also determine whether to delete the text information corresponding to the selected voice information according to user needs. Sharing information includes: transmitting the content to be shared in the note to other terminals, and you can choose the sharing method. In some possible cases, the content to be shared includes: other content in the note except voice information, or, including other content in the note except voice information and text information converted from the voice information. In addition, the user can choose through the electronic device whether to use the text information converted from the voice information as part of the content to be shared.

[0067] The sharing methods include but are not limited to one or more of the following sharing methods:

[0068] Sharing method 1. Convert the content to be shared in the note into a picture, and then transfer it to other devices in the form of a picture.

[0069] Sharing method 2. Convert the content to be shared in the note into a document and then transfer it to other devices in the form of a document.

[0070] Sharing method 3: Transfer the content to be shared in the note to other terminals in the form of notes.

[0071] For relevant content in the management information scenario, please refer to the following description of Figures 18-29, which will not be repeated here.

[0072] First, the relevant contents involved in the record information are described.

[0073] A set of exemplary user interfaces involved in recording information are described in FIG. 1A , FIG. 1B , and FIG. 3 - FIG. 12 .

[0074] Here we take the example of recording two voice clips in one note, and converting voice to text and entering other information during the two recordings.

[0075] The content related to the electronic device creating a new note can refer to the following description of Figures 1A and 1B. The first recording and its related content can refer to the following description of Figures 4-7. After the first recording is completed, the content related to the electronic device recording information can refer to the following description of Figure 8. The second recording and its related content can refer to the following description of Figures 9-12.

[0076] The following is an exemplary description of the relevant contents of creating a new note on an electronic device based on FIG. 1A and FIG. 1B .

[0077] Referring to the user interface 10 shown in (1) of FIG1A , in response to an operation (e.g., a click operation) on a note-taking application (e.g., Honor Note 101), the electronic device may open the note-taking application. At this time, the electronic device may display a user interface 11a as shown in (2) of FIG1A .

[0078] As shown in (2) of FIG. 1A , user interface 11a is an exemplary user interface involved in creating a new note. The user interface 11a may include a control 111 corresponding to viewing all notes. In response to an operation on the control 111, the electronic device may display the user interface 11b shown in (3) of FIG. 1A below.

[0079] The user interface 11b may include a control 1131, which may trigger the electronic device to display the folder involved in saving the note.

[0080] In response to the operation on the control 1131, the electronic device can display all folders, wherein all folders include folders created by the user through the electronic device (for example, collectively referred to as new folders), and also include default folders in the system. Any non-empty folder may include at least one file, each of which may be referred to as a note. Empty folders do not include files. For example, as shown in the user interface 11c shown in (4) of reference FIG. 1A, the new folder may include folder 1, and the default folder may be independent of the new folder. In response to the operation on the icon 112 corresponding to folder 1, the electronic device may display all notes included in file 1. For example, at this time, the electronic device may display the user interface 11d shown in (1) of FIG. 1B described below.

[0081] As shown in (1) of FIG. 1B , the user interface 11d includes the notes involved in the file 1, including Note A and Note B.

[0082] The user interfaces 11a and 11c may also include a new control 113, which may be used to trigger a new note. In response to a user operation (eg, a click operation) on the new control 113 in the user interface 11c, the new note created by the electronic device belongs to the currently opened folder, here, to file 1.

[0083] It should be understood that in the user interface 11a shown in FIG. 1A (2), since no folder is currently opened but all notes are displayed, in response to the user's operation (e.g., click operation) on the new control 113 in the user interface 11a, the newly created note of the electronic device does not belong to the folder created by the user through the electronic device, but to the default folder included in the system. Subsequently, the user can set the newly created note to other folders.

[0084] In response to the operation on the new creation control 113, the electronic device can create a new note. At this time, the electronic device can display the user interface shown in (2) in Figure 1B.

[0085] As shown in (2) of FIG1B , the user interface 12 is an initialization interface involved after creating a new note. In response to an operation on the title input control 121, the electronic device can set the name of the new note. For example, the new note is named Note 1.

[0086] It should be understood that the method of creating a new note shown in Figure 1A and Figure 1B is an exemplary description. In actual applications, the process of creating a new note may involve more or fewer interfaces and controls, which should not constitute a limitation on the embodiments of the present application.

[0087] The following is an exemplary description of the first recording and its related contents based on FIG. 2 to FIG. 7 .

[0088] The aforementioned Note 1 has not recorded any information input by the user. After the electronic device enters Note 1, the recording function can be triggered through the recording control. After the recording function is turned on, the electronic device can divide the user interface into two areas (area 1 and area 2). Area 1 is used to present content related to recording, and area 1 can also be referred to as the recording area. Area 2 is used to present other information input by the user (such as text, pictures, etc.). The other information can be referred to as non-recording information, and area 2 can also be referred to as an editing area.

[0089] The recording area (area 1) may further include two sub-areas: a voice recording area (recorded as area 11) and a voice-to-text area (recorded as area 12). The relevant descriptions of area 11 and area 12 are as follows.

[0090] The voice recording and broadcasting area (area 11) may include functional controls involved in recording and broadcasting (recording or playing) voice, such as a recording bar. The recording bar can be used to trigger functions such as recording voice, pausing recording voice, playing voice, and pausing playing voice. The recording bar has different states, and the recording bar in different states is composed of different components. The state of the recording bar is different, and the function of the recording bar is different. For details, please refer to the description of the relevant content below, which will not be repeated here.

[0091] The speech-to-text area (area 12) may include speech-to-text content and may also include a conversion control. The conversion control is a control provided by the electronic device to control the speech-to-text function to be turned on or off. The speech-to-text content includes text converted from the recorded speech.

[0092] It should be understood that the functional controls involved in recording or playing voice in the aforementioned area 11 may include other controls besides the recording bar, such as conversion controls, etc. This embodiment of the present application does not limit this.

[0093] It should be understood that, here, the area 11 and the area 12 are displayed in one area (area 1) as an example for description, and in other possible situations, the area 11 and the area 12 can be separated.

[0094] The editing area (area 2) is used to present other information (non-recording information) input by the user, such as text, pictures, etc. The electronic device can provide an input tool for inputting information. Among them, the input tool can include a keyboard and a stylus tool bar.

[0095] In some possible cases, the electronic device may display an input tool in a user interface, and when the input tool is displayed, a shortcut control for switching to other input tools may be provided.

[0096] In this way, in some possible cases, when the electronic device is recording, the user can view the recording status through the recording bar in area 11. While recording, the electronic device can also convert speech to text, and display the converted text in area 12 for the user to view. While recording, the user can also manually input through the input tool, and the input information is displayed in area 2 for the user to view. Manual input includes inputting text, inserting pictures, etc.

[0097] For relevant contents about area 1, area 2 and different input tools, please refer to the following exemplary description of FIG. 2 .

[0098] As shown in (1) of FIG2 , user interface 13 is an exemplary user interface displayed after the electronic device enters the note. At this time, the input tool provided by the electronic device by default is the keyboard. For example, a keyboard 131 may be displayed in user interface 13. When the keyboard is displayed, the electronic device may also display a note toolbar (e.g., note toolbar 132).

[0099] The note toolbar can provide an entry for convenient functions (such as a recording function) when the user records information. The note toolbar 132 may include an insert control 132a, a recording control 132b, and a "handwriting" control 132c. Among them, the insert control 132a can be used to trigger the input of information such as pictures and videos into the user interface 13 for display. The recording control 132b can be used to trigger the start of the recording function. The "handwriting" control 132c can be used to trigger the switching of the input tool from the keyboard 131 to the stylus toolbar. In addition to the insert control 132a, the recording control 132b and the "handwriting" control 132c, the note toolbar may also include other controls, for example, it may also include a list creation control 132d and a style setting control 132e.

[0100] The user interface 13 may also include an editing area 133, which may be used to display non-recording information input by the user. For example, the user may input text information into the editing area 133 for display through the keyboard 131, or may insert pictures and other information into the editing area 133 for display through the insert control 132a.

[0101] In response to an operation on the "handwriting" control 132c (e.g., a click operation), the electronic device switches the input tool from the keyboard 131 to the stylus toolbar. As shown in (2) of FIG. 2 , the stylus toolbar may be the stylus toolbar 134 displayed in the user interface 13a. The stylus toolbar 134 may include different styluses, such as stylus 134a-stylus 134f. The stylus can be used to make marks in the editing area, for example, to add an underline, draw a circle, etc. The user interface 13a may also include a keyboard switching control 135. The keyboard switching control 135 can be used to trigger the electronic device to switch the input tool from the stylus toolbar to the keyboard.

[0102] In some possible cases, the keyboard switch control 135 can be used as a shortcut control in the stylus toolbar 134 .

[0103] In response to an operation (e.g., a click operation) on the recording control 132b in state A1, the electronic device can turn on the recording function, and divide the aforementioned area 1 and area 2 in the user interface. At this time, the electronic device can switch the state of the recording control 132b from state A1 to state B1. The recording control 132b in state B1 can indicate that the recording function is turned on, and the recording control 132b in state A1 can indicate that the recording function is not turned on. The state of the recording control 132b in the aforementioned user interface 13 is state A1, and state B1 is another state different from state A1. As shown in (3) in Figure 2, the recording control 132b in the user interface 13b is grayed out, that is, the grayed-out state is a state B1. In response to an operation (e.g., a click operation) on the recording control 132b in state B1, the electronic device can turn off the recording function, and update the state of the recording control 132b from state B1 to state A1.

[0104] Referring to the user interface 13b shown in (3) of FIG. 2 , when the state of the recording control 132b is state B1, the electronic device may divide the user interface into area 1 and area 2, where it can be understood that area 2 is a new editing area.

[0105] The area 1 can be divided into an area 11 and an area 12 .

[0106] The area 11 may include a recording bar in state 1 (also referred to as recording bar 1), and the recording bar 1 may include a pause recording control 136a, a recording status bar 136b, and a recording duration 136c corresponding to the recording of the voice, and the recording duration 136c may be the total duration of all the recorded voices. The pause recording control 136a is used to indicate that the current terminal has started recording. The recording status bar 136b can reflect the energy of the sound signal collected by the electronic device. The greater the energy, the greater the change in the recording status bar 136b. The smaller the energy, the smaller the degree of change in the recording status bar 136b. The recording duration 136c can be used to indicate the total duration of all the recorded voices.

[0107] The area 12 may include a conversion control 137a in state C, and the conversion control 137a in state C may be represented by a solid line. The conversion control 137a in state C may indicate that the electronic device has turned on the speech-to-text function. Area 12 does not display the text information obtained by speech-to-text conversion, and when the speech-to-text function is turned on, the electronic device may also display a prompt message 137b, which may be used to prompt that the electronic device has turned on the speech-to-text function. For example, the prompt message 137b may be a prompt text: "Speech-to-text conversion in progress". When the speech-to-text function is turned on, the electronic device may process the collected sound signal to obtain speech, and convert the speech, and display the converted text in area 12.

[0108] In some other possible cases, the recording duration 136c may not be used to indicate the total duration of all recorded speech, but may be used to indicate the total duration of the speech being recorded.

[0109] Area 2 is used to present input non-recording information, such as text, pictures, etc. When non-recording information is not displayed in area 2, a prompt message 138a may be displayed, and the prompt message 138a may be used to remind the user that recording is in progress and information may be input in area 2 at the same time. The prompt message 138a may be a text prompt: "Recording is in progress, you may write or doodle in the blank space".

[0110] When recording starts and the voice-to-text function is turned on, the electronic device can also perform voice-to-text conversion while recording, and display the converted text in area 12 for the user to view. While recording, the user can also perform manual input through an input tool, and display the input information in area 2 for the user to view. Manual input includes inputting text, inserting pictures, etc. As shown in the user interface 13c of (4) in Figure 2, after recording starts, the electronic device can collect sound signals from the user or the environment, and convert the sound signal into speech, the content of which is: "The note includes two parts". At the same time, the speech can be converted into text and displayed in area 12, and non-voice information input by the user can be received. For example, the non-voice information can be input into area 2 by the user through the keyboard 131 or the tool in the stylus toolbar 134 for display. The non-voice information can include text information input into area 2 and information 139, which is: "Content".

[0111] The electronic device can also be set to turn off the voice-to-text function. In this way, after starting recording, the recorded voice can be not converted into text information, but non-recording information input by the user can be accepted during recording.

[0112] For details on how to disable the speech-to-text function, please refer to the following exemplary description of FIG. 3 .

[0113] As shown in the user interface 13b of FIG. 3 (1), in response to an operation (e.g., a click operation) on the conversion control 137a (state C), the electronic device can turn off the speech-to-text function, and update the state of the conversion control 137a from state C to state D, which is different from state C. In the case where the prompt information 137b is displayed in the area 12, it indicates that the electronic device has not obtained the speech-to-text content. At this time, in response to an operation (e.g., a click operation) on the conversion control 137 (state C), the electronic device may no longer display the prompt information 137b, but display the prompt information 141. The prompt information 141 is used to notify the user that the speech-to-text function is turned off.

[0114] As shown in (2) in FIG. 3 , user interface 14a is an exemplary user interface involved in turning off the voice-to-text function. A prompt message 141 may be displayed in area 12 to indicate that the electronic device has turned off the voice-to-text function. For example, the prompt content of the prompt message may be: "Voice-to-text has been paused". At this time, the conversion control 137a (state D) may be represented by a dotted line. In some possible cases, state D may be represented in other forms besides being represented by a solid line, such as changing color, graying out, etc., which is not limited in the embodiments of the present application.

[0115] In some embodiments, after the recording function is turned on, but in the case of pausing recording, if area 12 does not include text obtained by voice-to-text conversion, the electronic device may no longer display area 12. At this time, area 1 may only include area 11. For example, in user interface 14a, in response to an operation on the pause recording control 136a, the electronic device may pause recording and display user interface 14b shown in (3) in FIG. 3. State 2 is the state in which the recording function is turned on but the recording is paused.

[0116] As shown in (3) of FIG. 3 , user interface 14b is an exemplary user interface involved after pausing recording. At this time, area 1 only includes recording bar 2. In some possible cases, the recording bar 2 may include a start recording control 141a, a start playing control 141b, a play progress bar 141c, a play time indicator 141d, and a voice menu control 141e. Among them, the start recording control 141a can be used to trigger the electronic device to start recording again. The start playing control 141b can be used to trigger the electronic device to play the recorded voice. The play progress bar 141c can be used to indicate the progress of the currently played voice. The play time indicator 141d is used to indicate the current play time and the total duration of all voices. The voice menu control 141e is used to trigger the electronic device to display and manage all recorded voices, which include all voices recorded in note 1. When all the voices recorded in note 1 are Q (an integer greater than or equal to 2) segments of voice, the electronic device can integrate the Q segments of voice into a long voice, and the total duration of the Q segments of voice is the total duration of the long voice. At this time, the play progress bar 141c may also include Q-1 nodes, dividing the play progress bar 141c into Q segments (which may be referred to as Q segment sub-progress bars). Among them, the i-th segment sub-progress bar in the Q segment sub-progress bar corresponds to the i-th segment of speech. For the description of the nodes and their related contents, please refer to the following description of (4) in Figure 12. It will not be repeated here.

[0117] It should be understood that the play progress bar 141c can be used to indicate the progress of the current voice playback: the play progress bar 141c can include an identifier 1411, and the identifier 1411 is at position A1 of the play progress bar 141c, indicating that the voice corresponding to the playback position A1 is played.

[0118] It should be understood here that, in the user interface 14a shown in FIG. 3 (2), the operation for pausing the recording control 136a is responded to, so that the recording of the voice can be paused. The purpose of displaying the user interface 14b shown in FIG. 3 (3) is to indicate that the recording process can be paused. When the voice-converted text is not displayed in the area 12 during the pause, the area 12 can be closed. Actually, in the embodiment of the present application, the process of recording the voice for the first time is not ended here. A possible display method includes: after displaying the user interface 14a shown in FIG. 3 (2), the user does not operate the control 136a in the user interface 14a, so the electronic device continues to record and displays the user interface 14c shown in FIG. 3 (4).

[0119] In some possible cases, when the electronic device is recording the i-th segment of speech among Q segments of speech, the starting recording duration corresponding to the i-th segment of recording may be the ending recording duration of the i-1th segment of speech, or the ending recording duration of the i-1th segment of speech + 1. Then the time displayed corresponding to the recording duration 136c when the electronic device completes recording the Q-th segment of speech is the total duration of the Q segments of speech. For example, referring to (3) in FIG. 3 and (4) in FIG. 3 , as shown in the user interface 14b of (3) in FIG. 3 , the ending recording duration corresponding to the speech recorded by the electronic device is 2s. When the start recording control 141a is clicked to record the next segment of speech, the starting recording duration indicated in the recording duration 136c shown in (4) in FIG. 3 is 3s, or it may be 2s. The embodiments of the present application are not limited to this.

[0120] In some other possible cases, when the electronic device is recording the i-th segment of speech among Q segments of speech, the starting recording duration corresponding to the i-th segment of recording may start from 0 seconds. In this case, the recording duration 136c may not be used to indicate the total duration of all recorded speech. It may be used to indicate the total duration of the segment of speech being recorded.

[0121] It should be understood that when all the voices recorded in Note 1 are one segment, the playback progress bar 141c does not include a node. For example, as shown in the user interface 14b of (3) in FIG3 : Since only the first segment of voice has been recorded at this time, the playback progress bar 141c does not include a node at this time.

[0122] It should also be understood that the recording bar 2 shown in (3) in Figure 3 is only an exemplary illustration. In actual applications, the recording bar 2 may also include more or fewer components, and the shapes of the components may be the same as or different from those shown in the figure. The embodiments of the present application are not limited to this.

[0123] In response to an operation (eg, a click operation) on the start recording control 141a, the electronic device may be triggered to record a new voice, and the area 1 may be divided into area 11 and area 12. At this time, the electronic device may display a user interface as shown in (4) in FIG. 3 .

[0124] As shown in (4) of FIG3 , user interface 14c is an exemplary user interface involved in recording a new speech by an electronic device. User interface 14c may include area 1, which includes two sub-areas (area 11 and area 12). At this time, area 11 may include a recording bar (recording bar 1) in state 1, which is used to prompt the user that the current electronic device is recording a speech.

[0125] In some possible cases, if the speech-to-text function of the electronic device is turned off before the operation of the start recording control 141a is detected, then after the operation of the start recording control 141a is detected, the speech-to-text function of the electronic device is still turned off. For example, in the user interface 14c, when the electronic device starts recording a new voice, the conversion control in area 12 is in a dotted state (a state D), indicating that the speech-to-text function is turned off. If area 12 does not include text obtained by voice conversion, the electronic device can also display prompt information 141 to prompt the user that the speech-to-text function is turned off. In response to an operation (such as a click operation) on the conversion control 137a in state D, the electronic device can turn on the speech-to-text function.

[0126] In some possible cases, the size of the speech-to-text area (area 12) can be adjusted, and the size of the area 12 can be switched between size 1 and size 2, wherein size 1 is smaller than size 2. Moreover, the speech-to-text area supports sliding display. The text obtained by the latest recorded speech conversion can be displayed at the end of all the text in area 12. The maximum number of complete characters that can be displayed in the speech-to-text area is W. When W characters are displayed in the speech-to-text area, for every E new characters added, E original characters (already displayed) can be not displayed or cannot be fully displayed in the speech-to-text area. Among them, W is an integer greater than or equal to 1, and E is an integer less than or equal to W. When the size of the speech-to-text area is size 1 and size 2, the value of W is different. When it is size 2, more speech-to-text content can be displayed. The speech-to-text content here may include the text obtained by speech-to-text conversion and punctuation added by the electronic device.

[0127] For the size change of the speech-to-text area (area 12) and the text display, please refer to the following description of Figures 4 and 5.

[0128] As shown in (1) in Figure 4, in the user interface 15a, the electronic device can record voice. For example, the recorded voice content can be: "The first part mainly talks about XXX". And the electronic device can display the text obtained by converting the voice in the voice-to-text area (area 12). At this time, the user interface 15a displays an exemplary area 12 of size 1. A row of characters can be displayed completely in the area 12, as well as an incomplete display of a row of characters. In some possible cases, the electronic device can add a mask to the incompletely displayed row of characters, so that the incompletely displayed row of characters is "vaguely visible". At this time, a row of characters can always be displayed completely in the area 12, and every time E new characters are added, they can be completely displayed in the area 12, and the front E original characters (already displayed) are slid up one row for incomplete display.

[0129] The area 12 of size 1 may also include an expansion control 151a and a sliding control 151b. The expansion control 151a may be used to switch the size of the area 12 from size 1 to a larger size 2. The sliding control 151b may be used to indicate that the area 12 supports sliding display.

[0130] In response to an operation (eg, a click operation) on the expansion control 151a, the electronic device may expand the area 12 and change the size to size 2. At this time, the electronic device may display a user interface as shown in (2) in FIG. 4 .

[0131] As shown in (2) of FIG4 , user interface 15b is an exemplary user interface after expanding area 12. Area 12 of size 2 may include a collapse control 151c. The collapse control 151c may be used to trigger the size change of area 12 from size 2 to size 1.

[0132] In some possible cases, when the size of area 12 is size 2, the size of area 12 can be set to 1 / 3 of the size of the mobile phone screen, or other sizes, which is not limited in the embodiments of the present application.

[0133] As shown in (2) of FIG. 4 , the electronic device continues to collect sound signals, the content of which is: "The second part mainly talks about XXXX", and then obtains voice through the sound signal, and converts the voice into text (text 1) and displays it in area 12 (size 2). Subsequently, the electronic device can continue to convert the recorded voice into text and display it in area 12, for example, referring to the user interface 15c shown in (3) of FIG. 4 .

[0134] As shown in (3) in FIG. 4 , the electronic device continues to collect a sound signal, the content of which is: "This time, let's explain the first part first." Then, a voice is obtained through the sound signal, and the voice is converted into text (text 2) and displayed in area 12 (size 2). At this time, text 2 is displayed behind the aforementioned text 1. At this time, after text 2 is displayed in area 12, compared to before text 2 was displayed, a new line of text is added to area 12, and the position of the sliding control 151b can be moved downward. The position of the sliding control 151b can correspond to the position of the newly added characters: the further back the newly added characters are in area 12, the lower the sliding control is.

[0135] In some possible cases, the text displayed in area 12 is the text obtained by converting voice with a later recording time, and area 12 can support sliding display to display the text obtained by converting voice with an earlier recording time. As shown in (1) in Figure 5, the electronic device continues to collect sound signals and converts the sound signals into voice into text and displays it in area 12. For example, the content of the sound signal is: "I will explain in detail later." In response to operation 1 in area 12 (such as a downward sliding operation), the electronic device can display the text obtained by converting voice with an earlier recording time. Before operation 1 is detected, the text obtained by converting voice with an earlier recording time may not be displayed in area 12. For example, at this time, the electronic device can display the user interface 15e shown in (2) in Figure 5.

[0136] It should be understood that the way to display the text converted from the voice recorded earlier in area 12 may be other operations besides operation 1 for area 12 shown in (1) in FIG. 5 , for example, other operations may include: dragging the sliding control 151b upwards. This embodiment of the present application is not limited to this.

[0137] As shown in (2) and (3) of FIG. 5 , after detecting operation 1, if no operation on area 12 is detected again within a preset time (e.g., 1 second), the electronic device can continue to display the text converted from the latest recorded voice in area 12. At this time, the user interface displayed by the electronic device can be updated from user interface 15e to user interface 15f shown in (3) of FIG. 5 .

[0138] As shown in (3) of FIG5 , the electronic device can continue to collect sound signals, obtain speech based on the sound signals, and can continue to display the text converted from the latest recorded speech in area 12. For example, the content of the sound signal here can be: "Content of the second part".

[0139] It should be understood that in the foregoing, characters may be displayed incompletely in region 12, and a mask may be added to the incompletely displayed characters. In some possible cases, only characters that can be displayed completely may be displayed in region 12, and no mask may be added. This may be reflected in region 12 in subsequent figures, and will not be described in detail here.

[0140] In some possible cases, the speech-to-text area (area 12) may support other functions in addition to supporting sliding display of text. For example, the text in area 12 may be processed, such as editing (including copying, pasting, etc.) and sharing. The text information 152 shown in (1) of FIG. 5 is obtained by copying and pasting the text in area 12.

[0141] During the recording process, the process of editing the text in area 12 can refer to the following description of the relevant contents in Figures 6 and 7.

[0142] Here, the speech-to-text area (area 12) can be understood as an editable area, and the text therein can be edited, and the editing involved here includes but is not limited to one or more of the following: copy, cut, select all (optional), insert text, etc. Among them, inserting text includes pasting text into area 12 or inputting text through the keyboard and then displaying it in area 12.

[0143] As shown in the user interface 16a in (1) of FIG6 , in response to an operation 2 (e.g., a long press operation) on position 1 in area 12, the electronic device can select U characters closest to position 1, and can display a processing toolbar, which can include function controls involved in processing the selected characters. At this time, the electronic device can display a user interface as shown in (2) of FIG6 below.

[0144] As shown in (2) of FIG. 6 , in the user interface 16b, 6 characters (“Note 1 includes”) are selected, and the electronic device can add a check mark 162 to the selected characters, and one end of the check mark 162 includes a control 163, and the other end includes a control 164. Among them, the control 163 and the control 164 can be used to trigger the adjustment of the selection area corresponding to the check mark 162, that is, the control 163 and the control 164 can be used to set the number and position of the selected characters. The user interface 16b can also include a processing toolbar 161, and the processing toolbar 161 can include a select all control 161a, a cut control 161b, a copy control 161c, a paste control 161d, and a share control 161e. Among them, the select all control 161a can be used to trigger the selection of all characters displayed in the area 12, and display a new toolbar including the cut control 161b, the copy control 161c, the paste control 161d, and the share control 161e. The cut control 161b can be used to trigger the copying of the selected characters and, after copying, the deletion. The copy control 161c can be used to trigger the copying of the selected characters. The paste control 161d can be used to trigger the replacement of the selected characters with other characters (that have been copied).

[0145] In response to an operation on control 164, such as sliding control 164 to the right to position A, the electronic device may display control 164 at position A, and the characters included in the selection mark 162 are all characters between control 163 and control 164 (displayed at position A). At this time, the electronic device may display user interface 16c shown in (3) of FIG. 6 .

[0146] As shown in (3) of FIG6 , the characters included in the selection mark 162 (selected characters 1) are updated to: "Note 1 includes two parts, wherein the first part mainly describes XXXXXX.", which is the aforementioned text information 152. At this time, the position of the control 163 does not change, and the position of the control 164 is updated from the position in the user interface 16b to the position shown in the user interface 16c (which can be regarded as a case of position A).

[0147] In response to an operation (eg, a click operation) on the copy control 161c in the processing toolbar 161, the electronic device may copy the selected character 1. The selected character 1 may be subsequently pasted into the area 12 or the area 2. For example, reference may be made to the description of the following content.

[0148] As shown in the user interface 16d in (4) of FIG6 , in response to an operation (e.g., a long press operation) on the position of the cursor 165 in area 2, the electronic device may display a user interface 16e as shown in (1) of FIG7 . The user interface 16e includes a paste control 166, which may be triggered to paste the copied characters (e.g., the selected characters 1) into area 2 for display.

[0149] In response to the operation on the paste control 166, the electronic device can paste the copied characters (e.g., the selected characters 1) into the area 2. At this time, the electronic device can display the user interface 16f as shown in (2) in Figure 7. For example, the text information 152 in the user interface 16f is the pasted characters.

[0150] It should be understood that during the first recording process, in response to an operation (e.g., a click operation) on the conversion control 137a in state C, the electronic device may turn off the speech-to-text function and change the state of the conversion control 137a from state C (e.g., represented by a solid line) to state D (e.g., represented by a dotted line). As shown in the user interface 16f, if the area 12 includes text obtained by speech-to-text conversion, the prompt information 141 may no longer be displayed in the area 12.

[0151] As shown in (2) of FIG. 7 , in response to an operation (eg, a click operation) on the pause recording control 136a, the electronic device may end the first recording after note 1 is created.

[0152] After a recording is finished, the electronic device may display area 12 in size 1. For example, refer to user interface 16g shown in (3) of FIG7 . Area 12 may also be displayed in size 2, for example, refer to user interface 16h shown in (4) of FIG7 . The present application embodiment does not limit this.

[0153] It should be understood that in response to an operation (e.g., a click operation) on the pause recording control 136a, the electronic device can end the recording and also end the voice-to-text conversion. That is, regardless of whether the voice-to-text function is available before the recording is paused, the voice-to-text function is not available when the recording is paused. At this time, in response to an operation (e.g., a click operation) on the pause recording control 136a, the electronic device can also set the state of the conversion control 137a to state D (e.g., indicated by a dotted line) to indicate that the voice-to-text function is not available. When the recording is paused, the conversion control 137a may not receive the user's operation.

[0154] In some possible cases, after pausing the recording, the electronic device can process the text in area 12, such as editing (including copying, pasting, etc.) and sharing.

[0155] When the recording is paused, the process of editing the text in area 12 can refer to the following description of the relevant content in FIG. 8 .

[0156] Referring to the user interface 17a shown in (1) of FIG8 , the electronic device can select some or all characters (selected characters 2) in the area 12, add a selection mark 162 to the selected characters, and display a processing toolbar 161 to process the selected characters. For example, the selected characters may include: "The second part mainly describes XXXXXX." The process of selecting the selection mark 162, the processing toolbar 161, and the electronic device selecting characters can refer to the aforementioned description of the relevant contents of (1) and (2) of FIG6 , which will not be repeated here.

[0157] In response to an operation (eg, a click operation) on the copy control 161c in the processing toolbar 161, the electronic device may copy the selected character 2. The selected character 2 may be subsequently pasted into the area 12 or area 2. For example, reference may be made to the description of the following content.

[0158] Referring to the user interface 17b shown in (2) of FIG. 8 , in response to an operation (eg, a long press operation) on the position of the cursor 165 in area 2 , the electronic device may display a user interface 17c as shown in (3) of FIG. 8 .

[0159] As shown in (3) of FIG. 8 , the user interface 17c includes a paste control 166, which can be used to trigger pasting of the copied characters (selected characters 2) into area 2 for display.

[0160] In response to the operation on the paste control 166, the electronic device can paste the copied characters (selected characters 2) into the area 2. At this time, the electronic device can display the user interface 17d as shown in (4) of Figure 8. For example, the text information 171 in the user interface 17d is the pasted characters.

[0161] As shown in (4) of Fig. 8, after the first recording is completed, in response to the operation of the start recording control 141a, the electronic device can perform a second recording. For the relevant description of the second recording, please refer to the following description of Figs. 9 to 12.

[0162] Then, the electronic device can make the first recording and the second recording into a long voice. After stopping recording the second recording, a node 1 can be displayed in the playback progress bar, and the node is used to divide the playback speed bar into two sub-progress bars, the sub-progress bar before node 1 corresponds to the voice obtained by the first recording, and the sub-progress bar after node 1 corresponds to the voice obtained by the second recording.

[0163] It should be understood that here the first recording and the second recording to obtain a long voice are used as examples for explanation. In actual situations, the electronic device can also perform a third recording, a fourth recording, and so on. The number of recordings is recorded here as Q. After the Qth recording is completed, a node can be added to the playback progress bar. After the Qth recording is completed, there are a total of Q-1 nodes in the playback progress bar, and the playback progress bar is divided into Q segments (which can be called Q segment progress bars). The i-th sub-progress bar in the Q segment progress bar corresponds to the i-th segment of voice. Among them, Q is an integer greater than or equal to 2. For the subsequent third recording, fourth recording, etc., the process of recording can refer to the aforementioned description of the first recording and the subsequent second recording, which will not be repeated here.

[0164] It should also be understood that during the recording process and after the recording is paused, the electronic device can input non-recording information in area 2. In addition to the aforementioned methods of inputting non-recording information through the keyboard and copying and pasting, editing in area 2 can also be performed in other ways, including: inserting pictures into area 2, editing in area 2 through the stylus toolbar (such as graffiti, handwriting text input), etc. The relevant content of editing in area 2 by other methods can be described in the second recording, and the specific details can be referred to the following description of Figures 9 to 12.

[0165] Part of the process involved in the second recording and the process of inserting a picture in area 2 can refer to the following description of Figures 9 and 10.

[0166] As shown in (1) of FIG9 , user interface 18a is an exemplary user interface involved in the second recording process. At this time, the text displayed in area 12 is converted from the voice obtained in the first recording. When the electronic device displays the text converted from the voice obtained in the second recording in area 12, it can be displayed in different ways, including but not limited to the following display methods.

[0167] Display mode 1: The text converted from the speech obtained in the first recording and the text converted from the speech obtained in the second recording are displayed continuously. That is, assuming that after the first recording is completed and before the second recording begins, the last character included in area 12 is displayed on the hth row of all characters in area 12. When the last character is not the last character of the hth row, the electronic device can display the first text converted from the speech obtained in the second recording on the hth row and after the last character. In this case, there may be no space between the first text (obtained in the second recording) and the last character (obtained in the first recording). When the last character is the last character of the hth row, the electronic device can display the first text converted from the speech obtained in the second recording on the next row of the last character. Among them, an exemplary user interface involved in display mode 1 can refer to the following description of (2) in Figure 9.

[0168] As shown in (2) of FIG9 , the user interface 18b includes text information 181 and text information 182, wherein the text information 181 is converted from the voice obtained by the first recording. The text information 182 is converted from the voice obtained by the second recording. For example, the content of the text information 182 may be: "The first part starts from the following figure". At this time, the last character in the text information 181 and the first character in the text information 182 are displayed in the same line and are displayed continuously without a space in between.

[0169] Display mode 2: Display the text converted from the voice obtained by the first recording and the text converted from the voice obtained by the second recording separately. For example, assuming that after the first recording is completed and before the second recording begins, the last character included in area 12 is displayed on the hth row of all characters in area 12. When the last character is not the last character of the hth row, the electronic device can display the first text converted from the voice obtained by the second recording on the next row of the last character. Among them, an exemplary user interface involved in display mode 2 can refer to the following description of (3) in Figure 9. As shown in (3) in Figure 9, the user interface 18c also includes the aforementioned text information 181 (obtained from the first recording) and text information 182 (obtained from the second recording). At this time, the last character in text information 181 and the first character in text information 182 are displayed on different rows: the first character in text information 182 is displayed on the next row of the last character in text information 181.

[0170] Another possible implementation of display mode 2 is that when the last character is the last character of the h-th line, the electronic device can generate a blank line (the blank line may not be used to display any characters), and then display the first text converted from the voice obtained from the second recording on the line below the blank line, or the electronic device can leave two spaces on the line below the h-th line, and then display the first text converted from the voice of the second recording.

[0171] The following content describes other contents involved in the embodiment of the present application by taking display mode 1 as an example. For example, the process of inserting a picture in area 2 is described.

[0172] As shown in (2) of Fig. 9, in response to the operation on the insert control 132a, the electronic device may display at least one insert mode identifier or at least one insertable content identifier. At this time, the electronic device may display the user interface 18d as shown in (1) of Fig. 10.

[0173] As shown in (1) of FIG. 10 , the user interface 18d may include multiple insertion method identifiers and multiple insertable content identifiers. For example, the insertable content identifiers may include a shooting icon 183a, a table icon 183c, a schedule icon 183d, a card scan icon 183e, a mind map icon 183g, and a recording icon 183h. The insertion method identifier may include a “select from gallery” icon 183b and a “file scan” icon 183f. Among them, the shooting icon 183a may be used to trigger opening the camera, taking a picture, and then inserting the taken picture into area 2. The table icon 183c may be used to insert a table into area 2. The schedule icon 183d may be used to insert a schedule identifier into area 2. The “card scan” icon 183e may be used to trigger opening the scanning function, scanning the card, and displaying the scanned content in area 2. The mind map icon 183g may be used to insert a mind map into area 2. The recording icon 183h may be used to insert a recorded voice into area 2. The “Select from Gallery” icon 183b can be used to trigger opening the gallery, and then select a picture or video from the gallery to insert into area 2. The “File Scan” icon 183f can be used to trigger opening the scanning function, scanning the file, and displaying the scanned content in area 2.

[0174] It should be understood that the insertion mode identifier and the insertable content identifier shown in the user interface 18d are only exemplary, and may actually include other identifiers, or may include more or fewer identifiers than those shown in the figure. In addition to being an icon, the identifier may also be in other forms, such as text, etc. This embodiment of the application does not limit this.

[0175] In response to an operation (e.g., a click operation) on the "Select from Gallery" icon 183b, the electronic device can open the gallery, select a picture or video from the gallery and insert it into area 2, and display a user interface as shown in (2) in FIG10. At this time, the electronic device can also collect sound signals to obtain speech, and convert the speech into text and display it in area 11. For example, the content of the sound signal can be: "In the picture".

[0176] As shown in (2) of FIG10 , user interface 18e is an exemplary interface after opening the gallery. In response to an operation on picture 1 (such as a click operation), the electronic device can insert the picture 1 into area 2. At this time, the electronic device can display user interface 18f as shown in (3) of FIG10 .

[0177] As shown in (3) of FIG10 , picture 1 may be displayed in area 2 to prompt the user that picture 1 has been inserted. At this time, the electronic device may also collect sound signals to obtain voice, and convert the voice into text to be displayed in area 11. For example, the content of the sound signal may be: "recorded".

[0178] In response to an operation (e.g., a click operation) on the "handwriting" control 132c, the electronic device may switch the input tool from the keyboard to the stylus toolbar. Editing (e.g., graffiti, handwriting, etc.) may be performed in area 2 through the stylus toolbar.

[0179] Part of the process involved in the second recording and the process of editing (eg, graffiti) in area 2 through the stylus toolbar can refer to the following description of FIG. 11 and FIG. 12 .

[0180] Referring to the user interface 19a shown in (1) of FIG. 11 , in response to an operation (e.g., a click operation) on the stylus 134b in the stylus toolbar 134, the electronic device can trigger editing (e.g., graffiti) in area 2 by the stylus 134b, and the electronic device can highlight the stylus 134b or change the state of the stylus 134b to indicate that the stylus 134b is selected. At this time, the electronic device can display the user interface shown in (2) of FIG. 11 .

[0181] Referring to the user interface 19b shown in (2) of Figure 11, the stylus 134b is highlighted to indicate that the stylus 134b is selected. In response to the operation of scribbling in area 2 using the stylus 134b, the electronic device may display a user interface as shown in (3) of Figure 11.

[0182] As shown in (3) of FIG. 11 , the user interface 19c may include an underline 191, which is added in the area 2 using the stylus 134b.

[0183] It should be understood that the stylus toolbar may include at least one stylus, and different stylus pens may be of different types, for example, marker pen 1, marker pen 2, eraser pen, pencil, etc. When editing (e.g., graffiti) in area 2 using different stylus pens, different results are obtained. It can also be understood that different stylus pens draw different types of lines when editing. Among them, the different types of lines may include different colors and shapes. For example, marker pen 1 can draw lines of shape 1 (e.g., straight lines), and marker pen 2 can draw lines of shape 2 (e.g., curves), etc. The lines edited by different stylus pens can be adjusted, for example, the color and thickness of the lines can be adjusted.

[0184] In response to an operation (eg, a click operation) on the keyboard switching control 135, the electronic device may switch the input tool from the stylus toolbar to the keyboard. Subsequently, the electronic device continues to input non-recording information in area 2 while performing the second recording, and then ends the second recording.

[0185] As shown in (1) of FIG. 12 , the user interface 20a includes a picture 2. It is assumed here that picture 2 is displayed after picture 1. For the process of inserting picture 2, reference can be made to the aforementioned description of inserting picture 1, which will not be repeated here. At this time, the electronic device can continue to collect sound signals to obtain speech, and the content of the sound signal can be: "In addition, the first part XX..." While recording, the electronic device can perform speech-to-text conversion and display the converted text in area 12. Moreover, while recording, the electronic device can also input non-voice information in area 2. For example, in response to an operation (such as a click operation) for editing the text "picture", the electronic device can input the edited text "picture" into area 2 for display. At this time, the electronic device can display a user interface 20b as shown in (2) of FIG. 12 .

[0186] The electronic device can then end the second recording. Referring to the user interface 20c shown in (3) of FIG. 12 , in response to an operation (such as a click operation) on the pause recording control 136a, the electronic device can end the second recording. Assuming that at this time, the duration of the voice obtained in the second recording is 12 seconds, the recording duration is 23 seconds, which can be regarded as the sum of the duration of voice 1 (11 seconds) and the duration of voice 2 (12 seconds). After the second recording ends, the electronic device can display a user interface as shown in (4) of FIG. 12 .

[0187] As shown in (4) of FIG. 12 , the user interface 20d may include a recording bar (recording bar 2) in state 2. After the second recording is completed, the electronic device may make the voice obtained in the first recording (voice 1) and the voice obtained in the second recording (voice 2) into a long voice (long voice 1). Here, the duration of long voice 1 may be expressed as the duration of voice 1 plus the duration of voice 2. For example, as shown in the user interface 20d, it can be seen in the play time indicator 141d that the duration of long voice 1 is 23s, which can be regarded as the sum of the duration of voice 1 (11s) and the duration of voice 2 (12s).

[0188] The user interface 20d may also include a play progress bar 141c, which may include a node 201 (which may be regarded as a node 1). The node 201 may divide the play progress bar 141c into two sub-progress bars. The sub-progress bar before the node 201 corresponds to the voice (voice 1) obtained by the first recording, and the sub-progress bar after the node 201 corresponds to the voice (voice 2) obtained by the second recording.

[0189] Subsequently, the electronic device can save the note 1 recording the information. After saving, the user can view the note 1 through the electronic device.

[0190] The content of Note 1 saved by the electronic device may refer to the following description.

[0191] Referring to the user interface 20d shown in (4) of FIG. 12 , in response to an operation (eg, a click operation) on the completion control 401 , the electronic device can save the note 1 .

[0192] In some possible cases, after completing the saving of note 1, the electronic device may also display a prompt message to prompt the user that the saving is successful. For example, as shown in FIG13, the user interface 41 may include a prompt message 411, and the prompt message 411 is used to prompt the user that note 1 is saved successfully.

[0193] It should be understood that the above content is explained by taking the example that the electronic device recorded two voices after creating Note 1. In actual situations, the electronic device can also record more or less voices after creating Note 1, and the embodiments of the present application do not limit this. After recording information in Note 1, the user can also view the information recorded in Note 1 through the electronic device. For the content involved in viewing the information, please refer to the following description of Figures 14 to 17.

[0194] The following describes the related contents involved in viewing information.

[0195] An exemplary set of user interfaces involved in viewing information is described in FIGS. 14-17 .

[0196] Before and after saving Note 1, the user can view the information recorded in Note 1 through the electronic device. When viewing the note, the electronic device can play voice to allow the user to view the recorded content. When playing voice, the electronic device can achieve audio and text synchronization.

[0197] In some possible cases, audio-text synchronization may include one or more of the following:

[0198] Synchronous mode 1. When playing a recording, the non-recorded information corresponding to the played voice in area 2 (editing area) is displayed in state A (recorded as information A), and the non-recorded information corresponding to the unplayed voice in area 2 is displayed in state B (recorded as information B). Here, information A and information B are described by taking the electronic device playing voice A (recording time is time A) as an example: information A refers to information whose input time is earlier than or equal to time A. Information B refers to information whose input time is later than time A. Among them, time A can also be called the timestamp corresponding to voice A. The input time of information A can be called the timestamp corresponding to information A. The input time of information B can be called the timestamp corresponding to information B. Among them, state A is different from state B. For example, state B can be to add a mask to information B, or to make information B semi-transparent, so that information B is "looming". To indicate that before recording the currently playing voice, the information B has not been entered into the note. State A can be to not add a mask to information A, to indicate that before recording the currently playing voice, the information A has been entered into the note.

[0199] Synchronous mode 2. When playing a recording, the text converted from the played voice can be displayed in area 12 (voice-to-text area).

[0200] 14 to 17 are described by taking the audio-text synchronization including the aforementioned synchronization mode 1 and synchronization mode 2 as an example. In actual applications, the audio-text synchronization may only include synchronization mode 1 or synchronization mode 2, and the embodiment of the present application does not limit this.

[0201] The following is an exemplary description of the relevant contents involved in audio-text synchronization based on Figures 14 to 16.

[0202] As shown in (1) of FIG. 14 , the user interface 30 is an exemplary user interface involved in the case where the recording function is turned on and the recording is paused, and the user interface 30 may include a recording bar (recording bar 2) in state 2. State 2 is the state where the recording function is turned on but the recording is paused.

[0203] It should be understood that the stylus toolbar 134 shown in (1) of FIG14 can be switched by touching the “handwriting” control 132c. The electronic device can also switch the stylus toolbar 134 to the keyboard through the keyboard switching control 135.

[0204] In response to an operation (e.g., a click operation) on the start play control 141b in the recording strip 2, the electronic device can start playing the recorded voice (long voice). During the voice playback, the electronic device can achieve audio-text synchronization. For example, when playing to the 3rd second, the electronic device can achieve audio-text synchronization. At this time, the electronic device can display a user interface as shown in (2) in FIG. 14 below.

[0205] Referring to the user interface 31 shown in (2) of FIG14 , when the voice corresponding to the 3rd second (voice A1) is played, the electronic device can achieve audio-text synchronization in the following two aspects.

[0206] In the first aspect, text information 311 may be displayed in the speech-to-text area (area 12), and the text information 311 includes text converted when recording the speech A1. The relevant contents involved in the electronic device recording the speech A1 (the speech corresponding to the 3rd second) can refer to the aforementioned description of the user interface 15a shown in (1) of FIG. 4, and will not be repeated here.

[0207] Second, no mask is added to the non-recording information 312a in the editing area (area 2). A mask is added to the non-recording information 312b. It can also be understood that: the area in area 2 displaying the non-recording information 312a has no mask added, and the area displaying the non-recording information 312b has a mask added. Among them, the input time of the non-recording information 312a is earlier than or equal to the time of recording the voice A1. The input time of the non-recording information 312b is later than the time of recording the voice A1.

[0208] The above description that the speech-to-text area (area 12) can synchronize audio and text is explained by taking area 12 of size 1 as an example. The speech-to-text area (area 12) of size 2 can also synchronize audio and text. For example, in response to an operation (such as a click operation) on the expansion control 151a, the electronic device can display a speech-to-text area (area 12) of size 2. At this time, the electronic device can display a user interface 32 as shown in (3) in Figure 14. In the user interface 32, area 12 still includes text information 311. No mask is added to the non-recording information 312a in area 2. A mask is added to the non-recording information other than the non-recording information 312a in area 2.

[0209] Subsequently, the electronic device can continue to achieve audio-text synchronization when playing voice. As shown in the user interface 33 of (4) in Figure 14, when the voice corresponding to the 8th second (voice A2) is played, the electronic device can display text information 313 in the voice-to-text area (area 12) of size 2, and the text information 313 includes the text converted when recording voice A2. The relevant content involved in the electronic device when recording voice A2 (the voice corresponding to the 8th second) can refer to the aforementioned description of the user interface 15d shown in (1) in Figure 5, which will not be repeated here. The electronic device can also add a mask to the non-recording information 314b in the editing area (area 2) to distinguish it from the non-recording information 314a. It means that the input time of the non-recording information 314b is later than the time of recording voice A2, and the input time of the non-recording information 314a is earlier than or equal to the time of recording voice A2.

[0210] It should be understood that in response to an operation (e.g., a click operation) on the start play control 141b in the recording strip 2, the electronic device can start playing the recorded voice (long voice). At this time, the electronic device can also replace the start play control 141b in the recording strip 2 with the pause play control 141f to obtain a recording strip (recording strip 3) in state 3, and the play control 141b can be used to trigger the pause play of the voice (long voice). The recording strip 3 can also include other controls, such as a start recording control 141a, a play progress bar 141c, a play time indicator 141d, and a voice menu control 141e. For the relevant content of the other controls, please refer to the description of the relevant controls in the user interface 14b shown in (3) in the aforementioned Figure 3, which will not be repeated here.

[0211] In some possible cases, before the electronic device starts playing the audio, it can also display a prompt message to remind the user that the audio and text can be synchronized when playing the voice. For example, referring to the user interface 30 in the aforementioned Figure 14, the electronic device can display a prompt box 301, which can be presented in the form of a bubble, pointing to the start play control 141b, and the content in the prompt box 301 can be: "Click to play the recording, and the content you recorded can be displayed when the recording is played." The content in the prompt box 301 can be used to prompt the user to click the start play control 141b to play the audio, and the audio and text can be synchronized when playing the audio. The prompt box 301 can be displayed after pausing the recording, and the display number is 1. The prompt box 301 will disappear when the user clicks anywhere on the screen. The prompt box 301 can also have other display rules and disappearance rules, which are not limited in the embodiments of the present application.

[0212] In some possible cases, when viewing a note, the electronic device can also implement an advance preview. The advance preview may include one or more of the following contents.

[0213] Preview method 1: When playing the voice recorded at time B, an operation A (such as a continuous long press operation) is detected for position T on the playback progress bar (the voice played at position T corresponds to the voice recorded at time C), and the electronic device can display the text converted from the voice recorded at time C (a certain time after time B) and part of the text converted from the voice recorded before time C in area 12, without affecting the voice recorded at time B. This allows the user to preview the text converted from the voice recorded at time C. Among them, time C and time B can indicate a period of time or a moment, which is not limited in the embodiments of the present application.

[0214] Preview method 2: When playing the voice recorded at time B, if an operation B (such as a continuous long press operation after double-clicking) is detected for position T on the playback progress bar (the voice played corresponding to position T is the voice recorded at time C), the electronic device can highlight the non-recording information (non-recording information A) input at time C (a time after time B) in area 2, and does not affect the playback of the voice recorded at time B. Among them, highlighting includes marking the non-recording information A in red, bolding, etc., one or more, which is not limited in the embodiments of the present application. Highlighting the non-recording information A can also be understood as displaying the non-recording information A in a different state (a state different from state A and state B).

[0215] It should be understood that operation A and operation B may be the same operation or different operations. Here, operation A and operation B are the same operation, and the electronic device can implement advance preview through preview mode 1 and preview mode 2 as an example for explanation. In actual applications, operation A and operation B may be different, and the electronic device may implement advance preview through one of preview mode 1 or preview mode 2.

[0216] As shown in (1) of FIG. 15 , the voice currently played by the electronic device is the voice corresponding to the position 341 on the play progress bar 141c in the recording bar 3 (ie, the voice corresponding to the 8th second in the user interface 34).

[0217] In response to an operation (e.g., a continuous long press operation) on position 342 (equivalent to a position T) on the play progress bar 141c in the recording bar 3, the electronic device can change the content displayed in area 12 and area 2, and at this time, the electronic device can continue to play the voice corresponding to position 341. It is assumed here that the voice corresponding to position 342 is the voice corresponding to the 23rd second, and the recording time of the voice corresponding to the 23rd second is time C. Then the electronic device can display the text obtained by converting the voice recorded at time C in area 12, as well as part of the text obtained by converting the voice recorded before time C. For example, text information 344 can be included. Among them, the content involved when the electronic device obtains the text information 344 can refer to the aforementioned description of (1) in Figure 12, which will not be repeated here. The electronic device can also highlight the non-recording information 334 (a non-recording information A) input at time C in area 2. For example, the non-recording information 334 can be displayed in bold. The content of the non-recording information 334 input by the electronic device into area 2 can refer to the aforementioned description of (1) in Figure 12, which will not be repeated here.

[0218] It should be understood that when the electronic device detects that the user ends the long press operation at position 342, the electronic device can update the content included in area 12 and area 2 to the content displayed when the voice corresponding to position 341 is played. For example, referring to user interface 34, in response to the user ending the long press operation at position 342, the electronic device can redisplay the aforementioned user interface 33.

[0219] In some possible cases, after the electronic device opens Note 1, when playing the voice in Note 1, the audio-text synchronization function is turned on by default, and the electronic device can turn off the audio-text synchronization function. An exemplary method of turning off the audio-text synchronization function can refer to the following descriptions of (2), (3) and (4) in Figure 15.

[0220] Referring to the user interface 33a shown in (2) of FIG. 15 , in response to an operation (such as a long press operation) at any position in area 2, the electronic device can display a control corresponding to turning off the audio-text synchronization function. For example, referring to the user interface 35 shown in (3) of FIG. 15 , the control 351 is the control corresponding to turning off the audio-text synchronization function. The control 351 can also include prompt information, which is used to remind the user that the control is used to trigger the turning off of the audio-text synchronization function. For example, the prompt information can be: "Stop the note playback animation", where the note playback animation is the aforementioned audio-text synchronization. After turning off the audio-text synchronization function, the electronic device no longer adds a mask in area 2 to distinguish whether the input time of the non-recording information is later than the recording time of the currently playing voice. For example, at this time, the electronic device can display the user interface 36 shown in (4) of FIG. 15 below.

[0221] It should be understood that the aforementioned method of turning off the audio-text synchronization function can be regarded as turning off the audio-text synchronization of Note 1. It can also be regarded as turning off the audio-text synchronization of all notes. This embodiment of the present application does not limit this.

[0222] In other possible situations, the electronic device can also turn off the audio-text synchronization of all notes in other ways. For example, the electronic device can add a setting item 1 for all notes, and the setting item 1 can be used to control whether to turn on the audio-text synchronization. When the setting value corresponding to the setting item 1 is off (OFF), it means that the audio-text synchronization of all notes is turned off, that is, the audio-text synchronization function cannot be used when entering any note. When the setting value corresponding to the setting item 1 is on (ON), it means that the audio-text synchronization of all notes is turned on, that is, the audio-text synchronization function can be used when entering any note. For the relevant content involved in this process, please refer to the following description of Figure 16.

[0223] As shown in (1) of FIG. 16 , the user interface 11f may include a control 114, which may be used to trigger the electronic device to display more setting items related to the note. For the description of the user interface 11f, reference may be made to the description of the user interface 11a in (2) of FIG. 1A , which will not be repeated here.

[0224] In response to the operation on the control 114, the electronic device may display a setting item about the note. For example, at this time, the electronic device may display a user interface as shown in (2) in FIG. 16 below.

[0225] As shown in (2) of Figure 16, the user interface 37 may include a setting function item 374, which can be used to trigger the electronic device to set all notes. For example, the audio and text synchronization function for all notes is set (turned off or on). The user interface 37 may also include other setting items, such as a grid view setting item 371, a batch deletion setting item 372, and a sorting method setting item 373. Among them, the grid view setting item 371 can be used to set the display mode of all notes. The batch deletion setting item 372 can be used to delete one or more notes at one time. The sorting method setting item 373 can be used to set the sorting method of all notes, such as arranging from front to back according to the size of the notes.

[0226] In response to an operation (eg, a click operation) on the setting function item 374, the electronic device may display more setting items for all notes. At this time, the electronic device may display a user interface as shown in (3) of FIG. 16 described below.

[0227] As shown in (3) of FIG. 16 , the user interface 38 may include a “note playback animation” setting item 381 (equivalent to a setting item 1). The “note playback animation” setting item 381 is enabled by default, that is, the electronic device enables the audio-text synchronization function of all notes by default. In response to an operation to disable the “note playback animation” setting item 381, the electronic device may disable the audio-text synchronization function of all notes.

[0228] After the electronic device saves Note 1, the user can view the information recorded in Note 1 and can continue to record information in Note 1. The process can refer to the following description of FIG. 17.

[0229] As shown in (1) of FIG. 17 , the user interface 42 includes at least one directory item corresponding to a note. When a user triggers a directory item corresponding to a note, the electronic device can open the corresponding note and display the content recorded in the note. For example, in response to an operation (such as a click operation) on the directory item 421 corresponding to note 1, the electronic device can open note 1 and display the content recorded in note 1.

[0230] In some possible cases, when the electronic device opens the note 1 that records information, it can still divide the user interface into two areas: the recording area (the aforementioned area 1) and the editing area (the aforementioned area 2). Area 1 is used to present content related to recording, and area 2 is used to display non-recording information. After closing note 1, when you open note 1 again, the content included in area 1 is one of the following two situations:

[0231] Case 1. After closing Note 1, when Note 1 is reopened, Area 1 is still divided into a voice recording area (the aforementioned area 11) and a voice-to-text area (the aforementioned area 12). For example, referring to the user interface 43 shown in (2) of Figure 17, in the user interface 43, Area 11 includes a recording bar. After closing Note 1, when Note 1 is reopened, the recording function is in the off state by default. At this time, the recording bar displayed in Area 11 can be referred to as a recording bar in the 4th state (recording bar 4). State 4 is the state when the recording function is off and no voice is played. The content of the voice-to-text can be displayed in Area 12. The recording bar 4 can include a start playback control 141b, a playback progress bar 141c, a playback time indicator 141d, and a voice menu control 141e. The description of the various controls included in the recording bar 4 can refer to the aforementioned description of the various controls included in the recording bar 2, which will not be repeated here.

[0232] Case 2. After closing Note 1, when Note 1 is reopened, Area 1 may include the recording area (Area 1), but may not include the speech-to-text area (Area 12). For example, referring to the user interface 44 shown in (3) of FIG. 17 , in the user interface 44, Area 11 may include Area 1, and Area 11 includes the recording strip 4. At this time, Area 1 does not include the speech-to-text area (Area 12).

[0233] It should be understood that the display of recording strip 4 here is only an exemplary description. In other cases, the recording strip can also be in other states, for example, it can be a recording strip (recording strip 2) in the aforementioned state 2. This embodiment of the application does not limit this.

[0234] Here, case 1 is used as an example for description. In response to an operation (eg, a click operation) on the start playing control 141b, the electronic device can start playing the recorded voice (long voice). At this time, the electronic device can display the user interface 45 as described in (4) of FIG. 17 below.

[0235] The user interface 45 may include a recording bar (recording bar 5) in state 5, where the recording function is turned off and the voice is played. The recording bar 5 may include a pause control 141f, a play progress bar 141c, a play time indicator 141d, and a voice menu control 141e. The description of each control included in the recording bar 5 can refer to the description of each control included in the recording bar 3, which will not be repeated here.

[0236] It should be understood that the display of recording bar 5 here is only an exemplary description. In other cases, the recording bar can also be in other states, for example, it can be a recording bar (recording bar 3) in the aforementioned state 3. This embodiment of the application is not limited to this.

[0237] The following describes the relevant contents involved in the management information.

[0238] Management information includes deletion information, sharing information, and saving information. Deletion information includes the option to delete part or all of the voice information recorded in Note 1. Sharing information includes transmitting the content to be shared in the note to other terminals, and the sharing method can be selected. The content to be shared can be selected by the user through an electronic device. For example, you can choose to share other information in Note 1 except voice, you can also choose to share other information in Note 1 except voice and text converted from voice, and you can also share all the information in Note 1.

[0239] Figures 18-29 describe the relevant content involved when an electronic device manages information.

[0240] Figures 18 to 24 are a set of exemplary user interfaces involved in deleting information on an electronic device. Figures 25 to 29 are a set of exemplary user interfaces involved in sharing information on an electronic device.

[0241] The following describes the relevant content involved when an electronic device deletes information based on Figures 18-24.

[0242] Deleting information includes deleting voice information. When deleting voice information, the electronic device can also determine whether to delete the text information corresponding to the selected voice information according to user needs. The text information corresponding to the voice information is obtained by converting the voice. Note 1 can record Q voice segments, and the electronic device can choose to delete L of the Q voice segments, and choose whether to delete the text information corresponding to the L voice segments. Where L is an integer less than or equal to Q.

[0243] In some possible cases, the electronic device may provide a function of deleting all voices. When deleting all voices, the electronic device may also determine whether to delete text information corresponding to all voices according to user requirements.

[0244] FIG. 18 depicts a set of exemplary user interfaces involved when an electronic device deletes all speech.

[0245] As shown in (1) of FIG. 18 , when voice playback is paused, in response to operation C (such as a long press operation) on the playback progress bar 141c, the electronic device can display a management toolbar. The management toolbar includes at least one control related to managing note 1, and different controls can be used to trigger different processing of note 1. For example, as shown in (2) of FIG. 18 , the management toolbar 511 may include a delete control 511a, a save control 511b, and a share control 511c. Among them, the delete control 511a can be used to trigger the electronic device to delete all voice information. The save control 511b can be used to trigger the electronic device to save all recorded voices. The share control 511c can be used to trigger the electronic device to share all voice information.

[0246] Referring to the user interface 51 shown in (2) of FIG. 18 , in response to an operation (e.g., a click operation) on the delete control 511a, the electronic device may display a prompt box A involved in deleting all voices, and the prompt box A may be used to prompt the user that the content to be deleted is all voices, and may also be used to receive a user input to confirm the operation of deleting all voices or cancel the operation of deleting all voices. As shown in (3) of FIG. 18 , the prompt box 521 displayed in the user interface 52 may be an exemplary prompt box A.

[0247] The prompt box 521 may include prompt information 521a, and the prompt information 521a may be used to prompt the user whether to delete all recordings (voices).

[0248] The prompt box 521 may also include a selection control 521b, which can be used to receive the user's operation of whether to retain the speech-to-text content (the text information corresponding to all recordings). At this time, the speech-to-text content is the text information corresponding to all voices. In some possible cases, the speech-to-text content is selected by default, and the selection control 521b is in state E, for example, state E is grayed out. When the state of the selection control 521b is state E, it means that the speech-to-text content is selected to be retained. In response to the operation of the selection control 521b for state E, the electronic device can change the state of the selection control 521b to state F, for example, the state F is not grayed out. When the state of the selection control 521b is state F, it means that the speech-to-text content is not selected to be retained. When all voices are deleted, the speech-to-text content will also be deleted. The state of the selection control 521b can be switched between state E and state F to determine whether the speech-to-text content corresponding to all voices is deleted when all voices are deleted.

[0249] The prompt box 521 may also include a confirm delete control 521c and a cancel control 521d. The confirm delete control 521c may be used to trigger the deletion of all voices in Note 1. If the user chooses to delete (not retain) the voice-to-text content corresponding to all voices, the confirm delete control 521c may also be used to trigger the deletion of the text information (voice-to-text content) corresponding to all voices. The cancel control 521d is used to cancel the deletion of all voices and to close the prompt box 521.

[0250] In some other possible situations, the electronic device may also choose to delete part or all of the voice. When deleting part or all of the voice, it may also be set whether to delete the text information corresponding to the part or all of the voice.

[0251] Among them, the electronic device can delete all the voice-related contents by referring to the relevant descriptions of Figures 19-21.

[0252] Referring to the user interface 50 shown in (1) of FIG. 19 , in response to an operation (e.g., a click operation) on the voice menu control 141e, the electronic device may display a display box A including Q segments of voice information. The display box A is used to display information corresponding to the Q segments of recording (e.g., recording duration, etc.). The display box A may also include controls involved in managing the recorded voice. At this time, the electronic device may display the user interface shown in (2) of FIG. 19 .

[0253] As shown in (2) of FIG. 19 , the display box 535 included in the user interface 53a can be regarded as an exemplary display box A. The display box 535 may include Q segments of recorded voice information: including the name (recording 001) corresponding to the first recorded voice and its corresponding total duration (11s), and the name (recording 002) corresponding to the second recorded voice and its corresponding total duration (12s). The display box 535 may also include an editing control 535a. The editing control 535a may be used to trigger the display of related interfaces involved in processing (editing) the recorded voice.

[0254] In response to the operation on the editing control 535a, the electronic device can display more controls involved in managing (editing) the voice in the note. It can also trigger the display of information corresponding to all the voices recorded in Note 1, which can include the total duration of each voice, the name of the voice, etc. At this time, the electronic device can display the user interface shown in (3) in Figure 19.

[0255] As shown in (3) of FIG. 19 , user interface 53b is an exemplary user interface involved in managing (editing) a voice. The user interface 53b may include a sharing control 531, a rename control 532, a delete control 533, and a deselect all control 534. The sharing control 531 may be used to trigger the selected voice to be shared with other devices. The rename control 532 may be used to trigger the name of the voice to be changed. The delete control 533 may be used to trigger the selected voice. The electronic device may be set to select all voices for processing by default, and the deselect all control 534 may be used to trigger the update of all voices from selected to unselected. In the user interface 53b, the electronic device selects all voices by default, for example, the selected control 530a corresponding to recording 001 (the name corresponding to the voice obtained by the first recording) is in state E, for example, a grayed out state. The grayed out state of the selected control 530a indicates that the voice obtained by the first recording is the selected voice. Similarly, the selected control 530b corresponding to recording 002 (the name corresponding to the voice obtained by the second recording) is also in state E, for example, a grayed out state. This means that the voice obtained by the first recording is also the selected voice.

[0256] When the selected voice is all voices, in response to an operation (e.g., a click operation) on the delete control 533, the electronic device can display the aforementioned prompt box A involved in deleting all voices, which can be used to prompt the user that the deleted content is all voices, and can also be used to receive the user's input of an operation to delete all voices or cancel the operation of deleting all voices. Among them, when all voices are selected, the delete control 533 and the delete control 511a can be regarded as controls with the same function but different forms. At this time, the electronic device can display the user interface 54 shown in (1) in Figure 20.

[0257] When deleting all the voices, the electronic device retains the text information corresponding to all the voices. For the relevant contents involved, please refer to the following description of FIG. 20.

[0258] As shown in (1) of FIG. 20 , the user interface 54 is an exemplary user interface involved in managing speech. The user interface 54 may include a prompt box 521, which may be an exemplary prompt box A. For the description of the prompt box 521, reference may be made to the content involved in (3) of FIG. 18 , which will not be repeated here. At this time, the selected control 521b in the prompt box 521 is in state E, indicating that the speech-to-text content is selected to be retained (not deleted).

[0259] When all the voices are selected and the text information (voice text content) corresponding to all the voices is retained, in response to the operation on the confirmation deletion control 521c, the electronic device can delete all the voices and retain (not delete) the text information corresponding to all the voices. That is, the electronic device can retain the text information corresponding to all the voices in Note 1, but delete all the voices in Note 1. The way in which the electronic device retains the text information corresponding to all the voices in Note 1 includes but is not limited to one of the following two ways.

[0260] Retention mode 1: The electronic device may not display the recording area (area 1), and insert the text information corresponding to all voices in front of the non-recording information, or insert it in the back of the non-recording information. The exemplary user interface involved in inserting the text information corresponding to all voices in front of the non-recording information can refer to the user interface 55a shown in (2) of Figure 20.

[0261] Retention mode 2: The electronic device may not display the recording area (area 1), and a new area (area 3) supporting sliding display is set in note 1 to display the text information corresponding to all the voices. As shown in (3) in FIG. 20 , the user interface 55b may include area 3, and part of the text information corresponding to all the voices may be displayed in area 3. In response to an operation on area 3 (such as a sliding operation), the electronic device may display the other part of the text information corresponding to all the voices.

[0262] When deleting all the voices, the electronic device also deletes the text information corresponding to all the voices. For details, please refer to the following description of Figure 21.

[0263] As shown in (1) of FIG. 21 , user interface 54b is an exemplary user interface involved in managing voice. The user interface 54b may include a prompt box 521, which may be an exemplary prompt box A. For the description of the prompt box 521, reference may be made to the content involved in (3) of FIG. 18 , which will not be repeated here. At this time, the selected control 521b in the prompt box 521 is in state F, indicating that the voice-to-text content is selected to be deleted.

[0264] In response to the operation of the confirmation deletion control 521c, the electronic device can delete all the voices in Note 1, and delete the text information corresponding to all the voices. After the deletion, Note 1 no longer includes the recorded voice and the text information corresponding to the voice, and can include non-recorded information. For example, at this time, the electronic device can display the user interface 55c shown in (2) in Figure 21.

[0265] For the content related to deleting part of the speech by the electronic device, please refer to the relevant description of Figures 22-23.

[0266] Referring to the user interface 53b shown in (1) of FIG. 22, in response to an operation (e.g., a click operation) for canceling the all-select control 534, the electronic device may change the selected controls corresponding to all voices (e.g., selected controls 530a and selected controls 530b) from state E (e.g., grayed out) to state F (not grayed out) to indicate that all voices are set from selected to unselected. At this time, the electronic device may display a user interface as shown in (2) of FIG. 22 below. For the relevant description of the user interface 53b, reference may be made to the aforementioned description of (3) of FIG. 19, which will not be repeated here.

[0267] As shown in (2) of FIG. 22 , the selected controls corresponding to all the voices in the user interface 56 (e.g., the selected control 530a and the selected control 530b) are not grayed out. In response to an operation (e.g., a click operation) on the selected control 530b that is not grayed out, the electronic device may gray out the control 530b to indicate that recording 002 (the voice obtained during the second recording) is selected. At this time, the electronic device may display the user interface 57 shown in (3) of FIG. 22 described below.

[0268] As shown in (3) in FIG. 22 , the selected voice includes recording 002 (the voice obtained during the second recording) but does not include recording 001 (the voice obtained during the first recording). When part of the voice is selected, in response to the operation on the delete control 533, the electronic device can display a prompt box B involved in deleting part of the voice (the selected voice), and the prompt box B can be used to prompt the user that the content to be deleted is the selected voice, and can also be used to receive the user's input to confirm the operation of deleting the selected voice or cancel the operation of deleting the selected voice.

[0269] As shown in (4) of FIG22 , the prompt box 581 displayed in the user interface 58 may be an exemplary prompt box B. The prompt box 581 may also include prompt information 581a, and the prompt information 581a may be used to prompt the user whether to delete the selected recording (voice).

[0270] The prompt box 581 may also include a selection control 581b, which can be used to receive an operation of whether the user retains the speech-to-text content (the text information corresponding to the selected recording). In some possible cases, the speech-to-text content is selected by default, and the selected control 581b is in state E, for example, state E is grayed out. When the state of the selected control 581b is state E, it means that when the selected voice is deleted, the text information corresponding to the selected voice is retained (not deleted), and in response to the operation of the selected control 581b, the electronic device can change the state of the selected control 581b to state F, for example, the state F is not grayed out. When the state of the selected control 581b is state F, it means that when the selected voice is deleted, the text information corresponding to the selected voice will also be deleted. The state of the selected control 581b can be switched between state E and state F to determine whether the speech-to-text content corresponding to the selected voice is deleted when the selected voice is deleted.

[0271] In the user interface 58, the state of the selected control 581b is not grayed out, indicating that the text information corresponding to the selected voice is deleted when the selected voice is deleted. At this time, the selected voice includes recording 002 (the voice obtained during the second recording), but does not include recording 001 (the voice obtained during the first recording). In response to the operation of the confirmation deletion control 581c, the electronic device can delete the voice obtained during the second recording and the text information corresponding to the voice obtained during the second recording. The voice obtained during the first recording and the text information corresponding to the voice can also be retained in Note 1.

[0272] In the case where Q segments of speech are recorded in Note 1 and L segments of speech are deleted, when L is equal to Q, after deleting L segments of speech and deleting the text information corresponding to the L segments of speech, the user interface displayed by the electronic device can refer to the aforementioned description of (2) in Figure 21. After deleting L segments of speech but retaining the text information corresponding to the L segments of speech, the user interface displayed by the electronic device can refer to the aforementioned description of (2) in Figure 20 or (3) in Figure 20, which will not be repeated here.

[0273] In the case where Q segments of speech are recorded in Note 1 and L segments of speech are deleted, when L is less than Q, after deleting the L segments of speech and deleting the text information corresponding to the L segments of speech, the user interface displayed by the electronic device can refer to that shown in (1) in the following Figure 23.

[0274] As shown in (1) in Figure 23, the playback progress bar 141c included in the user interface 59a includes QL-1 nodes, that is, compared with before deletion, the number of nodes has been reduced by L, corresponding to the deletion of L segments of speech. Here, Q=2, L=1, then the playback progress bar 141c no longer includes nodes, indicating that only one speech is recorded in the note at this time. The total duration recorded in the playback time indicator 141d is changed from the total duration of Q segments of speech to the total duration of QL segments of speech. For example, here it is changed to the total duration of the speech obtained by the first recording: 11s. Area 12 includes text information corresponding to the QL segments of speech that have not been deleted, and no longer includes text information corresponding to the L segments of speech that have been deleted.

[0275] In the case where Q segments of speech are recorded in Note 1 and L segments of speech are deleted, when L is less than Q, after deleting the L segments of speech and not deleting (retaining) the text information corresponding to the L segments of speech, the user interface displayed by the electronic device can refer to that shown in (2) in the following Figure 23.

[0276] As shown in (2) in Figure 23, the playback progress bar 141c included in the user interface 59b includes QL-1 nodes, that is, compared with before the deletion, the number of nodes has been reduced by L, corresponding to the deletion of L segments of speech. Here, Q=2, L=1, then the playback progress bar 141c no longer includes nodes, indicating that only one speech is recorded in the note at this time. The total duration recorded in the playback time indicator 141d is changed from the total duration of Q segments of speech to the total duration of QL segments of speech. For example, here it is changed to the total duration of the speech obtained by the first recording: 11s. Area 12 includes text information corresponding to the Q segments of speech.

[0277] In some possible cases, when the voice recorded in Note 1 only includes one segment of voice, the electronic device can trigger the display of an interface involved in managing (editing) the segment of voice in other ways. The process can refer to the following description of FIG.

[0278] Referring to the user interface 60 shown in (1) of FIG. 24 , in response to an operation (e.g., a click operation) on the voice menu control 141e, the electronic device may not display the aforementioned display box A. Only the editing control is displayed, and the editing control can be used to trigger the display of the interface involved in managing (editing) the voice segment. An exemplary display of the editing control can refer to the editing control 611 included in the user interface 61 shown in (2) of FIG. 24 below.

[0279] In response to the operation on the editing control 611, the electronic device can display more controls involved in managing (editing) the speech segment. It can also trigger the display of information corresponding to the speech segment, which may include the total duration of each speech, the name of the speech, etc. At this time, the electronic device can display the user interface shown in (3) of Figure 24. For the description of the controls involved in the user interface 62, please refer to the description of (2) in Figure 22 above, which will not be repeated here.

[0280] The following describes the relevant content involved when electronic devices share information based on Figures 25-28.

[0281] Sharing information includes transmitting the content to be shared in the note to other terminals, and the sharing method can be selected. The content to be shared can be selected by the user through the electronic device.

[0282] In some possible cases, the content to be shared may be information other than voice information in the note. For example, the information other than voice information includes speech-to-text content in area 12 and non-recording content in area 2.

[0283] Exemplarily, FIG. 25 describes a set of exemplary user interfaces involved when the content to be shared is information other than voice in a note.

[0284] As shown in (1) of FIG. 25 , user interface 70 is an exemplary user interface involved in processing note 1. The user interface 70 includes at least one functional control for note 1. For example, it may include a sharing control 701a, a favorite control 701b, a delete control 701c, and a more control 701d. Among them, the favorite control 701b can be used to trigger the collection of note 1. The delete control 701c can be used to trigger the deletion of note 1. The more control 701d can be used to trigger the display of more functional controls for note 1. The sharing control 701a can be used to trigger the display of related interfaces involved in sharing the content in note 1.

[0285] In response to an operation on the sharing control 701a (e.g., a click operation), the electronic device may display the user interface 71 shown in (2) of FIG. 25 . The user interface 71 is an exemplary interface involved in sharing the content in the note 1. The user interface 71 may include a selection box 711, and the selection box 711 may include controls involved in selecting different sharing methods. For example, the selection box 711 may include controls 711a, controls 711b, controls 711c, and controls 711d. Among them, the control 711a may be used to trigger the content to be shared in the note to be converted into a picture and then transmitted to other terminals in the form of a picture. The control 711b may be used to trigger the content to be shared in the note to be converted into text and then transmitted to other terminals in the form of a document, and the format of the text includes txt. The control 711d may be used to trigger the content to be shared in the note to be transmitted to other terminals in the form of a note, that is, the format of the note may not be changed when sharing. Control 711c can be used to trigger the conversion of a note into a document and then save it. The process includes: the electronic device can call the function of generating a document with a document editing application to convert Note 1 into a document and then save it. Subsequently, the electronic device can share the document to the terminal. The document can include a word document or a PDF document.

[0286] Here, converting the content to be shared into a picture for sharing is taken as an example.

[0287] In response to the operation on the control 711a, the electronic device may display the user interface 72 shown in (3) of the following FIG. 25, which is an exemplary sharing interface involved in converting the content to be shared in the note into a picture for sharing. The user interface 72 may also include icons corresponding to applications with sharing functions, for example, the applications with sharing functions may be application 1, application 2, and other applications shown in the figure. The icon corresponding to the application with sharing function is used to trigger the transmission of the content to be shared to other devices through the application corresponding to the icon.

[0288] The user interface 72 may also include a selection control 722. By default, the state of the selection control 722 may be set to state G (e.g., state G is grayed out), and the selection control 722 in state G may be used to indicate that the speech-to-text content in area 12 is to be used as part of the content to be shared. At this time, the electronic device may integrate the speech-to-text content in area 12 and the non-recording information in area 2 into a picture for sharing. An exemplary display of the integrated picture may refer to picture 721 shown in the interface 72.

[0289] Subsequently, the electronic device can integrate the speech-to-text content in area 12 and the non-recording information in area 2 into a picture and transmit it to other devices through an application with a sharing function (such as application 1, application 2 and other applications shown in the figure).

[0290] In response to the operation on the selected control 722, the electronic device may display the user interface 73 shown in (4) of FIG. 25. In the user interface 73, the electronic device may set the state of the selected control from state G to state F (e.g., not grayed out), and the selected control 722 in state F may be used to indicate that the speech-to-text content in area 12 may not be included as part of the content to be shared. At this time, the electronic device may integrate the non-recorded information in area 2 into a picture for sharing. An exemplary display of the integrated picture may refer to picture 731 shown in interface 73.

[0291] Subsequently, the electronic device can integrate the non-recording information in area 2 into a picture and transmit it to other devices through an application with a sharing function (such as application 1, application 2 and other applications shown in the figure).

[0292] It should be understood that here, the example of selecting the control 722 to indicate that the speech-to-text content in area 12 is used as part of the content to be shared is used as an example. In actual use, the control 722 can also be selected to indicate that the speech-to-text content in area 12 is not used as part of the content to be shared by default. This embodiment of the application is not limited to this.

[0293] In some possible cases, the content to be shared may be all the content in the note. For example, the entire content may include all voices, voice-to-text content in area 12, and non-recorded content in area 2.

[0294] Exemplarily, FIG. 26 describes a set of exemplary user interfaces involved when the content to be shared may be the entire content in the note.

[0295] In this case, referring to the user interface 70 shown in (1) of FIG25 , in response to the operation on the sharing control 701a, the electronic device may display the user interface 74a shown in (1) of FIG26 . The user interface 74a is another exemplary interface involved in sharing the content in the note 1.

[0296] As shown in (1) of Figure 26, the user interface 74a may include a selection box 741, and the selection box 741 may include controls involved in selecting different sharing methods. For example, the selection box 741 may include controls 741a and controls 741b. Among them, control 741a can be used to trigger the transmission of the voice in the content to be shared to other terminals in the form of audio, and, after converting other information other than the voice into pictures, it is transmitted to other terminals in the form of pictures. Control 741b can be used to trigger the transmission of the voice in the content to be shared to other terminals in the form of audio, and, after converting other information other than the voice into text, it is transmitted to other terminals in the form of a document, and the format of the text includes txt. Other sharing methods may also be included, such as the aforementioned method of sharing to other devices in the form of notes, which is not limited in the embodiments of the present application.

[0297] In response to the operation on the control 741a, the electronic device may display the user interface 74b shown in (2) of the following FIG. 26. The user interface 74b is an exemplary sharing interface involved in converting the content to be shared in the note into pictures and audio for sharing. The user interface 74b may include a selected control 742a and a selected control 742b. By default, the state of the selected control 742a and the selected control 742b may be set to state J (for example, the state J is grayed out), and the selected control 742a in state J may be used to indicate that the speech-to-text content in area 12 is used as part of the content to be shared. The control 742b in state J is used to indicate that the voice in note 1 is used as part of the content to be shared. At this time, the electronic device can transmit the voice in note 1 as audio (for example, audio 743) to other devices. The electronic device can also integrate the speech-to-text content in area 12 and the non-recording information in area 2 into a picture for sharing. An exemplary display of the integrated picture can refer to the picture 744 shown in the user interface 74b.

[0298] Subsequently, the electronic device may transmit the audio 743 and the picture 744 to other devices through an application with a sharing function (such as application 1, application 2, and other applications shown in the figure).

[0299] The display modes of the audio 743 and the image 744 received by other devices include but are not limited to the following display modes:

[0300] Display mode 11: The audio 743 and the picture 744 are displayed as two pieces of information. The display mode of the audio 743 includes displaying it in the form of an audio file. After downloading the audio file, the audio 743 can be played.

[0301] Display mode 12: The audio 743 and the picture 744 are displayed as two pieces of information. The display mode of the audio 743 includes displaying it as an audio message, and in response to an operation (such as a click operation) on the audio message, the audio 743 can be played.

[0302] Display mode 13: The audio 743 and the picture 744 are displayed as two pieces of information. The display mode of the audio 743 includes displaying it in the form of a voice bar, and two controls can be provided in the voice bar, one of which is used to trigger the audio playback, and the other is used to trigger the voice-to-text conversion.

[0303] It should be understood here that when the state of the selected control 742b is state K, for example, the state K may not be grayed out. The electronic device may integrate the speech-to-text content in area 12 and the non-recording information in area 2 into a picture or document for sharing. This process may refer to the aforementioned description of (3) in Figure 25, which will not be repeated here. When the states of the selected control 742a and the selected control 742b are both in state K. The electronic device may not analyze the speech-to-text content in area 12, and may integrate the non-recording information in area 2 into a picture or document for sharing. This process may refer to the aforementioned description of (4) in Figure 25, which will not be repeated here.

[0304] In some possible cases, the content to be shared may include the selected voice and may also include text information corresponding to the selected voice.

[0305] Exemplarily, FIG. 27A describes a set of exemplary user interfaces involved when the content to be shared may be a selected voice and text information corresponding to the selected voice.

[0306] As shown in (1) of FIG. 27A , user interface 57 is an exemplary interface involved in editing a voice. For the relevant description of the user interface 57, reference can be made to the relevant description of (3) of FIG. 22 , which will not be repeated here. At this time, the voice selected by the electronic device includes recording 002 (the name corresponding to the voice obtained by the second recording). In response to the operation of the sharing control 531, the electronic device can display a prompt box C involved in sharing the selected voice, and the prompt box C can be used to prompt the user that the content to be shared is the selected voice, and can also be used to receive the user's input to confirm the operation of sharing the selected voice or cancel the operation of sharing the selected voice.

[0307] As shown in (2) of FIG27A , the prompt box 751 displayed in the user interface 75 may be an exemplary prompt box C. The prompt box 751 may also include prompt information 751a, and the prompt information 751a may be used to prompt the user whether to share the selected recording (voice).

[0308] The prompt box 751 may also include a selected control 751b, which can be used to receive an operation of whether the user shares the voice-to-text content (the text information corresponding to the selected voice). In some possible cases, the voice-to-text content is selected by default, and the selected control 751b is in state E1, for example, state E1 is grayed out. When the state of the selected control 751b is state E1, it means that when the selected voice is shared, the text information corresponding to the selected voice will also be shared. In response to the operation of the selected control 751b, the electronic device can change the state of the selected control 751b to state F1, for example, the state F1 is not grayed out. When the state of the selected control 751b is state F1, it means that when the selected voice is shared, the text information corresponding to the selected voice may not be shared. The state of the selected control 751b can be switched between state E1 and state F1 to determine whether the text information corresponding to the selected voice is shared when the selected voice is shared.

[0309] The prompt box 751 may also include a confirmation sharing control 751c. When the state of the selected control 751 is E1 (for example, grayed out), the confirmation sharing control 751c can be used to trigger the sharing of the selected voice and the text information corresponding to the selected voice. At this time, in response to the operation of determining the sharing control 751c, the electronic device can display the user interface involved in selecting the sharing method. After selecting the sharing method, the electronic device can transmit the selected voice and the text information corresponding to the selected voice to other terminals. The process can refer to the aforementioned description of the sharing methods involved in (1) and (2) in Figure 26, which will not be repeated here.

[0310] When the state of the selected control 751b is F1 (e.g., not grayed out), the confirmation sharing control 751c can be used to trigger sharing of the selected voice, but not to share the text information corresponding to the selected voice. At this time, in response to the operation of the confirmation sharing control 751c, the electronic device can transmit the selected voice in the form of audio to other devices through applications with sharing functions (e.g., application 1, application 2, and other applications shown in the figure).

[0311] It should be understood that the aforementioned selection control 751b is optional. In some possible cases, when sharing the selected voice, it may not be involved in whether to share the text information corresponding to the selected voice. By default, the text information corresponding to the selected voice is not shared. The embodiments of the present application do not limit this.

[0312] In other possible cases, the content to be shared may include the selected voice, text information corresponding to the selected voice, and notes to which the voice belongs.

[0313] As shown in (1) of FIG. 27A , in response to an operation on the sharing control 531, the electronic device may not display the aforementioned prompt box A, but may display a prompt box D involved in sharing the selected voice, which may be used to prompt the user that the content to be shared is the selected voice, and may also be used to receive an operation input by the user to confirm sharing the selected voice, or to cancel sharing the selected voice. It may also be used to receive an operation input by the user to confirm sharing the note described by the selected voice, or to cancel sharing the note.

[0314] As shown in FIG. 27B , the prompt box 761 displayed in the user interface 76 may be an exemplary prompt box D. The prompt box 761 may also include prompt information 751a, which may be used to prompt the user whether to share the selected recording (voice). The prompt box 761 may also include a selection control 751b, which may be used to receive an operation of whether the user shares the voice-to-text content (the text information corresponding to the selected voice). For the operation of the prompt information 751a and the control 751b, reference may be made to the description of (2) in FIG. 27A above, which will not be repeated here.

[0315] The prompt box 761 may also include a selection control 7611, which can be used to receive an operation of whether to share the note (note 1) to which the selected voice belongs. In some possible cases, note 1 is selected to be shared by default, and the selection control is in state E2 at this time, for example, state E2 is grayed out. When the state of the selection control 7611 is state E2, it means that when the selected voice is shared, the note to which the selected voice belongs will also be shared. In response to the operation on the selection control 7611, the electronic device can change the state of the selection control 7611 to state F2, for example, state F2 is not grayed out. When the state of the selection control 7611 is state F2, it means that when sharing the selected voice, the note to which the selected voice belongs may not be shared. The state of the selection control 7611 can be switched between state E2 and state F2 to determine whether to share the note to which the selected voice belongs when sharing the selected voice.

[0316] In some other possible cases, the content to be shared may include selected speech-to-text content.

[0317] Exemplarily, FIG. 28 describes a set of exemplary user interfaces involved when the content to be shared may be selected speech-to-text content.

[0318] As shown in FIG28 , the user interface 17a is an exemplary user interface involved in processing the selected speech-to-text content. For the relevant content involved in the user interface 17a, reference can be made to the description of (1) in FIG8 , which will not be repeated here. At this time, the selection mark 162 indicates that the selected speech-to-text content is: "The second part mainly talks about XXXXXX." In response to the operation of the sharing control 161e, the electronic device can transmit the selected speech-to-text content to other devices.

[0319] It should be understood that the user interface involved in the embodiment of the present application is an exemplary display, and any user interface can include more or fewer controls. The form of each control can be changed, including but not limited to icons, text, etc. The position of each control can also be changed, and should not constitute a limitation on the embodiment of the present application. For example, the conversion control 137a displayed in area 1 can be displayed in area 11 or other places in addition to being displayed in area 12. For example, as shown in (1) of reference Figure 29, after starting recording, the conversion control 137a can be placed in area 11. For example, as shown in (2) of reference Figure 29, after pausing recording, the conversion control 1 can be placed in area 11.

[0320] FIG. 30 depicts an exemplary flowchart of the information processing method of the present application.

[0321] In some possible cases, the exemplary process involved in recording information by the electronic device may refer to the following description of steps S101 to S106.

[0322] S101. After creating note 1, the electronic device displays interface 1, which includes area 1, area 2 and a conversion control in state C.

[0323] In some possible cases, the note 1 mentioned in the foregoing content may also be referred to as the first file. The interface 1 may also be referred to as the first interface. The area 1 may be referred to as the first area, and the area 2 may be referred to as the second area. The state C may be referred to as the first state. The conversion control may be referred to as the first control.

[0324] In step S101, the relevant process involved in establishing note 1 can refer to the aforementioned description of Figures 1A and 1B, which will not be repeated here.

[0325] The conversion control may be the conversion control 137a mentioned above. Area 1 is the area mentioned above for presenting content related to recording. Area 2 is the editing area mentioned above. The interface 1 may be the exemplary user interface mentioned above including area 1, area 2 and the conversion control in state C. For example, it may be the user interface 13b shown in (3) of FIG. 2, the user interface 13c shown in (4) of FIG. 2, etc.

[0326] The conversion control in state C is used to trigger the conversion of the recorded speech into text.

[0327] S102. For the first time, the display control 1 instructs the electronic device to display text converted from the recorded voice 1 in area 1, and to receive input information 1 and display the information 1 in area 2.

[0328] In some possible cases, the voice 1 may also be referred to as the first voice, the control 1 may also be referred to as the second control, and the information 1 may also be referred to as the first information.

[0329] Voice 1 may be the voice recorded for the first time mentioned above. The first time may be a certain time when the electronic device records voice 1. Information 1 may be information input by the electronic device through an input tool, such as text or a picture. The input tool includes a keyboard and a stylus tool bar. Control 1 may be the recording bar (recording bar 1) or the pause recording control 136a in the state 1 mentioned above.

[0330] After the electronic device creates note 1, the recording control included in interface 1 can trigger recording voice 1. When the conversion control is in state C, the electronic device can turn on the voice-to-text function. At this time, the electronic device can display the text converted from voice 1 in area 1 while recording voice 1, and can input information (e.g., information 1) input by the input tool, and display the information 1 in area 2. The exemplary user interface involved in this process can refer to the user interface 13c and other related interfaces shown in Figure 2 above.

[0331] S103. In response to the operation on the conversion control in state C, the electronic device stops converting speech into text, and updates the state of the conversion control to state D.

[0332] In response to an operation on a conversion control in state C, the electronic device may update the state of the conversion control to state D, and the conversion control in state D may be used to indicate stopping converting speech to text.

[0333] At this time, the electronic device can still continue to record the voice, and during the voice recording process, information can be input through the input tool.

[0334] The exemplary interfaces involved in this process can be referred to in the aforementioned description of FIG. 7 (1) and FIG. 7 (2), which will not be repeated here.

[0335] S104. Area 1 is divided into area 11 and area 12, area 11 includes control 1, and area 12 includes text obtained by voice conversion. In response to the operation on control 1, the electronic device replaces control 1 with control 2, and control 2 is used to instruct the electronic device to end recording voice and is also used to trigger the electronic device to record other voices.

[0336] In some possible cases, the area 11 may be referred to as a first sub-area, and the area 12 may be referred to as a second sub-area. The control 2 may also be referred to as a third control.

[0337] Area 11 may be the aforementioned voice recording area, and area 12 may be the aforementioned voice-to-text area.

[0338] When control 1 is a recording bar (recording bar 1) in state 1, control 2 may be a recording bar (recording bar 2) in state 2. When control 1 is a pause recording control 136a, control 2 may be a start recording control 141a.

[0339] The relevant contents involved in step S104 can refer to the aforementioned description of the relevant contents in (2) in FIG. 7 and (3) in FIG. 7 , which will not be repeated here.

[0340] S105. After the voice recording is finished, if no text obtained by voice conversion is obtained, area 1 does not include area 12.

[0341] The relevant contents involved in this process can be referred to the aforementioned description of the relevant contents in (2) in FIG. 3 and (3) in FIG. 3 , which will not be repeated here.

[0342] S106. The electronic device records the voice 1, the text converted from the voice 1, and the information 1 into the note 1.

[0343] The following first introduces an exemplary electronic device provided by an embodiment of the present application.

[0344] FIG31 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0345] The following is a specific description of the embodiment using an electronic device as an example. It should be understood that the electronic device may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0346] The electronic device may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194 and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0347] It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0348] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0349] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0350] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0351] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, etc.

[0352] It is understandable that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0353] The charging management module 140 is used to receive charging input from a charger.

[0354] The power management module 141 is used to connect the battery 142 , the charging management module 140 and the processor 110 .

[0355] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0356] In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include the global system for mobile communications (GSM), general packet radio service (GPRS), etc.

[0357] The electronic device realizes the display function through a GPU, a display screen 194, and an application processor.

[0358] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0359] The electronic device can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0360] The ISP is used to process data fed back by the camera 193 .

[0361] The camera 193 is used to capture still images or videos.

[0362] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals. For example, when an electronic device selects a frequency point, a digital signal processor is used to perform Fourier transform on the frequency point energy.

[0363] Video codecs are used to compress or decompress digital video.

[0364] NPU is a neural-network (NN) computing processor. It can quickly process input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn.

[0365] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0366] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external non-volatile memory.

[0367] The electronic device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0368] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0369] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device can listen to music, recordings, or listen to hands-free calls through the speaker 170A.

[0370] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0371] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0372] The earphone jack 170D is used to connect a wired earphone.

[0373] Buttons 190 include a power button, a volume button, and the like.

[0374] Motor 191 can generate vibration prompts.

[0375] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0376] The SIM card interface 195 is used to connect a SIM card.

[0377] In the embodiment of the present application, the processor 110 can call the computer instructions stored in the internal memory 121 to enable the electronic device to execute the information processing method in the embodiment of the present application.

[0378] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0379] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0380] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0381] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

An information processing method, characterized in that: The method includes: an electronic device displays a first interface, the first interface includes a first area, a second area and a first control in a first state; at a first moment, when the electronic device displays the second control and the first control in the first state, the electronic device records a first voice and displays text obtained by converting the first voice in the first area; the second control is used to indicate that recording is in progress, and the first control in the first state is used to indicate that the recorded voice is converted into text during recording; when the electronic device displays the second control and the first control in the first state, the electronic device receives first information input by a user and displays the first information in the second area; in response to an operation on the first control in the first state, when the second control is displayed, the electronic device switches the state of the first control to the second state, stops converting the recorded voice into text, and the first control in the second state is used to indicate pausing the conversion of the recorded voice into text; the electronic device records the first voice, the text obtained by converting the first voice and the first information into a first file. The method according to claim 1, characterized in that The first area includes a first sub-area and a second sub-area, the first sub-area is used to display the second control; the second sub-area is used to display text obtained by voice conversion; When the electronic device displays the second control, the method further includes: in response to an operation on the second control, the electronic device replaces the second control with a third control; The third control is used to instruct the electronic device to end voice recording; after the voice recording is ended, when the electronic device does not obtain the text converted from the voice, the first area does not include the second sub-area. The method according to claim 1 or 2, characterized in that The method also includes: when playing the first voice, the electronic device displays a progress bar, and the progress bar is used to indicate the progress of playing the voice; when the first identifier is displayed at the first position of the progress bar, the electronic device displays the first information in a third state, and displays the second information in the second area in a fourth state; wherein the first identifier is used at the first position to indicate that the electronic device is playing the voice recorded at the first moment; the input time of the second information is a second moment, and the second moment is later than the first moment. The method according to claim 3, characterized in that In the case where the first mark is displayed at the first position of the progress bar, the method further includes: the electronic device displays text converted from the voice recorded at the first moment in the first area. The method according to claim 3 or 4, characterized in that After displaying the second information in the second area in the fourth state, the method further includes: in response to an operation on a fourth control, the electronic device displays the second information in the third state. The method according to any one of claims 3 to 5, characterized in that In the case where a first identifier is displayed at a first position of the progress bar, the method further includes: in response to a first operation on a second position in the progress bar, the electronic device displays third information in a second area in a fifth state; wherein the input time of the third information is a third moment, and the voice recorded by the electronic device at the third moment is indicated at the second position. The method according to any one of claims 2 to 6, characterized in that The method also includes: when Q segments of speech are recorded after the first file is established, the electronic device displays Q-1 nodes in the progress bar; the Q-1 nodes divide the progress bar into Q sub-progress bars; the i-th sub-progress bar in the Q sub-progress bars is used to indicate the i-th segment of speech in the Q segments of speech; Q is an integer greater than or equal to 2; after detecting an operation on the fifth control, when the first identifier is in the i-th sub-progress bar, the electronic device plays the i-th segment of speech. The method according to claim 7, characterized in that The method also includes: the electronic device selects L segments of speech from Q segments of speech; L is an integer less than or equal to Q; when the sixth control is in the sixth state, in response to the operation of the seventh control, the electronic device deletes the L segments of speech, and deletes the text converted from the L segments of speech; when the sixth control is not in the sixth state, in response to the operation of the seventh control, the electronic device deletes the L segments of speech, and retains the text converted from the L segments of speech. The method according to claim 8, characterized in that The method also includes: when the eighth control is in the eighth state, in response to the operation of the ninth control, the electronic device transmits the content in the second area and the text converted from the Q-segment speech to other devices; when the eighth control is not in the eighth state, in response to the operation of the ninth control, the electronic device transmits the content in the second area to other devices. The method according to any one of claims 1 to 9, characterized in that Receiving first input information specifically includes: the electronic device displays a first input tool in the first interface; the electronic device receives the first input information through the first input tool; the method also includes: when displaying the first input tool, also displaying a tenth control; in response to an operation on the tenth control, the electronic device switches the first input tool to a second input tool; when displaying the second input tool, also displaying an eleventh control; the eleventh control is used to trigger switching from the second input tool to the first input tool. The method according to any one of claims 1 to 10, characterized in that The method further includes: in response to an operation on a twelfth control; the electronic device changes the size of the second sub-area from a first size to a second size. A computer storage medium, characterized in that The storage medium stores a computer program, wherein the computer program includes executable instructions. When the executable instructions are executed by a processor, the processor is enabled to perform the method according to any one of claims 1 to 11. An electronic device, characterized in that: The electronic device comprises: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions so that the electronic device executes the method as described in any one of claims 1 to 11.

Images