Voice information sending method, device and electronic equipment

By providing voice input and editing controls in the graphical user interface, users can edit voice data in real time during recording, solving the problem of re-recording the entire voice segment in existing technologies and improving the efficiency and experience of voice recording.

CN117041409BActive Publication Date: 2026-02-24NETEASE (HANGZHOU) NETWORK CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202310771408.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-27
Publication Date
2026-02-24
Estimated Expiration
2043-06-27

AI Technical Summary

Technical Problem

In existing technologies, when users encounter errors or unsatisfactory voice data during voice recording, they need to re-record the entire voice segment, resulting in a waste of time and effort, and a poor voice recording experience.

Method used

A method for sending voice information is provided, which allows users to enter a voice editing mode during the recording process through voice input and editing controls in a graphical user interface, so as to edit and modify erroneous or unsatisfactory voice data in real time, avoiding the need to re-record the entire voice segment.

Benefits of technology

It enables real-time modification of erroneous or unsatisfactory voice data during the voice recording process, saving users time and effort and improving the voice recording experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117041409B_ABST
    Figure CN117041409B_ABST
Patent Text Reader

Abstract

The present disclosure provides a voice information sending method, device and electronic equipment. First, in response to a first trigger operation on a voice input control, voice data is received, and a modification control is displayed in a graphical user interface. Then, in response to a second trigger operation on the modification control, a voice editing mode for the voice data is entered. In the voice editing mode, in response to an editing operation on the voice data, edited voice data is determined. Then, in response to a voice information sending operation, voice information containing the edited voice data is sent to a communication party. This way, the user can modify the voice data that is incorrect or unsatisfactory during real-time voice input, without having to re-record the entire voice to modify it, thereby saving the user's time and effort in modifying the voice and improving the user's experience in voice recording.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of data processing technology, and in particular to a method, apparatus and electronic device for transmitting voice information. Background Technology

[0002] The application of voice recording in chat systems and products is becoming increasingly widespread. For example, in social media, voice chat applications, and voice input products, users can use voice to input text, leave voice messages, and comment. The voice recording methods provided by related technologies typically require users to press and hold a voice recording control to record voice and generate a complete recording. However, if errors or unsatisfactory voice data occur during recording, the entire recording usually needs to be re-recorded, wasting the user's time and effort, potentially interrupting their train of thought, and resulting in a poor user experience. Summary of the Invention

[0003] The purpose of this disclosure is to provide a method, apparatus, and electronic device for transmitting voice information, so as to modify erroneous or unsatisfactory voice data in real time during the user's voice recording process, without having to re-record the entire voice segment, thereby saving the user's time and effort and improving the user's voice recording experience.

[0004] In a first aspect, this disclosure provides a method for transmitting voice information, which provides a graphical user interface through a terminal device; the graphical user interface includes a voice input control; the method includes: receiving voice data in response to a first trigger operation on the voice input control, and displaying a modification control in the graphical user interface; controlling entry into a voice editing mode for the voice data in response to a second trigger operation on the modification control; in the voice editing mode, determining the edited voice data in response to an editing operation on the voice data; and transmitting voice information containing the edited voice data to a communicating party in response to a voice information transmission operation.

[0005] Secondly, this disclosure provides a voice information transmission device that provides a graphical user interface (GUI) via a terminal device. The GUI includes a voice input control. The device comprises: a control display module, configured to receive voice data in response to a first trigger operation on the voice input control and display a modification control in the GUI; a control trigger module, configured to control entry into a voice editing mode for the voice data in response to a second trigger operation on the modification control; a voice editing module, configured to determine the edited voice data in response to an editing operation on the voice data in the voice editing mode; and a voice transmission module, configured to send voice information containing the edited voice data to the communicating party in response to a voice information transmission operation.

[0006] Thirdly, this disclosure provides an electronic device including a processor and a memory, the memory storing machine-executable instructions that can be executed by the processor, the processor executing the machine-executable instructions to implement the above-described method for transmitting voice information.

[0007] Fourthly, this disclosure provides a computer-readable storage medium storing computer-executable instructions that, when invoked and executed by a processor, cause the processor to implement the aforementioned method for transmitting voice information.

[0008] The embodiments disclosed herein bring the following beneficial effects:

[0009] This disclosure provides a method, apparatus, and electronic device for transmitting voice information. First, it responds to a first trigger operation on a voice input control, receives voice data, and displays a modification control in a graphical user interface. Then, it responds to a second trigger operation on the modification control, controlling entry into a voice editing mode for the voice data. In voice editing mode, it responds to an editing operation on the voice data, confirming the edited voice data. Finally, it responds to a voice information transmission operation, sending voice information containing the edited voice data to the communicating party. This method allows users to modify erroneous or unsatisfactory voice data during real-time voice input without needing to re-record the entire voice segment, thus saving users time and effort in modifying voice and improving the user's voice recording experience.

[0010] Other features and advantages of this disclosure will be set forth in the following description, or some features and advantages may be inferred from the description or determined without doubt, or may be learned by practicing the techniques described above.

[0011] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the specific embodiments of this disclosure or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0013] Figure 1 A flowchart illustrating a method for transmitting voice information provided in this embodiment of the disclosure;

[0014] Figure 2A flowchart illustrating another method for transmitting voice information provided in this disclosure embodiment;

[0015] Figure 3 A flowchart illustrating another method for transmitting voice information provided in this disclosure embodiment;

[0016] Figure 4 A schematic diagram illustrating a graphical user interface provided in an embodiment of this disclosure;

[0017] Figure 5 This is a schematic diagram illustrating another graphical user interface provided in an embodiment of the present disclosure;

[0018] Figure 6 This is a schematic diagram showing a variant template provided in an embodiment of this disclosure;

[0019] Figure 7 This is a schematic diagram of the structure of a voice information transmitting device provided in an embodiment of the present disclosure;

[0020] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0022] Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely to illustrate selected embodiments of the disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0023] The application of voice recording in chat systems and products is becoming increasingly widespread. For example, in social media, voice chat applications, and voice input products, users can use voice to input text, leave voice messages, and comment. The voice recording methods provided by related technologies typically require users to press and hold a voice recording control to record voice and generate a complete recording. However, if pronunciation errors, mispronunciations, or unsatisfactory voice data occur during recording, the entire recording usually needs to be re-recorded, wasting the user's time and effort, potentially interrupting their train of thought, and resulting in a poor user experience. Furthermore, editing and polishing voice recordings also presents certain difficulties and limitations, affecting the quality and effect of the recording.

[0024] In view of the above problems, this disclosure provides a method, apparatus and electronic device for sending voice information, which can be applied to scenarios such as voice recording and voice chat.

[0025] To facilitate understanding of this embodiment, a method for sending voice information disclosed in this disclosure will first be described in detail, which provides a graphical user interface through a terminal device; the terminal device may be a mobile phone, tablet computer, smartwatch, or personal computer, etc., and the graphical user interface includes voice input controls; such as Figure 1 As shown, the method includes the following specific steps:

[0026] Step S102: In response to the first trigger operation for the voice input control, receive voice data and display the modification control in the graphical user interface.

[0027] In practical implementation, the aforementioned voice input control can be displayed anywhere in the graphical user interface (GUI). This location can be determined based on development needs; for example, the voice input control can be displayed at the bottom or right side of the GUI. The first trigger operation can be a long press or drag operation by the user on the voice input control, which can be determined according to development requirements. When the user performs the first trigger operation on the voice input control, the system begins receiving the user's voice input and identifies the received voice as voice data. Simultaneously, a modification control is displayed in the GUI. This modification control is used to modify the voice data.

[0028] Step S104: In response to the second trigger operation for the modification control, control enters the voice editing mode for the voice data.

[0029] The specific operation of the second trigger operation can be determined according to the research and development needs. For example, the second trigger operation can be a user's click operation on the modification control or an operation where the voice input control slides to the position of the modification control. When the user performs the second trigger operation on the modification control, the control enters the voice editing mode for voice data. In the voice editing mode, the user needs to stop recording voice and modify and edit the currently recorded voice data.

[0030] Step S106: In voice editing mode, respond to the editing operation on the voice data and determine the edited voice data.

[0031] The above editing operations can be determined based on the R&D operations. For example, the editing operation can be a selection operation of the audio content that needs to be retained in the audio data, and the audio content that needs to be retained is determined as the edited audio data; the editing operation can also be a deletion operation of the audio content that needs to be deleted in the audio data, and the audio data after the deletion is determined as the edited audio data; the editing operation can also be an operation of inserting new audio content at a certain position in the audio data, and the audio data after the insertion is determined as the edited audio data; the editing operation can also be a modification operation of a certain segment of audio in the audio data.

[0032] Step S108: In response to the voice information sending operation, the voice information containing the edited voice data is sent to the communicating party.

[0033] The aforementioned voice information sending operation can be determined based on R&D needs or user actions. For example, the voice information sending operation could be a click operation on a control, or it could end the triggering operation of the voice input control. After the user performs the voice information sending operation, voice information containing edited voice data will be sent to the communication party, which is the terminal device controlled by the object to which the user needs to send voice in real time. This terminal device can be a mobile phone, tablet computer, or computer, etc.

[0034] This disclosure provides a method for sending voice information. First, it responds to a first trigger operation on a voice input control, receives voice data, and displays a modification control in a graphical user interface. Then, it responds to a second trigger operation on the modification control, controlling entry into a voice editing mode for the voice data. In voice editing mode, it responds to an editing operation on the voice data, confirming the edited voice data. Finally, it responds to a voice information sending operation, sending voice information containing the edited voice data to the communicating party. This method allows users to modify erroneous or unsatisfactory voice data during real-time voice input without needing to re-record the entire voice segment, thus saving users time and effort in modifying voice and improving the user's voice recording experience.

[0035] This disclosure also provides another method for transmitting voice information, which is implemented based on the above embodiments. The method focuses on describing the specific process of responding to control entry into a voice editing mode for voice data (implemented through step S204 below), and the specific process of determining the edited voice data in response to editing operations on the voice data in the voice editing mode (implemented through step S206 below); such as Figure 2 As shown, the method includes the following specific steps:

[0036] Step S202: In response to the first trigger operation for the voice input control, receive voice data and display the modification control at a specified location in the graphical user interface.

[0037] In practice, when a user presses and holds the voice input control, the system collects the user's voice, obtains voice data, displays the recording interface in the graphical user interface, and displays the modification control at a specified position in the recording interface. This specified position can be determined according to the development needs. For example, the specified position can be above, to the left, or to the right of the voice input control.

[0038] Step S204: In response to the second trigger operation on the modification control, control enters the voice editing mode for the voice data, and displays the voice progress editing bar corresponding to the voice data in the graphical user interface.

[0039] In one specific embodiment, the second triggering operation for modifying the control includes: starting from the triggering position of the first triggering operation, sliding to the position where the modification control is located.

[0040] In the actual implementation, when the user triggers the modification control, it will enter the voice editing mode for the voice data, and the voice progress editing bar corresponding to the voice data will be displayed at a certain position in the graphical user interface. The voice progress editing bar is used to indicate the total duration of the voice data received through the voice input control, and each time period in the voice progress editing bar corresponds to the corresponding voice data.

[0041] Step S206: Respond to the drag operation on the voice progress editing bar and determine the edited voice data based on the drag operation.

[0042] In practice, players can drag the voice progress bar to select a target area marked on the voice progress indicator. The voice data corresponding to the selected target area is then designated as the voice data to be saved, and this saved voice data becomes the edited voice data. Players can also delete the voice data corresponding to the selected target area, thus designating the voice data after deletion as the edited voice data. Furthermore, players can modify the voice content of the voice data corresponding to the selected target area to obtain modified voice data, which is then designated as the edited voice data. Specifically, the editing of the voice data corresponding to the target area selected by dragging can be determined based on development needs or user input.

[0043] Step S208: In response to the voice information sending operation, the voice information containing the edited voice data is sent to the communicating party.

[0044] The above-mentioned method for sending voice information allows users to trigger a modification control during voice recording to enter voice editing mode, enabling real-time editing of voice data and avoiding the hassle and cost of re-recording the entire voice segment.

[0045] The following examples focus on describing how the edited voice data is determined.

[0046] Specifically, in voice editing mode, the process of responding to editing operations on voice data and determining the specific details of the edited voice data may include: responding to editing operations on voice data and displaying a save control in the graphical user interface; and responding to selection operations on the save control and saving the edited voice data.

[0047] In practice, the selection operation can be a click, long press, or drag operation on the save control, depending on the development needs. When the player selects to save the control, the edited voice data will be saved.

[0048] In an optional embodiment, after saving the edited voice data, a third trigger operation targeting the voice input control can also be responded to to receive voice data based on the saved edited voice data.

[0049] When a user saves edited voice data, the data is saved. The user can then continue inputting voice data, seamlessly connecting the edited data with the newly entered voice data, thus avoiding the need to re-record the entire audio segment. This method avoids the risk of voice data loss and provides flexible voice management and continued input functionality.

[0050] In an optional embodiment, after saving the edited voice data, a prompt message is displayed in the graphical user interface to instruct the user to continue voice input. The specific content of the prompt message can be determined according to development needs. For example, the prompt message could be: move your finger back to the voice input control, or it could be: click the voice input control to continue inputting voice, etc.

[0051] In an optional embodiment, after the player performs the operation indicated by the prompt message, in response to the user's action to continue voice input, a recording countdown is displayed in the graphical user interface. When the recording countdown ends, new voice data is received. This countdown method can prompt the user when to start receiving voice data, thereby making voice input smoother.

[0052] This disclosure also provides another method for sending voice information, which is implemented based on the above embodiments. This method focuses on describing the editing of text data corresponding to voice data, and implements the specific process of editing voice data; for example... Figure 3 As shown, the method includes the following specific steps:

[0053] Step S302: In response to the first trigger operation for the voice input control, receive voice data and display the modification control in the graphical user interface; during the process of receiving voice data, display the text data corresponding to the voice data in the graphical user interface.

[0054] In practice, when a user triggers the voice input control, the system uses speech recognition technology to convert the voice data into text data and displays the corresponding text data in real time above the graphical user interface. This allows the user to clearly see the text content corresponding to their voice, making it easy for them to check whether their voice is correct and meets their requirements.

[0055] Step S304: In response to the second trigger operation for the modification control, control the above text data to enter the editable state.

[0056] Specifically, the text data corresponding to the voice data enters an editable state, that is, it enters the voice editing mode for the voice data. During voice input, if the user finds that they have mispronounced a word or need to modify the voice data, they can perform a second trigger operation on the modification control. When the user performs a second trigger operation on the modification control, the text data corresponding to the voice data will enter an editable state, and the user can modify or re-edit the text data corresponding to the voice data in this editable state.

[0057] Step S306: Respond to the text editing operation on the text data and determine the edited text data based on the text editing operation.

[0058] In practice, the above editing operations can be determined according to the research and development needs, and the editing operations will vary depending on the different modifications made to the text data.

[0059] In an optional embodiment, when the user performs a second trigger operation on the modification control, not only is a save control displayed in the graphical user interface, but also a voice progress editing bar is displayed. When the voice progress editing bar is displayed in the graphical user interface, it indicates entry into a voice editing mode for voice data, allowing the user to edit the text data displayed in the graphical user interface. The length of the voice progress editing bar corresponds to the total duration of the text data corresponding to the voice data, and each segment of the voice progress editing bar corresponds to a certain amount of time and text data. For example... Figure 4 The diagram shown is a graphical user interface provided in an embodiment of this disclosure. Figure 4 The bottom left corner of the image shows the voice input control; the circular control with a cross is the cancel control, and the circular control with the word "edit" is the edit control. Figure 4 The image on the left shows the text data corresponding to the input voice displayed above the graphical user interface after the user presses the voice input control. When the user slides their finger up to the edit control, the graphical user interface will display... Figure 4 The image on the right shows a save control and a voice progress bar, with the voice progress bar displayed above the save control.

[0060] Based on the above description, users can tap a position on the voice progress bar to set that position as the initial position, then drag that initial position to select a time range. Dragging the initial position again allows for adjustment. Users can also long-press a position on the voice progress bar and drag it to the target position to select the time range from the long-pressed position to the target position. Figure 4 As shown in the image on the right, the user selects two time segments using the voice progress bar, and the corresponding text data is displayed in the text data display position using a first display style. The specific display method of this first display style can be determined according to development needs; for example, it can be a highlighted display or a display in a specified color, allowing the user to intuitively see the currently selected text data. Specifically, Figure 4 The voice progress bar in the game displays four vertical lines. These four vertical lines represent drag controls. Players can adjust the selected voice content by adjusting the position of the drag controls. Figure 4 The gray area between the two drag controls is the selected portion.

[0061] In an optional embodiment, the specific process of step S306 above may further include: responding to the selection operation of the second text data in the text data corresponding to the voice data, determining the second text data as the text data to be saved; and determining the text data to be saved as the edited text data. Specifically, the user can also directly select the text data to be saved in the text data corresponding to the voice data while in the text data editing state. For example, the user can click on a position in the text data in the editing state to determine this position as the initial position, and then drag this initial position to select a segment of text data. Dragging the initial position again can adjust the initial position. The user can also long-press on a position in the text data in the editable state, and then drag it to the target position in the text data in the editable state to select the text data corresponding to the area from the long-pressed position to the target position, and determine the selected text data as the text data to be saved.

[0062] It should be noted that, in an optional embodiment, the text data corresponding to the selected time area in the voice progress editing bar can also be determined as the text data to be deleted, or the text data selected in the text data in the editing state can be determined as the text data to be deleted.

[0063] In an optional embodiment, step S306 above can be implemented by the following steps 10-11:

[0064] Step 10: In response to the fourth trigger operation on the first text data in the text data, display an editing control in the graphical user interface; wherein the editing control is used to trigger modifications to the first text data.

[0065] The first text data mentioned above can be any text data in the graphical user interface, specifically determined by the user's fourth trigger operation. When the user triggers the first text data through the fourth trigger operation, not only can the first text data be selected, but the corresponding editing control will also be displayed in the graphical user interface. The fourth trigger operation mentioned above can be a click operation, long press operation, or drag operation of the first text data by the user, and the specific operation can be determined according to the development needs.

[0066] Step 11: Respond to the fifth trigger operation for the edit control, modify the first text data, and determine the edited text data based on the modified first text data.

[0067] The fifth trigger operation described above can be determined based on R&D needs or user operations, and is not specifically limited here. In an optional embodiment, the above-mentioned editing control includes a delete control and a re-entry control; therefore, in response to a trigger operation on the delete control, the first text data can be deleted; or, in response to a trigger operation on the re-entry control, target voice data can be received, and the first text data can be replaced with the text data corresponding to the target voice data. Specifically, the above-mentioned target voice data can be voice data recorded by the user after triggering the re-entry control.

[0068] like Figure 5 The diagram shown is another graphical user interface display provided in an embodiment of this disclosure. Figure 5 This method involves long-pressing the first selected text data in the graphical user interface, which displays delete and re-enter controls. Clicking the delete control removes the selected text data, while long-pressing the re-enter control receives the user-entered target voice data and replaces the selected text data with the corresponding text. This method allows for quick insertion of new text data into the existing text, improving the user's voice input experience and increasing operational flexibility.

[0069] In practical applications, in response to editing operations on voice data or text data, an undo control is displayed in the graphical user interface; this undo control is used to undo the current editing operation. For example... Figure 5 To the left of the save control is an undo control. The display style and position of both the undo and save controls can be determined according to development needs. Figure 5 Only an illustrative description is provided. Specifically, when the user clicks the undo control, the current editing operation is undone, and the graphical user interface returns to the state it was in before the current editing operation.

[0070] In an optional embodiment, the specific process of step S306 above may further include: responding to a text insertion operation at a first position of the text data corresponding to the voice data, inserting the target text data input by the text insertion operation at the first position of the text data corresponding to the voice data; and determining the text data corresponding to the voice data in which the target text data is inserted at the first position as the edited text data. Specifically, the first position can be any position in the text data, determined according to the user operation. In editing mode, the user can directly input the target text data at the first position of the text data corresponding to the voice data, thereby inputting the target text data into the text data corresponding to the voice data.

[0071] In an optional embodiment, the specific process of step S306 above may further include: responding to a modification operation on third text data in the text data corresponding to the voice data, replacing the third text data with the text data input by the modification operation, obtaining the text data corresponding to the replaced voice data, and determining the text data corresponding to the replaced voice data as the edited text data. Specifically, the third text data may be a piece of text content or a word, etc., specifically determined according to the user's modification operation. The user can select the third text data and input new text data, thereby replacing the third text data with new text data, thus completing the editing of the text data.

[0072] Step S308: Determine the edited speech data based on the edited text data.

[0073] In practice, the edited text data can be converted into speech to obtain the edited speech data.

[0074] Step S310: In response to the voice information sending operation, the voice information containing the edited voice data is sent to the communicating party.

[0075] The aforementioned method for sending voice information displays the corresponding text data in real time when the voice input control is triggered, allowing users to check and correct errors instantly during voice recording, thereby improving the accuracy and efficiency of voice recording. Moreover, by adding a modification control, users can trigger the modification control during voice recording to enter edit mode and achieve real-time editing of voice data, avoiding the trouble and cost of re-recording the entire voice segment.

[0076] The following examples focus on the processing of multiple sub-speech when the edited speech data includes multiple sub-speech.

[0077] Specifically, in voice editing mode, in response to editing operations on voice data, after determining the edited voice data, multiple sub-voices can be integrated and processed in chronological order to obtain the final edited voice data; during the integration process, optimization processing is performed on the connection part between two sub-voices.

[0078] In practical applications, edited audio data can consist of multiple sub-speech segments. When integrating these sub-speech segments, the system can perform correction processing at the transitions between them, thereby refining the audio content. In other words, after the user edits the audio data, the system applies AI technology to refine the transitions between audio segments. Specifically, the system can use natural language processing and speech synthesis technologies to automatically correct and optimize audio segments, making the connections between segments (equivalent to the aforementioned sub-speech segments) more natural and fluent, avoiding abruptness and discontinuity between segments.

[0079] In some embodiments, when a user edits voice data, AI technology can be applied to refine the transitions between voice segments in the following ways:

[0080] 1. Utilize speech recognition technology: Convert user-recorded voice data into text format using speech recognition technology for subsequent processing and editing.

[0081] 2. Utilize natural language processing technology: Perform natural language processing on speech data, including word segmentation, part-of-speech tagging, and syntactic analysis, to obtain the correlation and grammatical structure between speech segments.

[0082] 3. Utilize machine learning techniques: Optimize the transitions between speech segments by using trained machine learning models. For example, neural network models can be used to predict and generate appropriate transition words, phrases, or grammatical structures by learning from a large amount of speech data, thereby making the transitions between speech segments more natural and fluent.

[0083] 4. Utilize speech synthesis technology: Convert the optimized speech segment text into speech form through speech synthesis technology, thereby generating a polished and fluent speech recording.

[0084] In the above method, by applying AI polishing technology, the connection between audio segments can be automatically corrected and optimized, making the recorded audio segments more natural and fluent at the connection points, thus improving the quality of audio recording.

[0085] The following examples focus on describing methods for converting speech data into intonation or speech content.

[0086] Specifically, in response to a second trigger operation on the modification control, at least one variant template of the voice data is displayed in the graphical user interface; wherein, different variant templates correspond to different emotion types, and different variant templates process the voice content and tone of the voice data in different ways; in response to a selection operation on the target variant template, the voice content of the voice data is modified according to the target variant template to obtain the modified voice data, and the modified voice data is played through the tone of the emotion type corresponding to the target variant template.

[0087] The selection operation mentioned above can be a click operation or a long press operation on the target variant template. When the user selects the target variant template, the voice content of the voice data will be adjusted according to the emotional type corresponding to the target variant template. Then, information such as the user's voice tone will be collected, and the adjusted voice data will be simulated for reading so that the user can judge whether the tone of the voice data played meets their own requirements.

[0088] In a specific implementation, at least one variant template of the above-mentioned speech data is determined through the following steps 20-22:

[0089] Step 20: Obtain the association information between the sender and receiver of the voice data; wherein, the association information includes the association data between the sender and receiver; wherein, the association data includes at least one of the following: the relationship, intimacy and historical dialogue habits data between the sender and receiver.

[0090] In practical implementation, AI can be used to acquire data on the relationship, intimacy, and historical conversation habits between the sender and receiver of the voice data. The relationship includes parent-child, employee-boss, and spousal relationships, determined specifically based on the sender's notes, chat content, and settings. Intimacy can be determined based on the frequency and duration of conversations between the sender and receiver. Historical conversation habits can be determined from the sender and receiver's past chat logs.

[0091] Step 21: Obtain the acquisition information of the voice data; wherein the acquisition information includes at least one of the following: the time of receiving the voice data and the location of receiving the voice data.

[0092] The aforementioned time for receiving voice data includes: the time when the system receives the voice data recorded by the sender, and whether that time corresponds to a special holiday. The aforementioned location for receiving voice data refers to the location where the system receives the voice data recorded by the sender.

[0093] Step 22: Based on the associated information and the collected information, determine the variant template of the voice data.

[0094] The pre-trained model can determine variant templates for speech data based on associated and collected information. Users can select different variant templates and edit the speech content and segments based on the selected variant templates. In addition, the AI ​​will collect information such as the user's tone of voice and simulate the playback of the speech data.

[0095] like Figure 6 The image shown is a schematic diagram of a variant template provided in an embodiment of this disclosure. Figure 6 The system provides four variant templates for voice data: original sentence template, gentle template, humorous template, and persuasive template. Users can adjust the voice data in different ways by clicking on different variant templates. For example, if the gentle template is selected, some harsh words in the voice data may become softer, and the adjusted voice data will be played with a gentler tone.

[0096] In an optional embodiment, in voice editing mode, in response to a selection operation on the first voice data, at least one variant template of the first voice data is displayed in the graphical user interface. The first voice data can be any segment of voice data. After the user selects the first voice data, the corresponding variant template is displayed in the graphical user interface. This can be understood as the graphical user interface displaying not only variant templates for the entire voice data but also variant templates for each selected voice data segment, allowing for adjustments using different variant templates for different voice segments, thereby increasing the freedom of voice editing.

[0097] In the above method, the system can perform different variations of voice data according to user operations, thereby improving the user's voice input experience.

[0098] In accordance with the above-described method embodiments, this disclosure also provides a voice information transmission device that provides a graphical user interface via a terminal device; the graphical user interface includes voice input controls; such as Figure 7 As shown, the device includes:

[0099] The control display module 70 is used to respond to the first trigger operation of the voice input control, receive voice data, and display the modification control in the graphical user interface.

[0100] The control trigger module 71 is used to respond to the second trigger operation for modifying the control and control the entry into the voice editing mode for voice data.

[0101] The voice editing module 72 is used in voice editing mode to respond to editing operations on voice data and determine the edited voice data.

[0102] The voice sending module 73 is used to respond to the voice information sending operation and send the voice information containing the edited voice data to the communicating party.

[0103] The aforementioned voice information sending device first responds to a first trigger operation on the voice input control, receives voice data, and displays modification controls in the graphical user interface; then, it responds to a second trigger operation on the modification controls, controlling entry into a voice editing mode for the voice data; in voice editing mode, it responds to editing operations on the voice data, confirming the edited voice data; finally, it responds to a voice information sending operation, sending voice information containing the edited voice data to the communicating party. This method allows users to modify erroneous or unsatisfactory voice data during real-time voice input without having to re-record the entire voice segment, thus saving users time and effort in modifying voice and improving the user's voice recording experience.

[0104] Specifically, the aforementioned control triggering module 71 is used to: display the voice progress editing bar corresponding to the voice data in the graphical user interface; the aforementioned voice editing module 72 is used to: respond to the drag operation on the voice progress editing bar, and determine the edited voice data based on the drag operation.

[0105] Furthermore, the aforementioned device also includes a text display module, used to: display text data corresponding to the voice data in a graphical user interface during the reception of voice data. The aforementioned control trigger module 71 is used to: control the text data to enter an editable state; the aforementioned voice editing module 72 is used to: respond to text editing operations on the text data, determine the edited text data based on the text editing operations, and determine the edited voice data based on the edited text data.

[0106] In a specific implementation, the aforementioned voice editing module 72 is used to: respond to editing operations on voice data and display a save control in the graphical user interface; and respond to selection operations on the save control and save the edited voice data.

[0107] Furthermore, the aforementioned dedicated function also includes a voice continuing reception module, which is used to: after saving the edited voice data, respond to a third trigger operation on the voice input control, and receive voice data based on the saved edited voice data.

[0108] Furthermore, the device also includes a prompting module for displaying a prompt message after saving the edited voice data, the prompt message being used to instruct the user to continue the voice input operation.

[0109] In a specific implementation, the device also includes a timing reminder module, which is used to: display a recording countdown in the graphical user interface in response to the user's continued voice input, and receive new voice data when the recording countdown ends.

[0110] Furthermore, the second triggering operation for the modification control mentioned above includes: starting from the triggering position of the first triggering operation, sliding to the position where the modification control is located.

[0111] In a specific implementation, the aforementioned voice editing module 72 is further configured to: respond to a fourth trigger operation on the first text data in the text data, and display an editing control in the graphical user interface; wherein the editing control is used to trigger modifications to the first text data; respond to a fifth trigger operation on the editing control, modify the first text data, and determine the edited text data based on the modified first text data.

[0112] Specifically, the above-mentioned editing controls include a delete control and a re-entry control; the above-mentioned voice editing module 72 is used to: in response to a trigger operation on the delete control, delete the first text data; or, in response to a trigger operation on the re-entry control, receive target voice data and replace the first text data with the text data corresponding to the target voice data.

[0113] Furthermore, the above-mentioned device also includes a retraction module for: displaying a retraction control in a graphical user interface in response to an editing operation on voice data; wherein the retraction control is used to retract the current editing operation.

[0114] In a specific implementation, the above-mentioned device further includes a voice variant module, used to: in response to a second trigger operation on the modification control, display at least one variant template of the voice data in the graphical user interface; wherein, different variant templates correspond to different emotion types, and different variant templates process the voice content and tone of the voice data in different ways; in response to a selection operation on a target variant template, modify the voice content of the voice data according to the target variant template to obtain modified voice data, and play the modified voice data through the tone of the emotion type corresponding to the target variant template.

[0115] Specifically, at least one variant template of the aforementioned voice data is determined by: acquiring association information between the sender and receiver of the voice data; wherein the association information includes association data between the sender and receiver; wherein the association data includes at least one of the following: relationship, intimacy, and historical dialogue habits data between the sender and receiver; acquiring acquisition information of the voice data; wherein the acquisition information includes at least one of the following: the time and location of receiving the voice data; and determining a variant template of the voice data based on the association information and the acquisition information.

[0116] In a specific implementation, the above-mentioned device further includes a variant template display module, which is used to: in voice editing mode, in response to a selection operation of the first voice data in the voice data, display at least one variant template of the first voice data in the graphical user interface.

[0117] In a specific implementation, the edited speech data includes multiple sub-speech data; the device also includes a speech polishing module, which is used to: in speech editing mode, respond to the editing operation on the speech data, determine the edited speech data, and then integrate the multiple sub-speech data in chronological order to obtain the final edited speech data; and optimize the connection between the two sub-speech data during the integration process.

[0118] The voice information sending device provided in this disclosure has the same implementation principle and technical effect as the aforementioned method embodiment. For the sake of brevity, any parts not mentioned in the device embodiment can be referred to the corresponding content in the aforementioned method embodiment.

[0119] This disclosure also provides an electronic device, such as... Figure 8 As shown, the electronic device includes a processor and a memory. The memory stores machine-executable instructions that can be executed by the processor, which executes the machine-executable instructions to implement the aforementioned method for transmitting voice information.

[0120] Specifically, a graphical user interface is provided through a terminal device; the graphical user interface includes a voice input control; the method for sending the aforementioned voice information includes: responding to a first trigger operation on the voice input control, receiving voice data, and displaying a modification control in the graphical user interface; responding to a second trigger operation on the modification control, controlling entry into a voice editing mode for the voice data; in the voice editing mode, responding to an editing operation on the voice data, determining the edited voice data; and responding to a voice information sending operation, sending voice information containing the edited voice data to the communicating party.

[0121] The above method allows users to modify erroneous or unsatisfactory voice data during real-time voice input without having to re-record the entire voice segment. This saves users time and effort in modifying voice recordings and improves their voice recording experience.

[0122] In an optional embodiment, the above-mentioned control enters the voice editing mode for voice data, including: displaying a voice progress editing bar corresponding to the voice data in the graphical user interface; in the voice editing mode, responding to the editing operation for the voice data and determining the edited voice data, including: responding to the drag operation for the voice progress editing bar and determining the edited voice data according to the drag operation.

[0123] In an optional embodiment, the method further includes: displaying text data corresponding to the voice data in a graphical user interface during the process of receiving voice data.

[0124] In an optional embodiment, the above-mentioned control to enter the voice editing mode for voice data includes: controlling text data to enter an editable state; in the voice editing mode, responding to the editing operation for voice data and determining the edited voice data includes: responding to the text editing operation for text data and determining the edited text data based on the text editing operation; and determining the edited voice data based on the edited text data.

[0125] In an optional embodiment, the above response to the editing operation of the voice data, determining the edited voice data, includes: responding to the editing operation of the voice data by displaying a save control in the graphical user interface; and responding to the selection operation of the save control by saving the edited voice data.

[0126] In an optional embodiment, after saving the edited voice data, the method further includes: responding to a third trigger operation on the voice input control, and receiving voice data based on the saved edited voice data.

[0127] In an optional embodiment, after saving the edited voice data, the method further includes: displaying a prompt message, which instructs the user to continue the voice input operation.

[0128] In an optional embodiment, the method further includes: in response to the user continuing voice input, displaying a recording countdown in a graphical user interface, and receiving new voice data when the recording countdown ends.

[0129] In an optional embodiment, the second triggering operation for the modification control includes: starting from the triggering position of the first triggering operation, sliding to the position where the modification control is located.

[0130] In an optional embodiment, the above response to a text editing operation on the text data, and the determination of the edited text data based on the text editing operation, includes: responding to a fourth trigger operation on the first text data in the text data, displaying an editing control in the graphical user interface; wherein the editing control is used to trigger a modification of the first text data; responding to a fifth trigger operation on the editing control, modifying the first text data, and determining the edited text data based on the modified first text data.

[0131] In an optional embodiment, the above-mentioned editing control includes a delete control and a re-entry control; the above-mentioned response to the fifth trigger operation of the editing control, modifying the first text data, includes: responding to the trigger operation of the delete control, deleting the first text data; or, responding to the trigger operation of the re-entry control, receiving target voice data, and replacing the first text data with the text data corresponding to the target voice data.

[0132] In an optional embodiment, the method further includes: in response to an editing operation on the voice data, displaying an undo control in a graphical user interface; wherein the undo control is used to undo the current editing operation.

[0133] In an optional embodiment, the method further includes: responding to a second trigger operation on the modification control, displaying at least one variant template of the voice data in a graphical user interface; wherein different variant templates correspond to different emotion types, and different variant templates process the voice content and tone of the voice data in different ways; responding to a selection operation on a target variant template, modifying the voice content of the voice data according to the target variant template to obtain modified voice data, and playing the modified voice data through the tone of the emotion type corresponding to the target variant template.

[0134] In an optional embodiment, at least one variant template of the aforementioned voice data is determined by: acquiring association information between the sender and receiver of the voice data; wherein the association information includes association data between the sender and receiver; wherein the association data includes at least one of the following: relationship, intimacy, and historical dialogue habits data between the sender and receiver; acquiring collection information of the voice data; wherein the collection information includes at least one of the following: the time and location of receiving the voice data; and determining a variant template of the voice data based on the association information and the collection information.

[0135] In an optional embodiment, the method further includes: in voice editing mode, in response to a selection operation on first voice data in the voice data, displaying at least one variant template of the first voice data in a graphical user interface.

[0136] In an optional embodiment, the edited speech data includes multiple sub-speech data; in speech editing mode, after responding to the editing operation on the speech data and determining the edited speech data, the method further includes: integrating the multiple sub-speech data in chronological order to obtain the final edited speech data; during the integration process, optimizing the connection between two sub-speech data.

[0137] Furthermore, Figure 8 The electronic device shown also includes a bus 102 and a communication interface 103, with the processor 101, the communication interface 103 and the memory 100 connected via the bus 102.

[0138] The memory 100 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 103 (which can be wired or wireless), such as the Internet, wide area network, local area network, or metropolitan area network. The bus 102 may be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 8 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0139] Processor 101 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of processor 101 or by instructions in software form. The processor 101 can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this disclosure can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a readily available storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 100, and processor 101 reads information from memory 100 and, in conjunction with its hardware, completes the steps of the method described in the foregoing embodiments.

[0140] This disclosure also provides a computer-readable storage medium storing computer-executable instructions. When these computer-executable instructions are invoked and executed by a processor, they cause the processor to implement the aforementioned method for transmitting voice information. For specific implementation details, please refer to the method embodiments, which will not be repeated here.

[0141] Specifically, a graphical user interface is provided through a terminal device; the graphical user interface includes a voice input control; the method for sending the aforementioned voice information includes: responding to a first trigger operation on the voice input control, receiving voice data, and displaying a modification control in the graphical user interface; responding to a second trigger operation on the modification control, controlling entry into a voice editing mode for the voice data; in the voice editing mode, responding to an editing operation on the voice data, determining the edited voice data; and responding to a voice information sending operation, sending voice information containing the edited voice data to the communicating party.

[0142] The above method allows users to modify erroneous or unsatisfactory voice data during real-time voice input without having to re-record the entire voice segment. This saves users time and effort in modifying voice recordings and improves their voice recording experience.

[0143] In an optional embodiment, the above-mentioned control enters the voice editing mode for voice data, including: displaying a voice progress editing bar corresponding to the voice data in the graphical user interface; in the voice editing mode, responding to the editing operation for the voice data and determining the edited voice data, including: responding to the drag operation for the voice progress editing bar and determining the edited voice data according to the drag operation.

[0144] In an optional embodiment, the method further includes: displaying text data corresponding to the voice data in a graphical user interface during the process of receiving voice data.

[0145] In an optional embodiment, the above-mentioned control to enter the voice editing mode for voice data includes: controlling text data to enter an editable state; in the voice editing mode, responding to the editing operation for voice data and determining the edited voice data includes: responding to the text editing operation for text data and determining the edited text data based on the text editing operation; and determining the edited voice data based on the edited text data.

[0146] In an optional embodiment, the above response to the editing operation of the voice data, determining the edited voice data, includes: responding to the editing operation of the voice data by displaying a save control in the graphical user interface; and responding to the selection operation of the save control by saving the edited voice data.

[0147] In an optional embodiment, after saving the edited voice data, the method further includes: responding to a third trigger operation on the voice input control, and receiving voice data based on the saved edited voice data.

[0148] In an optional embodiment, after saving the edited voice data, the method further includes: displaying a prompt message, which instructs the user to continue the voice input operation.

[0149] In an optional embodiment, the method further includes: in response to the user continuing voice input, displaying a recording countdown in a graphical user interface, and receiving new voice data when the recording countdown ends.

[0150] In an optional embodiment, the second triggering operation for the modification control includes: starting from the triggering position of the first triggering operation, sliding to the position where the modification control is located.

[0151] In an optional embodiment, the above response to a text editing operation on the text data, and the determination of the edited text data based on the text editing operation, includes: responding to a fourth trigger operation on the first text data in the text data, displaying an editing control in the graphical user interface; wherein the editing control is used to trigger a modification of the first text data; responding to a fifth trigger operation on the editing control, modifying the first text data, and determining the edited text data based on the modified first text data.

[0152] In an optional embodiment, the above-mentioned editing control includes a delete control and a re-entry control; the above-mentioned response to the fifth trigger operation of the editing control, modifying the first text data, includes: responding to the trigger operation of the delete control, deleting the first text data; or, responding to the trigger operation of the re-entry control, receiving target voice data, and replacing the first text data with the text data corresponding to the target voice data.

[0153] In an optional embodiment, the method further includes: in response to an editing operation on the voice data, displaying an undo control in a graphical user interface; wherein the undo control is used to undo the current editing operation.

[0154] In an optional embodiment, the method further includes: responding to a second trigger operation on the modification control, displaying at least one variant template of the voice data in a graphical user interface; wherein different variant templates correspond to different emotion types, and different variant templates process the voice content and tone of the voice data in different ways; responding to a selection operation on a target variant template, modifying the voice content of the voice data according to the target variant template to obtain modified voice data, and playing the modified voice data through the tone of the emotion type corresponding to the target variant template.

[0155] In an optional embodiment, at least one variant template of the aforementioned voice data is determined by: acquiring association information between the sender and receiver of the voice data; wherein the association information includes association data between the sender and receiver; wherein the association data includes at least one of the following: relationship, intimacy, and historical dialogue habits data between the sender and receiver; acquiring collection information of the voice data; wherein the collection information includes at least one of the following: the time and location of receiving the voice data; and determining a variant template of the voice data based on the association information and the collection information.

[0156] In an optional embodiment, the method further includes: in voice editing mode, in response to a selection operation on first voice data in the voice data, displaying at least one variant template of the first voice data in a graphical user interface.

[0157] In an optional embodiment, the edited speech data includes multiple sub-speech data; in speech editing mode, after responding to the editing operation on the speech data and determining the edited speech data, the method further includes: integrating the multiple sub-speech data in chronological order to obtain the final edited speech data; during the integration process, optimizing the connection between two sub-speech data.

[0158] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a terminal device, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0159] In the description of this disclosure, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this disclosure. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0160] Finally, it should be noted that the above-described embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. A method for transmitting voice information, characterized in that, A graphical user interface is provided through the terminal device; The graphical user interface includes a voice input control; the method includes: In response to a first trigger operation on the voice input control, voice data is received and a modification control is displayed in the graphical user interface; In response to a second trigger operation on the modification control, the system enters a voice editing mode for the voice data and displays at least one variant template of the voice data in the graphical user interface to adjust the voice content and tone of the voice data according to the variant template. The at least one variant template of the voice data is determined by: acquiring association information between the sender and receiver of the voice data; wherein the association information includes association data between the sender and receiver; wherein the association data includes at least one of the following: the relationship, intimacy, and historical dialogue habits data between the sender and receiver; acquiring acquisition information of the voice data; wherein the acquisition information includes at least one of the following: the time and location of receiving the voice data; and determining the variant template of the voice data based on the association information and the acquisition information. In the voice editing mode, in response to an editing operation on the voice data, the edited voice data is determined; In response to the voice information sending operation, the voice information containing the edited voice data is sent to the communicating party.

2. The method according to claim 1, characterized in that, The control to enter the voice editing mode for the voice data includes: The graphical user interface displays a speech progress bar corresponding to the speech data. In the voice editing mode, responding to an editing operation on the voice data and determining the edited voice data includes: In response to a drag operation on the voice progress editing bar, the edited voice data is determined based on the drag operation.

3. The method according to claim 1, characterized in that, The method further includes: During the process of receiving the voice data, the text data corresponding to the voice data is displayed in the graphical user interface.

4. The method according to claim 3, characterized in that, The control to enter the voice editing mode for the voice data includes: Control the text data to enter an editable state; In the voice editing mode, responding to an editing operation on the voice data and determining the edited voice data includes: In response to a text editing operation on the text data, determine the edited text data based on the text editing operation; The edited speech data is determined based on the edited text data.

5. The method according to claim 1, characterized in that, The response to the editing operation on the voice data determines the edited voice data, including: In response to an editing operation on the voice data, a save control is displayed in the graphical user interface; In response to the selection operation of the save control, the edited voice data is saved.

6. The method according to claim 5, characterized in that, After saving the edited voice data, the method further includes: In response to a third trigger operation on the voice input control, voice data is received based on the saved edited voice data.

7. The method according to claim 5, characterized in that, After saving the edited voice data, the method further includes: A prompt message is displayed, which instructs the user to continue the voice input operation.

8. The method according to claim 7, characterized in that, The method further includes: In response to the user's continued voice input, a recording countdown is displayed in the graphical user interface, and new voice data is received when the recording countdown ends.

9. The method according to claim 1, characterized in that, The second trigger operation for the modified control includes: starting from the trigger position of the first trigger operation, sliding to the position of the modified control.

10. The method according to claim 4, characterized in that, The response to a text editing operation on the text data, and the determination of the edited text data based on the text editing operation, includes: In response to a fourth trigger operation on the first text data in the text data, an editing control is displayed in the graphical user interface; wherein the editing control is used to trigger a modification on the first text data; In response to the fifth trigger operation on the editing control, the first text data is modified, and the edited text data is determined based on the modified first text data.

11. The method according to claim 10, characterized in that, The editing controls include delete and re-entry controls; The response to the fifth triggered operation of the editing control modifies the first text data, including: In response to a trigger operation on the delete control, delete the first text data; Alternatively, in response to a trigger operation on the re-input control, the system receives target voice data and replaces the first text data with the text data corresponding to the target voice data.

12. The method according to claim 1, characterized in that, The method further includes: In response to an editing operation on the voice data, an undo control is displayed in the graphical user interface; wherein the undo control is used to undo the current editing operation.

13. The method according to claim 1, characterized in that, Different variant templates correspond to different emotion types, and different variant templates process the speech content and tone of voice data in different ways; The method further includes: In response to a selection operation for a target variant template, the speech content of the speech data is modified according to the target variant template to obtain modified speech data, and the modified speech data is played using the tone of voice of the emotion type corresponding to the target variant template.

14. The method according to claim 12, characterized in that, The method further includes: In the voice editing mode, in response to a selection operation on the first voice data in the voice data, at least one variant template of the first voice data is displayed in the graphical user interface.

15. The method according to claim 1, characterized in that, The edited speech data includes multiple sub-speech items; In the voice editing mode, after responding to an editing operation on the voice data and determining the edited voice data, the method further includes: The multiple sub-speech segments are integrated in chronological order to obtain the final edited speech data; during the integration process, optimization is performed on the connection between two sub-speech segments.

16. A device for transmitting voice information, characterized in that, A graphical user interface is provided through the terminal device; The graphical user interface includes a voice input control; the device includes: The control display module is used to respond to a first trigger operation on the voice input control, receive voice data, and display the modification control in the graphical user interface; A control triggering module is used to respond to a second triggering operation on the modification control, control entry into a voice editing mode for the voice data, and display at least one variant template of the voice data in the graphical user interface to adjust the voice content and tone of the voice data according to the variant template; wherein, at least one variant template of the voice data is determined by: obtaining association information between the sender and receiver of the voice data; wherein, the association information includes association data between the sender and the receiver; wherein, the association data includes at least one of the following: the relationship, intimacy, and historical dialogue habits data between the sender and the receiver; obtaining acquisition information of the voice data; wherein, the acquisition information includes at least one of the following: the time and location of receiving the voice data; and determining the variant template of the voice data based on the association information and the acquisition information. The voice editing module is used in the voice editing mode to respond to editing operations on the voice data and determine the edited voice data; The voice sending module is used to respond to the voice information sending operation and send the voice information containing the edited voice data to the communicating party.

17. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing machine-executable instructions that can be executed by the processor, the processor executing the machine-executable instructions to implement the method for transmitting voice information according to any one of claims 1 to 15.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when invoked and executed by a processor, cause the processor to implement the method for transmitting voice information as described in any one of claims 1 to 15.

Citation Information

Patent Citations

  • Voice message processing method and device and electronic equipment

    CN115359795A