Voice processing method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a voice processing method and device, equipment and a storage medium, which are used for maintaining stable recording of voice. The method comprises the steps that a first chat window assembly of a session application interface is displayed through terminal equipment, and the first chat window assembly at least comprises a voice recording control; when a trigger instruction of the voice recording control is received, a recording performing interface is displayed in the first chat window component, a first voice recording operation is performed through the recording performing interface, and the first voice recording operation stores recorded voice input data in real time; displaying a session list component of the session application interface when the first chat window component is changed from a display state to an exit or closing state; and switching the recording interface into a recording suspension interface, and displaying the recording suspension interface in the session list component in a suspension manner.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of data processing technology, and in particular to a speech processing method, apparatus, device and storage medium. Background Art

[0002] With the development of the Internet and cloud service technologies, more and more social users can send messages, such as text, emoticons, and voice, to other members participating in the conversation on the conversation page of a social application.

[0003] At present, the voice messaging capabilities that have been implemented in social applications in the prior art all require that the user keep pressing the voice recording key to receive the sound in a common chat window component, namely AIO, and when the user lets go, the voice message recorded by the user will be directly sent.

[0004] However, when a social user is sending a voice message, if the social user is accidentally interrupted while receiving the voice message, the voice message will be interrupted and will not be saved. As a result, if the social user still chooses to send a voice message, he or she will need to perform the receiving operation again, which can easily generate a lot of redundant and meaningless repetitive work and reduce the social user's experience. Summary of the invention

[0005] The embodiments of the present application provide a voice processing method, apparatus, device and storage medium, which are used to maintain the first voice recording operation without interruption and maintain continuous voice recording based on the recording floating interface when exiting the first chat window component or switching from the first chat window component to other chat window components, and can also switch to multiple other chat window components to perform other operations at the same time, so that the voice input data stored in the first voice recording operation can be sent to the first conversation object through the recording sending control in the recording floating interface even if it is not in the first chat window component, so as to improve the operational efficiency and convenience of using voice messaging capabilities, thereby improving the experience of social users.

[0006] The present invention provides a method for voice processing, including:

[0007] Displaying a first chat window component of the session application interface through the terminal device, wherein the first chat window component includes at least a voice recording control;

[0008] When a trigger instruction of the voice recording control is received, a recording process interface is displayed in the first chat window component, so as to perform a first voice recording operation through the recording process interface, wherein the first voice recording operation stores the recorded voice input data in real time;

[0009] When the first chat window component changes from the display state to the exit or closed state, displaying the conversation list component of the conversation application interface;

[0010] Switch the recording interface to the recording suspension interface, and display the recording suspension interface in the session list component.

[0011] On the other hand, the present application provides a speech processing device, comprising:

[0012] A display unit, configured to display a first chat window component of a conversation application interface through a terminal device, wherein the first chat window component includes at least a voice recording control;

[0013] A processing unit, configured to display a recording process interface in the first chat window component when receiving a trigger instruction of the voice recording control, so as to perform a first voice recording operation through the recording process interface, wherein the first voice recording operation stores the recorded voice input data in real time;

[0014] The display unit is further used to display the conversation list component of the conversation application interface when the first chat window component changes from the display state to the exit or closed state;

[0015] The display unit is also used to switch the recording interface to a recording suspension interface, and to suspend and display the recording suspension interface in the conversation list component.

[0016] In a possible design, in an implementation of another aspect of the embodiment of the present application, the display unit may be specifically used for:

[0017] When the first voice recording operation is interrupted, the first chat window component changes from a display state to a passive exit state or a passive closing state;

[0018] Switch from the first chat window component to the conversation list component, and pause the first voice recording operation;

[0019] The display unit can be used for:

[0020] The recording process interface is switched to the first recording suspension interface, and the first recording suspension interface is suspended and displayed in the first conversation object component of the conversation list component.

[0021] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0022] The display unit is further used to expand the first recording floating interface when receiving a click instruction of the first recording floating interface, and display the audio still icon, the start recording control and the recording sending control in the expanded first recording floating interface;

[0023] The processing unit is also used to send the voice input data stored in the first voice recording operation to the first conversation object corresponding to the first conversation object component in the conversation list component when receiving a trigger instruction of the recording sending control, and hide the first recording floating interface.

[0024] In a possible design, in an implementation of another aspect of the embodiment of the present application, the display unit may be specifically used for:

[0025] When the first chat window component changes from the display state to the active exit or active close state, switching from the first chat window component to the conversation list component;

[0026] The display unit can be used for:

[0027] The recording interface is switched to a second recording suspension interface, and the second recording suspension interface is suspended and displayed in the first conversation object component of the conversation list component.

[0028] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0029] The display unit is further used to expand the second recording floating interface when receiving a click instruction of the second recording floating interface, and display the audio animation icon and the recording sending control in the expanded second recording floating interface;

[0030] The processing unit is also used to send the voice input data stored in the first voice recording operation to the first conversation object corresponding to the first conversation component in the conversation list component when receiving a trigger instruction of the recording sending control, and hide the second recording floating interface.

[0031] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0032] The processing unit is also used to switch the recording interface displayed in the first chat window component to the recording pause interface and pause the first voice recording operation when a trigger instruction of the pause recording control is received, wherein the recording pause interface includes at least an audio still icon, a start recording control, a cancel recording control and a complete recording control.

[0033] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0034] The display unit is further configured to switch the recording progress interface or the recording pause interface displayed in the first chat window component to a recording completion interface when receiving a trigger instruction for completing the recording control, wherein the recording completion interface includes at least a recording sending control and a cancel sending control;

[0035] The processing unit is also used to send the voice input data stored in the first voice recording operation to the first conversation object corresponding to the first chat window component and hide the recording completion interface when a trigger instruction of the recording sending control is received through the recording completion interface.

[0036] In a possible design, in an implementation of another aspect of the embodiment of the present application, the processing unit may be specifically used for:

[0037] When the trigger instruction received for the voice recording control is a long press, a recording interface is displayed in the first chat window component to call the voice recording interface to perform the first voice recording operation.

[0038] In a possible design, in an implementation of another aspect of the embodiment of the present application, the processing unit may be specifically used for:

[0039] When the trigger instruction of the voice recording control is a click, a recording preparation interface is displayed in the first chat window component, wherein the recording preparation interface includes at least an audio still icon, a start recording control, and a cancel recording control;

[0040] When a trigger instruction to start recording control is received, the recording preparation interface displayed in the first chat window component is switched to the recording progress interface, and the voice recording interface is called to perform the first voice recording operation.

[0041] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0042] The processing unit is also used to delete the voice input data stored in the first recording operation and hide the recording interface, the recording pause interface or the recording completion interface when receiving a trigger instruction to cancel the recording control or the sending control.

[0043] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0044] An acquiring unit, configured to acquire a current recording duration corresponding to the voice input data recorded by the first voice recording operation;

[0045] The processing unit is also used to switch the recording interface displayed in the first chat window component to the recording completion interface if the current recording duration is greater than the time threshold, and end the first voice recording operation.

[0046] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0047] The display unit is further configured to display a second chat window component corresponding to the second conversation object component when receiving a trigger instruction of the second conversation object component in the conversation list component;

[0048] The processing unit is further configured to switch the second recording suspension interface to the first recording suspension interface and suspend the first voice recording operation when receiving a trigger instruction of the voice recording control of the second chat window component;

[0049] The processing unit is also used to display a second recording interface in the second chat window component, and call the voice recording interface to perform a second voice recording operation, wherein the second voice recording operation is used to store the recorded second voice input data in real time, and the second recording interface includes at least a second audio animation icon, a second pause recording control, a second cancel recording control, and a second send recording control.

[0050] In a possible design, in an implementation of another aspect of the embodiment of the present application, the processing unit may be specifically used for:

[0051] When a trigger instruction of the recording sending control is received, all voice input data stored in the first recording operation are obtained;

[0052] Performing data stream conversion on all voice input data to obtain a first audio stream;

[0053] The first audio stream is sent to the first conversation object through the conversation application interface, and the recording completion interface is hidden.

[0054] In a possible design, in an implementation of another aspect of the embodiment of the present application,

[0055] The processing unit is also used to, when receiving a move instruction of the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface, perform a move operation on the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface based on the move instruction in the conversation application interface, wherein the move operation includes dragging and hiding.

[0056] On the other hand, the present application provides a computer device, including: a memory, a processor, and a bus system;

[0057] Wherein, the memory is used to store programs;

[0058] The processor is used to implement the above-mentioned methods when executing the program in the memory;

[0059] The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other.

[0060] Another aspect of the present application provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer is enabled to execute the above-mentioned methods.

[0061] It can be seen from the above technical solutions that the embodiments of the present application have the following beneficial effects:

[0062] A first chat window component of a conversation application interface is displayed through a terminal device. When a trigger instruction of a voice recording control in the first chat window component is received, a recording process interface is displayed in the first chat window component, so that a first voice recording operation is performed through the recording process interface to store the recorded voice input data in real time. Then, when the first chat window component changes from a display state to an exit or closed state, a conversation list component of the conversation application interface is displayed, and the recording process interface is switched to a recording suspension interface. Then, the recording suspension interface is displayed in suspension in the conversation list component. Through the above method, when the first chat window component changes from the display state to the exit or close state, the recording interface is switched to the recording suspension interface, and the recording suspension interface is displayed in a suspended manner, so that when exiting the first chat window component or switching from the first chat window component to other chat window components, not only can the first voice recording operation be maintained without interruption based on the recording suspension interface and the continuous recording of the voice be maintained, but it can also switch to multiple other chat window components to perform other operations at the same time, such as editing text, sending images, etc., so that the recording sending control in the recording suspension interface can be used to implement the operation experience of sending the voice input data stored in the first voice recording operation to the first conversation object even if it is not in the first chat window component, so as to improve the operational efficiency and convenience of using the voice message capability, thereby improving the experience of social users. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 This is a schematic diagram of the architecture of a voice data control system in an embodiment of the present application;

[0064] Figure 2 is a flow chart of an embodiment of the speech processing method in the embodiment of the present application;

[0065] Figure 3 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0066] Figure 4 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0067] Figure 5 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0068] Figure 6 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0069] Figure 7is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0070] Figure 8 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0071] Fig. 9 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0072] Fig.10 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0073] Fig.11 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0074] Fig.12 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0075] Fig.13 is another embodiment flow chart of the speech processing method in the embodiment of the present application;

[0076] Fig.14 It is a schematic diagram of a principle flow of the speech processing method in an embodiment of the present application;

[0077] Fig.15 It is a hierarchical schematic diagram of a recording controller of the voice processing method in the embodiment of the present application;

[0078] Fig.16 It is a logical schematic diagram of a recording module of the voice processing method in an embodiment of the present application;

[0079] Fig.17 It is a logic diagram of an element stacking of the speech processing method in an embodiment of the present application;

[0080] Fig.18 It is a logical schematic diagram of a recording and sending of the voice processing method in an embodiment of the present application;

[0081] Fig.19 is a schematic diagram of a recording preparation interface of the voice processing method in an embodiment of the present application;

[0082] Fig. 20 It is a schematic diagram of a recording interface of the voice processing method in an embodiment of the present application;

[0083] Fig.21 It is a floating schematic diagram of a recording floating interface of the voice processing method in the embodiment of the present application;

[0084] Fig. 22It is a schematic diagram showing a recording suspension interface of the voice processing method in an embodiment of the present application;

[0085] Fig.23 This is a page schematic diagram of a voice transmission of the voice processing method in an embodiment of the present application;

[0086] FIG. 24( a ) is a schematic diagram of a page for long-pressing voice recording in a voice processing method according to an embodiment of the present application;

[0087] FIG. 24( b ) is a schematic diagram of a page of a voice click recording of the voice processing method in an embodiment of the present application;

[0088] FIG. 24( c ) is a schematic diagram of a page showing a voice being recorded in the voice processing method according to an embodiment of the present application;

[0089] FIG. 24( d ) is a page diagram of a switching chat window component of the voice processing method in an embodiment of the present application;

[0090] FIG. 24( e ) is a schematic diagram of a speech processing page of the speech processing method in an embodiment of the present application;

[0091] FIG. 24( f ) is a schematic diagram of another speech processing page of the speech processing method in an embodiment of the present application;

[0092] Fig.25 is a schematic diagram of an embodiment of a speech processing device in an embodiment of the present application;

[0093] Fig.26 It is a schematic diagram of an embodiment of a computer device in an embodiment of the present application. DETAILED DESCRIPTION

[0094] The embodiments of the present application provide a voice processing method, apparatus, device and storage medium, which are used to maintain the first voice recording operation without interruption and maintain continuous voice recording based on the recording floating interface when exiting the first chat window component or switching from the first chat window component to other chat window components, and can also switch to multiple other chat window components to perform other operations at the same time, so that the voice input data stored in the first voice recording operation can be sent to the first conversation object through the recording sending control in the recording floating interface even if it is not in the first chat window component, so as to improve the operational efficiency and convenience of using voice messaging capabilities, thereby improving the experience of social users.

[0095] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "corresponding to" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0096] To facilitate understanding, some terms or concepts involved in the embodiments of the present application are first explained.

[0097] 1. Public chat window component (All In One, AIO): The target object (i.e., the chat object) participates in many different types of conversations such as friends, groups, and public accounts. In order to provide the target object with a unified interactive experience, the software provides a chat window component shared by different conversations. The input, click operation and other behavioral habits of the target object in the component can be regarded as consistent.

[0098] It is understandable that in the specific implementation of the present application, related data such as the first chat window component is involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0099] It is understandable that the speech processing method disclosed in the present application specifically involves cloud technology. The following further introduces cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network in a wide area network or a local area network to realize the calculation, storage, processing, and sharing of data. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model application, which can form a resource pool and be used on demand, flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites, and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately, and all kinds of industry data require strong system backing support, which can only be achieved through cloud computing.

[0100] Cloud computing is a computing model that distributes computing tasks across a resource pool consisting of a large number of computers, enabling various application systems to obtain computing power, storage space, and information services as needed. The network that provides resources is called a "cloud". From the user's perspective, the resources in the "cloud" are infinitely scalable and can be obtained at any time, used on demand, expanded at any time, and paid for by use.

[0101] As a provider of basic cloud computing capabilities, a cloud computing resource pool (referred to as a cloud platform, generally referred to as an IaaS (Infrastructure as a Service) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to choose to use. The cloud computing resource pool mainly includes: computing devices (virtualized machines, including operating systems), storage devices, and network devices.

[0102] According to the logical function division, the PaaS (Platform as a Service) layer can be deployed on the IaaS (Infrastructure as a Service) layer, and the SaaS (Software as a Service) layer can be deployed on the PaaS layer. SaaS can also be deployed directly on IaaS. PaaS is a platform for software operation, such as databases, web containers, etc. SaaS is a variety of transaction software, such as web portals, SMS mass senders, etc. Generally speaking, SaaS and PaaS are upper layers relative to IaaS.

[0103] Secondly, cloud security refers to the general term for security software, hardware, users, organizations, and security cloud platforms based on cloud computing business model applications. Cloud security integrates emerging technologies and concepts such as parallel processing, grid computing, and unknown virus behavior judgment. Through a large number of networked clients, it monitors abnormal software behavior in the network, obtains the latest information on Trojans and malicious programs on the Internet, and sends it to the server for automatic analysis and processing, and then distributes virus and Trojan solutions to each client.

[0104] Secondly, cloud storage is a new concept extended and developed from the concept of cloud computing. A distributed cloud storage system (hereinafter referred to as storage system) refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to bring together a large number of different types of storage devices (storage devices are also called storage nodes) in the network through application software or application interfaces to work together and provide external data storage and transaction access functions.

[0105] At present, the storage method of the storage system is: create a logical volume, and when creating a logical volume, allocate physical storage space for each logical volume. The physical storage space may be composed of disks of a storage device or several storage devices. The client stores data on a logical volume, that is, stores the data on the file system. The file system divides the data into many parts, each of which is an object. The object contains not only data but also additional information such as data identification (ID, ID entity). The file system writes each object into the physical storage space of the logical volume, and the file system records the storage location information of each object, so that when the client requests to access the data, the file system can allow the client to access the data according to the storage location information of each object.

[0106] The process of the storage system allocating physical storage space to a logical volume is as follows: based on the estimated capacity of the objects stored in the logical volume (this estimate often has a large margin relative to the actual capacity of the objects to be stored) and the grouping of independent redundant disk arrays (RAID, Redundant Array of Independent Disks), the physical storage space is pre-divided into stripes. A logical volume can be understood as a stripe, thereby allocating physical storage space to the logical volume.

[0107] It should be understood that the voice processing method provided in the present application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, maps, smart transportation, etc., and is used to call a voice recording interface to perform a first voice recording operation to perform voice recording. It can also switch the recording interface to a recording floating interface and trigger the recording sending control in the expanded recording floating interface to send the voice input data stored in the first voice recording operation to the first conversation object to complete voice processing, so as to be applied to scenarios such as instant messaging communication scenarios, multimedia social networks, game social or information communication scenarios.

[0108] In order to solve the above problems, this application proposes a speech processing method, which is applied to Figure 1 The voice data control system shown is shown in Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the architecture of a voice data control system in an embodiment of the present application. Figure 1As shown, the terminal device displays the first chat window component of the conversation application interface. When a trigger instruction of the voice recording control in the first chat window component is received, a recording interface is displayed in the first chat window component, so as to perform a first voice recording operation through the recording interface to store the recorded voice input data in real time. Then, when the first chat window component changes from a display state to an exit or closed state, a conversation list component of the conversation application interface is displayed, and the recording interface is switched to a recording suspension interface. Then, the recording suspension interface is displayed in suspension in the conversation list component. Through the above method, when the first chat window component changes from the display state to the exit or close state, the recording interface is switched to the recording suspension interface, and the recording suspension interface is displayed in a suspended manner, so that when exiting the first chat window component or switching from the first chat window component to other chat window components, not only can the first voice recording operation be maintained without interruption based on the recording suspension interface and the continuous recording of the voice be maintained, but it can also switch to multiple other chat window components to perform other operations at the same time, such as editing text, sending images, etc., so that the recording sending control in the recording suspension interface can be used to implement the operation experience of sending the voice input data stored in the first voice recording operation to the first conversation object even if it is not in the first chat window component, so as to improve the operational efficiency and convenience of using the voice message capability, thereby improving the experience of social users.

[0109] Understandably, Figure 1 Only one type of terminal device is shown in the figure. In actual scenarios, more types of terminal devices may participate in the data processing process. Terminal devices include but are not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, car terminals, etc. The specific number and type depend on the actual scenario and are not limited here. Figure 1 One server is shown in the figure, but in actual scenarios, multiple servers may also be involved, especially in the scenario of multi-model training interaction. The number of servers depends on the actual scenario and is not limited here.

[0110] It should be noted that in this embodiment, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. The terminal device and the server can be directly or indirectly connected through wired or wireless communication, and the terminal device and the server can be connected to form a blockchain network, which is not limited in this application.

[0111] Combined with the above introduction, the speech processing method in this application will be introduced below. Figure 2 In the embodiment of the present application, an embodiment of the speech processing method includes:

[0112] In step S101, a first chat window component of a conversation application interface is displayed through a terminal device, wherein the first chat window component includes at least a voice recording control;

[0113] In an embodiment of the present application, when the user object of the terminal device enters the conversation application interface and needs to have a chat session with the conversation object that can participate in the conversation in the conversation application interface, the conversation application interface can be displayed through the terminal device first, and the first chat window component corresponding to the first conversation object can be entered, so that the subsequent user object can have a conversation with the first conversation object through the first chat window component.

[0114] Among them, for example Fig.19 A first chat window component (such as Fig.19 The chat window with the first conversation object such as jad is shown in the figure), the first chat window component includes at least a voice recording control (such as Fig.19 The A1 microphone icon is used to start voice recording after clicking it, and is used to select (click or hold) the voice recording control to enter the recording interface (such as Fig. 20 The recording interface in A3 shown in the figure) can call the voice recording interface to perform voice recording operations.

[0115] Specifically, when the user of the terminal device enters the session application interface (such as Fig.19 The chat interface of the social application on the PC side shown in the figure) needs to be connected to the conversation object that can participate in the conversation in the conversation application interface (such as Fig.19 When a chat session is conducted with a first conversation object (such as jad) as shown in the figure, the conversation application interface can be displayed through the terminal device first, and the first chat window component (such as Fig.19 As shown in the chat window with the first conversation object such as jad), the subsequent user object can use the voice input control (such as Fig.19 A1 microphone icon is shown), which can be used to start voice recording after clicking to conduct a voice information conversation with the first conversation partner.

[0116] Alternatively, when the user of the terminal device enters the conversation application interface (the chat interface of the social application of the mobile terminal as shown in the left figure of Figure 24(a)), and needs to have a chat session with the conversation object that can participate in the conversation in the conversation application interface (the first conversation object such as ddd as shown in the left figure of Figure 24(a)), the conversation application interface can be displayed through the terminal device first, and the first chat window component corresponding to the first conversation object can be entered (the chat window with the first conversation object such as ddd as shown in the left figure of Figure 24(a)), so that the subsequent user can use the voice input control in the first chat window component (as shown in the left figure of Figure 24(a)) to start voice recording after long pressing to have a voice information conversation with the first conversation object.

[0117] In step S102, when a trigger instruction of a voice recording control is received, a recording process interface is displayed in the first chat window component, so as to perform a first voice recording operation through the recording process interface, wherein the first voice recording operation stores the recorded voice input data in real time;

[0118] In an embodiment of the present application, when a trigger instruction for a voice recording control is received from the user of the terminal device, a recording interface is displayed in the first chat window component to call the voice recording interface to perform a first voice recording operation, and the recorded voice input data is stored in real time so that the user of the terminal device can perceive that the voice is being recorded.

[0119] The first voice recording operation stores the recorded voice input data in real time (i.e., collects, stores and records the voice duration of the user of the terminal device in real time). The recording interface includes at least an audio animation icon (such as Fig. 20 The vertical line in A3 and the speech duration mark (such as 4" or 4 minutes), the pause recording control (such as Fig. 20 Double circle icon in A3), cancel recording control (such as Fig. 20 A2 cross icon as shown), recording send controls (such as Fig. 20 The Send button in A3 is shown) and complete the recording controls.

[0120] It is understandable that the conversation application interface supports independent recording capabilities, wherein the implementation of independent recording capabilities includes the implementation of recording capabilities and time limit logic, and specifically, voice recording can be achieved by calling the corresponding voice recording interface (API) provided by the technology stack.

[0121] For example, in a cross-platform desktop application framework (Electron), recording can be achieved by calling the corresponding recording interface (API) provided by the technology stack, such as the navigator.mediaDevices.getUserMedia interface. Specifically, the audio stream can be initialized first, and the navigator.mediaDevices.getUserMedia recording interface is called to perform voice recording. Or, for example, recording can be achieved by calling another recording interface (API) such as the MediaRecorder API interface.

[0122] It should be noted that the audio stream stream is globally unique, and the recording logic is independent of the public chat window component AIO. In the architecture of this embodiment, the recording controller Recorder is an independent module under the level of the conversation application App, which can be called by any other module. Fig.16 As shown, the recording module provided in this embodiment is specifically designed.

[0123] For example, suppose there is a recording module of a cross-platform desktop application framework (Electron) that can initialize a timer first. The timer can be used to set the maximum recording time, such as 600s. That is, when the voice recording time reaches the maximum recording time, a time trigger such as the onend field can be entered to execute a time forced stop. That is, it can be understood that when the recorded voice exceeds the maximum time limit, the voice recording is forcibly completed.

[0124] It is understandable that the class of the recording module inherits Singleton and conforms to the singleton mode. The core recording capability is provided by the voice recording interface MediaRecorder API that can be cross-platform desktop application framework (Electron). The recording module maintains an audio stream stream to manage the recording stream, and also notifies and maintains a custom timer to manage the voice recording time. If the voice recording time reaches the maximum recording time, the voice recording will be terminated immediately; in addition, it also provides methods such as starting voice recording (start), pausing voice recording (stop), and completing voice recording (end) for the view layer to call. After the call is successful, the logic layer notifies the view layer to update the UI status, for example, switching to the recording interface, switching to the recording pause interface, switching to the recording completion interface, etc.

[0125] Among them, the design and implementation of the recording module view layer includes: component hierarchy, component class diagram, and core description.

[0126] It is understandable that the recording controller is at the top of the entire session application. The recording controller receives responses with the highest priority in the interaction area between the component levels. Fig.15 As shown, including the session menu (such as Fig.15 menu(1)), a list of public chat window components (such as Fig.15 AIOList(1) as shown), and public chat window components (such as Fig.15 AIO (1) as shown) and recording controller (as shown Fig.15 Recorder(1) as shown, where Fig.15 The numbers after the brackets shown represent the element stacking zIndex (level) property of the component. It can be understood that the larger the number, the higher the level.

[0127] It is understandable that if Fig.17 As shown, the recording controller has multiple states, supporting capabilities such as recording, pausing, sending, and resuming.

[0128] Among them, Fig.17 As shown in the figure, state is used to indicate the state of the recording controller. recorder is used to indicate the logical singleton of the recording module. position is used to indicate the coordinates of the component in the application, including the two properties x and y. handleMove is used to indicate the acceptance of interactive events such as mouse or gesture touch to handle moving operations (such as drag logic, used to change the value of the coordinate position to achieve a drag effect). handleTouch is used to indicate the acceptance of interactive events such as mouse or gesture touch, used to handle the logic of mouse hovering, and used to change the content displayed in the view layer UI.

[0129] Among them, Fig.17 As shown, handleStart (used to represent the start button), handStop (used to represent the pause button), handleResume (used to represent the restart button), and handleEnd (used to represent the finish button) respectively correspond to the relevant logic of the recording module Recorder, and are triggered by the social user clicking the corresponding button; handleSend (used to represent the send button) is triggered by the social user clicking, and the audio stream stream data will be sent to the corresponding public chat window component AIO (such as the first chat window component).

[0130] The recording state, ecorderState, includes the following values: Fig.14 The illustrated states are idle (default state), ready (recording ready state), recording (recording in progress state), pausing (recording paused state), finish (recording finished but not sent state, i.e. recording completed state), end (recording finished and sent, i.e. recording sent state).

[0131] Among them, the component state of the recording controller is reversed as follows Fig.14 As shown, when the recording controller is in the idle state, the controller is not displayed; when the recording controller is in the ready state, the controller is displayed, but recording is not started, that is, the recording preparation interface is displayed; when the recording controller is in the recording state, the controller is displayed, and the state is recording, that is, the recording process interface is displayed, such as the view layer UI needs to present the corresponding audio animation icon, pause recording control (i.e., pause button), cancel recording control (i.e., cancel button), complete recording control (i.e., complete button) and recording send control (i.e., send button); when the recording controller is in the pausing state, the controller is displayed, and the state is paused, that is, the recording pause interface is displayed, such as the view layer UI needs to present the corresponding audio still icon, recording send control (i.e., send button), start recording control (i.e., start button); when the recording controller is in the finish state, the recording completion interface is displayed, and the recording send control (i.e., send button) is displayed; when the recording controller is in the end state, the recording completion interface is hidden, and then returns to the idle state.

[0132] Specifically, when receiving a user of a terminal device (such as a PC such as an intelligent computer) for a voice input control (such as Fig.19 When a trigger instruction (such as clicking) is received by the user of the terminal device, the voice recording interface is called to perform a first voice recording operation, and the recorded voice input data is stored in real time, that is, the user of the terminal device receives, stores and records the voice duration in real time, and then, Fig. 20 As shown, the first chat window component in the conversation application interface displays an audio animation icon (such as Fig. 20 The vertical line in A3 and the speech duration mark (such as 4" or 4 minutes), the pause recording control (such as Fig. 20 Double circle icon in A3), cancel recording control (such as Fig. 20 A2 cross icon as shown) and send recording controls (as shown Fig. 20 The recording interface of the send button in A3 is shown.

[0133] Alternatively, when a trigger instruction (such as long press) is received from the user of the terminal device (such as a mobile terminal such as a smart phone) for the voice input control (press and hold the speak button as shown in the left figure of Figure 24 (a)), a recording interface (such as the recording interface as shown in the right figure of Figure 24 (a)) is entered, and the voice input control (press and hold the speak button as shown in the left figure of Figure 24 (a)) is switched to the S3 microphone button as shown in the right figure of Figure 24 (a), and the microphone button is continued to be pressed, and the voice recording interface is called to perform the first voice recording operation, and the recorded voice input data is stored in real time, that is, the user of the terminal device is collected, stored and the voice duration is recorded in real time. Further, it can be understood that when the user releases the S3 microphone button as shown in the right figure of Figure 24 (a), the voice recording is completed, and the recorded voice input data can be sent to the first chat window component corresponding to the first conversation object (as shown in the left figure of Figure 24 (a) with the first conversation object such as ddd).

[0134] Alternatively, when the user of a terminal device (such as a mobile terminal such as a smart phone) receives a recording interface (the recording interface as shown in the left figure of Figure 24(b)), and is holding down the microphone button, such as the S3 microphone button as shown in the left figure of Figure 24(b), to call the voice recording interface to perform the first voice recording operation, the user can also slide from the microphone button to the S1 double circle icon as shown in the left figure of Figure 24(b) and release it, thereby triggering the S1 double circle icon as shown in the right figure of Figure 24(b) to continue voice recording. The user can enter the recording interface as shown in the right figure of Figure 24(c) from the recording interface as shown in the left figure of Figure 24(c), without having to keep pressing the voice recording control so that the user can perform other operations. Further, it can be understood that when the user clicks the S6 pause icon as shown in the right figure of Figure 24(c), the voice recording is paused, or when the user clicks the S5 return icon as shown in the right figure of Figure 24(c), it can switch from the recording interface as shown in the left figure of Figure 24(d) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and keep the voice recording in S7 as shown in the right figure of Figure 24(d), and when the user clicks the send button in S7 as shown in the right figure of Figure 24(d), the recorded voice input data can be sent to the first chat window component corresponding to the first conversation object (such as the chat window with the first conversation object such as ddd as shown in the right figure of Figure 24(d)).

[0135] In step S103, when the first chat window component changes from the display state to the exit or closed state, the conversation list component of the conversation application interface is displayed;

[0136] In an embodiment of the present application, when the user object of the terminal device is conducting a voice conversation with the first conversation object, if the user object also wants to conduct conversations with other conversation objects but does not want to interrupt the voice conversation with the first conversation object, the user object can exit the first chat window component from the conversation application interface and return to the conversation list component, so that the recording interface can be switched to the recording suspension interface and the recording suspension interface can be suspended to keep the voice recording with the first conversation object uninterrupted. That is, when the user object is speaking, not only can the first voice recording operation be maintained uninterrupted based on the recording suspension interface and the continuous recording of the voice be maintained, but the user object can also switch to multiple other chat window components to conduct conversations with other conversation objects. While supporting the voice function without interruption, other operations such as editing text, sending pictures, and sending video messages can also be supported.

[0137] Alternatively, when the user of the terminal device is actively or passively interrupted during a voice conversation with the first conversation object, the first voice recording operation can be paused first, and the first chat window component can be exited from the conversation application interface to return to the conversation list component, so that the recording interface can be switched to the recording suspension interface and the recording suspension interface can be suspended. When the interruption is over, the voice recording can be continued through the paused recording suspension interface, avoiding the need to repeat the voice recording after the voice interruption, thereby improving the voice recording efficiency.

[0138] Among them, the recording suspension interface includes a first recording suspension interface and a second recording suspension interface.

[0139] Among them, the first recording floating interface refers to the floating interface of the audio animation icon including vertical lines S12 as shown in the first figure on the left side of Figure 24 (f), etc., indicating that the first voice recording operation is paused.

[0140] The second recording floating interface refers to Fig.21 The floating interface A4 shown in FIG. 24( e) is a floating interface containing an audio animation icon with vertical lines on the right side of the avatar icon A of the first conversation object in the conversation object list, indicating that voice recording is in progress, or the floating interface S9 shown in the left figure of FIG. 24( e) is a floating interface containing an audio animation icon with vertical lines, etc., and no specific limitation is made here.

[0141] Specifically, Fig.21 As shown, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first session object (such as Fig.21 In the process of conducting a voice conversation with the first conversation object in the conversation object list (such as jad), it is also necessary to communicate with other conversation objects (such as Fig.21The conversation object in the conversation object list (such as shasha) is performed, but the voice recording between the first conversation object and the first conversation object (such as Fig. 20 If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc.).

[0142] Alternatively, the user of a terminal device (such as a mobile terminal such as a smart phone) clicks the S5 return icon as shown in the right figure of Figure 24(c) to switch from the recording interface as shown in the left figure of Figure 24(d) to the first chat window component as shown in the right figure of Figure 24(d), that is, returns to the first chat window component and keeps the S7 voice recording as shown in the right figure of Figure 24(d), and then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), it returns to the conversation list component as shown in the left figure of Figure 24(e).

[0143] Alternatively, the voice may be interrupted actively. For example, when the voice recording duration exceeds the maximum duration limit, that is, the voice recording is actively paused, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing the voice recording, and then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), it returns to the conversation list component as shown in the left figure of Figure 24(f).

[0144] Similarly, voice may be passively interrupted. For example, during the voice recording process, it is interrupted by other applications such as receiving a voice call or a video call, that is, the voice recording is passively paused. Then, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing voice recording, and then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), it returns to the conversation list component as shown in the left figure of Figure 24(f).

[0145] In step S104, the recording process interface is switched to a recording suspension interface, and the recording suspension interface is displayed in a suspension state in the conversation list component.

[0146] In an embodiment of the present application, when the user object of the terminal device is conducting a voice conversation with the first conversation object, if the user object also wants to conduct conversations with other conversation objects but does not want to interrupt the voice conversation with the first conversation object, the user object can exit the first chat window component from the conversation application interface and return to the conversation list component, so that the recording interface can be switched to the recording suspension interface and the recording suspension interface can be suspended to keep the voice recording with the first conversation object uninterrupted. That is, when the user object is speaking, not only can the first voice recording operation be maintained uninterrupted based on the recording suspension interface and the continuous recording of the voice be maintained, but the user object can also switch to multiple other chat window components to conduct conversations with other conversation objects. While supporting the voice function without interruption, other operations such as editing text, sending pictures, and sending video messages can also be supported.

[0147] Alternatively, when the user of the terminal device is actively or passively interrupted during a voice conversation with the first conversation object, the first voice recording operation can be paused first, and the first chat window component can be exited from the conversation application interface to return to the conversation list component, so that the recording interface can be switched to the recording suspension interface and the recording suspension interface can be suspended. When the interruption is over, the voice recording can be continued through the paused recording suspension interface, avoiding the need to repeat the voice recording after the voice interruption, thereby improving the voice recording efficiency.

[0148] Specifically, Fig.21 As shown, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first session object (such as Fig.21 In the process of conducting a voice conversation with the first conversation object in the conversation object list (such as jad), it is also necessary to communicate with other conversation objects (such as Fig.21 The conversation object in the conversation object list (such as shasha) is performed, but the voice recording between the first conversation object and the first conversation object (such as Fig. 20 If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc. At this time, you can record the interface (such as Fig. 20 A3 recording interface) to the recording suspension interface (as shown Fig.21The illustrated A4 is a floating interface containing an audio animation icon with a vertical line on the right side of the avatar icon of the first conversation object in the conversation object list, and is suspended in the recording floating interface, so that the stored voice input data can be sent to the first conversation object through the recording floating interface later without being in the first chat window.

[0149] Alternatively, the user of the terminal device (such as a mobile terminal such as a smart phone) clicks the S5 return icon as shown in the right figure of Figure 24(c) to switch from the recording interface as shown in the left figure of Figure 24(d) to the first chat window component as shown in the right figure of Figure 24(d), that is, returns to the first chat window component and maintains the S7 voice recording as shown in the right figure of Figure 24(d). Then, when the user returns to the conversation list component as shown in the left figure of Figure 24(e) by clicking the S8 return button as shown in the right figure of Figure 24(d), that is, exits the first chat window component, at this time, the recording interface can be switched to the S9 recording suspension interface as shown in the left figure of Figure 24(e), indicating that voice recording is in progress. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still maintain the voice recording operation between the first conversation object ddd through the recording suspension interface of S9 as shown in the left figure of Figure 24(e) to maintain uninterrupted voice recording.

[0150] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the recording floating interface of S9 as shown in the left figure of Figure 24(e), the recording floating interface can be expanded to the recording floating interface of S10 as shown in the middle figure of Figure 24(e), which at least includes a recording pause control, an audio animation icon and a recording send control, so that the user can click on the recording pause control to immediately pause the voice recording, or the user can click on the recording send control (i.e., the send button) to directly send the recorded voice input data from the conversation application interface as shown in the middle figure of Figure 24(e) to the first conversation object. For example, as shown in the right figure of Figure 24(e), the voice of S11 has been sent to the conversation object ddd, and a voice message can be sent to the conversation object without entering the chat window component of the first conversation object such as ddd, that is, without going through the chat window component of the conversation object.

[0151] Alternatively, the voice may be interrupted actively. For example, when the voice recording duration exceeds the maximum duration limit, that is, the voice recording is actively paused, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing voice recording. Then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), return to the conversation list component as shown in the left figure of Figure 24(f), that is, exit the first chat window component, at this time, the recording pause interface is switched to the S12 recording suspension interface as shown in the left figure of Figure 24(f), indicating that the voice recording is paused. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still keep the voice recording between the first conversation object ddd paused but not cancel the sending through the recording suspension interface of S12 as shown in the left figure of Figure 24(f).

[0152] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the recording floating interface of S12 as shown in the first left figure of Figure 24(f), the recording floating interface can be expanded to the recording floating interface of S13 as shown in the second left figure of Figure 24(f), which at least includes a recording start control, an audio still icon and a recording send control, so that the user clicks the recording send control (i.e., the send button) to directly send the recorded voice input data from the conversation application interface as shown in the fourth left figure of Figure 24(f) to the first conversation object. For example, as shown in the fourth left figure of Figure 24(f), the voice in S15 has been sent to the conversation object ddd, and there is no need to enter the chat window component of the first conversation object such as ddd, that is, there is no need to go through the chat window component of the conversation object, and a voice message can be sent to the conversation object.

[0153] Similarly, voice may be passively interrupted. For example, during the voice recording process, it is interrupted by other applications such as receiving a voice call or a video call, that is, the voice recording is passively paused. Then, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing voice recording. Then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), return to the conversation list component as shown in the left figure of Figure 24(f), that is, exit the first chat window component, at this time, the recording pause interface can be switched to the S12 recording suspension interface as shown in the left figure of Figure 24(f), indicating that the voice recording is paused. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still keep the voice recording between the first conversation object ddd paused but not cancel the sending through the recording suspension interface of S12 as shown in the left figure of Figure 24(f).

[0154] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the recording floating interface of S12 as shown in the first left figure of Figure 24 (f), the recording floating interface can be expanded to the recording floating interface of S13 as shown in the second left figure of Figure 24 (f), which at least includes a recording start control, an audio still icon and a recording send control, so that the user can click on the recording start control, that is, switch from the recording floating interface of S13 as shown in the second left figure of Figure 24 (f) to the recording floating interface of S14 as shown in the third left figure of Figure 24 (f) to continue voice recording, or, the user clicks on the recording send control (i.e., the send button), and the recorded voice input data can be directly sent from the conversation application interface as shown in the third left figure of Figure 24 (f) to the first conversation object. For example, as shown in the fourth left figure of Figure 24 (f), the voice in S15 has been sent to the conversation object ddd, and there is no need to enter the chat window component of the first conversation object such as ddd, that is, there is no need to go through the chat window component of the conversation object, and a voice message can be sent to the conversation object.

[0155] In an embodiment of the present application, a voice processing method is provided. Through the above method, when the first chat window component changes from a display state to an exit or closed state, the recording interface can be switched to a recording suspension interface, and the recording suspension interface can be suspended and displayed. When exiting the first chat window component or switching from the first chat window component to other chat window components, not only can the first voice recording operation be maintained without interruption based on the recording suspension interface and the continuous recording of the voice be maintained, but also other operations can be performed simultaneously in multiple other chat window components, such as editing text, sending images, etc., so that the recording sending control in the recording suspension interface can be used to implement the operation experience of sending the voice input data stored in the first voice recording operation to the first conversation object even if it is not in the first chat window component, so as to improve the operational efficiency and convenience of using the voice message capability, thereby improving the experience of social users.

[0156] Optionally, in the above Figure 2 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Figure 3 As shown, the recording suspension interface includes a first recording suspension interface, the conversation list component includes a conversation object component, and the conversation object component has a one-to-one correspondence with the chat window component; step S103 when the first chat window component changes from a display state to an exit or closed state, the conversation list component of the conversation application interface is displayed, including: steps S301 to S302; and step S104 includes: step S303;

[0157] In step S301, when the first voice recording operation is interrupted, the first chat window component changes from the display state to the passive exit or passive closing state;

[0158] In step S302, the first chat window component is switched to the conversation list component, and the first voice recording operation is paused;

[0159] In an embodiment of the present application, when an active or passive interruption occurs during a voice conversation between an object using a terminal device and a first conversation object, the first voice recording operation can be paused first, and the first chat window component can be exited from the conversation application interface to return to the conversation list component, so that the recording interface can be subsequently switched to the first recording floating interface and the first recording floating interface can be displayed in a suspended manner. When the interruption ends, voice recording can be continued through the paused first recording floating interface, thereby avoiding the need to repeat voice recording after voice interruption, thereby improving voice recording efficiency.

[0160] Among them, the first recording floating interface refers to the floating interface of the audio animation icon including vertical lines S12 as shown in the first figure on the left side of Figure 24 (f), etc., indicating that the first voice recording operation is paused.

[0161] Specifically, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first conversation object (such as Fig. 20 In the illustrated example, during the voice conversation with the first conversation object in the conversation object list (such as jad), the voice is interrupted (such as receiving a video call, a voice call, or the voice recording time exceeds the maximum time limit, etc.), that is, the first chat window component changes from the display state to the passive exit or passive closed state, but does not want to interrupt the voice recording with the first conversation object (such as Fig. 20 If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first voice recording operation can be paused, and the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc.).

[0162] Alternatively, the voice may be actively interrupted. For example, when the user of a terminal device (such as a mobile terminal such as a smart phone) is having a voice conversation with a first conversation object (such as the first conversation object such as ddd as shown in FIG. 24(a)), when the voice recording duration exceeds the maximum duration limit, that is, the voice recording is actively paused, the user can return from the recording interface as shown in the right figure of FIG. 24(c) to the first chat window component as shown in the right figure of FIG. 24(d), and pause the S7 voice recording as shown in the right figure of FIG. 24(d), that is, enter the recording pause interface for pausing the voice recording. Then, when the user returns to the conversation list component as shown in the left figure of FIG. 24(f) by clicking the S8 return button as shown in the right figure of FIG. 24(d), the first chat window component changes from the display state to the passive exit or passive closing state.

[0163] Similarly, voice may be passively interrupted. For example, during the voice recording process, it is interrupted by other applications such as receiving a voice call or a video call, that is, the voice recording is passively paused. Then, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing voice recording, and then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), it returns to the conversation list component as shown in the left figure of Figure 24(f).

[0164] In step S303, the recording process interface is switched to a first recording suspension interface, and the first recording suspension interface is suspended and displayed in a first conversation object component of the conversation list component.

[0165] In an embodiment of the present application, when an active or passive interruption occurs during a voice conversation between an object using a terminal device and a first conversation object, the first voice recording operation can be paused first, and the first chat window component can be exited from the conversation application interface. After returning to the conversation list component, the recording interface can be switched to the first recording floating interface, and the first recording floating interface can be displayed in a suspended manner. When the interruption ends, voice recording can be continued through the paused recording floating interface, thereby avoiding the need to repeat voice recording after voice interruption, thereby improving voice recording efficiency.

[0166] Specifically, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first conversation object (such as Fig. 20 In the illustrated example, during the voice conversation with the first conversation object in the conversation object list (such as jad), the voice is interrupted (such as receiving a video call, a voice call, or the voice recording time exceeds the maximum time limit, etc.), that is, the first chat window component changes from the display state to the passive exit or passive closed state, but does not want to interrupt the voice recording with the first conversation object (such as Fig. 20 If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first voice recording operation can be paused, and the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc. At this time, you can record the interface (such as Fig. 20 The A3 recording progress interface shown in the figure switches to the first recording suspension interface (i.e., the suspension interface for pausing voice recording), and suspends the first recording suspension interface, so that the stored voice input data can be sent to the first conversation object through the first recording suspension interface later without being in the first chat window.

[0167] Alternatively, the voice may be actively interrupted. For example, when the user of a terminal device (such as a mobile terminal such as a smart phone) is having a voice conversation with a first conversation object (such as the first conversation object such as ddd as shown in FIG. 24(a)), when the voice recording duration exceeds the maximum duration limit, that is, the voice recording is actively paused, the user can return from the recording interface as shown in the right figure of FIG. 24(c) to the first chat window component as shown in the right figure of FIG. 24(d), and pause the voice recording in S7 as shown in the right figure of FIG. 24(d), that is, enter the recording pause interface for pausing the voice recording. Then, when the user returns to the conversation list component as shown in the left figure of FIG. 24(f) by clicking the S8 return button as shown in the right figure of FIG. 24(d), that is, the first chat window component changes from the display state to the passive exit or passive closing state, that is, exits the first chat window component. At this time, the recording pause interface is switched to the recording suspension interface of S12 as shown in the left figure of FIG. 24(f), indicating that the voice recording is paused. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still keep the voice recording between the first conversation object ddd paused but not cancel the sending through the first recording floating interface of S12 as shown in the left figure of Figure 24(f).

[0168] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the first recording floating interface of S12 as shown in the first left figure of Figure 24(f), the first recording floating interface can be expanded to the recording floating interface of S13 as shown in the second left figure of Figure 24(f), which at least includes a recording start control, an audio still icon and a recording send control, so that when the user clicks the recording send control (i.e., the send button), the recorded voice input data can be directly sent from the conversation application interface as shown in the fourth left figure of Figure 24(f) to the first conversation object. For example, as shown in the fourth left figure of Figure 24(f), the voice in S15 has been sent to the conversation object ddd, and there is no need to enter the chat window component of the first conversation object such as ddd, that is, there is no need to go through the chat window component of the conversation object, and a voice message can be sent to the conversation object.

[0169] Similarly, voice may be passively interrupted. For example, during the voice recording process, it is interrupted by other applications such as receiving a voice call or a video call, that is, the voice recording is passively paused. Then, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing voice recording. Then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), returning to the conversation list component as shown in the left figure of Figure 24(f), that is, exiting the first chat window component, at this time, the recording pause interface can be switched to the first recording floating interface of S12 as shown in the left figure of Figure 24(f), indicating that the voice recording is paused. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still keep the voice recording between the first conversation object ddd paused but not cancel the sending through the first recording floating interface of S12 as shown in the left figure of Figure 24(f).

[0170] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the first recording floating interface of S12 as shown in the first left figure of Figure 24 (f), the recording floating interface can be expanded to the recording floating interface of S13 as shown in the second left figure of Figure 24 (f), which at least includes a recording start control, an audio still icon and a recording send control, so that the user can click on the recording start control, that is, switch from the recording floating interface of S13 as shown in the second left figure of Figure 24 (f) to the recording floating interface of S14 as shown in the third left figure of Figure 24 (f) to continue voice recording, or, the user clicks on the recording send control (i.e., the send button), and the recorded voice input data can be directly sent from the conversation application interface as shown in the third left figure of Figure 24 (f) to the first conversation object. For example, as shown in the fourth left figure of Figure 24 (f), the voice has been sent to the conversation object ddd in S15, and a voice message can be sent to the conversation object without entering the chat window component of the first conversation object such as ddd, that is, without going through the chat window component of the conversation object.

[0171] Optionally, in the above Figure 3 On the basis of the corresponding embodiment, in another optional embodiment of the voice processing method provided by the embodiment of the present application, after step S303 switches the recording interface to the first recording suspension interface, and suspends and displays the first recording suspension interface in the first conversation object component of the conversation list component, the method further includes:

[0172] In step S304, when a click instruction of the first recording floating interface is received, the first recording floating interface is expanded, and an audio still icon, a start recording control, and a recording send control are displayed in the expanded first recording floating interface;

[0173] In step S305, when a trigger instruction of the recording sending control is received, in the conversation list component, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first conversation object component, and the first recording floating interface is hidden.

[0174] Specifically, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first conversation object (such as Fig. 20 In the illustrated example, during the voice conversation with the first conversation object in the conversation object list (such as jad), the voice is interrupted (such as receiving a video call, a voice call, or the voice recording time exceeds the maximum time limit, etc.), that is, the first chat window component changes from the display state to the passive exit or passive closed state, but does not want to interrupt the voice recording with the first conversation object (such as Fig. 20 If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first voice recording operation can be paused, and the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc. At this time, you can record the interface (such as Fig. 20 The A3 recording progress interface shown in the figure switches to the first recording suspension interface (i.e., the suspension interface for pausing voice recording), and suspends the first recording suspension interface, so that the stored voice input data can be sent to the first conversation object through the first recording suspension interface later without being in the first chat window.

[0175] Further, when the user of the terminal device (such as a PC such as an intelligent computer) clicks on the first recording suspension interface (i.e., the suspension interface for pausing voice recording), the first recording suspension interface can be expanded, and the first recording suspension interface at least includes a recording start control, an audio still icon, and a recording send control, so that the user clicks the recording send control (i.e., the send button) to directly send the recorded voice input data from the conversation list component to the first conversation object, for example, Fig.23 The voice shown has been sent to the first conversation object jad. There is no need to enter the chat window component of the first conversation object such as jad, that is, there is no need to go through the chat window component of the conversation object to send a voice message to the conversation object and hide the first recording floating interface.

[0176] Alternatively, the voice may be actively interrupted. For example, when the user of a terminal device (such as a mobile terminal such as a smart phone) is having a voice conversation with a first conversation object (such as the first conversation object such as ddd as shown in FIG. 24(a)), when the voice recording duration exceeds the maximum duration limit, that is, the voice recording is actively paused, the user can return from the recording interface as shown in the right figure of FIG. 24(c) to the first chat window component as shown in the right figure of FIG. 24(d), and pause the voice recording in S7 as shown in the right figure of FIG. 24(d), that is, enter the recording pause interface for pausing the voice recording. Then, when the user returns to the conversation list component as shown in the left figure of FIG. 24(f) by clicking the S8 return button as shown in the right figure of FIG. 24(d), that is, the first chat window component changes from the display state to the passive exit or passive closing state, that is, exits the first chat window component. At this time, the recording pause interface is switched to the first recording suspension interface as shown in S12 as shown in the left figure of FIG. 24(f), indicating that the voice recording is paused. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still keep the voice recording between the first conversation object ddd paused but not cancel the sending through the recording suspension interface of S12 as shown in the left figure of Figure 24(f).

[0177] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the first recording floating interface of S12 as shown in the first left figure of Figure 24(f), the recording floating interface can be expanded to the recording floating interface of S13 as shown in the second left figure of Figure 24(f), which at least includes a recording start control, an audio still icon and a recording send control, so that when the user clicks the recording send control (i.e., the send button), the recorded voice input data can be directly sent from the conversation application interface as shown in the fourth left figure of Figure 24(f) to the first conversation object. For example, as shown in the fourth left figure of Figure 24(f), the voice has been sent to the conversation object ddd. There is no need to enter the chat window component of the first conversation object such as ddd, that is, there is no need to go through the chat window component of the conversation object, and a voice message can be sent to the conversation object and the first recording floating interface can be hidden.

[0178] Similarly, voice may be passively interrupted. For example, during the voice recording process, it is interrupted by other applications such as receiving a voice call or a video call, that is, the voice recording is passively paused. Then, you can return from the recording interface as shown in the right figure of Figure 24(c) to the first chat window component as shown in the right figure of Figure 24(d), that is, return to the first chat window component and pause the S7 voice recording as shown in the right figure of Figure 24(d), that is, enter the recording pause interface for pausing voice recording. Then, when the user clicks the S8 return button as shown in the right figure of Figure 24(d), returning to the conversation list component as shown in the left figure of Figure 24(f), that is, exiting the first chat window component, at this time, the recording pause interface can be switched to the first recording floating interface of S12 as shown in the left figure of Figure 24(f), indicating that the voice recording is paused. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still keep the voice recording between the first conversation object ddd paused but not cancel the sending through the first recording floating interface of S12 as shown in the left figure of Figure 24(f).

[0179] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the first recording floating interface of S12 as shown in the first left figure of Figure 24 (f), the first recording floating interface can be expanded into the recording floating interface of S13 as shown in the second left figure of Figure 24 (f), which at least includes a recording start control, an audio still icon and a recording send control, so that the user can click on the recording start control, that is, switch from the recording floating interface of S13 as shown in the second left figure of Figure 24 (f) to the recording floating interface of S14 as shown in the third left figure of Figure 24 (f) to continue voice recording, or, the user clicks on the recording send control (i.e., the send button), and the recorded voice input data can be directly sent from the conversation application interface as shown in the third left figure of Figure 24 (f) to the first conversation object. For example, as shown in the fourth left figure of Figure 24 (f), the voice has been sent to the conversation object ddd in S15, and there is no need to enter the chat window component of the first conversation object such as ddd, that is, there is no need to go through the chat window component of the conversation object, and a voice message can be sent to the conversation object and the first recording floating interface can be hidden.

[0180] Optionally, in the above Figure 2 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Figure 4As shown, the recording suspension interface also includes a second recording suspension interface, the conversation list component includes a conversation object component, and the conversation object component has a one-to-one correspondence with the chat window component; step S103 when the first chat window component changes from the display state to the exit or closed state, the conversation list component of the conversation application interface is displayed, including: step S401; and step S104 includes: step S402;

[0181] In step S401, when the first chat window component changes from the display state to the active exit or active close state, the first chat window component is switched to the conversation list component;

[0182] In step S402, the recording process interface is switched to a second recording suspension interface, and the second recording suspension interface is suspended and displayed in the first conversation object component of the conversation list component.

[0183] In an embodiment of the present application, when the user object of the terminal device is conducting a voice conversation with the first conversation object, if the user object also wants to conduct conversations with other conversation objects but does not want to interrupt the voice conversation with the first conversation object, the user object can exit the first chat window component from the conversation application interface and return to the conversation list component, so that the recording interface can be switched to the second recording suspension interface and the second recording suspension interface can be suspended to keep the voice recording with the first conversation object uninterrupted. That is, when the user object is speaking, not only can the first voice recording operation be maintained uninterrupted based on the second recording suspension interface and the continuous recording of the voice be maintained, but the user object can also switch to multiple other chat window components to conduct conversations with other conversation objects. While supporting the voice function without interruption, other operations such as editing text, sending pictures, and sending video messages can also be supported.

[0184] The second recording floating interface refers to Fig.21 The floating interface A4 shown in FIG. 24( e) is a floating interface containing an audio animation icon with vertical lines on the right side of the avatar icon A of the first conversation object in the conversation object list, indicating that voice recording is in progress, or the floating interface S9 shown in the left figure of FIG. 24( e) is a floating interface containing an audio animation icon with vertical lines, etc., and no specific limitation is made here.

[0185] Specifically, Fig.21 As shown, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first session object (such as Fig.21 In the process of conducting a voice conversation with the first conversation object in the conversation object list (such as jad), it is also necessary to communicate with other conversation objects (such as Fig.21 The conversation object in the conversation object list (such as shasha) is performed, but the voice recording between the first conversation object and the first conversation object (such as Fig. 20If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc. At this time, you can record the interface (such as Fig. 20 A3 recording interface shown in the figure) switches to the second recording suspension interface (as shown Fig.21 The illustrated A4 is a floating interface containing an audio animation icon with a vertical line to the right of the avatar icon A of the first conversation object in the conversation object list, and is suspended in the second recording floating interface, indicating that the voice is being recorded, so that the stored voice input data can be sent to the first conversation object later through the second recording floating interface without being in the first chat window.

[0186] Alternatively, the user of the terminal device (such as a mobile terminal such as a smart phone) clicks the S5 return icon as shown in the right figure of Figure 24(c) to switch from the recording interface as shown in the left figure of Figure 24(d) to the first chat window component as shown in the right figure of Figure 24(d), that is, returns to the first chat window component and maintains the S7 voice recording as shown in the right figure of Figure 24(d). Then, when the user returns to the conversation list component as shown in the left figure of Figure 24(e) by clicking the S8 return button as shown in the right figure of Figure 24(d), that is, exits the first chat window component, at this time, the recording interface can be switched to the S9 recording suspension interface as shown in the left figure of Figure 24(e), indicating that voice recording is in progress.

[0187] Optionally, in the above Figure 4 On the basis of the corresponding embodiment, in another optional embodiment of the voice processing method provided by the embodiment of the present application, after step S402 switches the recording interface to the second recording suspension interface, and suspends and displays the second recording suspension interface in the first conversation object component of the conversation list component, the method further includes:

[0188] In step 403, when a click instruction of the second recording floating interface is received, the second recording floating interface is expanded, and an audio animation icon and a recording sending control are displayed in the expanded second recording floating interface;

[0189] In step S404, when a trigger instruction of the recording sending control is received, in the conversation list component, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first conversation component, and the second recording floating interface is hidden.

[0190] Specifically, Fig.21As shown, when the user object of the terminal device (such as a PC such as an intelligent computer) is in communication with the first session object (such as Fig.21 In the process of conducting a voice conversation with the first conversation object in the conversation object list (such as jad), it is also necessary to communicate with other conversation objects (such as Fig.21 The conversation object in the conversation object list (such as shasha) is performed, but the voice recording between the first conversation object and the first conversation object (such as Fig. 20 If the voice duration in A3 is marked as 4", i.e., 4 minutes of audio), the first chat window component can be exited (e.g., Fig. 20 The chat window of the first conversation object jad shown in FIG. 1 may return to the conversation list component (eg, Fig.21 The session object list on the left side shows multiple session objects such as shasha, ccc or ddd, etc. At this time, you can record the interface (such as Fig. 20 A3 recording interface) to the recording suspension interface (as shown Fig.21 The illustrated A4 is a floating interface of an audio animation icon including a vertical line on the right side of the avatar icon of the first conversation object in the conversation object list), and is displayed floatingly in the recording floating interface, indicating that the voice is being recorded.

[0191] Further, when the user of the terminal device (such as a PC such as a smart computer) clicks the second recording floating interface (such as Fig.21 A4 shown in the figure is a floating interface containing an audio animation icon with a vertical line on the right side of the avatar icon of the first conversation object in the conversation object list), and the second recording floating interface can be expanded (such as Fig. 22 The A5 recording suspension interface shown in FIG. 1 ), the second recording suspension interface at least includes an audio animation icon (such as Fig. 22 The animated audio icon with vertical lines in A5 as shown) and the recording send control (such as Fig. 22 The send button in A5 shown in the figure) allows the user object to click the recording send control (ie, the send button) to directly send the recorded voice input data from the conversation list component to the first conversation object, for example, Fig.23 The voice message shown has been sent to the first conversation object jad, and the voice message can be sent to the conversation object without entering the chat window component of the first conversation object such as jad, that is, without going through the chat window component of the conversation object, and the second recording floating interface is hidden, so that the stored voice input data can be sent to the first conversation object later through the recording floating interface without being in the first chat window.

[0192] Alternatively, the user of the terminal device (such as a mobile terminal such as a smart phone) clicks the S5 return icon as shown in the right figure of Figure 24(c) to switch from the recording interface as shown in the left figure of Figure 24(d) to the first chat window component as shown in the right figure of Figure 24(d), that is, returns to the first chat window component and maintains the S7 voice recording as shown in the right figure of Figure 24(d). Then, when the user returns to the conversation list component as shown in the left figure of Figure 24(e) by clicking the S8 return button as shown in the right figure of Figure 24(d), that is, exits the first chat window component, at this time, the recording interface can be switched to the S9 recording suspension interface as shown in the left figure of Figure 24(e), indicating that voice recording is in progress. It can be understood that if the object can be used at this time to enter the chat window component corresponding to other conversation objects (such as the conversation object aaa as shown in the left figure of Figure 24(e)) and perform other conversation operations such as text editing or image sending, this embodiment can still maintain the voice recording operation between the first conversation object ddd through the recording suspension interface of S9 as shown in the left figure of Figure 24(e) to maintain uninterrupted voice recording.

[0193] Furthermore, when the user of the terminal device (such as a mobile terminal such as a smart phone) clicks on the recording floating interface of S9 as shown in the left figure of Figure 24(e), the recording floating interface can be expanded to the recording floating interface of S10 as shown in the middle figure of Figure 24(e), which at least includes a recording pause control, an audio animation icon and a recording send control, so that the user can click on the recording pause control to immediately pause the voice recording, or the user can click on the recording send control (i.e., the send button) to directly send the recorded voice input data from the conversation application interface as shown in the middle figure of Figure 24(e) to the first conversation object. For example, as shown in the right figure of Figure 24(e), the voice of S11 has been sent to the conversation object ddd. There is no need to enter the chat window component of the first conversation object such as ddd, that is, there is no need to go through the chat window component of the conversation object, and a voice message can be sent to the conversation object, and the second recording floating interface can be hidden.

[0194] Optionally, in the above Figure 2 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Figure 5 As shown, the recording interface includes a pause recording control; in step S102, when a trigger instruction of the voice recording control is received, the recording interface is displayed in the first chat window component to perform a first voice recording operation through the recording interface, and the method further includes:

[0195] In step S501, when a trigger instruction to pause the recording control is received, the recording interface displayed in the first chat window component is switched to the recording pause interface, and the first voice recording operation is paused, wherein the recording pause interface includes at least an audio still icon, a start recording control, a cancel recording control, and a complete recording control.

[0196] In an embodiment of the present application, when the user of the terminal device interrupts or pauses voice recording, a trigger instruction for the pause recording control from the user of the terminal device can be received, the first voice recording operation can be paused, and the recording interface can be switched to the recording pause interface, so that the user of the terminal device can perceive that the voice recording is paused, and can support the ability to quickly pause and continue recording the voice by switching the recording interface to the recording pause interface, so that when the voice recording is interrupted, there is no need to re-perform the sound reception operation, thereby avoiding a lot of redundant and meaningless repetitive work, improving the operational efficiency and convenience of using the voice message capability, and thus can improve the social user experience to a certain extent.

[0197] The recording pause interface includes at least an audio still icon, a start recording control (i.e., a restart button), and a cancel recording control (i.e., Fig. 20 A2 cross icon as shown) and complete recording controls.

[0198] Specifically, when the user of the terminal device interrupts or pauses voice recording, a trigger instruction for the pause recording control from the user of the terminal device can be received, the first voice recording operation can be paused, and the recording interface can be switched to the recording pause interface. Then, an audio refined icon, a cancel recording control (such as a voice recording icon) and a voice recording control icon (such as a voice recording icon) can be displayed in the first chat window component in the conversation application interface. Fig. 20 A2 cross icon as shown), complete recording controls, and send recording controls (as shown Fig. 20 The recording pause interface of A3 (shown as the send button in A3).

[0199] Optionally, in the above Figure 5 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Figure 6 As shown, the recording interface also includes a completion recording control; when a trigger instruction of the pause recording control is received in step S501, the recording interface displayed in the first chat window component is switched to the recording pause interface, and the first voice recording operation is paused, the method further includes:

[0200] In step S601, when a trigger instruction of completing the recording control is received, the recording progress interface or the recording pause interface displayed in the first chat window component is switched to the recording completion interface, wherein the recording completion interface at least includes a recording sending control and a cancel sending control;

[0201] In an embodiment of the present application, when the user of the terminal device completes the voice recording, a trigger instruction from the user of the terminal device to complete the recording control can be received, and the recording progress interface or the recording pause interface can be switched to the recording completion interface, so that the user of the terminal device can perceive that the voice recording has been completed.

[0202] The recording completion interface includes at least a cancel send control (such as Fig. 20 A2 cross icon as shown, or Figure 24(a) to Figure 24(d) S4 cross icon as shown) and recording send controls (as shown Fig. 20 The send button in A3 is shown.

[0203] Specifically, when the user of the terminal device completes the voice recording, a trigger instruction for completing the recording control from the user of the terminal device can be received, the recording progress interface or the recording pause interface can be switched to the recording completion interface, and the recorded voice input data can be uploaded. Then, a cancel sending control (such as a cancel button) can be displayed in the first chat window component in the conversation application interface. Fig. 20 A2 cross icon as shown, or Figure 24(a) to Figure 24(d) S1 double circle icon) and recording send controls (such as Fig. 20 The recording completion interface (shown as the Send button in A3).

[0204] In step S602, when a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first chat window component, and the recording completion interface is hidden.

[0205] In an embodiment of the present application, when the user object of the terminal device completes the voice recording and needs to send the recorded voice message to the first conversation object, a trigger instruction for the recording and sending control from the user object of the terminal device can be received, the voice input data stored in the first voice recording operation can be sent to the first conversation object, and the recording completion interface can be hidden so that the user object of the terminal device can perceive that the voice recording has been successfully sent.

[0206] Specifically, when the user object of the terminal device completes the voice recording and needs to send the recorded voice message to the first conversation object, the user object of the terminal device can receive the recording sending control (ie, Fig. 20The trigger instruction of the send button in A3 shown in FIG. 1 can send the voice input data stored in the first voice recording operation to the first conversation object (ie, Fig. 20 The session object jad shown in the figure) and hides the recording completion interface, and can hide the cancel sending control (such as Fig. 20 A2 cross icon as shown, or Figure 24(a) to Figure 24(d) S4 cross icon as shown) and recording send controls (as shown Fig. 20 The recording completion interface (shown as the Send button in A3).

[0207] Furthermore, when the user of the terminal device completes the voice recording and needs to send the recorded voice message to the first conversation object, as shown in the left figure of Figure 24 (d), the user of the terminal device can receive a trigger instruction for completing the recording control (such as the return button of S5 as shown in the left figure of Figure 24 (d)), upload all the voice input data stored in the first voice recording operation, and enter the recording completion interface as shown in the right figure of Figure 24 (d). After receiving a trigger instruction for the recording sending control (such as the send button in S7 as shown in the right figure of Figure 24 (d)), the user of the terminal device can send all the voice input data stored in the first voice recording operation (the duration of S7 in Figure 24 (d) is marked as 4", that is, 4 minutes of audio) to the first conversation object (that is, the conversation object ddd as shown in the right figure of Figure 24 (d)), and hide the recording completion interface.

[0208] It can be understood that the interaction between the recording module and the AIO module includes the following two parts:

[0209] 1. The user object can click the voice recording control (i.e., the recording button) through the public chat window component AIO to call up the recording controller RecorderController, i.e., AIO calls RecorderController;

[0210] 2. The object can be used to click Send through the recording controller RecorderController to trigger the recording and sending control of the public chat window component AIO (i.e., call up the sending audio logic), that is, RecorderController calls AIO.

[0211] It is understandable that since the recording module is no longer a part of the AIO module but exists as an independent module, the interaction between the public chat window component AIO and the recording module needs to be processed by a third-party bridge, such as Fig.18 As shown, here we choose to use the global session application App object for bridging processing.

[0212] For example, Fig.18 As shown, when the object triggers handleSend (i.e., the voice processing button) through the recording controller recorderController of the global conversation application App, i.e., GlobalApp, the recording controller obtains the sending audio logic currentAIO to send the audio to the corresponding public chat window component AIO. When the public chat window component AIO triggers handleRecorder (i.e., the voice recording button), the global conversation application App, i.e., GlobalApp, displays the recording controller (e.g., the recording interface).

[0213] Furthermore, as for the data layer of the recording module, it can be to manage the local audio stream stream, specifically, it can be fully hosted to the voice recording interface MediaRecorder, and when the audio sending logic is triggered, the data stream conversion can be performed, that is, after the voice recording is completed, the audio stream stream in the recording module recorder is the complete recorded audio stream (that is, all recorded voice input data), and the background upload service can be called to convert the local audio stream into a first audio stream (such as a content distribution network CDN-style audio stream), and then, the first audio stream can be sent to an instant message such as an IM message in the public chat window component AIO.

[0214] Optionally, in the above Figure 2 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Figure 7 As shown, in step S102, when a trigger instruction of a voice recording control is received, a recording process interface is displayed in the first chat window component to perform a first voice recording operation through the recording process interface, including:

[0215] In step S701, when the trigger instruction received for the voice recording control is a long press, a recording interface is displayed in the first chat window component to call the voice recording interface to perform a first voice recording operation.

[0216] In an embodiment of the present application, when a trigger instruction of a long press is received from the user of the terminal device for the voice input control, the voice recording interface is called to perform a first voice recording operation, the recorded voice input data is stored in real time, and a recording interface is displayed in the conversation application interface, so that the user of the terminal device can perceive that the voice is being recorded.

[0217] Specifically, when the user of the terminal device enters the first chat window component (the chat session window as shown in the left figure of Figure 24(a)), and clicks the "Press and Hold to Speak" button as shown in the left figure of Figure 24(a), the recording interface as shown in the right figure of Figure 24(a) can be entered. Then, when the user of the terminal device receives a trigger instruction for a long press of the voice input control, for example, by long pressing the S3 microphone button as shown in the right figure of Figure 24(a) through a mouse or gesture touch, the voice recording interface can be called to perform the first voice recording operation, and the recorded voice input data can be stored in real time, that is, the user of the terminal device is recorded. The audio is received, stored and the voice duration is recorded in real time. Then, as shown in the right figure of FIG24(a), a recording interface including an audio animation icon (the vertical line in S2 as shown in the right figure of FIG24(a) and a voice duration mark such as 00:03, i.e., 3 seconds), a pause recording control (the double circle icon of S1 as shown in the right figure of FIG24(a)), a cancel recording control (the cross icon of S4 as shown in the right figure of FIG24(a)) and a text conversion control (the text conversion button as shown in the right figure of FIG24(a), which is used to convert voice input data into text information) is displayed in the first chat window component in the conversation application interface.

[0218] Further, it can be understood that when the user of the terminal device releases the "press and speak" button as shown in the left figure of Figure 24(a), the voice recording is completed and the recorded voice input data can be sent to the first conversation object.

[0219] Optionally, in the above Figure 2 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Figure 8 As shown, in step S102, when a trigger instruction of a voice recording control is received, a recording process interface is displayed in the first chat window component to perform a first voice recording operation through the recording process interface, including:

[0220] In step S701, when the trigger instruction of the voice recording control is a click, a recording preparation interface is displayed in the first chat window component, wherein the recording preparation interface includes at least an audio still icon, a start recording control, and a cancel recording control;

[0221] In step S702, when a trigger instruction to start recording control is received, the recording preparation interface displayed in the first chat window component is switched to the recording progress interface, and the voice recording interface is called to perform the first voice recording operation.

[0222] In an embodiment of the present application, when a trigger instruction for a voice input control is received from a user of the terminal device as a click, a recording preparation interface is displayed in the conversation application interface, and then, when a trigger instruction for starting a recording control is received, the voice recording interface can be called to perform a first voice recording operation, and the recorded voice input data is stored in real time, and the recording preparation interface is switched to a recording progress interface in the conversation application interface, so that the user of the terminal device can perceive that the voice is being recorded, and can continue voice recording even without long pressing a key, without affecting the recording function, so that the user of the terminal device does not need to keep pressing a keyboard or mouse to perform a recording operation, making the sound reception experience more user-friendly.

[0223] Specifically, when the user of the terminal device enters the first chat window component (the chat session window as shown in the left figure of Figure 24(a)), and clicks the "Press and Hold to Speak" button as shown in the left figure of Figure 24(a), the user can directly enter the recording preparation interface as shown in the right figure of Figure 24(b). Alternatively, after entering the recording interface as shown in the left figure of Figure 24(b), the user of the terminal device can use the mouse or gesture touch to slide from the S3 microphone button as shown in the left figure of Figure 24(b) to the start recording control as shown in the left figure of Figure 24(b) (the S1 double circle icon as shown in the left figure of Figure 24(b)), and then enter the recording preparation interface as shown in the right figure of Figure 24(b).

[0224] Furthermore, when the trigger instruction received from the user of the terminal device for the voice input control is a click, for example, by clicking the start recording control as shown in the right figure of Figure 24(b) (the S1 double circle icon as shown in the right figure of Figure 24(b)) through a mouse or gesture touch, the voice recording interface can be called to perform the first voice recording operation, and the recorded voice input data is stored in real time, that is, the user of the terminal device is sounded, stored and the voice duration is recorded in real time. Then, as shown in the right figure of Figure 24(c), a recording interface including an audio animation icon (the S2 vertical line as shown in the right figure of Figure 24(c) and a voice duration mark such as 00:18, i.e. 18 seconds), a recording control (the S6 square icon as shown in the right figure of Figure 24(c)) and a recording completion control (the S5 return button as shown in the right figure of Figure 24(c), used to complete the voice recording and return to the first chat window component) is displayed in the first chat window component in the conversation application interface.

[0225] Furthermore, it can be understood that when the user of the terminal device completes the voice recording, he can click the recording completion control (such as the S5 return button shown in the right figure of Figure 24(c)) to return to the first chat window component and send the recorded voice input data to the first conversation object.

[0226] Optionally, in the above Figure 6 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Fig. 9 As shown, in step S602, when a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first chat window component, and before hiding the recording completion interface, the method further includes:

[0227] In step S901, when a trigger instruction to cancel a recording control or a sending control is received, the voice input data stored in the first recording operation is deleted, and a recording progress interface, a recording pause interface, or a recording completion interface is hidden.

[0228] In an embodiment of the present application, when a trigger instruction for canceling a recording control or canceling a sending control is received from the user of the terminal device as a click, the voice input data stored in the first recording operation is deleted, and the recording progress interface, the recording pause interface or the recording completion interface is hidden in the conversation application interface, so that the user of the terminal device can perceive the cancellation of the voice recording.

[0229] Specifically, when the user of the terminal device enters the first chat window component (the chat session window as shown in the left figure of Figure 24(a)), and clicks the "Press and Speak" button as shown in the left figure of Figure 24(a), the recording preparation interface as shown in the right figure of Figure 24(b) can be directly entered. The user of the terminal device can slide from the S3 microphone button as shown in the left figure of Figure 24(b) to the cancel recording control as shown in the left figure of Figure 24(b) (the S4 cross icon as shown in the left figure of Figure 24(b)) through the mouse or gesture touch, that is, when a trigger instruction to cancel the recording control or cancel the sending control is received, the voice input data stored in the first recording operation is deleted, that is, the audio or voice input data corresponding to the S2 voice duration mark such as 00:03, i.e. 3 seconds as shown in the left figure of Figure 24(b) can be deleted, and the recording preparation interface is thus recorded.

[0230] Alternatively, when a trigger instruction for a voice input control is received from the user of the terminal device, which is a click, for example, by clicking the start recording control as shown in the right figure of Figure 24(b) (the S4 double circle icon as shown in the right figure of Figure 24(b)) through a mouse or gesture touch, the voice recording interface can be called to perform a first voice recording operation, and the recorded voice input data is stored in real time, that is, the user of the terminal device is sounded, stored and the voice duration is recorded in real time, and then, as shown in the right figure of Figure 24(c), the first chat window component in the conversation application interface displays an audio animation icon (the S2 vertical line and the voice duration mark such as 00:18, i.e. 18 seconds, as shown in the right figure of Figure 24(c)), a recording control (such as After the recording interface is displayed, the user of the terminal device can click the cancel recording control as shown in the right figure of Figure 24(c) (the S5 return button as shown in the left figure of Figure 24(c)) by mouse or gesture touch, that is, when a trigger instruction to cancel the recording control or cancel the sending control is received, the voice input data stored in the first recording operation is deleted, that is, the audio or voice input data corresponding to the S2 voice duration mark such as 00:18 or 18 seconds as shown in the left figure of Figure 24(c) can be deleted, and the recording interface is hidden.

[0231] Or, if Fig. 20 As shown, the first chat window component in the conversation application interface displays an audio animation icon (such as Fig. 20 After the recording interface is switched to the recording pause interface (the vertical line in A3 shown in FIG. 1 and the voice duration mark such as 4" (i.e. 4 minutes)), the user of the terminal device can click on the recording pause interface by mouse or gesture touch. Fig. 20 The cancel recording control shown (such as Fig. 20 When a trigger instruction of canceling the recording control or canceling the sending control is received, the voice input data stored in the first recording operation is deleted, that is, the audio or voice input data corresponding to the voice duration mark such as "4" or 4 minutes in A3 as shown in 20 can be deleted, and the recording pause interface is hidden.

[0232] Or, if Fig. 20 As shown, the first chat window component in the conversation application interface displays an audio animation icon (such as Fig. 20 After the recording interface is switched to the recording completion interface (the vertical line in A3 shown in FIG. 1 and the voice duration mark such as 4" (i.e. 4 minutes)), the user of the terminal device can click on the recording interface by mouse or gesture touch. Fig. 20 The cancel recording control shown (such as Fig. 20When a trigger instruction of canceling the recording control or canceling the sending control is received, the voice input data stored in the first recording operation is deleted, that is, the audio or voice input data corresponding to the voice duration mark such as "4" or 4 minutes in A3 as shown in 20 can be deleted, and the recording completion interface is hidden.

[0233] Optionally, in the above Figure 6 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Fig.10 As shown, in step S602, when a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first chat window component, and before hiding the recording completion interface, the method further includes:

[0234] In step S1001, the current recording time corresponding to the voice input data recorded by the first voice recording operation is obtained;

[0235] In step S1002, if the current recording duration is greater than the time threshold, the recording interface displayed in the first chat window component is switched to the recording completion interface, and the first voice recording operation is ended.

[0236] In an embodiment of the present application, when calling a voice recording interface to perform a first voice recording operation and storing voice input data in real time, the voice duration corresponding to the voice input data can be recorded in real time, and the current recording duration corresponding to the voice input data recorded by the first voice recording operation can be obtained in real time. Then, the current recording duration can be compared with the time threshold in real time. If the current recording duration is greater than the time threshold, the recording interface can be switched to the recording completion interface, and the first voice recording operation can be ended to complete the voice recording.

[0237] Specifically, Fig. 22 As shown, when the user object wants to continue the voice recording with the first conversation object, pause the voice recording, or send the voice recording, the user object can click the second recording suspension interface (such as Fig.21 A4 is performing voice recording in the recording suspension interface shown in the figure), that is, receiving a click instruction of the second recording suspension interface, the second recording suspension interface can be expanded (such as Fig. 22 The recording floating interface in A5 is shown in FIG. 1 ), and the pause recording control is displayed in the expanded recording floating interface (as shown in FIG. 1 ). Fig. 22 The double circle icon in A5 as shown), audio animation icon (such as Fig. 22 The vertical lines in A5 and the speech duration mark (such as 4" or 4 minutes) and the recording sending control (such as Fig. 22 The send button in A5 shown in the figure) can be understood that while storing the voice input data in real time, the voice duration corresponding to the voice input data can also be recorded in real time, then the current recording duration corresponding to the voice input data recorded by the first voice recording operation can be obtained in real time, and then, the current recording duration can be compared with the time threshold (for example, 600s, not specifically limited here) in real time. If the current recording duration is greater than the time threshold, that is, the current recording duration exceeds the preset duration limit, the voice recording is forced to stop, and the recording interface is switched to the recording completion interface, ending the first voice recording operation to complete the voice recording.

[0238] Optionally, in the above Figure 4 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Fig.11 As shown, after step S402 switches the recording interface to the second recording suspension interface and suspends and displays the second recording suspension interface in the first conversation object component of the conversation list component, the method further includes:

[0239] In step S1101, when a trigger instruction of a second conversation object component in a conversation list component is received, a second chat window component corresponding to the second conversation object component is displayed;

[0240] In step S1102, when a trigger instruction of the voice recording control of the second chat window component is received, the second recording floating interface is switched to the first recording floating interface, and the first voice recording operation is paused;

[0241] In step S1103, a second recording interface is displayed in the second chat window component, and a voice recording interface is called to perform a second voice recording operation, wherein the second voice recording operation is used to store the recorded second voice input data in real time, and the second recording interface includes at least a second audio animation icon, a second pause recording control, a second cancel recording control, and a second send recording control.

[0242] In an embodiment of the present application, when switching to the second chat window component, the voice recording control of the second chat window component is clicked, and a trigger instruction of the voice recording control of the second chat window component can be received, the second recording floating interface is switched to the first recording floating interface, and the first voice recording operation is paused, and the second recording interface is displayed in the second chat window component, and the voice recording interface is called to perform the second voice recording operation, so that the user object of the terminal device switches to the voice conversation with other conversation objects, and can perceive in real time that the voice is being recorded, so as to support the conversation voice capability of multi-instance recording.

[0243] Among them, the second chat window component (such as Fig.23 The chat window with the second conversation object such as shasha shown in the figure), the second chat window component includes at least a voice input control (such as Fig.23 The microphone icon shown is used to start voice recording after clicking it, and is used to select (click or hold) the voice input control to enter the recording interface, and the voice recording interface can be called to perform voice recording operations.

[0244] The second voice recording operation stores the recorded voice input data in real time (i.e., collects, stores and records the voice duration of the user of the terminal device in real time). The second recording interface includes at least a second audio animation icon (such as Fig. 20 A3 shown in the figure), a second pause recording control (similar to the audio animation icon in the figure), Fig. 20 The double circle icon in A3 shown in the figure), a second cancel recording control (same as the Fig. 20 The same cross icon as the one for A2 shown) and complete recording controls.

[0245] Specifically, for example, after the recording process interface is displayed in the first conversation window component, when the user object exits the first chat window component and returns to the conversation list component, the recording process interface (such as Fig. 20 The recording interface of A3 shown in the figure) is switched to the second recording suspension interface (as shown Fig.21 A4 corresponds to the recording floating interface of the voice recording in progress, and is displayed in the first conversation object component, and the first voice recording operation is continued. Then, the second conversation object component can be clicked to enter the second chat window component (such as Fig.21 When the user wants to have a voice conversation with the second conversation object (such as shasha shown in 21), the user clicks the voice recording control of the second chat window component (such as the microphone button of A1 shown in 21), and then the trigger instruction of the voice input control of the second chat window component can be received. At this time, the second recording suspension interface in the first conversation object component is switched to the first recording suspension interface (that is, the recording suspension interface that pauses the first voice recording operation), that is, the first voice recording operation is paused, and the second recording interface is displayed in the second chat window component (such as Fig. 20 The recording interface of A3 shown is similar), so as to call the voice recording interface to perform the second voice recording operation and store the recorded voice input data in real time.

[0246] Furthermore, for example, after the recording progress interface is displayed in the first conversation window component, when the user object exits the first chat window component and returns to the conversation list component, the recording progress interface is switched to the second recording suspension interface and displayed in the first conversation object component to continue the first voice recording operation. Then, by clicking on the third conversation object component, the third chat window component can be entered. When the user object wants to have a voice conversation with the third conversation object, the voice recording control of the third chat window component is clicked, and a trigger instruction of the voice input control of the third chat window component can be received. At this time, the second recording suspension interface in the first conversation object component is switched to the first recording suspension interface, that is, the first voice recording operation is paused, and the third recording progress interface is displayed in the third chat window component to call the voice recording interface to perform the third voice recording operation, and store the recorded voice input data in real time, so that the user object of the terminal device switches to the voice conversation with other conversation objects, and can perceive in real time that the voice is being recorded, so as to support the conversation voice capability of multi-instance recording.

[0247] Among them, the third chat window component (such as Fig.23 The chat window with the third conversation object such as ccc is shown in the figure), and the third chat window component includes at least a voice input control (such as Fig.23 The microphone icon shown is used to start voice recording after clicking it, and is used to select (click or hold) the voice input control to enter the recording interface, and the voice recording interface can be called to perform voice recording operations.

[0248] The third voice recording operation stores the recorded voice input data in real time (i.e., collects, stores and records the voice duration of the user of the terminal device in real time). The third recording interface includes at least a third audio animation icon (such as Fig. 20 ), a third pause recording control (similar to the audio animation icon shown in Fig. 20 double circle icon), a third cancel recording control (same as Fig. 20 ) and complete the recording controls.

[0249] Optionally, in the above Figure 6 Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Fig.12 As shown, step S602, when a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first session object corresponding to the first chat window component, and the recording completion interface is hidden, including:

[0250] In step S1201, when a trigger instruction of the recording and sending control is received, all voice input data stored in the first recording operation are obtained;

[0251] In step S1202, all voice input data are converted into data streams to obtain a first audio stream;

[0252] In step S1203, the first audio stream is sent to the first conversation object through the conversation application interface, and the recording completion interface is hidden.

[0253] In an embodiment of the present application, when the user object needs to send the recorded voice to the first conversation object, the user object can click the recording send control (i.e., the send button) on the recording completion interface, so that the trigger instruction of the recording send control can be received, and all voice input data stored in the first recording operation can be obtained, and all voice input data are converted into data streams to obtain the first audio stream, and then the first audio stream is sent to the first conversation object through the conversation application interface, and the recording completion interface is hidden.

[0254] It is understandable that, for example, Fig.18 As shown, when the object triggers handleSend (i.e., the voice sending button) through the recording controller recorderController of the global conversation application App, i.e., GlobalApp, the recording controller obtains the sending audio logic currentAIO to send the audio to the corresponding public chat window component AIO. When the public chat window component AIO triggers handleRecorder (i.e., the voice recording button), the global conversation application App, i.e., GlobalApp, displays the recording controller (e.g., the recording interface).

[0255] Furthermore, as for the data layer of the recording module, it can be to manage the local audio stream stream, specifically, it can be fully hosted to the voice recording interface MediaRecorder, and when the audio sending logic is triggered, the data stream conversion can be performed, that is, after the voice recording is completed, the audio stream stream in the recording module recorder is the complete recorded audio stream (that is, all recorded voice input data), and the background upload service can be called to convert the local audio stream into a first audio stream (such as a content distribution network CDN-style audio stream), and then, the first audio stream can be sent to an instant message such as an IM message in the public chat window component AIO, that is, the first audio stream is sent to the first session object through the first chat window component through the session application interface, and the recording completion interface is hidden.

[0256] Optionally, in the above Figure 6Based on the corresponding embodiment, in another optional embodiment of the speech processing method provided in the embodiment of the present application, as Fig.13 As shown, in step S602, when a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first chat window component, and before hiding the recording completion interface, the method further includes:

[0257] In step S1301, when a move instruction of the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface is received, in the conversation application interface, a move operation is performed on the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface based on the move instruction, wherein the move operation includes dragging and hiding.

[0258] Specifically, for example, when the user object wants to record the interface (such as Fig. 20 Recording interface as shown), recording pause interface, recording completion interface, recording preparation interface or recording suspension interface (as shown Fig.21 When the user moves the recording interface, recording pause interface, recording completion interface, recording preparation interface or recording suspension interface to any position in the display area of ​​the conversation application interface, the recording interface, recording pause interface, recording completion interface, recording preparation interface or recording suspension interface can be dragged and dropped. Alternatively, when the user wants to collapse the recording interface, recording pause interface, recording completion interface, recording preparation interface or recording suspension interface, the recording interface (such as Fig. 20 Recording interface as shown), recording pause interface, recording completion interface, recording preparation interface or recording suspension interface (as shown Fig.21 Then, in the conversation application interface, based on the movement instruction, the recording interface, the recording pause interface, the recording completion interface, the recording preparation interface or the recording suspension interface can be moved, such as pushed, dragged or hidden.

[0259] The following is a detailed description of the speech processing device in this application. Fig.25 , Fig.25 This is a schematic diagram of an embodiment of a speech processing device in an embodiment of the present application. The speech processing device 20 includes:

[0260] A display unit 201 is used to display a first chat window component of a conversation application interface through a terminal device, wherein the first chat window component at least includes a voice recording control;

[0261] The processing unit 202 is configured to display a recording process interface in the first chat window component when receiving a trigger instruction of the voice recording control, so as to perform a first voice recording operation through the recording process interface, wherein the first voice recording operation stores the recorded voice input data in real time;

[0262] The display unit 201 is further configured to display a conversation list component of the conversation application interface when the first chat window component changes from a display state to an exit or closed state;

[0263] The display unit 201 is further used to switch the recording interface to a recording suspension interface, and to suspend and display the recording suspension interface in the conversation list component.

[0264] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application, the display unit 201 can be specifically used for:

[0265] When the first voice recording operation is interrupted, the first chat window component changes from a display state to a passive exit state or a passive closing state;

[0266] Switch from the first chat window component to the conversation list component, and pause the first voice recording operation;

[0267] The display unit 201 can be specifically used for:

[0268] The recording process interface is switched to the first recording suspension interface, and the first recording suspension interface is suspended and displayed in the first conversation object component of the conversation list component.

[0269] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0270] The display unit 201 is further configured to expand the first recording floating interface when receiving a click instruction on the first recording floating interface, and display an audio still icon, a start recording control, and a recording send control in the expanded first recording floating interface;

[0271] The processing unit 202 is also used to send the voice input data stored in the first voice recording operation to the first conversation object corresponding to the first conversation object component in the conversation list component when receiving a trigger instruction of the recording sending control, and hide the first recording floating interface.

[0272] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application, the display unit 201 can be specifically used for:

[0273] When the first chat window component changes from the display state to the active exit or active close state, switching from the first chat window component to the conversation list component;

[0274] The display unit 201 can be specifically used for:

[0275] The recording interface is switched to a second recording suspension interface, and the second recording suspension interface is suspended and displayed in the first conversation object component of the conversation list component.

[0276] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0277] The display unit 201 is further configured to expand the second recording floating interface and display an audio animation icon and a recording sending control in the expanded second recording floating interface when a click instruction of the second recording floating interface is received;

[0278] The processing unit 202 is further configured to, when receiving a trigger instruction of the recording sending control, send the voice input data stored in the first voice recording operation to the first conversation object corresponding to the first conversation component in the conversation list component, and hide the second recording floating interface.

[0279] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0280] The processing unit 202 is also used to switch the recording interface displayed in the first chat window component to the recording pause interface and pause the first voice recording operation when a trigger instruction of the pause recording control is received, wherein the recording pause interface includes at least an audio still icon, a start recording control, a cancel recording control, and a complete recording control.

[0281] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0282] The display unit 201 is further configured to switch the recording progress interface or the recording pause interface displayed in the first chat window component to a recording completion interface when receiving a trigger instruction for completing the recording control, wherein the recording completion interface includes at least a recording sending control and a cancel sending control;

[0283] The processing unit 202 is also used to send the voice input data stored in the first voice recording operation to the first conversation object corresponding to the first chat window component and hide the recording completion interface when a trigger instruction of the recording sending control is received through the recording completion interface.

[0284] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application, the processing unit 202 can be specifically used for:

[0285] When the trigger instruction received for the voice recording control is a long press, a recording interface is displayed in the first chat window component to call the voice recording interface to perform the first voice recording operation.

[0286] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application, the processing unit 202 can be specifically used for:

[0287] When the trigger instruction of the voice recording control is a click, a recording preparation interface is displayed in the first chat window component, wherein the recording preparation interface includes at least an audio still icon, a start recording control, and a cancel recording control;

[0288] When a trigger instruction to start recording control is received, the recording preparation interface displayed in the first chat window component is switched to the recording progress interface, and the voice recording interface is called to perform the first voice recording operation.

[0289] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0290] The processing unit 202 is further configured to delete the voice input data stored in the first recording operation and hide the recording in progress interface, the recording pause interface or the recording completion interface when receiving a trigger instruction to cancel the recording control or the sending control.

[0291] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0292] An acquiring unit 203 is used to acquire a current recording duration corresponding to the voice input data recorded by the first voice recording operation;

[0293] The processing unit 202 is also used to switch the recording interface displayed in the first chat window component to the recording completion interface if the current recording duration is greater than the time threshold, and end the first voice recording operation.

[0294] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0295] The display unit 201 is further configured to display a second chat window component corresponding to the second conversation object component when receiving a trigger instruction of the second conversation object component in the conversation list component;

[0296] The processing unit 202 is further configured to switch the second recording floating interface to the first recording floating interface and suspend the first voice recording operation when receiving a trigger instruction of the voice recording control of the second chat window component;

[0297] The processing unit 202 is also used to display a second recording interface in the second chat window component, and call the voice recording interface to perform a second voice recording operation, wherein the second voice recording operation is used to store the recorded second voice input data in real time, and the second recording interface includes at least a second audio animation icon, a second pause recording control, a second cancel recording control, and a second send recording control.

[0298] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application, the processing unit 202 can be specifically used for:

[0299] When a trigger instruction of the recording sending control is received, all voice input data stored in the first recording operation are obtained;

[0300] Performing data stream conversion on all voice input data to obtain a first audio stream;

[0301] The first audio stream is sent to the first conversation object through the conversation application interface, and the recording completion interface is hidden.

[0302] Optionally, in the above Fig.25 On the basis of the corresponding embodiment, in another embodiment of the speech processing device provided by the embodiment of the present application,

[0303] The processing unit 202 is also used to, when receiving a move instruction of the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface, perform a move operation on the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface based on the move instruction in the conversation application interface, wherein the move operation includes dragging and hiding.

[0304] On the other hand, the present application provides another schematic diagram of a computer device, such as Fig.26 As shown, Fig.263 is a schematic diagram of a computer device structure provided in an embodiment of the present application. The computer device 300 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 310 (for example, one or more processors) and a memory 320, and one or more storage media 330 (for example, one or more mass storage devices) storing application programs 331 or data 332. Among them, the memory 320 and the storage medium 330 may be temporary storage or permanent storage. The program stored in the storage medium 330 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations in the computer device 300. Furthermore, the central processing unit 310 may be configured to communicate with the storage medium 330 to execute a series of instruction operations in the storage medium 330 on the computer device 300.

[0305] The computer device 300 may also include one or more power supplies 340, one or more wired or wireless network interfaces 350, one or more input and output interfaces 360, and / or one or more operating systems 333, such as Windows Server 2000, Windows Server 2003, Windows Server 2003E, Windows Server 2003R ... TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0306] The computer device 300 is also used to perform the following steps: Figures 2 to 13 The steps in the corresponding embodiments.

[0307] Another aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the following Figures 2 to 13 The illustrated embodiments describe steps in a method.

[0308] Another aspect of the present application provides a computer program product comprising a computer program, which, when executed by a processor, implements the following Figures 2 to 13 The illustrated embodiments describe steps in a method.

[0309] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0310] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0311] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0312] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0313] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

Claims

1. A speech processing method, characterized in that: include: Displaying a first chat window component of the session application interface through a terminal device, wherein the first chat window component includes at least a voice recording control; When a trigger instruction of the voice recording control is received, a recording progress interface is displayed in the first chat window component, so as to perform a first voice recording operation through the recording progress interface, wherein the first voice recording operation stores the recorded voice input data in real time; When the first chat window component changes from a display state to an exit or closed state, displaying a conversation list component of the conversation application interface; The recording process interface is switched to a recording suspension interface, and the recording suspension interface is suspended and displayed in the conversation list component.

2. The method according to claim 1, characterized in that: The recording suspension interface includes a first recording suspension interface, the conversation list component includes a conversation object component, and the conversation object component has a one-to-one correspondence with the chat window component; when the first chat window component changes from a display state to an exit or closed state, the conversation list component of the conversation application interface is displayed, including: When the first voice recording operation is interrupted, the first chat window component changes from a display state to a passive exit state or a passive closing state; Switching from the first chat window component to the conversation list component, and pausing the first voice recording operation; The step of switching the recording interface to a recording suspension interface and suspending and displaying the recording suspension interface in the conversation list component includes: The recording progress interface is switched to a first recording suspension interface, and the first recording suspension interface is suspended and displayed in a first conversation object component of the conversation list component.

3. The method according to claim 2, characterized in that After switching the recording interface to the first recording suspension interface and suspending and displaying the first recording suspension interface in the first conversation object component of the conversation list component, the method further includes: When receiving a click instruction of the first recording floating interface, expanding the first recording floating interface, and displaying the audio still icon, the start recording control, and the recording send control in the expanded first recording floating interface; When a trigger instruction of the recording sending control is received, in the conversation list component, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first conversation object component, and the first recording floating interface is hidden.

4. The method according to claim 1, characterized in that: The recording suspension interface further includes a second recording suspension interface, the conversation list component includes a conversation object component, and the conversation object component has a one-to-one correspondence with the chat window component; When the first chat window component changes from the display state to the exit or closed state, displaying the conversation list component of the conversation application interface includes: When the first chat window component changes from the display state to the active exit or active close state, switching from the first chat window component to the conversation list component; The step of switching the recording interface to a recording suspension interface and suspending and displaying the recording suspension interface in the conversation list component includes: The recording progress interface is switched to a second recording suspension interface, and the second recording suspension interface is suspended and displayed in the first conversation object component of the conversation list component.

5. The method according to claim 4, characterized in that After switching the recording interface to a second recording suspension interface and suspending and displaying the second recording suspension interface in the first conversation object component of the conversation list component, the method further includes: When receiving a click instruction of the second recording floating interface, expanding the second recording floating interface, and displaying the audio animation icon and the recording sending control in the expanded second recording floating interface; When a trigger instruction of the recording sending control is received, in the conversation list component, the voice input data stored in the first voice recording operation is sent to the first conversation object corresponding to the first conversation component, and the second recording floating interface is hidden.

6. The method according to claim 1, characterized in that The recording process interface includes the pause recording control; when the trigger instruction of the voice recording control is received, the recording process interface is displayed in the first chat window component to perform the first voice recording operation through the recording process interface, and the method further includes: When a trigger instruction for pausing recording control is received, the recording interface displayed in the first chat window component is switched to the recording pause interface, and the first voice recording operation is paused, wherein the recording pause interface includes at least an audio still icon, a start recording control, the cancel recording control, and a complete recording control.

7. The method according to claim 6, characterized in that The recording process interface also includes the completion recording control; when the trigger instruction of the pause recording control is received, the recording process interface displayed in the first chat window component is switched to the recording pause interface, and the first voice recording operation is paused, and the method further includes: When a trigger instruction of the recording completion control is received, the recording progress interface or the recording pause interface displayed in the first chat window component is switched to a recording completion interface, wherein the recording completion interface at least includes the recording send control and the cancel send control; When a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first session object corresponding to the first chat window component, and the recording completion interface is hidden.

8. The method according to claim 1, characterized in that When receiving the trigger instruction of the voice recording control, displaying a recording interface in the first chat window component to perform a first voice recording operation through the recording interface includes: When the trigger instruction received for the voice recording control is a long press, the recording interface is displayed in the first chat window component to call the voice recording interface to perform the first voice recording operation.

9. The method according to claim 1, characterized in that: When receiving the trigger instruction of the voice recording control, displaying a recording interface in the first chat window component to perform a first voice recording operation through the recording interface includes: When the trigger instruction of the voice recording control is a click, a recording preparation interface is displayed in the first chat window component, wherein the recording preparation interface at least includes the audio still icon, the start recording control, and the cancel recording control; When a trigger instruction of the start recording control is received, the recording preparation interface displayed in the first chat window component is switched to the recording progress interface, and the voice recording interface is called to perform the first voice recording operation.

10. The method according to claim 7, characterized in that When a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first session object corresponding to the first chat window component, and before hiding the recording completion interface, the method further includes: When a trigger instruction of the cancel recording control or the cancel sending control is received, the voice input data stored in the first recording operation is deleted, and the recording progress interface, the recording pause interface or the recording completion interface is hidden.

11. The method according to claim 7, characterized in that When a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first session object corresponding to the first chat window component, and before hiding the recording completion interface, the method further includes: Obtaining a current recording duration corresponding to the voice input data recorded by the first voice recording operation; If the current recording duration is greater than the time threshold, the recording progress interface displayed in the first chat window component is switched to the recording completion interface, and the first voice recording operation is ended.

12. The method according to claim 4, characterized in that After switching the recording interface to a second recording suspension interface and suspending and displaying the second recording suspension interface in the first conversation object component of the conversation list component, the method further includes: When receiving a trigger instruction of a second conversation object component in the conversation list component, displaying a second chat window component corresponding to the second conversation object component; When receiving a trigger instruction of the voice recording control of the second chat window component, switching the second recording suspension interface to the first recording suspension interface, and pausing the first voice recording operation; A second recording interface is displayed in the second chat window component, and a voice recording interface is called to perform a second voice recording operation, wherein the second voice recording operation is used to store the recorded second voice input data in real time, and the second recording interface includes at least a second audio animation icon, a second pause recording control, a second cancel recording control, and a second send recording control.

13. The method according to claim 7, characterized in that When a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first session object corresponding to the first chat window component, and the recording completion interface is hidden, including: When a trigger instruction of the recording sending control is received, all voice input data stored in the first recording operation are obtained; Convert all the voice input data into data streams to obtain a first audio stream; The first audio stream is sent to the first conversation object through the conversation application interface, and the recording completion interface is hidden.

14. The method according to claim 7, characterized in that When a trigger instruction of the recording sending control is received through the recording completion interface, the voice input data stored in the first voice recording operation is sent to the first session object corresponding to the first chat window component, and before hiding the recording completion interface, the method further includes: When a movement instruction of the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface is received, in the conversation application interface, a movement operation is performed on the recording in progress interface, the recording pause interface, the recording completed interface, the recording preparation interface or the recording floating interface based on the movement instruction, wherein the movement operation includes dragging and hiding.

15. A speech processing device, characterized in that: include: A display unit, configured to display a first chat window component of a conversation application interface through a terminal device, wherein the first chat window component at least includes a voice recording control; a processing unit, configured to display a recording process interface in the first chat window component when receiving a trigger instruction of the voice recording control, so as to perform a first voice recording operation through the recording process interface, wherein the first voice recording operation stores the recorded voice input data in real time; The display unit is further configured to display a conversation list component of the conversation application interface when the first chat window component changes from a display state to an exit or closed state; The display unit is further used to switch the recording interface to a recording suspension interface, and to suspend and display the recording suspension interface in the conversation list component.

16. A computer device comprising a memory, a processor and a bus system, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 14 are implemented; The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other.

17. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 14 are implemented.

18. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 14 are implemented.

Images