Voice information display method and device

Abstract

The present application discloses a method and device for displaying voice information, which belongs to the field of communication technology. The method comprises: receiving a first voice message and a second voice message sent by a second electronic device, wherein the second voice message is associated with the first voice message; and displaying a second difference text with a semantic difference in the second semantic result when a first semantic result corresponding to the first voice message and a second semantic result corresponding to the second voice message are different.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a method and device for displaying voice information. Background Art

[0002] With the rapid development of mobile communication technology, mobile terminals, led by smart phones, have become indispensable tools in all aspects of people's lives. The various functions of mobile terminals have also been gradually improved, providing a variety of intelligent services, bringing great convenience to users.

[0003] Taking the voice chat function as an example, many applications of mobile terminals currently have this function. Through voice chat, users can communicate with each other in real time. On the one hand, the communication effect is better than text chat. On the other hand, when it is inconvenient for users to type, voice input can achieve normal communication. However, in the prior art, during the voice message recording process, users cannot obtain the content of the newly received voice message, so users need to re-record after listening to the newly received voice message, which is cumbersome and has low communication efficiency. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a method and device for displaying voice information, which can facilitate users to quickly read voice messages, thereby facilitating replies and improving communication efficiency.

[0005] In a first aspect, an embodiment of the present application provides a method for displaying voice information, which is applied to a first electronic device, and the method includes:

[0006] Receiving first voice information and second voice information sent by a second electronic device, wherein the second voice information is associated with the first voice information;

[0007] When the first semantic result corresponding to the first voice information and the second semantic result corresponding to the second voice information are different, a second difference text having the semantic difference in the second semantic result is displayed.

[0008] In a second aspect, an embodiment of the present application provides a voice information display device, the device comprising:

[0009] A receiving module, used for receiving a first voice message and a second voice message sent by a second electronic device, wherein the second voice message is associated with the first voice message;

[0010] The display module is used to display a second difference text with semantic difference in the second semantic result when a first semantic result corresponding to the first voice information and a second semantic result corresponding to the second voice information are different.

[0011] In a third aspect, an embodiment of the present application further provides a method for displaying voice information, which is applied to a second electronic device, and the method includes:

[0012] Receiving a first voice input and generating first voice information corresponding to the first voice input;

[0013] Sending a first voice message to a first electronic device;

[0014] receiving a second voice input for the first voice information, and generating second voice information corresponding to the second voice input;

[0015] The second voice information is associated with the first voice information, and the second voice information is sent to the first electronic device, so that the first electronic device displays a second difference text with semantic difference in the second semantic result corresponding to the second voice information according to the first voice information and the second voice information.

[0016] In a fourth aspect, an embodiment of the present application further provides a voice information display device, the device comprising:

[0017] A second receiving module, used to receive a first voice input and generate first voice information corresponding to the first voice input;

[0018] A second sending module, used for sending the first voice information to the first electronic device;

[0019] The second receiving module is also used to receive a second voice input of the first voice information, and generate second voice information corresponding to the second voice input;

[0020] The second sending module is also used to associate the second voice information with the first voice information and send the second voice information to the first electronic device so that the first electronic device displays a second difference text with semantic difference in the second semantic result corresponding to the second voice information based on the first voice information and the second voice information.

[0021] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method provided in the first aspect or the third aspect are implemented.

[0022] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method provided in the first aspect or the third aspect are implemented.

[0023] In the seventh aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method provided in the first aspect or the third aspect.

[0024] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method provided in the first aspect or the third aspect.

[0025] In an embodiment of the present application, by performing semantic analysis on the associated first voice information and the second voice information, the first semantic result can be compared with the second semantic result, and a second difference text with semantic difference in the second semantic result can be generated and displayed, so that the user can quickly read the second difference text without listening to the voice information, thereby improving communication efficiency; in particular, when the user is recording a new voice message or editing a new text message, the user can also make an effective reply based on the second difference text, which to a certain extent avoids or reduces the situation where the user has modified the reply content after replying based on the first voice message and then listening to the second voice message. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a flowchart of a method for displaying voice information provided by an embodiment of the present application;

[0027] Figure 2 This is one of the display interface schematic diagrams of the voice information display method in the embodiment of the present application;

[0028] Figure 3 This is a partial flow chart of a method for displaying voice information provided by an embodiment of the present application;

[0029] Figure 4 This is one of the display interface schematic diagrams of the voice information display method in the embodiment of the present application;

[0030] Figure 5 This is a partial flow chart of a method for displaying voice information provided by an embodiment of the present application;

[0031] Figure 6 This is one of the display interface schematic diagrams of the voice information display method in the embodiment of the present application;

[0032] Figure 7 This is a partial flow chart of a method for displaying voice information provided by an embodiment of the present application;

[0033] Figure 8 This is a partial flow chart of a method for displaying voice information provided by an embodiment of the present application;

[0034] Fig. 9 It is a flowchart of a method for displaying voice information provided by an embodiment of the present application;

[0035] Fig.10 This is a partial flow chart of a method for displaying voice information provided by an embodiment of the present application;

[0036] Fig.11 is a structural diagram of a voice information display device provided by an embodiment of the present application;

[0037] Fig.12 is a structural schematic diagram of a voice information display device provided by another embodiment of the present application;

[0038] Fig.13 is a structural schematic diagram of an electronic device provided by another embodiment of the present application;

[0039] Fig.14 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0041] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0042] The following is a detailed description of the voice information display method provided in the embodiment of the present application through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0043] like Figure 1 As shown, Figure 1 : is a flow chart of a method for displaying voice information provided by an embodiment of the present application. The embodiment of the present application provides a method for displaying voice information, which is applied to a first electronic device. The method may include:

[0044] S101, receiving first voice information and second voice information sent by a second electronic device, where the second voice information is associated with the first voice information;

[0045] In this application, electronic devices include but are not limited to mobile phones, tablet computers, laptop computers, PDAs, vehicle-mounted terminals, wearable devices, etc., as long as they have instant messaging functions. The first electronic device and the second electronic device provided in this application can be electronic devices of the same model or different models held by different users.

[0046] The first voice message and the second voice message are both voice messages sent by the second electronic device, and the user can associate the first voice message with the second voice message when sending the second voice message. That is, the association relationship between the first voice message and the second voice message is determined by the second electronic device. Exemplarily, the second voice message can be recorded by pressing the area displayed on the first voice message, thereby associating the first voice message and the second voice message. Exemplarily, the first voice message and the second voice message can also be associated by dragging the display area of ​​the second voice message that has been sent to the first electronic device to the display area of ​​the first voice message. The user can control the second electronic device to associate with the first voice message during or after the sending process of the second voice message. There are many ways for the user to control the second electronic device to associate the first voice message with the second voice message, which will not be described one by one here.

[0047] Optionally, the association relationship between the first voice information and the second voice information may also be determined based on the voice contents of the first voice information and the second voice information, such as the voice contents are associated with the same topic, the voice contents include the same keyword, etc.

[0048] S102: When a first semantic result corresponding to the first voice information and a second semantic result corresponding to the second voice information are different, display a second different text having a semantic difference in the second semantic result.

[0049] The semantic result is character information obtained through semantic analysis that is consistent with the meaning expressed by the voice information. The first voice information and the second voice information can be semantically analyzed by a semantic analysis model to obtain a first semantic result corresponding to the first voice information and a second semantic result corresponding to the second voice information. The semantic analysis model can be obtained by training a neural network or a semantic analysis network. It should be noted that the embodiment of the present application does not limit the implementation method of semantic analysis, which will not be elaborated here.

[0050] The obtained semantic results are compared, so that the text with semantic difference can be identified. Similarly, the first semantic result and the second semantic result are compared to obtain the second difference text, which can also be performed through a semantic analysis model. It should be noted that the embodiment of the present application does not limit the method for obtaining the first difference text and the second difference text, and will not be elaborated here.

[0051] In some embodiments, in order to remind the user of the difference between the first voice information and the second voice information, the first difference text with semantic difference in the first semantic result is displayed while displaying the second difference text. In order to facilitate user browsing, a display area can be pre-set in the display interface to display the first difference text and the second difference text, or a display box can be popped up in the display interface to display the first difference text and the second difference text in the display box. In order to facilitate the user to distinguish the first difference text of the first voice information and the second difference text of the second voice information, in some embodiments, the first difference text is displayed in the first display area corresponding to the first voice information, and the second difference text is displayed in the second display area corresponding to the second voice information.

[0052] See also Figure 2 , Figure 2 This is a display interface schematic diagram of a voice information display method provided by an embodiment of the present application. In the display interface, a first voice information is displayed in the first display area 201, and the size of the first display area 201 is positively correlated with the length of the first voice information. When the user clicks the first display area 201, the first voice information is played. At the same time, the first distinguishing text "Friday" is displayed in the first display area 201, and the second voice information is displayed in the second display area 202. The size of the second display area 202 is positively correlated with the length of the second voice information. When the user clicks the second display area 202, the second voice information is played. At the same time, the second distinguishing text "Thursday" is displayed in the second display area 202. Thus, the user can quickly distinguish that "Friday" in the first distinguishing text belongs to the first voice information, and "Thursday" in the second distinguishing text belongs to the second voice information. When the user listens to the first voice information, according to the date "Friday" in the first voice information, or in the process of editing a new text message, the second voice information sent by the second electronic device is received, and the user does not need to listen to the second voice information, that is, according to the displayed second distinguishing text "Thursday", the reply content is promptly corrected.

[0053] In the above embodiment, by performing semantic analysis on the associated first voice information and the second voice information, the first semantic result and the second semantic result can be compared, and a second difference text with semantic difference in the second semantic result can be generated and displayed, so that the user can quickly read the second difference text without listening to the voice information, thereby improving communication efficiency; in particular, when the user is recording a new voice message or editing a new text message, the user can also effectively correct the reply according to the second difference text, thereby avoiding or reducing to a certain extent the situation where the user has already replied according to the first voice message and then supplements the reply after listening to the second voice message.

[0054] See also Figure 3 In some embodiments, after S102, the method further includes:

[0055] S201, in a case where a third voice message has been recorded in reply to the first voice message, according to the semantic category to which the second distinguishing text belongs, determining a semantic sub-result of the same category as the semantic category in a third semantic result corresponding to the third voice message;

[0056] S202: Replace the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information to generate fourth voice information.

[0057] The third voice message is a reply message recorded by the user through the first electronic device according to the first voice message. The audio data generated by the user's voice recording operation on the first voice message can be used as the third voice message. For example, in response to the user long pressing the first display area corresponding to the first voice message, voice recording is performed, and the voice recording data is the third voice message in reply to the first voice message. The voice recording data received immediately after the first voice message is played can also be confirmed as the third voice message in reply to the first voice message. It can also be that after the third voice message is recorded, after receiving the user's operation input to associate the third voice message with the first voice message, the third voice message is confirmed as a voice message in reply to the first voice message.

[0058] Semantic classification is the classification of the second distinguishing text. Those skilled in the art can set semantic classification as needed. Contact name class, title class, amount class, time class, etc. can be set. For example, the contact name class can include contact names such as Zhang San and Li Si set in the address book of the first electronic device. For example, the title class can include father, mother, etc. For example, the amount class can include numerical values ​​with monetary units such as yuan, block, and thousand.

[0059] The semantic sub-result is a semantic sub-result with the same semantic classification in the third semantic result, and the semantic sub-result may be the entire third semantic result or a part of the third semantic result. It is understandable that when the semantic classification to which the second distinguishing text belongs is the title class, the semantic sub-result should also correspond to the title class; when the semantic classification to which the first distinguishing text and the second distinguishing text belong is the amount class, the semantic sub-result should also correspond to the amount class, and so on.

[0060] Those skilled in the art can understand that the third voice information is a segment of audio data A, and the semantic sub-result corresponds to a small segment of audio a of the audio data A. Similarly, the second voice information is a segment of audio data B, and the second distinguishing text corresponds to a small segment of audio b of the audio data B. When the user has recorded the third voice information, the small segment of audio a corresponding to the semantic sub-result in the third voice information is replaced with the audio b corresponding to the second distinguishing text in the second voice information to generate the fourth voice information. The user can select the appropriate voice information from the third voice information and the fourth voice information as needed to send to the second electronic device.

[0061] Since the fourth voice information is generated based on the third voice information and is not recorded additionally by the user, the generated fourth voice information can save the user the step of re-recording the voice information after listening to the second voice information to correct the audio a corresponding to the semantic sub-result in the third voice information, thereby making the user more flexible in replying with the correct information.

[0062] In some embodiments, after S201, the method further includes:

[0063] The semantic sub-result is displayed in a third display area corresponding to the third voice information.

[0064] In this example, see Figure 4 , Figure 4 It is a display interface schematic diagram of the voice information display method provided by an embodiment of the present application. In this display interface, the first voice information is displayed in the first display area 401, and the first distinguishing text "Friday" is displayed in the first display area 401. The second voice information is displayed in the second display area 402, and the second distinguishing text "Thursday" is displayed in the second display area 402. The third voice information is displayed in the third display area 403, and the semantic sub-result "Friday" is displayed in the third display area 403. The semantic classification of the first distinguishing text "Friday", the second distinguishing text "Thursday" and the semantic sub-result "Friday" are all time categories.

[0065] By displaying the semantic sub-results in the third display area, it is convenient for the user to confirm the semantically different parts in each voice information.

[0066] See also Figure 5 In order to further improve communication efficiency, in some embodiments, S202 includes:

[0067] S501, receiving a first input of a second distinguishing text;

[0068] S502: In response to the first input, replace the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information to generate fourth voice information.

[0069] The first input may be a touch input, for example, the touch input may be a touch click operation, or a sliding operation, or other operations. The first input may also be an input operation performed by a user with the help of a mouse, remote control device, keyboard or other input devices connected to the electronic device. Optionally, the first input may indicate the second area where the second distinguishing text is located. Unless otherwise specified, the input to the electronic device in the following description may be a touch click operation, a sliding operation or other operations, and may also be an input operation performed by a user with the help of a mouse, remote control device, keyboard or other input devices connected to the electronic device.

[0070] For example, the first input may be to drag the second distinguishing text to the area where the semantic sub-result is located. Figure 6 , Figure 6 It is a display interface schematic diagram of the voice information display method provided by an embodiment of the present application. In the display interface, the first voice information is displayed in the first display area 401, and the first distinguishing text "Friday" is displayed in the first display area 401. The second voice information is displayed in the second display area 402, and the second distinguishing text "Thursday" is displayed in the second display area 402. The third voice information is displayed in the third display area 403, and the semantic sub-result "Friday" is displayed in the third display area 403. The first input is a sliding operation from the second distinguishing text "Thursday" to the area where the semantic sub-result "Friday" is displayed.

[0071] Since the first electronic device can send multiple reply messages after receiving the first voice message, and the same second voice message can correspond to multiple second distinguishing texts, the voice data that the user wants to replace can be determined through the user's first input of the second distinguishing text, so that the generated fourth voice message can better meet user needs.

[0072] Those skilled in the art can understand that, when there are multiple second distinguishing texts in the second voice information, the user's first input of the third distinguishing text is received, and the audio data corresponding to the third distinguishing text is used to replace the audio data corresponding to the semantic sub-result of the same type as the third distinguishing text in the third voice information, wherein the multiple second distinguishing texts include the third distinguishing text, so as to achieve the replacement of the voice data of some semantic sub-results of the third voice information. For example: the second voice information is a segment of audio data B, and the second voice information has two second distinguishing texts, and the two second distinguishing texts correspond to the audio "Friday" and the audio "playing football" in the audio data B. The third voice information is a segment of audio data A, which has two semantic sub-results of the same type as the second distinguishing text, and the two semantic sub-results correspond to the audio "Thursday" and the audio "playing basketball" in the audio data A. When the first input of the second distinguishing text "Friday" is received, "Thursday" in the third voice information is replaced with "Friday", and when the first input of the second distinguishing text "playing football" is received, "playing basketball" in the third voice information is replaced with "playing football".

[0073] See also Figure 7 In some other embodiments, after S202, the method further includes:

[0074] S701: When the third voice information has not been sent to the second electronic device, or when the third voice information has been sent to the second electronic device and marked as read, send a fourth voice information to the second electronic device.

[0075] The third voice message is not sent to the second electronic device, that is, the third voice message has been recorded but not sent to the second electronic device. In this case, the fourth voice message is directly sent to the second electronic device to save the user's selection operation.

[0076] The third voice message is marked as read, which means that the third voice message has been read by the user of the second electronic device. In this case, if a new voice message is sent to the second electronic device via the first electronic device so that the new voice message replaces the third voice message that has been read in the second electronic device, it will not only fail to reduce the possibility of the user hearing the wrong message and making an incorrect reply, but may also cause the user to miss the voice message with correct semantics. Therefore, in this embodiment, the voice data corresponding to the semantic sub-result in the third voice message is replaced with the voice data corresponding to the second distinguishing text in the second voice message to generate a fourth voice message, and the new fourth voice message is directly sent to the second electronic device, so that the user of the second electronic device can hear the fourth voice message with correct semantics, thereby eliminating the need for the user of the first electronic device to record the complete fourth voice message again.

[0077] See also Figure 8 In another embodiment, after S202, the method further includes:

[0078] S801, when the third voice message has been sent to the second electronic device and is marked as unread, associating the fourth voice message with the third voice message;

[0079] The third voice message is marked as unread, which means that the user of the second electronic device has not read the third voice message. It can be understood by those skilled in the art that after the user of the second electronic device reads the third voice message, the second electronic device sends a state change instruction to the first electronic device, so that the first electronic device changes the unread mark of the third voice message to a read mark.

[0080] S802: Send fourth voice information to the second electronic device, so that the second electronic device replaces the third voice information with the fourth voice information.

[0081] When the user has recorded and replied to the third voice message according to the first voice message, the third voice message can be replaced by generating a new fourth voice message. It can be understood by those skilled in the art that the third voice message is a segment of audio data A, the semantic sub-result corresponds to a small segment of audio a of the audio data A, and the second voice message is a segment of audio data B, and the second distinguishing text corresponds to a small segment of audio b of the audio data B. When the first electronic device sends the third voice message and the third voice message is not read by the user of the second electronic device, a new fourth voice message is generated by replacing a small segment of audio a corresponding to the semantic sub-result in the third voice message with the audio b corresponding to the second distinguishing text in the second voice message. Thereby avoiding the user from recording the voice message again, and generating the fourth voice message after the correction information, and then sending the fourth voice message associated with the third voice message to the second electronic device, so that the second electronic device replaces the received third voice message with the fourth voice message, and the user of the second electronic device can directly listen to the fourth voice message. To a certain extent, it avoids the communication errors caused by the user of the second electronic device listening to the third voice message with wrong information.

[0082] Those skilled in the art can understand that, for the second electronic device, when the third voice message sent by the first electronic device is marked as unread and the fourth voice message associated with the third voice message is received, the third voice message can be deleted and the received fourth voice message can be displayed.

[0083] In some embodiments, in order to facilitate the user to quickly determine the correspondence between each distinguished text and voice information, S201 includes:

[0084] The second distinguishing text is displayed in the second display area corresponding to the second voice information. Of course, the first distinguishing text can also be displayed in the first display area corresponding to the first voice information.

[0085] In some other embodiments, in order to facilitate the user to determine the position of the audio corresponding to each distinguished text in the voice information, S201 includes:

[0086] Determine that the voice data corresponding to the second distinguishing text is at a second position of the second voice information;

[0087] According to the second position, the second distinguishing text is displayed in the second area of ​​the second display area, the second display area is the display area corresponding to the second voice information, and the second area of ​​the second display area corresponds to the second position of the second voice information.

[0088] Those skilled in the art can understand that the voice length of the second voice information is in direct proportion to the display length of the second display area, that is, the longer the voice length of the voice information is, the longer the display length of the display area is. The second distinguishing text corresponds to the second position of the second voice information, and the second position is the specific position of the voice data of the second distinguishing text in the entire voice length of the second voice information. Through the proportional relationship between the voice length of the second voice information and the display length of the second display area, the second area corresponding to the second distinguishing text in the second display area can be calculated, so that the second distinguishing text can be displayed in the second area.

[0089] In the case of displaying the first distinguishing text, the first distinguishing text is displayed in the first area of ​​the first display area in the same manner, which will not be repeated here.

[0090] The user can roughly determine the position of the voice data corresponding to the second distinguishing text in the second voice information according to the position of the second area in the second display area. Optionally, the user clicks the second display area to play the second voice information. While the user is listening to the second voice information, the user can quickly locate the voice data corresponding to the second distinguishing text by dragging the progress bar corresponding to the second voice information to listen to the voice data.

[0091] By displaying the second distinguishing text in the second area, it is convenient for the user to determine the position of the distinguishing text corresponding to the voice information, and it is convenient for the user to listen to the voice corresponding to the distinguishing text in the voice information to verify whether the semantic analysis is accurate. In particular, when there are multiple first distinguishing texts and multiple second distinguishing texts, it is necessary for the user to repeatedly listen to and check the first voice information and the second voice information.

[0092] It should be noted that the voice information display method provided in the above embodiment can be executed by the first electronic device. The following embodiment also provides another voice information display method, which can be executed by the second electronic device. Fig. 9 , the voice information display method includes:

[0093] S901, receiving a first voice input, and generating first voice information corresponding to the first voice input;

[0094] S902, sending a first voice message to a first electronic device;

[0095] S903, receiving a second voice input for the first voice information, and generating second voice information corresponding to the second voice input;

[0096] S904, associating the second voice information with the first voice information, and sending the second voice information to the first electronic device, so that the first electronic device displays a second difference text with semantic difference in the second semantic result corresponding to the second voice information according to the first voice information and the second voice information.

[0097] In S901 and S903, the first voice input can be performed through a built-in or external microphone, and the second electronic terminal converts the received analog signal into a digital signal, that is, generates a first voice message corresponding to the first voice input, and records the voice information to generate a second voice message corresponding to the voice information.

[0098] After the first voice message and the second voice message are sent to the first electronic device, the first electronic device can execute the steps S101 to S102, thereby realizing displaying the second difference text with semantic difference in the second voice message according to the first voice message and the second voice message. The specific implementation method can refer to the various embodiments of the voice message display method in which the execution subject is the first electronic device, which will not be repeated here.

[0099] In this embodiment, in a scenario where the first voice message has audio with erroneous semantics, the user can send a second voice message associated with the first voice message to the first electronic device, so that the first electronic device generates and displays a second difference text with semantic difference in the second semantic result, so that the user of the first electronic device can quickly read the second difference text without listening to the voice message, thereby improving communication efficiency; in particular, when the user of the first electronic device is recording a new voice message or editing a new text message, he can also make an effective reply based on the first difference text and the second difference text, thereby avoiding or reducing to a certain extent the need for the user to make a supplementary reply after listening to the second voice message when he has already replied based on the first voice message.

[0100] See also Fig.10 In some embodiments, after receiving a second voice input for the first voice information and generating the second voice information corresponding to the second voice input, the method includes:

[0101] S1001, receiving third voice information sent by a first electronic device;

[0102] S1002: When the third voice information is marked as unread and a fourth voice information associated with the third voice information is received, the received third voice information is replaced with the fourth voice information.

[0103] Those skilled in the art can understand that the third voice information in S1001 can be the third voice information described in S801, and the fourth voice information in S1002 can be the fourth voice information described in S802. Similarly, after the user of the second electronic device reads the third voice information, the first electronic device and the second electronic device can mark the third voice information as read.

[0104] When the second electronic device receives the fourth voice message, the received third voice message is replaced with the fourth voice message, so that the user of the second electronic device can directly listen to the fourth voice message. To a certain extent, communication errors caused by the user of the second electronic device listening to the third voice message with wrong information are avoided.

[0105] It should be noted that the voice information display method provided in the embodiment of the present application can be executed by a voice information display device. In the embodiment of the present application, the voice information display device executing the voice information display method is taken as an example to illustrate the voice information display device provided in the embodiment of the present application.

[0106] Fig.11 is a structural diagram of a voice information display device provided by another embodiment of the present application, such as Fig.11 As shown, the voice information display device may include:

[0107] The first receiving module 1101 is used to receive first voice information and second voice information sent by a second electronic device, where the second voice information is associated with the first voice information;

[0108] The first display module 1102 is used to display a second difference text with semantic difference in the second semantic result when the first semantic result corresponding to the first voice information and the second semantic result corresponding to the second voice information are different.

[0109] In an optional example, the voice information display device may further include:

[0110] The first analysis module 1103 is used to determine, in the case where a third voice message in reply to the first voice message has been recorded, a semantic sub-result of the same category as the semantic category in the third semantic result corresponding to the third voice message according to the semantic category to which the second distinguishing text belongs;

[0111] The audio replacement module 1104 is used to replace the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information to generate fourth voice information.

[0112] In another optional example, the first display module 1102 is further configured to display the semantic sub-result in a third display area corresponding to the third voice information.

[0113] In another alternative example,

[0114] The first receiving module 1101 is also used to receive a first input of a second distinguishing text;

[0115] The audio replacement module 1104 is also used to replace the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information in response to the first input, so as to generate fourth voice information.

[0116] In another optional example, the voice information display device may further include:

[0117] The first sending module 1104 is used to send the fourth voice information to the second electronic device when the third voice information has not been sent to the second electronic device, or when the third voice information has been sent to the second electronic device and marked as read.

[0118] In another optional example, the audio replacement module 1104 is further configured to associate the fourth voice information with the third voice information when the third voice information has been sent to the second electronic device and is marked as unread;

[0119] The first sending module 1104 is further configured to send fourth voice information to the second electronic device, so that the second electronic device replaces the third voice information with the fourth voice information.

[0120] In another optional example, the first display module 1102 is further used to determine that the voice data corresponding to the second distinguishing text is at a second position of the second voice information;

[0121] According to the second position, the second distinguishing text is displayed in the second area of ​​the second display area, the second display area is the display area corresponding to the second voice information, and the second area of ​​the second display area corresponds to the second position of the second voice information.

[0122] Fig.12is a structural diagram of a voice information display device provided by another embodiment of the present application, such as Fig.12 As shown, the voice information display device may include:

[0123] The second receiving module 1201 is used to receive a first voice input and generate a first voice message corresponding to the first voice input; receive a second voice input of the first voice message and generate a second voice message corresponding to the second voice input, including:

[0124] The second sending module 1202 is used to send the first voice information to the first electronic device;

[0125] The second receiving module 1201 is further used to receive a second voice input for the first voice information, and generate second voice information corresponding to the second voice input;

[0126] The second sending module 1202 is also used to associate the second voice information with the first voice information, and send the second voice information to the first electronic device, so that the first electronic device displays a second difference text with semantic difference in the second semantic result corresponding to the second voice information according to the first voice information and the second voice information.

[0127] In another optional example, the second receiving module 1201 is further configured to receive third voice information sent by the first electronic device;

[0128] The voice information display device may include:

[0129] The second display module 1203 is used to replace the third voice information with the fourth voice information when the third voice information is marked as unread and the fourth voice information associated with the third voice information is received.

[0130] The voice information display device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0131] The voice information display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0132] The voice information display device provided in the embodiment of the present application can achieve Figures 1 to 8 Method embodiments or Figures 9 and 10 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0133] Alternatively, if Fig.13 As shown, an embodiment of the present application also provides an electronic device 100, including a processor 1301, a memory 1302, and a program or instruction stored in the memory 1302 and executable on the processor 1301. When the program or instruction is executed by the processor 1301, each process of the above-mentioned voice information display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0134] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices. The electronic device 100 may be the above-mentioned first electronic device or the second electronic device.

[0135] Fig.14 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0136] The electronic device 100 includes but is not limited to components such as a radio frequency unit 141, a network module 142, an audio output unit 143, an input unit 144, a sensor 145, a display unit 146, a user input unit 147, an interface unit 148, a memory 149, and a processor 140.

[0137] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 140 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.14 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0138] The radio frequency unit 141 is used to receive the first voice information and the second voice information sent by the second electronic device, and the second voice information is associated with the first voice information;

[0139] The processor 140 is configured to display a second difference text having a semantic difference in the second semantic result when the first semantic result corresponding to the first voice information and the second semantic result corresponding to the second voice information are different.

[0140] Optionally, the voice information display device may further include:

[0141] The processor 140 is configured to determine, in a case where a third voice message in reply to the first voice message has been recorded, a semantic sub-result of the same category as the semantic category in a third semantic result corresponding to the third voice message according to the semantic category to which the second distinguishing text belongs;

[0142] The processor 140 is configured to replace the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information, so as to generate fourth voice information.

[0143] Optionally, the processor 140 is further configured to display the semantic sub-result in a third display area corresponding to the third voice information.

[0144] Optionally, the input unit 144 is used to receive a first input of the second distinguishing text;

[0145] The processor 140 is further configured to, in response to the first input, replace the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information to generate fourth voice information.

[0146] Optionally, the voice information display device may further include:

[0147] The radio frequency unit 141 is used to send the fourth voice information to the second electronic device when the third voice information has not been sent to the second electronic device, or when the third voice information has been sent to the second electronic device and marked as read.

[0148] Optionally, the processor 140 is further configured to associate the fourth voice information with the third voice information when the third voice information has been sent to the second electronic device and is marked as unread;

[0149] The radio frequency unit 141 is further configured to send fourth voice information to the second electronic device, so that the second electronic device replaces the third voice information with the fourth voice information.

[0150] Optionally, the processor 140 is further configured to determine that the voice data corresponding to the second distinguishing text is at a second position of the second voice information;

[0151] According to the second position, the second distinguishing text is displayed in the second area of ​​the second display area, the second display area is the display area corresponding to the second voice information, and the second area of ​​the second display area corresponds to the second position of the second voice information.

[0152] In another electronic device, the input unit 144 is used to receive a first voice input and generate first voice information corresponding to the first voice input;

[0153] The radio frequency unit 141 is also used to send the first voice information to the first electronic device;

[0154] The input unit 144 is used to receive a second voice input of the first voice information and generate second voice information corresponding to the second voice input;

[0155] The radio frequency unit 141 is also used to associate the second voice information with the first voice information and send the second voice information to the first electronic device so that the first electronic device displays a second difference text with semantic difference in the second semantic result corresponding to the second voice information according to the first voice information and the second voice information.

[0156] Optionally, the radio frequency unit 141 receives third voice information sent by the first electronic device;

[0157] The processor 140 is further configured to replace the third voice information with the fourth voice information when the third voice information is marked as unread and fourth voice information associated with the third voice information is received.

[0158] It should be understood that in the embodiment of the present application, the input unit 144 may include a graphics processor (Graphics Processing Unit, GPU) 1441 and a microphone 1442, and the graphics processor 1441 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 146 may include a display panel 1461, and the display panel 1461 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 147 includes a touch panel 1471 and at least one of other input devices 1472. The touch panel 1471 is also called a touch screen. The touch panel 1471 may include two parts: a touch detection device and a touch controller. Other input devices 1472 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0159] The memory 149 can be used to store software programs and various data. The memory 149 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 149 may include a volatile memory or a non-volatile memory, or the memory 149 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 149 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0160] The processor 140 may include one or more processing units; optionally, the processor 140 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 140.

[0161] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned voice information display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0162] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0163] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned voice information display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0164] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0165] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned voice information display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0166] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0167] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0168] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for displaying voice information, applied to a first electronic device, characterized in that: include: Receiving first voice information and second voice information sent by a second electronic device, wherein the second voice information and the first voice information are configured to be associated with each other by the second electronic device, or the second voice information and the first voice information are associated with each other according to the voice content of the second voice information and the voice content of the first voice information; In the case where a first semantic result corresponding to the first voice information and a second semantic result corresponding to the second voice information are different, a second difference text having the semantic difference in the second semantic result is displayed.

2. The method according to claim 1, characterized in that After displaying the second difference text with semantic difference in the second semantic result, the method further includes: In the case where a third voice message has been recorded in reply to the first voice message, according to the semantic category to which the second distinguishing text belongs, a semantic sub-result of the same category as the semantic category is determined in the third semantic result corresponding to the third voice message; The voice data corresponding to the second distinguishing text in the second voice information is used to replace the voice data corresponding to the semantic sub-result in the third voice information to generate fourth voice information.

3. The method according to claim 2, characterized in that After determining the semantic sub-results of the same category as the semantic classification in the third semantic results corresponding to the third voice information, the method further includes: The semantic sub-result is displayed in a third display area corresponding to the third voice information.

4. The method according to claim 2, characterized in that: The step of replacing the voice data corresponding to the semantic sub-result in the third voice information with the voice data corresponding to the second distinguishing text in the second voice information to generate the fourth voice information includes: receiving a first input of the second distinguished text; In response to the first input, the voice data corresponding to the semantic sub-result in the third voice information is replaced by the voice data corresponding to the second distinguishing text in the second voice information to generate fourth voice information.

5. The method according to claim 2, characterized in that: After generating the fourth voice information, the method further includes: When the third voice information has not been sent to the second electronic device, or when the third voice information has been sent to the second electronic device and marked as read, the fourth voice information is sent to the second electronic device.

6. The method according to claim 2, characterized in that After generating the fourth voice information, the method further includes: When the third voice information has been sent to the second electronic device and is marked as unread, associating the fourth voice information with the third voice information; The fourth voice information is sent to the second electronic device, so that the second electronic device replaces the third voice information with the fourth voice information.

7. The method according to claim 1, characterized in that The displaying of the second difference text with semantic difference in the second semantic result includes: Determine that the voice data corresponding to the second distinguishing text is at a second position of the second voice information; According to the second position, a second distinguishing text is displayed in a second area of ​​a second display area, the second display area is a display area corresponding to the second voice information, and the second area of ​​the second display area corresponds to the second position of the second voice information.

8. A method for displaying voice information, applied to a second electronic device, characterized in that: include: Receiving a first voice input and generating first voice information corresponding to the first voice input; Sending the first voice information to a first electronic device; receiving a second voice input for the first voice information, and generating second voice information corresponding to the second voice input; The second voice information is associated with the first voice information, and the second voice information is sent to the first electronic device, so that the first electronic device displays a second difference text with semantic difference in a second semantic result corresponding to the second voice information according to the first voice information and the second voice information.

9. The method according to claim 8, characterized in that After receiving a second voice input for the first voice information and generating second voice information corresponding to the second voice input, the method includes: receiving a third voice message sent by the first electronic device; When the third voice information is marked as unread and fourth voice information associated with the third voice information is received, the third voice information is replaced by the fourth voice information.

10. A voice information display device, characterized in that: include: A first receiving module is used to receive first voice information and second voice information sent by a second electronic device, where the second voice information and the first voice information are configured to be associated by the second electronic device or are associated according to the voice content of the second voice information and the voice content of the first voice information; The first display module is used to display a second difference text with semantic difference in the second semantic result when the first semantic result corresponding to the first voice information and the second semantic result corresponding to the second voice information are different.

Images