Information display method and apparatus, electronic device, storage medium, and program product

Abstract

Embodiments of the present disclosure provide an information display method and apparatus, an electronic device, a storage medium, and a program product. The method comprises: acquiring target audio data corresponding to an information display event; in response to the information display event, displaying, in a first area of a preset interface, target text information corresponding to the target audio data, the target text information being generated by performing speech recognition on the target audio data; and displaying recommendation information in a second area of the preset interface, the recommendation information being associated with at least part of information content of the target text information.

Description

Information display methods, devices, electronic equipment, storage media and program products

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411440651.2, filed on October 15, 2024, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0003] This disclosure relates to an information display method, apparatus, electronic device, storage medium, and program product. Background Technology

[0004] Currently, some applications support speech recognition of audio data and display of the resulting text content. However, the interaction methods for the text content obtained from speech recognition are relatively limited. Summary of the Invention

[0005] This disclosure provides an information display method, apparatus, electronic device, storage medium, and program product.

[0006] In a first aspect, embodiments of this disclosure provide an information display method, including:

[0007] Acquire the target audio data corresponding to the information display event;

[0008] In response to the information display event, target text information corresponding to the target audio data is displayed in the first area of ​​the preset interface. The target text information is generated by speech recognition of the target audio data.

[0009] Recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least a portion of the information content of the target text information.

[0010] Secondly, this disclosure also provides an information display device, including:

[0011] The data acquisition module is used to acquire the target audio data corresponding to the information display event;

[0012] A text information display module is used to respond to the information display event and display target text information corresponding to the target audio data in a first area of ​​a preset interface. The target text information is generated by speech recognition of the target audio data.

[0013] The first recommendation information display module is used to display recommendation information in the second area of ​​the preset interface, wherein the recommendation information is associated with at least a portion of the information content of the text information.

[0014] Thirdly, embodiments of this disclosure also provide an electronic device, including:

[0015] One or more processors;

[0016] Memory, used to store one or more programs.

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the information display method as described in the embodiments of this disclosure.

[0018] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the information display method as described in embodiments of this disclosure.

[0019] Fifthly, this disclosure also provides a computer program product that, when executed by a computer, enables the computer to implement the information display method as described in this disclosure. Attached Figure Description

[0020] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0021] Figure 1 is a flowchart illustrating an information display method provided in an embodiment of this disclosure;

[0022] Figure 2 is a schematic diagram illustrating the display of target text information provided in an embodiment of this disclosure;

[0023] Figure 3 is a schematic diagram illustrating a recommendation information provided in an embodiment of this disclosure;

[0024] Figure 4 is a schematic diagram illustrating another type of recommendation information provided in an embodiment of this disclosure;

[0025] Figure 5 is a schematic diagram illustrating another type of recommendation information provided in an embodiment of this disclosure;

[0026] Figure 6 is a schematic diagram illustrating a recommendation control provided in an embodiment of this disclosure;

[0027] Figure 7 is a flowchart illustrating another information display method provided in an embodiment of this disclosure;

[0028] Figure 8 is a schematic diagram illustrating the display of target session information provided in an embodiment of this disclosure;

[0029] Figure 9 is a schematic diagram showing a preset interface provided in an embodiment of this disclosure;

[0030] Figure 10 is a schematic diagram showing another preset interface provided in an embodiment of this disclosure;

[0031] Figure 11 is a schematic diagram of a target session information display process provided in an embodiment of this disclosure;

[0032] Figure 12 is a structural block diagram of an information display device provided in an embodiment of this disclosure;

[0033] Figure 13 is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0034] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0035] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0036] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0037] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0038] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0039] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0040] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0041] Figure 1 is a flowchart illustrating an information display method provided in an embodiment of this disclosure. This method can be executed by an information display device, which can be implemented by software and / or hardware and can be configured in an electronic device, typically a computer, mobile phone, or tablet computer. The information display method provided in this embodiment is applicable to scenarios where recommended information is displayed based on text content obtained from speech recognition, such as scenarios where conversations are conducted based on text content obtained from speech recognition. As shown in Figure 1, the information display method provided in this embodiment may include:

[0042] S101. Obtain the target audio data corresponding to the information display event.

[0043] Information display events can be understood as events that support the display of text information corresponding to audio data, along with associated recommendations. Information display events can be pre-configured; for example, they can include call events, media content display events, and / or multi-person conference events, etc.

[0044] The event categories include: Call events, which can be events involving a call, such as audio call events and / or video call events. Audio call events can be events involving an audio call, such as the current user having a voice call with another user. Video call events can be events involving a video call, such as the current user having a video call with another user. This other user can be a real person, such as another user, or a virtual person, such as a smart assistant, chatbot, or virtual contact whose content is generated based on a voice model. Media content display events can be events involving the display of media content, such as the display of media content information or images in a preset interface's media content display area. This media content can be media content containing audio data, such as video and / or audio media content. Multi-person conference events can be events involving multiple people in a conference, such as the current user having a conference with at least one other user. Multi-person conference events can be online conference events, such as conferences conducted through applications that support conferencing (such as the current application), or offline conference events. The following explanation uses a multi-person meeting event as an example of an online meeting event.

[0045] The target audio data can be understood as the audio data of an information display event. Optionally, the information display event includes a call event, and the target audio data is the audio data of the call event, which includes at least one of an audio call event and a video call event; or, the information display event includes a media content display event, and the target audio data is the audio data of the target media content corresponding to the media content display event; or, the information display event includes a multi-person conference event, and the target audio data is the conference audio data of the multi-person conference event. For example, when the information display event is a call event, the target audio data can be the call audio data of this call event; when the information display event is a media content display event, the target audio data can be the audio data of the media content displayed in this media content display event; when the information display event is a multi-person conference event, the target audio data can be the audio data of this multi-person conference event, that is, the conference audio data corresponding to this multi-person conference event.

[0046] In this embodiment, when an information display event occurs, such as when an information display event happens, the audio data of this information display event can be obtained as the target audio data. For example, when it is detected that the current user is in a call with another user, the audio data of this call can be obtained as the target audio data for this call event; when it is detected that the current user triggers the display of media content, the audio data of this media content can be obtained as the target audio data for this media content display event; when it is detected that the current user is participating in a meeting, the meeting audio data of this meeting can be obtained as the target audio data for this multi-person meeting event, and so on.

[0047] The timing of acquiring the target audio data is not limited. For example, the target audio data of the information display event can be acquired in real time when the information display event occurs; or the target audio data of the information display event can be acquired in advance when there is an information display requirement, such as when the current conditions meet the information display conditions of the information display event, and so on.

[0048] S102. In response to the information display event, target text information corresponding to the target audio data is displayed in the first area of ​​the preset interface. The target text information is generated by speech recognition of the target audio data.

[0049] The preset interface can be an interface used to display text information corresponding to the aforementioned information display events. The preset interfaces corresponding to different types of information display events can be the same or different; and / or, the layout of the preset interfaces can be the same or different when displaying text information corresponding to different types of information display events. The preset interface can include a first area and a second area. The first area is used to display the text information corresponding to the information display event; the second area is used to display recommended information associated with the text information corresponding to the information display event. The target text information can be understood as the text information of the target audio data of the information display event. The target text information can be generated by speech recognition of the target audio data and is used to display the content broadcast by the target audio data in text form.

[0050] Specifically, after obtaining the target audio data corresponding to the information display event, if the current conditions meet the information display conditions of the information display event, the target text information corresponding to the target audio data can be displayed in the first area 20 of the preset interface, as shown in Figure 2, so that the current user can view and / or further obtain recommended information related to this target text information.

[0051] In this embodiment, text information corresponding to the target audio data of the information display event can be displayed during the execution of the information display event. For example, during the execution of the information display event, speech recognition can be performed on the target audio data of the information display event in real time or periodically, and the target text information obtained from the speech recognition can be displayed in the first area of ​​the preset interface. That is, the target text information supports display during the execution of the information display event. Alternatively, after the information display event is completed, the target text information corresponding to the target audio data of the information display event can be obtained and displayed in the first area of ​​the preset interface. That is, the target text information corresponding to the target audio data of the information display event can be displayed after the information display event is completed. The following description uses the display of text information corresponding to the target audio data of the information display event during the execution of the information display event as an example.

[0052] The conditions for displaying information in an information display event can be flexibly set as needed. For example, the conditions can be confirmed to be met when an information display event is detected and / or when the currently displayed interface is a preset interface. Alternatively, the conditions can be determined to be met when the current user's information display operation or information display instruction is received. When the conditions for displaying information in an information display event are met, the target text information corresponding to the target audio data of the information display event can be displayed in the first area of ​​the preset interface. This information display event can be a currently occurring information display event or a completed information display event, such as the information display event selected by the current user.

[0053] The display method of the target text information in the first area of ​​the preset interface is not limited. Optionally, as shown in Figure 2, the information content of the target text information is displayed in the form of conversation information. For example, speech recognition can be performed on the target audio data to obtain the text information segments corresponding to each speaker, and the text information segments corresponding to each text information segment can be displayed in the first area 20 of the preset interface in the form of conversation information sent by each speaker, according to the arrangement order of the audio data segments corresponding to each text information segment in the target audio data. For example, for each text information segment of each speaker, the text information segment of this speaker can be displayed in the first area 20 of the preset interface in the form of the information content of the conversation information sent by this speaker. At this time, the first area 20 of the preset interface can be used to display the conversation information between each speaker in the target audio data, which is converted based on the target audio data.

[0054] S103. Recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least a portion of the information content of the target text information.

[0055] The recommended information can be information associated with at least a portion of the target text information, such as information recommended based on at least a portion of the target text information. The recommended information can be used to respond to this at least a portion of the information content, such as responding to questions contained within it; it can also be used to describe objects mentioned in this at least a portion of the information content or objects corresponding to the information display event (such as media content), for example, the recommended information can be a brief introduction or detailed information about the objects mentioned in this at least a portion of the information content.

[0056] For example, recommended information related to at least a portion of the target text information can be displayed in the second area of ​​the preset interface for the current user to view or refer to. For instance, in a call scenario and / or a multi-person conference scenario, the current user can refer to this recommended information to respond to questions raised by other callers or participants, or to describe objects mentioned during the call or conference; in a media content display scenario, the current user can view this recommended information to understand the currently displayed media content and / or adjust the display progress of the currently displayed media content based on this recommended information, and so on.

[0057] In this embodiment, recommended information associated with at least a portion of the target text information can be displayed during the execution of an information display event. That is, the recommended information can be displayed during the execution of the information display event for the current user's reference, facilitating the user's continued execution of the information display event. Alternatively, after the information display event is completed, the recommended information associated with at least a portion of the target text information can be obtained and displayed in the second area of ​​a preset interface. In other words, the target text information associated with at least a portion of the target text information can be displayed after the information display event is completed, for the current user to view. The following explanation uses the display of recommended information associated with at least a portion of the target text information during the execution of an information display event as an example.

[0058] The display conditions for recommended information can be flexibly set as needed. For example, when the target audio data and / or the target text information displayed in the first area mentions a question and / or object that supports the display of recommended information, recommended information associated with that question and / or object can be automatically displayed in the second area to simplify the operation required for the current user to view the recommended information. Alternatively, when the current user requests a recommendation information display operation for at least part of the information content in the target text information displayed in the first area, recommended information associated with that at least part of the information content can be displayed in the second area. Furthermore, when the current user sends a session message in the second area based on at least part of the information content in the target text information displayed in the first area, recommended information associated with that at least part of the information content and used to reply to the session message sent by the current user can be displayed in the second area. The specific settings can be flexibly configured as needed.

[0059] The display method of the recommended information 30 in the second area 21 of the preset interface is not limited. It can take the form of notification information, prompt information, or conversation information, displaying recommended information 30 that is related to at least a portion of the target text information displayed in the first area 20. Optionally, as shown in Figure 3, the recommended information 30 is displayed in the form of conversation information. For example, the second area 21 of the preset interface can be a conversation area between the current user and a virtual user whose content is generated based on a speech model. This conversation area can be used for the current user to send conversation information to this virtual user and / or display conversation information between the current user and this virtual user. In this case, the recommended information 30 can be displayed in the second area 21 of the preset interface in the form of conversation information sent by this virtual user. The virtual user can be, for example, an intelligent assistant, a conversational robot, or a virtual contact, which can engage in conversation with the current user based on content generated by a speech model.

[0060] In some implementations, after displaying recommendation information in the second area of ​​a preset interface, the current user can further perform interactive operations associated with this recommendation information. For example, the user can interact with one or more conversation objects in the target audio data, or with other objects besides the conversation objects in the target audio data, based on this recommendation information. This enriches the functionality of the recommendation information and simplifies the operations required for interaction based on the recommendation information. Optionally, displaying recommendation information in the second area of ​​the preset interface includes: displaying the recommendation information and at least one interactive control corresponding to the recommendation information in the second area of ​​the preset interface, wherein the interactive control is configured to trigger the execution of an interactive operation associated with the recommendation information.

[0061] Specifically, as shown in Figure 3, when displaying recommendation information 30, one or more interactive controls 31 corresponding to this recommendation information 30 can be further displayed. Different interactive controls 31 can be configured to trigger different interactive operations associated with this recommendation information 30. Thus, when it is detected that the current user triggers an interactive control 31 associated with a certain recommendation information 30, it can be determined that the interactive operation corresponding to this interactive control 31 has been received, and in response to this interactive operation, the interactive event corresponding to this interactive operation is executed.

[0062] In the above implementation, the interactive control corresponding to the recommendation information can be associated with the information content of the recommendation information. When the information content of the recommendation information is different, the interactive control corresponding to the recommendation information can be different.

[0063] In some exemplary scenarios, the recommended information can be content that a speaker in the target audio data wants to know, such as the answer to a question asked by a speaker in the target audio data, or descriptive information about an object mentioned by a speaker in the target audio data. In this case, when displaying this recommended information, one or more sending controls can be displayed as interactive controls corresponding to this recommended information, with different sending controls corresponding to different information sending methods. When it is detected that the current user triggers a sending control corresponding to this recommended information, the information content of this recommended information can be sent to the corresponding speaker in the target audio data using the information sending method corresponding to this sending control, thereby simplifying the operation required to send the recommended information content.

[0064] Optionally, the interactive control includes an information sending control, which is configured to send the recommendation information using an information sending method corresponding to the sending control. Different sending controls correspond to different information sending methods.

[0065] Taking a call scenario as an example, the current user can make a call with one or more other users. During the current user's call, the text information of the current call can be displayed in the first area of ​​the preset interface, and recommended information related to at least part of the text information displayed in the first area can be displayed in the second area of ​​the preset interface. When it is detected that the current user triggers a certain sending control corresponding to the recommended information, the information content of the recommended information can be sent to at least some of the other users who are making a call with the current user using the information sending method corresponding to the sending control.

[0066] The message delivery method can be understood as the way the recommended information displayed in the second area is sent, and it can be configured as needed. For example, different message delivery methods can correspond to different contact methods of the receiving user, such as sending the message via SMS, sending it through the current application, or sending it through an application other than the current application, and so on. Furthermore, different message delivery methods can also correspond to different message delivery formats. Taking sending recommended information through an application as an example, this recommended information can be sent in the form of a notification message and / or a conversation message.

[0067] In some exemplary scenarios, the content of the recommended information can be the query results for processing methods of a certain object to be processed, such as the query results for processing methods of a certain item, a certain place, a certain media content, and / or a certain interactive information. In this case, when displaying this recommended information, processing controls corresponding to one or more of the queried processing methods can be displayed as interactive controls corresponding to this recommended information. Different processing controls correspond to different processing methods for the object to be processed. When it is detected that the current user triggers a processing control corresponding to this recommended information, the object to be processed can be processed using the processing method corresponding to this processing control. The processing method for the object to be processed is not limited. Taking interactive information as an example, the processing method for the object to be processed can be, for example, replying, deleting, and / or hiding.

[0068] In some exemplary scenarios, the recommended information can be the query result for a certain attribute of an object to be processed, such as the query result for a certain attribute of an item, a place, media content, and / or interactive information. In this case, when displaying this recommended information, one or more processing controls corresponding to the query result can be displayed as interactive controls corresponding to this recommended information. Different processing controls correspond to different processing methods for the object to be processed. When it is detected that the current user triggers a processing control corresponding to this recommended information, the object to be processed can be processed using the processing method corresponding to that processing control. Taking the query to determine the display methods supported by a certain media content as an example, display controls corresponding to at least one display method supported by the media can be displayed. When it is detected that the current user triggers a display control, the media content can be displayed using the display method corresponding to that display control, and so on. Among them, the display methods supported by the media content can be, for example, full-screen playback, small window playback, background playback, and / or audio-only playback, etc.

[0069] The information display method provided in this embodiment acquires target audio data corresponding to an information display event; in response to this information display event, it displays target text information generated by speech recognition of the target audio data in a first area of ​​a preset interface; and it displays recommended information associated with at least a portion of the content of the target text information in a second area of ​​the preset interface. This embodiment utilizes the above technical solution to support information recommendation based on text information obtained from speech recognition, displaying recommended information associated with at least a portion of the content of this text information. This enriches the interaction methods of text information obtained from speech recognition and simplifies the operations required to obtain recommended information associated with the content mentioned in the audio data.

[0070] In some embodiments, as shown in FIG3, the recommendation information 30 can be used to reply to the target conversation information 32 sent by the current user in the second area 21 of the preset interface based on at least part of the information content in the target text information, so as to simplify the operation required for the current user to view and obtain the reply content of the corresponding content in the target audio data and reduce the difficulty of the current user's reply. Optionally, the recommendation information 30 includes the reply information of the target conversation information 32, which is generated based on at least part of the information content of the target text information. For example, the current user can send the target conversation information 32 in the second area 21 based on at least part of the information content of the target text information displayed in the first area 20 to obtain the reply information of this at least part of the information content; accordingly, the current application can display the reply information of this target conversation information 32 (i.e., recommendation information 30) in the second area 21 so that the current user can view or refer to this reply information to reply to this at least part of the information content.

[0071] In some embodiments, as shown in FIG4, the recommendation information 30 may be object information of an associated object of at least a portion of the information content in the target text information, so that the current user can view or refer to this object information for calls or meetings, etc. For example, it can automatically identify whether the target text information and / or target audio data mention a target object that supports the display of object information or content associated with the target object, and when it is determined that the target text information and / or target audio data mention a target object that supports the display of object information or content associated with the target object, the object information of this object is obtained as recommendation information 30, and this recommendation information 30 is displayed in the second area 21 of the preset interface, without requiring the current user to perform an operation to instruct the display of this recommendation information 30, further simplifying the operation required to view the recommendation information 30. In this case, optionally, the recommendation information 30 includes object information of the target object, wherein the target object is an associated object of at least a portion of the information content in the target text information.

[0072] The target object can be an object associated with at least part of the information content in the target text information, such as a person, place, location, order, and / or media content associated with at least part of the information content in the target text information. The method for determining the target object is not limited. For example, the target object in the target text information and / or target audio data can be identified based on a pre-trained object recognition model; alternatively, keywords corresponding to each object can be pre-set, thereby identifying whether the target text information and / or target audio data mentions the preset keywords, and using the object corresponding to the preset keywords mentioned in the target text information and / or target audio data as the target object, and so on.

[0073] In some implementations, the at least part of the information content is a preset keyword, and the display of recommended information in the second area of ​​the preset interface includes: in response to the target audio data containing a target audio segment, displaying recommended information associated with the target object in the second area of ​​the preset interface, wherein the target audio segment is an audio segment that broadcasts the preset keyword; and / or, in response to the target text information containing the preset keyword, displaying recommended information associated with the target object in the second area of ​​the preset interface.

[0074] The preset keywords can be keywords corresponding to objects that support the display of object information. For example, preset keywords can be the identification information or characteristic information of the corresponding object. Taking the identification information of the corresponding object as an example, preset keywords can be names of people, places, locations, order numbers, and / or media content names, etc. The target audio segment can be an audio segment in the target audio data that plays the preset keywords. In other words, the target audio segment plays the preset keywords.

[0075] For example, it is possible to determine whether there are preset keywords corresponding to objects that support the display of their information based on the target audio data. For example, for each keyword, based on the audio features corresponding to the preset keyword, it is possible to identify whether there are audio segments in the target audio data that match these audio features. If so, it is determined that the target audio data contains the target audio segment corresponding to this keyword, and recommendation information associated with the target object corresponding to this preset keyword is displayed in the second area of ​​the preset interface.

[0076] For example, based on the target text information obtained through speech recognition of the target audio data, it can be determined whether there are preset keywords corresponding to the objects that support displaying the information. For instance, it can identify whether the target text information contains a preset keyword; if so, recommended information associated with the target object corresponding to the preset keyword contained in the target text information can be displayed in the second area of ​​the preset interface.

[0077] In this embodiment, when it is determined that the target text information contains preset keywords based on the target audio data and / or target text information, the preset keywords contained in the target text information and other information content besides the preset keywords can be displayed in the first area of ​​the preset interface using the same or different display styles.

[0078] For example, as shown in Figure 4, different display styles can be used to display the preset keywords (such as "XXX Restaurant" in Figure 4) contained in the target text information, as well as other information content besides these preset keywords, in the first area 20 of the preset interface, thereby reducing the difficulty of viewing and locating the preset keywords contained in the target text information. Optionally, the preset keywords are displayed in the first area 20 using a first display style, and the information content in the target text information other than the preset keywords is displayed in the first area 20 using a second display style. The first display style can be understood as the display style of the preset keywords in the target text information in the first area 20, and the second display style can be the display style of other information content in the target text information besides the preset keywords in the first area 20. The first and second display styles can be different display styles; for example, the first and second display styles can correspond to different fonts, font sizes, text colors, and / or background colors, etc.

[0079] In the above embodiments, when identifying preset keywords, the audio theme of the target audio data can be disregarded to simplify the operations required to identify preset keywords.

[0080] In the above embodiments, when identifying keywords, the audio theme of the target audio data can also be considered to improve the correlation between the displayed object information and the target audio data and / or target text information. For example, keyword sets corresponding to different audio themes can be preset, and the keyword sets corresponding to different audio themes can be different; thus, when performing keyword identification, the audio theme of the target audio data can be determined, the keyword set corresponding to this audio theme can be obtained, and it can be identified whether the target audio data and / or target text information mentions the preset keywords in this keyword set. Only when it is identified that the target audio data and / or target text information mentions the preset keywords in this keyword set, recommendation information associated with the target object corresponding to the preset keywords is displayed in the second area of ​​the preset interface. Here, optionally, the preset keywords are keywords corresponding to the audio theme of the target audio data. The audio theme of the target audio data can be the dialogue theme of the dialogue in the target audio data, such as the dialogue scene corresponding to the target audio data. This dialogue scene can be, for example, a dining scene, a scenic spot scene, and / or a shopping scene, etc.

[0081] In some embodiments, as shown in Figure 5 (where the information display event is taken as an example of a media content display event), the recommended information can be a description of the target text information, such as a content description and / or key node information, to help the current user quickly understand the content and / or key nodes of the target audio data and / or target text information. Optionally, the recommended information includes the content description of the target text information, which includes content description and / or key node information. The content description information can be information used to describe the content of the target audio data and / or target text information, such as a brief introduction or summary. The key node information can be information about key nodes in the target audio data and / or target text information, such as the time node corresponding to the key node in the target audio data and / or the description of the key node.

[0082] In some implementations, the key node information, in addition to being visible to the current user, can also be used to allow the current user to switch the playback progress of the target audio data and / or the information content of the target text information currently displayed in the first area, thereby enriching the switching methods for the playback progress of the target audio data and / or the information content of the target text information. For example, when it is detected that the current user triggers a key node information displayed in the recommendation information, the playback progress of the target audio data can be switched to the key node corresponding to this key node information; and / or, information content in the target text information associated with the key node corresponding to this key node information can be displayed in the first area, such as displaying information content near this key node. In this case, optionally, the key node information is configured to trigger the switching of the target audio data to the key node corresponding to the key node information and / or the display of information content in the target text information corresponding to the key node information in the first area.

[0083] Taking the information display event as a media content display event as an example, as shown in Figure 5, the preset interface can also include a media content display area 22. For example, when the displayed media content is video content, this media content display area can be used to display the media content screen of the currently displayed media content; when the displayed media content is audio content, this media content display area can be used to display the identification information of the media content. Thus, when a display operation for a certain media content is received from the current user, the media content screen or identification information of the media content can be displayed in the media content display area 22 of the preset interface; the information content of the target text information generated based on the audio data of the media content is displayed in the first area 20 of the preset interface in the form of conversation information; and the content introduction information of the media content (recommendation information 30 as shown in Figure 5) is displayed in the second area 21 of the preset interface in the form of conversation information.

[0084] Furthermore, the target text information displayed in the first area can support user interaction, such as sending target session information in the second area based on at least part of the target text information to obtain recommended information corresponding to this target session information, and so on.

[0085] In some embodiments, the second area displays at least one recommendation control, and different recommendation controls correspond to different information recommendation topics. The information display method further includes: in response to a trigger operation on a target recommendation control among the at least one recommendation controls, displaying recommendation information corresponding to the target recommendation topic in the second area, wherein the target recommendation topic is the recommendation topic corresponding to the target recommendation control.

[0086] The recommendation controls can be configured to trigger different information recommendation operations. Different information recommendation operations can correspond to different information recommendation themes, used to indicate the retrieval and display of recommended information under the corresponding theme. In a customer service scenario, for example, different recommendation controls can be used to query different types of business information. For instance, different recommendation controls can support triggering calls to related information databases for information queries, thereby improving the efficiency of information retrieval for customer service personnel and reducing waiting time for both customer service staff and served users. This business information database may include, for example, an activity information database, a location information database, and / or an order information database. The target recommendation control can be the recommendation control triggered by the current user. The target recommendation theme can be the information recommendation theme corresponding to the target recommendation control.

[0087] For example, as shown in Figure 6, when a preset interface is displayed, at least one recommendation control 60 can be displayed in the second area 21 of the preset interface. Different recommendation controls 60 correspond to different information recommendation themes. When it is detected that the current user triggers a recommendation control 60 (i.e., the target recommendation control) displayed in the second area 21, recommendation information 30 matching the information recommendation theme (i.e., the target information recommendation theme) of this recommendation control 60 can be obtained. For example, recommendation information 30 matching the information recommendation theme corresponding to this recommendation control can be generated based on the information stored in the information database corresponding to this recommendation control 60, and this recommendation information 30 can be displayed in the second area 21 of the preset interface.

[0088] The display position of the recommendation control 60 is not limited. For example, the recommendation control 60 can be displayed in the preset position of the second area 21; it can also be displayed in the associated position of the information input sub-area 23 of the second area 21, such as above, below, to the left or right of this information input sub-area 23, as shown in Figure 6 (Figure 6 takes the recommendation information 60 displayed above the information input sub-area 23 as an example).

[0089] In this embodiment, a recommendation control can be displayed in the second area of ​​the preset interface, allowing users to recommend information based on this control, such as calling relevant business systems for information query with one click, which simplifies the operations required for the current user to obtain recommendation information.

[0090] Figure 7 is a flowchart illustrating another information display method provided in an embodiment of this disclosure. The solution in this embodiment can be combined with one or more optional solutions in the above embodiments. Optionally, displaying recommended information in the second area of ​​the preset interface includes: in response to a preset trigger operation based on the target text information, displaying target session information in an information display sub-area of ​​the second area; and in response to the display of the target session information, displaying recommended information for the target session information in the information display sub-area.

[0091] Accordingly, as shown in Figure 7, the information display method provided in this embodiment may include:

[0092] S201. Obtain the target audio data corresponding to the information display event.

[0093] S202. In response to the information display event, target text information corresponding to the target audio data is displayed in the first area of ​​the preset interface. The target text information is generated by speech recognition of the target audio data.

[0094] S203. In response to a preset trigger operation based on the target text information, target session information is displayed in the information display sub-area of ​​the second area, the target session information being generated based on at least a portion of the information content of the target text information.

[0095] The preset trigger operation can be a trigger operation used to instruct the display of target session information associated with at least a portion of the target text information. For example, the preset trigger operation can instruct the sending of target session information in the second area to obtain a reply to this target session information. The execution method of the preset trigger operation is not limited; for example, the preset trigger operation can be an operation that triggers a control or performs a swipe gesture. The information display sub-area can be a sub-area used to display the session information sent between the current user and the virtual user corresponding to the second area.

[0096] In this embodiment of the disclosure, it is possible to support the current user to send target session information by sending at least part of the target text information obtained by speech recognition based on target audio data, and to obtain recommendation information associated with this at least part of the information content.

[0097] Specifically, when a preset trigger operation based on target text information is received, target session information 32 generated based on at least part of the target text information can be triggered and displayed in the information display sub-area of ​​the second area 21 of the preset interface, as shown in Figure 8.

[0098] In this embodiment, the method of sending target session information can be flexibly set as needed.

[0099] In some implementations, the current user can input information to be sent into the information input sub-area of ​​the second area based on the target text information displayed in the first area, so that the current user can continue to edit this information content. Optionally, in response to a preset trigger operation based on the target text information, displaying the target session information in the information display sub-area of ​​the second area includes: in response to a first preset trigger operation targeting at least a portion of the information content in the target text information, inputting the at least a portion of the information content into the information input sub-area of ​​the second area; and in response to a first information sending operation, using the content input in the information input sub-area as the information content of the target session information, and displaying the target session information in the information display sub-area of ​​the second area.

[0100] The first preset trigger operation can be a trigger operation used to instruct at least a portion of the target text information displayed in the first area to be input into the information input sub-area of ​​the second area. The execution method of the first preset trigger operation is not limited; for example, the first preset trigger operation can be an operation to trigger a copy control or an operation to perform a copy gesture, etc. The first information sending operation can be an operation used to instruct the sending of the information content entered in the information input sub-area, such as an operation to trigger a send control or an operation to perform a send gesture, etc. The information input sub-area can be a sub-area used to input and edit the information content of the conversation information to be sent.

[0101] Specifically, upon receiving a first preset trigger operation targeting at least a portion of the information content in the target text information, such as when it is detected that the current user has triggered a copy control corresponding to at least a portion of the information content in the first area, this at least a portion of the information content can be input into the information input sub-area of ​​the second area.

[0102] After at least a portion of the target text information is input into the information input sub-area of ​​the second area, the current user can directly execute the first information sending operation to send this at least a portion of the information content; the current user can also edit the input at least a portion of the information content and send the edited information content by executing the first sending operation after the editing is completed.

[0103] Upon receiving the first information sending operation, if it is detected that the current user has triggered the sending control displayed in the second area, the content currently entered in the information input sub-area can be used as the information content of the target session information to be sent to the virtual user corresponding to the second area, and the target session information can be displayed in the information display sub-area of ​​the second area.

[0104] In some optional examples, taking the display of target text information in the form of conversational information as an example, when the current user triggers (e.g., clicks or long presses) a conversational message displayed in the first area 20 of the preset interface, or when the current user hovers an input indicator (e.g., cursor) over a sub-area of ​​a conversational message in the first area 20, a copy control 90 corresponding to this conversational message can be displayed. For example, the copy control 90 corresponding to this conversational message can be displayed at the associated position of this conversational message, as shown in Figure 9 (Figure 9 shows the copy control 90 corresponding to the third conversational message in the first area 20 as an example). Thus, when the current user triggers this copy control 90, the information content of this conversational message can be input into the information input sub-area 23 of the second area 21, as shown in Figure 10, so that the current user can edit and / or send the input content. When the current user triggers the send control 24 displayed in the second area 21, the content currently entered in the information input sub-area 23 can be used as the information content of the target session information 32 and sent to the virtual user corresponding to the second area 21. The target session information 32 is then displayed in the information display sub-area of ​​the second area 21, as shown in Figure 8.

[0105] In some implementations, the current user can directly send at least a portion of the information content displayed in the first area as the information content of the target session information to be sent, thereby simplifying the operations required to send the target session information based on the target text information. Optionally, in response to a preset trigger operation based on the target text information, displaying the target session information in the information display sub-area of ​​the second area includes: in response to a second preset trigger operation targeting at least a portion of the information content in the target text information, using the at least a portion of the information content as the information content of the target session information, and displaying the target session information in the information display sub-area of ​​the second area.

[0106] The second preset trigger operation can be a trigger operation used to instruct at least a portion of the target text information displayed in the first area to be sent as the target session information. The execution method of the second preset trigger operation is not limited; for example, the second preset trigger operation can be an operation to trigger a recommendation control or an operation to perform a recommendation gesture, etc.

[0107] Specifically, when a second preset trigger operation is received targeting at least a portion of the information content in the target text information, such as when it is detected that the current user triggers the recommendation control corresponding to at least a portion of the information content in the first area, this at least a portion of the information content can be used as the information content of the target session information to be sent, and this target session information can be sent to the virtual user corresponding to the second area, and this target session information can be displayed in the information display sub-area of ​​the second area.

[0108] In some optional examples, taking the display of target text information in the form of conversation information as an example, when the current user triggers (e.g., clicks or long presses) a conversation message displayed in the first area 20 of the preset interface, or when the current user hovers an input indicator (e.g., cursor) over the display sub-area of ​​a conversation message in the first area 20, a recommended control 91 corresponding to this conversation message can be displayed. For example, the recommended control 91 corresponding to this conversation message can be displayed at the associated position of this conversation message, as shown in Figure 9 (Figure 9 shows the recommended control 91 corresponding to the third conversation message in the first area 20 as an example). Thus, when the current user triggers this recommended control 91, the information content of this conversation message can be used as the information content of the target conversation message 32, sent to the virtual user corresponding to the second area 21, and displayed in the information display sub-area of ​​the second area 21, as shown in Figure 8.

[0109] In some implementations, the current user can select the content of the target session information to be sent in the first area. This simplifies the operations required to send the target session information and makes the sent target session information more consistent with the current user's actual sending needs, thereby improving the accuracy of the recommended information generated based on the target session information. Optionally, in response to a preset trigger operation based on the target text information, displaying the target session information in the information display sub-area of ​​the second area includes: in response to a third preset trigger operation targeting at least a portion of the information content in the target text information, displaying the at least a portion of the information content as selected; and in response to a second information sending operation, using the selected information content in the target text information as the content of the target session information, and displaying the target session information in the information display sub-area of ​​the second area.

[0110] The third preset trigger operation can be a trigger operation that selects at least a portion of the information content displayed in the first area. The execution method of the third preset trigger operation is not limited; for example, it can be an operation that selects at least a portion of the information content displayed in the first area. The second information sending operation can be a trigger operation used to indicate the sending of information content selected in the first area, such as triggering the sending control corresponding to the selected information content in the first area or performing a sending gesture on the selected information content in the first area.

[0111] Specifically, upon receiving a third preset trigger operation targeting at least a portion of the information content in the target text information, such as when it is detected that the current user has selected at least a portion of the information content displayed in the first area, this at least a portion of the information content can be displayed as selected. Upon detecting a second information sending operation targeting the selected information content in the first area, the selected information content can be used as the information content of the target session information to be sent to the virtual user corresponding to the second area, and this target session information can be displayed in the information display sub-area of ​​the second area.

[0112] In some implementations, when information content is selected in the first area, a preset prompt message can be further displayed to indicate the currently selected information content; and / or, a reply control can be further displayed so that the current user can trigger the reply control to perform a second information sending operation. Optionally, the information display method further includes: in response to a third preset trigger operation targeting at least a portion of the information content in the target text information, displaying the preset prompt message and / or reply control, wherein the preset prompt message is used to indicate the selected information content in the target text information, and the reply control is configured to trigger the execution of the second information sending operation. The display position of the preset prompt message and / or reply control is not limited; for example, it can be displayed in the first or second area of ​​a preset interface, and can be set as needed.

[0113] In some optional examples, taking the display of target text information in the form of conversational information as an example, when it is detected that the current user has selected at least a portion of the content of one or more conversational messages displayed in the first area, the selected portion of the content can be displayed as selected, and a preset prompt message 110 and at least one reply control 111 corresponding to the selected portion of the content can be displayed, as shown in the first figure of Figure 11. Figure 11 uses the selection of a portion of the content of the third conversational message in the first area 20 (such as the content of the third conversational message with a gray background) as an example. Thus, when it is detected that the current user triggers a displayed reply control 111, the selected content in the first area 20 can be used as the content of the target conversational message and sent to the virtual user corresponding to the second area 21. This target conversational message 32 is displayed in the information display sub-area of ​​the second area 21, and the selected content in the first area 20 can be further switched to an unselected state, as shown in the second figure of Figure 11. The number of displayed reply controls 111 can be one or more. When multiple reply controls 111 are displayed, for example, different reply controls can be used to generate reply information with target information content based on information stored in different information databases.

[0114] S204. In response to the display of the target session information, recommended information for the target session information is displayed in the information display sub-area, and the recommended information includes the reply information of the target session information.

[0115] In this embodiment, after the target session information is displayed in the information display sub-area, a response to the display of the target session information can be generated as recommended information for the target session information, and this recommended information can be displayed in the information display sub-area of ​​the second area.

[0116] The information display method provided in this embodiment supports the current user to send target conversation information by sending at least part of the target text information obtained from the speech recognition of the target audio data, thereby obtaining recommended information associated with at least part of the information content. This can enrich the generation method of recommended information and reduce the difficulty of replying to the information content in the target audio data.

[0117] Figure 12 is a structural block diagram of an information display device provided in an embodiment of this disclosure. This device can be implemented by software and / or hardware and can be configured in an electronic device, typically a computer, mobile phone, or tablet computer. It can display recommended information based on text content obtained from speech recognition by executing an information display method, such as conducting a conversation based on text content obtained from speech recognition. As shown in Figure 12, the information display device provided in this embodiment may include:

[0118] Data acquisition module 1201 is used to acquire target audio data corresponding to the information display event;

[0119] The text information display module 1202 is used to respond to the information display event and display target text information corresponding to the target audio data in a first area of ​​a preset interface. The target text information is generated by speech recognition of the target audio data.

[0120] The first recommendation information display module 1203 is used to display recommendation information in the second area of ​​the preset interface, wherein the recommendation information is associated with at least a portion of the information content of the text information.

[0121] The information display device provided in this embodiment acquires target audio data corresponding to an information display event through a data acquisition module; responds to this information display event through a text information display module, displaying target text information generated by speech recognition of the target audio data in a first area of ​​a preset interface; and displays recommended information associated with at least a portion of the content of the target text information in a second area of ​​the preset interface through a first recommended information display module. This embodiment, utilizing the above technical solution, supports information recommendation based on text information obtained through speech recognition, displaying recommended information associated with at least a portion of the content of this text information. This enriches the interaction methods of text information obtained through speech recognition and simplifies the operations required to obtain recommended information associated with the content mentioned in the audio data.

[0122] Optionally, the recommendation information includes response information for the target session information, which is generated based on at least a portion of the information content of the target text information.

[0123] Optionally, the first recommendation information display module 1203 includes: a conversation information display unit, configured to display target conversation information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information; and a recommendation information display unit, configured to display recommendation information for the target conversation information in the information display sub-area in response to the display of the target conversation information.

[0124] Optionally, the session information display unit may be specifically used to: in response to a first preset trigger operation for at least a portion of the information content in the target text information, input the at least a portion of the information content into the information input sub-area of ​​the second area; in response to a first information sending operation, use the content input in the information input sub-area as the information content of the target session information, and display the target session information in the information display sub-area of ​​the second area.

[0125] Optionally, the recommended information display unit may be specifically used to: in response to a second preset trigger operation targeting at least a portion of the information content in the target text information, display the target session information as the information content of the target session information in the information display sub-area of ​​the second area.

[0126] Optionally, the session information display unit may be specifically used to: in response to a third preset trigger operation for at least a portion of the information content in the target text information, display the at least a portion of the information content as a selected state; in response to a second information sending operation, use the selected information content in the target text information as the information content of the target session information, and display the target session information in the information display sub-area of ​​the second area.

[0127] Optionally, the conversation information display unit can also be used to: in response to a third preset trigger operation for at least a portion of the information content in the target text information, display preset prompt information and / or a reply control, wherein the preset prompt information is used to prompt the information content in the target text information that is in a selected state, and the reply control is configured to trigger the execution of the second information sending operation.

[0128] Optionally, the recommendation information includes object information of the target object, wherein the target object is an associated object of at least a portion of the information content in the target text information.

[0129] Optionally, at least part of the information content is a preset keyword, and the first recommendation information display module 1203 may be specifically used to: in response to the target audio data containing a target audio segment, display recommendation information associated with the target object in the second area of ​​the preset interface, wherein the target audio segment is an audio segment that broadcasts the preset keyword; and / or, in response to the target text information containing the preset keyword, display recommendation information associated with the target object in the second area of ​​the preset interface.

[0130] Optionally, the preset keywords are displayed in the first area using a first display style, and the information content in the target text information other than the preset keywords is displayed in the first area using a second display style.

[0131] Optionally, the preset keywords are keywords corresponding to the audio theme of the target audio data.

[0132] Optionally, the recommendation information includes content description information of the target text information, and the content description information includes content description information and / or key node information.

[0133] Optionally, the key node information is configured to trigger the switching of the target audio data to the key node corresponding to the key node information and / or to display the information content in the target text information corresponding to the key node information in the first area.

[0134] Optionally, the first recommendation information display module 1203 may be specifically used to: display recommendation information and at least one interactive control corresponding to the recommendation information in the second area of ​​the preset interface, wherein the interactive control is configured to trigger the execution of an interactive operation associated with the recommendation information.

[0135] Optionally, the interactive control includes an information sending control, which is configured to send the recommendation information using an information sending method corresponding to the sending control. Different sending controls correspond to different information sending methods.

[0136] Optionally, the second area displays at least one recommendation control, with different recommendation controls corresponding to different information recommendation topics. The information display device may further include: a second recommendation information display module, used to respond to a trigger operation on a target recommendation control among the at least one recommendation controls, and display recommendation information corresponding to the target recommendation topic in the second area, wherein the target recommendation topic is the recommendation topic corresponding to the target recommendation control.

[0137] Optionally, the information display event includes a call event, and the target audio data is the audio data of the call event, wherein the call event includes at least one of an audio call event and a video call event; or, the information display event includes a media content display event, and the target audio data is the audio data of the target media content corresponding to the media content display event; or, the information display event includes a multi-person conference event, and the target audio data is the conference audio data of the multi-person conference event.

[0138] Optionally, the target text information and the recommendation information can be displayed during the execution of the information display event.

[0139] Optionally, the information content of the target text information and / or the recommendation information may be displayed in the form of conversational information.

[0140] The information display device provided in this disclosure can execute the information display method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the information display method. Technical details not described in detail in this embodiment can be found in the information display method provided in any embodiment of this disclosure.

[0141] Referring now to FIG13, a schematic diagram of the structure of an electronic device (e.g., a terminal device) 1300 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG13 is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present disclosure.

[0142] As shown in Figure 13, the electronic device 1300 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from a storage device 1308 into a random access memory (RAM) 1303. The RAM 1303 also stores various programs and data required for the operation of the electronic device 1300. The processing unit 1301, ROM 1302, and RAM 1303 are interconnected via a bus 1304. An input / output (I / O) interface 1305 is also connected to the bus 1304.

[0143] Typically, the following devices can be connected to I / O interface 1305: input devices 1306 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 1307 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1308 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1309. Communication device 1309 allows electronic device 1300 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 13 shows electronic device 1300 with various devices, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0144] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1309, or installed from storage device 1308, or installed from ROM 1302. When the computer program is executed by processing device 1301, it performs the functions defined in the methods of embodiments of this disclosure.

[0145] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0146] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0147] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0148] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: acquire target audio data corresponding to an information display event; in response to the information display event, display target text information corresponding to the target audio data in a first area of ​​a preset interface, the target text information being generated by speech recognition of the target audio data; and display recommendation information in a second area of ​​the preset interface, the recommendation information being associated with at least a portion of the information content of the target text information.

[0149] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0150] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0151] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of modules do not, in some cases, constitute a limitation on the unit itself.

[0152] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0153] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0154] At least one embodiment of this disclosure provides an information display method, including:

[0155] Acquire the target audio data corresponding to the information display event;

[0156] In response to the information display event, target text information corresponding to the target audio data is displayed in the first area of ​​the preset interface. The target text information is generated by speech recognition of the target audio data.

[0157] Recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least a portion of the information content of the target text information.

[0158] For example, in at least one embodiment of this disclosure, the recommendation information includes response information for the target session information, which is generated based on at least a portion of the information content of the target text information.

[0159] For example, in at least one embodiment of this disclosure, displaying recommendation information in the second area of ​​the preset interface includes:

[0160] In response to a preset trigger operation based on the target text information, the target session information is displayed in the information display sub-area of ​​the second area;

[0161] In response to the display of the target session information, recommended information for the target session information is displayed in the information display sub-area.

[0162] For example, in at least one embodiment of this disclosure, displaying target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information includes:

[0163] In response to a first preset trigger operation targeting at least a portion of the information content in the target text information, the at least a portion of the information content is input into the information input sub-region of the second region;

[0164] In response to the first information sending operation, the content entered in the information input sub-area is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0165] For example, in at least one embodiment of this disclosure, displaying target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information includes:

[0166] In response to a second preset trigger operation targeting at least a portion of the information content in the target text information, the at least a portion of the information content is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0167] For example, in at least one embodiment of this disclosure, displaying target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information includes:

[0168] In response to a third preset trigger operation targeting at least a portion of the information content in the target text information, the at least a portion of the information content is displayed as a selected state;

[0169] In response to the second information sending operation, the selected information content in the target text information is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0170] For example, at least one embodiment of this disclosure further includes:

[0171] In response to a third preset trigger operation targeting at least a portion of the information content in the target text information, a preset prompt message and / or a reply control are displayed, wherein the preset prompt message is used to prompt the information content in the target text information that is selected, and the reply control is configured to trigger the execution of the second information sending operation.

[0172] For example, in at least one embodiment of this disclosure, the recommendation information includes object information of a target object, wherein the target object is an associated object of at least a portion of the information content in the target text information.

[0173] For example, in at least one embodiment of this disclosure, the at least part of the information content consists of preset keywords, and the display of recommended information in the second area of ​​the preset interface includes:

[0174] In response to the inclusion of a target audio segment in the target audio data, recommendation information associated with the target object is displayed in the second area of ​​the preset interface, wherein the target audio segment is an audio segment that broadcasts preset keywords; and / or

[0175] In response to the target text information containing the preset keywords, recommended information associated with the target object is displayed in the second area of ​​the preset interface.

[0176] For example, in at least one embodiment of this disclosure, the preset keywords are displayed in the first area using a first display style, and the information content in the target text information other than the preset keywords is displayed in the first area using a second display style.

[0177] For example, in at least one embodiment of this disclosure, the preset keyword is a keyword corresponding to the audio theme of the target audio data.

[0178] For example, in at least one embodiment of the method disclosed herein, the recommendation information includes content description information of the target text information, and the content description information includes content description information and / or key node information.

[0179] For example, in at least one embodiment of this disclosure, the key node information is configured to trigger the switching of the target audio data to a key node corresponding to the key node information and / or to display the information content in the target text information corresponding to the key node information in the first area.

[0180] For example, in at least one embodiment of this disclosure, displaying recommendation information in the second area of ​​the preset interface includes:

[0181] The second area of ​​the preset interface displays recommendation information and at least one interactive control corresponding to the recommendation information. The interactive control is configured to trigger the execution of an interactive operation associated with the recommendation information.

[0182] For example, in at least one embodiment of this disclosure, the interactive control includes an information sending control, which is configured to send the recommendation information using an information sending method corresponding to the sending control. Different sending controls correspond to different information sending methods.

[0183] For example, in at least one embodiment of this disclosure, the second area displays at least one recommendation control, with different recommendation controls corresponding to different information recommendation topics, and the method further includes:

[0184] In response to a trigger operation on a target recommendation control in the at least one recommendation control, recommendation information corresponding to the target recommendation topic is displayed in the second area, wherein the target recommendation topic is the recommendation topic corresponding to the target recommendation control.

[0185] For example, in at least one embodiment of this disclosure, the information display event includes a call event, the target audio data is the audio data of the call event, and the call event includes at least one of an audio call event and a video call event; or

[0186] The information display event includes a media content display event, and the target audio data is the audio data of the target media content corresponding to the media content display event; or

[0187] The information display event includes a multi-person conference event, and the target audio data is the conference audio data of the multi-person conference event.

[0188] For example, in at least one embodiment of this disclosure, the target text information and the recommendation information are supported for display during the execution of the information display event.

[0189] For example, in at least one embodiment of this disclosure, the information content of the target text information and / or the recommendation information are displayed in the form of conversational information.

[0190] At least one embodiment of this disclosure also provides an information display device, including:

[0191] The data acquisition module is used to acquire the target audio data corresponding to the information display event;

[0192] A text information display module is used to respond to the information display event and display target text information corresponding to the target audio data in a first area of ​​a preset interface. The target text information is generated by speech recognition of the target audio data.

[0193] The first recommendation information display module is used to display recommendation information in the second area of ​​the preset interface, wherein the recommendation information is associated with at least a portion of the information content of the text information.

[0194] At least one embodiment of this disclosure also provides an electronic device, including:

[0195] One or more processors;

[0196] Memory, used to store one or more programs.

[0197] When the one or more programs are executed by the one or more processors, the one or more processors implement the information display method as described in any of the above embodiments.

[0198] At least one embodiment of this disclosure also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the information display method as described in any of the above embodiments.

[0199] At least one embodiment of this disclosure also provides a computer program product, which, when executed by a computer, enables the computer to implement the information display method described in any of the above embodiments.

[0200] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0201] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0202] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. An information display method, comprising: Acquire the target audio data corresponding to the information display event; In response to the information display event, target text information corresponding to the target audio data is displayed in the first area of ​​the preset interface. The target text information is generated by speech recognition of the target audio data. Recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least a portion of the information content of the target text information.

2. The method of claim 1, wherein, The recommendation information includes response information for the target session information, which is generated based on at least a portion of the information content of the target text information.

3. The method of claim 2, wherein, The display of recommended information in the second area of ​​the preset interface includes: In response to a preset trigger operation based on the target text information, the target session information is displayed in the information display sub-area of ​​the second area; In response to the display of the target session information, recommended information for the target session information is displayed in the information display sub-area.

4. The method of claim 3, wherein, The step of displaying target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information includes: In response to a first preset trigger operation targeting at least a portion of the information content in the target text information, the at least a portion of the information content is input into the information input sub-region of the second region; In response to the first information sending operation, the content entered in the information input sub-area is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

5. The method of claim 3, wherein, The step of displaying target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information includes: In response to a second preset trigger operation targeting at least a portion of the information content in the target text information, the at least a portion of the information content is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second region.

6. The method of claim 3, wherein, The step of displaying target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information includes: In response to a third preset trigger operation targeting at least a portion of the information content in the target text information, the at least a portion of the information content is displayed as a selected state; In response to the second information sending operation, the selected information content in the target text information is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

7. The method of claim 6, wherein, Also includes: In response to a third preset trigger operation targeting at least a portion of the information content in the target text information, a preset prompt message and / or a reply control are displayed, wherein the preset prompt message is used to prompt the information content in the target text information that is selected, and the reply control is configured to trigger the execution of the second information sending operation.

8. The method of claim 1, wherein, The recommendation information includes object information of the target object, wherein the target object is an associated object of at least a portion of the information content in the target text information.

9. The method of claim 8, wherein, The information content, at least a portion of which consists of preset keywords, and the display of recommended information in the second area of ​​the preset interface, includes: In response to the inclusion of a target audio segment in the target audio data, recommendation information associated with the target object is displayed in the second area of ​​the preset interface, wherein the target audio segment is an audio segment that broadcasts preset keywords; and / or In response to the target text information containing the preset keywords, recommended information associated with the target object is displayed in the second area of ​​the preset interface.

10. The method of claim 9, wherein, The preset keywords are displayed in the first area using a first display style, and the information content in the target text information other than the preset keywords is displayed in the first area using a second display style.

11. The method of claim 9, wherein, The preset keywords are keywords that correspond to the audio theme of the target audio data.

12. The method of claim 1, wherein, The recommendation information includes a description of the target text information, which includes content description information and / or key node information.

13. The method of claim 12, wherein, The key node information is configured to trigger the switching of the target audio data to the key node corresponding to the key node information and / or to display the information content in the target text information corresponding to the key node information in the first area.

14. The method of any one of claims 1-13, wherein, The display of recommended information in the second area of ​​the preset interface includes: The second area of ​​the preset interface displays recommendation information and at least one interactive control corresponding to the recommendation information. The interactive control is configured to trigger the execution of an interactive operation associated with the recommendation information.

15. The method of claim 14, wherein, The interactive control includes an information sending control, which is configured to send the recommendation information using an information sending method corresponding to the sending control. Different sending controls correspond to different information sending methods.

16. The method of any one of claims 1-13, wherein, The second area displays at least one recommendation control, with different recommendation controls corresponding to different information recommendation topics. The method further includes: In response to a trigger operation on a target recommendation control in the at least one recommendation control, recommendation information corresponding to the target recommendation topic is displayed in the second area, wherein the target recommendation topic is the recommendation topic corresponding to the target recommendation control.

17. The method of any one of claims 1-13, wherein, The information display event includes a call event, and the target audio data is the audio data of the call event. The call event includes at least one of an audio call event and a video call event. or The information display event includes a media content display event, and the target audio data is the audio data of the target media content corresponding to the media content display event; or The information display event includes a multi-person conference event, and the target audio data is the conference audio data of the multi-person conference event.

18. The method of claim 17, wherein, The target text information and the recommended information can be displayed during the execution of the information display event.

19. The method of any one of claims 1-13, wherein, The information content of the target text information and / or the recommendation information are displayed in the form of conversational information.

20. An information display device, comprising: The data acquisition module is configured to acquire the target audio data corresponding to the information display event; The text information display module is configured to respond to the information display event by displaying target text information corresponding to the target audio data in a first area of ​​a preset interface. The target text information is generated by speech recognition of the target audio data. The first recommendation information display module is configured to display recommendation information in the second area of ​​the preset interface, wherein the recommendation information is associated with at least a portion of the information content of the text information.

21. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the information display method according to any one of claims 1-19.

22. A computer-readable storage medium storing computer instructions, said computer instructions being configured to cause a processor to execute the information display method according to any one of claims 1-19.

23. A computer program product comprising a computer program that, when executed by a processor, implements the information display method according to any one of claims 1-19.

Images