Information display method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides an information display method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: acquiring target audio data corresponding to an information display event; in response to the information display event, displaying target text information corresponding to the target audio data in a first area of a preset interface, the target text information being generated by performing voice recognition on the target audio data; and displaying recommendation information in a second area of the preset interface, wherein the recommendation information is associated with at least part of information content of the target text information. By means of the technical scheme, the interaction mode of the text information obtained through voice recognition can be enriched.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular, to an information display method, device, electronic device, storage medium, and program product. Background Art

[0002] At present, some applications can support voice recognition of audio data and display the text content obtained by voice recognition. However, the interactive mode of the text content obtained by voice recognition is relatively simple. Summary of the invention

[0003] The embodiments of the present disclosure provide an information display method, device, electronic device, storage medium and program product to enrich the interaction mode of text content obtained by speech recognition.

[0004] In a first aspect, an embodiment of the present disclosure provides an information display method, including:

[0005] Obtain target audio data corresponding to the information display event;

[0006] In response to the information display event, displaying target text information corresponding to the target audio data in a first area of ​​a preset interface, the target text information being generated by performing speech recognition on the target audio data;

[0007] The recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least part of the information content of the target text information.

[0008] In a second aspect, the present disclosure also provides an information display device, including:

[0009] A data acquisition module, used to acquire target audio data corresponding to the information display event;

[0010] A text information display module, configured to display target text information corresponding to the target audio data in a first area of ​​a preset interface in response to the information display event, wherein the target text information is generated by performing speech recognition on the target audio data;

[0011] The first recommendation information display module is used to display recommendation information in the second area of ​​the preset interface, where the recommendation information is associated with at least part of the information content of the text information.

[0012] In a third aspect, an embodiment of the present disclosure further provides an electronic device, including:

[0013] one or more processors;

[0014] a memory for storing one or more programs,

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the information display method as described in the embodiment of the present disclosure.

[0016] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the information display method as described in the embodiment of the present disclosure is implemented.

[0017] In a fifth aspect, the embodiments of the present disclosure further provide a computer program product. When the computer program product is executed by a computer, the computer implements the information display method as described in the embodiments of the present disclosure.

[0018] The information display method, device, electronic device, storage medium and program product provided by the embodiments of the present disclosure support information recommendation based on text information obtained by voice recognition, display recommended information associated with at least part of the information content of this text information, enrich the interaction mode of text information obtained by voice recognition, and simplify the operations required to obtain recommended information associated with the content mentioned in the audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0020] Figure 1 A flowchart of an information display method provided by an embodiment of the present disclosure;

[0021] Figure 2 A schematic diagram for displaying target text information provided by an embodiment of the present disclosure;

[0022] Figure 3 A schematic diagram of displaying recommendation information provided by an embodiment of the present disclosure;

[0023] Figure 4 A schematic diagram showing another type of recommendation information provided in an embodiment of the present disclosure;

[0024] Figure 5 A schematic diagram of displaying another recommendation information provided by an embodiment of the present disclosure;

[0025] Figure 6 A schematic diagram showing a recommended control provided in an embodiment of the present disclosure;

[0026] Figure 7 A flowchart of another information display method provided by an embodiment of the present disclosure;

[0027] Figure 8 A schematic diagram of displaying target session information provided by an embodiment of the present disclosure;

[0028] Fig. 9 A schematic diagram showing a preset interface provided in an embodiment of the present disclosure;

[0029] Fig.10 A schematic diagram showing another preset interface provided in an embodiment of the present disclosure;

[0030] Fig.11 A schematic diagram of a display process of target session information provided by an embodiment of the present disclosure;

[0031] Fig.12 A structural block diagram of an information display device provided in an embodiment of the present disclosure;

[0032] Fig.13 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0033] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0034] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0035] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0036] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0037] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0038] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0039] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0040] Figure 1 A flowchart of an information display method provided in an embodiment of the present disclosure. The method can be executed by an information display device, wherein the device can be implemented by software and / or hardware and can be configured in an electronic device, typically, a computer, a mobile phone or a tablet computer. The information display method provided in an embodiment of the present disclosure is suitable for scenarios where recommended information is displayed based on text content obtained by voice recognition, such as scenarios where conversations are conducted based on text content obtained by voice recognition. Figure 1 As shown, the information display method provided in this embodiment may include:

[0041] S101. Acquire target audio data corresponding to an information display event.

[0042] The information display event can be understood as an event that supports displaying the text information corresponding to the audio data and the recommended information associated with the text information. The information display event can be pre-set, for example, the information display event can include a call event, a media content display event and / or a multi-person conference event, etc.

[0043] Among them, the call event may be an event for making a call, such as an audio call event and / or a video call event. The audio call event may be an event for making an audio call, such as an event for the current user to make a voice call with other call objects other than the current user. The video call event may be an event for making a video call, such as an event currently used to make a video call with other call objects other than the current user. This other call object may be an object for making a call with the current user, which may be a real object, such as other users other than the current user; or a virtual object, such as an intelligent assistant, a conversational robot, or a virtual contact that generates content based on a voice model. The media content display event may be an event for displaying media content, such as an event for displaying media content information or a media content screen of media content in a media content display area of ​​a preset interface. This media content may be media content with audio data, such as video-type media content and / or audio-type media content. The multi-person conference event may be an event for multiple people to hold a conference, such as an event for the current user to hold a conference with at least one other user other than the current user. The multi-person conference event may be an online conference event, such as an event for holding a conference through an application that supports holding a conference (such as the current application); or it may be an offline conference event. The following description takes a multi-person conference event as an online conference event as an example.

[0044] The target audio data can be understood as the audio data of the information display event. Optionally, the information display event includes a call event, and the target audio data is the audio data of the call event, and the call event includes at least one of an audio call event and a video call event; or, the information display event includes a media content display event, and the target audio data is the audio data of the target media content corresponding to the media content display event; or, the information display event includes a multi-person conference event, and the target audio data is the conference audio data of the multi-person conference event. For example, when the information display event is a call event, the target audio data can be the call audio data of this call event; when the information display event is a media content display event, the target audio data can be the audio data of the media content displayed by this media content display event; when the information display event is a multi-person conference event, the target audio data can be the audio data of this multi-person conference event, that is, the audio data of the conference corresponding to this multi-person conference event.

[0045] In this embodiment, when there is an information display event, such as when the information display event occurs, the audio data of the information display event can be obtained as the target audio data. For example, when it is detected that the current user is talking to another call object, the audio data of the call can be obtained as the target audio data of the call event; when it is detected that the current user triggers the display of a certain media content, the audio data of the media content can be obtained as the target audio data of the media content display event; when it is detected that the current user participates in a meeting, the conference audio data of the meeting can be obtained as the target audio data of the multi-person meeting event, and so on.

[0046] There is no limit to the timing of acquiring the target audio data. For example, the target audio data of the information display event can be acquired in real time when the information display event occurs; or the pre-stored target audio data of the information display event can be acquired when there is an information display demand, such as when the current conditions meet the information display conditions of the information display event, and so on.

[0047] S102. In response to the information display event, target text information corresponding to the target audio data is displayed in a first area of ​​a preset interface, where the target text information is generated by performing speech recognition on the target audio data.

[0048] Among them, the preset interface can be an interface for displaying the text information corresponding to the above-mentioned information display event. The preset interfaces corresponding to different types of information display events may be the same or different; and / or, when displaying text information corresponding to different types of information display events, the interface layout of the preset interface may be the same or different. The preset interface may include a first area and a second area, the first area being used to display the text information corresponding to the information display event; the second area being used to display recommended information associated with the text information corresponding to the information display event. The target text information can be understood as the text information of the target audio data of the information display event, and the target text information can be generated by performing speech recognition on the target audio data, and is used to display the content broadcast by the target audio data in the form of text.

[0049] Specifically, after the target audio data corresponding to the information display event is obtained, if the current condition satisfies the information display condition of the information display event, the target text information corresponding to the target audio data can be displayed in the first area 20 of the preset interface, such as Figure 2 As shown, the current user can view and / or further obtain recommended information associated with the target text information.

[0050] In this embodiment, the text information corresponding to the target audio data of the information display event can be displayed during the execution of the information display event. For example, during the execution of the information display event, the target audio data of the information display event can be voice recognized in real time or periodically, and the target text information obtained by the voice recognition can be displayed in the first area of ​​the preset interface, that is, the target text information supports display during the execution of the information display event; or after the information display event is executed, the target text information corresponding to the target audio data of the information display event can be obtained, and the target text information can be displayed in the first area of ​​the preset interface, that is, the target text information corresponding to the target audio data of the information display event can be displayed after the information display event is executed. The following is an example of displaying the text information corresponding to the target audio data of the information display event during the execution of the information display event.

[0051] The information display conditions of the information display event can be flexibly set as needed. For example, when the occurrence of the information display event is detected and / or the currently displayed interface is the preset interface, it can be confirmed that the current conditions meet the information display conditions of the information display event; or when the current user's information display operation or information display instruction is received, it can be determined that the current conditions meet the information display conditions of the information display event. In the case where the current conditions meet the information display conditions of the information display event, the target text information corresponding to the target audio data of the information display event can be displayed in the first area of ​​the preset interface, wherein this information display event can be an information display event that is currently occurring; or it can be an information display event that has been executed, such as the information display event selected by the current user.

[0052] The target text information is displayed in the first area of ​​the preset interface in any manner. Figure 2 As shown, the information content of the target text information is displayed in the form of conversation information. Exemplarily, the target audio data can be subjected to speech recognition to obtain text information paragraphs corresponding to each speaker, and the text information paragraphs corresponding to each speaker are displayed in the first area 20 of the preset interface in the form of conversation information sent by each speaker according to the arrangement order of the audio data segments corresponding to each text information paragraph in the target audio data. For example, for each text information paragraph of each speaker, the text information paragraph of this speaker can be displayed in the first area 20 of the preset interface in the form of the information content of the conversation information sent by this speaker. At this time, the first area 20 of the preset interface can be used to display the conversation information between each speaker in the target audio data obtained based on the conversion of the target audio data.

[0053] S103: Displaying recommended information in a second area of ​​the preset interface, where the recommended information is associated with at least a portion of the information content of the target text information.

[0054] The recommended information may be information associated with at least part of the information content of the target text information, such as information recommended based on at least part of the information content of the target text information. The recommended information may be used to respond to at least part of the information content, such as responding to questions contained in at least part of the information content; it may also be used to describe the object mentioned in at least part of the information content or the object (such as media content) corresponding to the information display event, such as the information content of the recommended information may be the brief introduction information or detailed information of the object mentioned in at least part of the information content.

[0055] Exemplarily, recommended information associated with at least part of the target text information can be displayed in the second area of ​​the preset interface for the current user to view or refer to. For example, in a call scenario and / or a multi-person conference scenario, the current user can refer to this recommended information to respond to questions raised by other call objects or other participants, or to describe objects mentioned during the call or conference; in a media content display scenario, the current user can understand the currently displayed media content by viewing this recommended information and / or adjust the display progress of the currently displayed media content based on this recommended information, etc.

[0056] In this embodiment, the recommended information associated with at least part of the information content of the target text information can be displayed during the execution of the information display event, that is, the recommended information supports being displayed during the execution of the information display event for reference by the current user, so that the current user can continue to execute this information display event; after the information display event is executed, the recommended information associated with at least part of the information content of the target text information can be obtained and displayed in the second area of ​​the preset interface, that is, the target text information associated with at least part of the information content of the target text information can be displayed after the information display event is executed, so that the current user can view it. The following is an example of displaying the recommended information associated with at least part of the information content of the target text information during the execution of the information display event.

[0057] The display conditions of recommended information can be flexibly set as needed. For example, when it is detected that the target audio data and / or the target text information displayed in the first area mentions a question and / or an object that supports the display of recommended information, the recommended information associated with the question and / or the object can be automatically displayed in the second area to simplify the operations required for the current user to view the recommended information; when the current user receives a recommended information display operation for at least part of the information content in the target text information displayed in the first area, the recommended information associated with this at least part of the information content can be displayed in the second area; when it is detected that the current user has sent a session information generated based on at least part of the information content in the target text information displayed in the first area in the second area, the recommended information associated with this at least part of the information content and used to reply to the session information sent by the current user can be displayed in the second area. The specific conditions can be flexibly set as needed.

[0058] The display method of the recommended information 30 in the second area 21 of the preset interface is not limited, for example, the recommended information 30 associated with at least part of the information content of the target text information displayed in the first area 20 can be displayed in the second area 21 of the preset interface in the form of notification information, prompt information or conversation information. Figure 3 As shown, the recommended information 30 is displayed in the form of conversation information. For example, the second area 21 of the preset interface can be a conversation area between the current user and the virtual user who generates content based on the voice model. This conversation area can be used for the current user to send conversation information to the virtual user and / or display the conversation information between the current user and the virtual user. At this time, the recommended information 30 can be displayed in the second area 21 of the preset interface in the form of conversation information sent by the virtual user. The virtual user can be, for example, an intelligent assistant, a conversation robot, or a virtual contact, which can have a conversation with the current user based on the content generated by the voice model.

[0059] In some embodiments, after the recommendation information is displayed in the second area of ​​the preset interface, the current user can be supported to further perform interactive operations associated with the recommendation information, such as interacting with one or more conversation objects in the target audio data or other objects other than the conversation objects in the target audio data based on the recommendation information, so as to enrich the functionality of the recommendation information and simplify the operations required for interacting based on the recommendation information. At this time, optionally, the displaying of the recommendation information in the second area of ​​the preset interface includes: displaying the recommendation information and at least one interactive control corresponding to the recommendation information in the second area of ​​the preset interface, and the interactive control is configured to trigger the execution of the interactive operation associated with the recommendation information.

[0060] Specifically, Figure 3As shown, when displaying the recommendation information 30, one or more interactive controls 31 corresponding to the recommendation information 30 may be further displayed, and different interactive controls 31 may be configured to trigger the execution of different interactive operations associated with the recommendation information 30. Thus, when it is detected that the current user triggers a certain interactive control 31 associated with a certain recommendation information 30, it may be determined that an interactive operation corresponding to the interactive control 31 is received, and in response to the interactive operation, an interactive event corresponding to the interactive operation is executed.

[0061] In the above implementation, the interactive control corresponding to the recommended information may be associated with the information content of the recommended information. When the information content of the recommended information is different, the interactive control corresponding to the recommended information may be different.

[0062] In some exemplary scenarios, the information content of the recommended information may be the content that a certain speaker in the target audio data wants to know, such as the answer to a question asked by a certain speaker in the target audio data, or the description information of an object mentioned by a certain speaker in the target audio data. In this case, when displaying the recommended information, one or more sending controls may be displayed as interactive controls corresponding to the recommended information, and different sending controls correspond to different information sending methods. When it is detected that the current user triggers a certain sending control corresponding to the recommended information, the information content of the recommended information may be sent to the corresponding speaker in the target audio data using the information sending method corresponding to the sending control, thereby simplifying the operation required to send the information content of the recommended information.

[0063] At this time, optionally, the interactive control includes an information sending control, and the sending control is configured to send the recommended information using an information sending method corresponding to the sending control, and different sending controls correspond to different information sending methods.

[0064] Taking a call scenario as an example, the current user can have a call with one or more other users. During the call of the current user, the text information of the call can be displayed in the first area of ​​the preset interface, and recommended information associated with at least part of the information content of the text information displayed in the first area can be displayed in the second area of ​​the preset interface; and when it is detected that the current user triggers a sending control corresponding to this recommended information, the information content of this recommended information can be sent to at least some of the other users who are having a call with the current user using the information sending method corresponding to this sending control.

[0065] Among them, the information sending method can be understood as a method of sending a certain recommended information displayed in the second area, which can be set as needed. Exemplarily, different information sending methods can correspond to different contact methods of the receiving user, such as the information sending method can be sent in the form of text messages, sent by the current application, or sent by an application other than the current application, etc. In addition, different information sending methods can also correspond to different information sending forms. Taking the use of a certain application to send recommended information as an example, this recommended information can be sent in the form of notification information and / or session information.

[0066] In some exemplary scenarios, the information content of the recommended information may be a query result of a processing method for a certain object to be processed, such as a query result of a processing method for a certain object, a certain place, a certain media content and / or a certain interactive information. In this case, when displaying this recommended information, processing controls corresponding to one or more processing methods determined by the query may be displayed as interactive controls corresponding to this recommended information, and different processing controls correspond to different processing methods for the object to be processed. When it is detected that the current user triggers a processing control corresponding to this recommended information, the processing method corresponding to this processing control may be used to process the object to be processed. The processing method for the object to be processed is not limited. Taking the object to be processed as interactive information as an example, the processing method for the object to be processed may be, for example, replying, deleting and / or hiding.

[0067] In some exemplary scenarios, the information content of the recommended information may be a query result for a certain attribute information of a certain object to be processed, such as a query result for a certain attribute information of a certain item, a certain place, a certain media content and / or a certain interactive information. In this case, when displaying this recommended information, one or more processing controls corresponding to this query result may be displayed as interactive controls corresponding to this recommended information, and different processing controls correspond to different processing methods for this object to be processed. When it is detected that the current user triggers a certain processing control corresponding to this recommended information, the object to be processed may be processed in a processing method corresponding to this processing control. For example, in the case of querying to determine the display method supported by a certain media content, a display control corresponding to at least one display method supported by this media determined by the query may be displayed. When it is detected that the current user triggers a certain display control, the display method corresponding to this display control may be used to display this media content, and so on. Among them, the display methods supported by the media content may be, for example, full-screen playback, small-window playback, background playback, and / or audio playback only.

[0068] The information display method provided in this embodiment obtains target audio data corresponding to an information display event; in response to this information display event, displays target text information generated by voice recognition of the target audio data in a first area of ​​a preset interface; and displays recommended information associated with at least part of the information content of the target text information in a second area of ​​the preset interface. This embodiment uses the above technical solution to support information recommendation based on text information obtained by voice recognition, and displays recommended information associated with at least part of the information content of this text information, which can enrich the interactive mode of text information obtained by voice recognition and simplify the operations required to obtain recommended information associated with the content mentioned in the audio data.

[0069] In some embodiments, Figure 3 As shown, the recommended information 30 can be used to reply to the target conversation information 32 sent by the current user in the second area 21 of the preset interface based on at least part of the information content in the target text information, so as to simplify the operation required for the current user to view and obtain the reply content of the corresponding content in the target audio data, and reduce the difficulty of the current user's reply. At this time, optionally, the recommended information 30 includes reply information of the target conversation information 32, and the target conversation information 32 is generated based on at least part of the information content of the target text information. For example, the current user can send the target conversation information 32 in the second area 21 based on at least part of the information content of the target text information displayed in the first area 20 to obtain reply information of this at least part of the information content; accordingly, the current application can display the reply information of this target conversation information 32 (i.e., the recommended information 30) in the second area 21, so that the current user can view or refer to this reply information to reply to this at least part of the information content.

[0070] In some embodiments, Figure 4 As shown, the recommended information 30 can be the object information of the associated object of at least part of the information content in the target text information, so that the current user can view or refer to this object information for calls or meetings, etc. For example, it can be automatically identified whether the target text information and / or the target audio data mentions the target object that supports the display of the object information or the content associated with the target object, and when it is determined that the target text information and / or the target audio data mentions the target object that supports the display of the object information or the content associated with the target object, the object information of this object is obtained as the recommended information 30, and the recommended information 30 is displayed in the second area 21 of the preset interface, without the current user performing an operation to indicate the display of this recommended information 30, further simplifying the operation required to view the recommended information 30. At this time, optionally, the recommended information 30 includes the object information of the target object, and the target object is the associated object of at least part of the information content in the target text information.

[0071] The target object may be an object associated with at least part of the information content in the target text information, such as a person, place, location, order and / or media content associated with at least part of the information content in the target text information. There is no limit to the method of determining the target object. For example, the target object in the target text information and / or target audio data may be identified based on a pre-trained object recognition model; keywords corresponding to each object may also be pre-set, so that it is possible to identify whether the preset keyword is mentioned in the target text information and / or target audio data, and the object corresponding to the preset keyword mentioned in the target text information and / or target audio data is used as the target object, and so on.

[0072] In some embodiments, at least part of the information content is a preset keyword, and displaying the recommended information in the second area of ​​the preset interface includes: in response to the target audio data containing a target audio segment, displaying the recommended information associated with the target object in the second area of ​​the preset interface, the target audio segment being an audio segment that broadcasts the preset keyword; and / or, in response to the target text information containing the preset keyword, displaying the recommended information associated with the target object in the second area of ​​the preset interface.

[0073] The preset keyword may be a keyword corresponding to an object that supports displaying object information. For example, the preset keyword may be identification information or feature information of the corresponding object. For example, the preset keyword may be a person name, a place name, a location name, an order number, and / or a media content name. The target audio segment may be an audio segment in the target audio data that broadcasts the preset keyword. In other words, the preset keyword is broadcast in the target audio segment.

[0074] For example, it can be determined based on the target audio data whether there is a preset keyword corresponding to the object whose information is supported for display. For example, for each keyword, based on the audio feature corresponding to the preset keyword, it can be identified whether there is an audio segment matching the audio feature in the target audio data, and if so, it is determined that the target audio data contains a target audio segment corresponding to the keyword, and the recommended information associated with the target object corresponding to the preset keyword is displayed in the second area of ​​the preset interface.

[0075] For another example, based on the target text information obtained by voice recognition of the target audio data, it can be determined whether there is a preset keyword corresponding to the object whose information is supported for display. For example, it can be identified whether the target text information contains a preset keyword, and if so, the recommended information associated with the target object corresponding to the preset keyword contained in the target text information is displayed in the second area of ​​the preset interface.

[0076] In this embodiment, when it is determined based on the target audio data and / or target text information that the target text information contains preset keywords, the preset keywords contained in the target text information and the information content other than the preset keywords can be displayed in the first area of ​​the preset interface using the same or different display styles.

[0077] For example, Figure 4 As shown, different display styles can be used to display the preset keywords (such as Figure 4 ) and information content other than the preset keywords, so as to reduce the difficulty of viewing and locating the preset keywords contained in the target text information. At this time, optionally, the preset keywords are displayed in the first area 20 using a first display style, and the information content other than the preset keywords in the target text information is displayed in the first area 20 using a second display style. Among them, the first display style can be understood as the display style of the preset keywords in the target text information in the first area 20, and the second display style can be the display style of other information content other than the preset keywords in the target text information in the first area 20. The first display style and the second display style can be different display styles. For example, the first display style and the second display style can correspond to different text fonts, different text font sizes, different text colors and / or different background colors, etc.

[0078] In the above implementation, when identifying the preset keyword, the audio theme of the target audio data may not be considered, so as to simplify the operations required to be performed to identify the preset keyword.

[0079] In the above embodiment, when identifying keywords, the audio theme of the target audio data can also be considered to improve the relevance between the displayed object information and the target audio data and / or the target text information. For example, keyword sets corresponding to different audio themes can be pre-set, and the keyword sets corresponding to different audio themes can be different; thus, when performing keyword recognition, the audio theme of the target audio data can be determined, the keyword set corresponding to this audio theme can be obtained, and it can be identified whether the preset keywords in this keyword set are mentioned in the target audio data and / or the target text information, and only when the preset keywords in this keyword set are mentioned in the target audio data and / or the target text information, the recommended information associated with the target object corresponding to the preset keyword is displayed in the second area of ​​the preset interface. At this time, optionally, the preset keyword is a keyword corresponding to the audio theme of the target audio data. Among them, the audio theme of the target audio data can be the conversation theme of the conversation conducted in the target audio data, such as the conversation scene corresponding to the target audio data, and this conversation scene can be, for example, a dining scene, a scenic spot scene and / or a shopping scene, etc.

[0080] In some embodiments, Figure 5 As shown (the figure takes the information display event as a media content display event as an example), the recommended information can be the content introduction information of the target text information, such as the content description information and / or key node information of the target text information, so that the current user can quickly understand the content and / or key nodes of the target audio data and / or target text information. At this time, optionally, the recommended information includes the content introduction information of the target text information, and the content introduction information includes content description information and / or key node information. Among them, the content description information can be information used to describe the content of the target audio data and / or target text information, such as introduction information or summary information. The key node information can be the information of the key nodes in the target audio data and / or target text information, such as the time nodes corresponding to the key nodes in the target audio data and / or the introduction information of the key nodes.

[0081] In some embodiments, in addition to being viewed by the current user, the key node information can also be used for the current user to switch the playback progress of the target audio data and / or the information content of the target text information currently displayed in the first area, so as to enrich the switching method of the playback progress of the target audio data and / or the information content of the target text information. For example, when it is detected that the current user triggers a certain key node information displayed in the recommended information, the playback progress of the target audio data can be switched to the key node corresponding to this key node information; and / or, the information content associated with the key node corresponding to this key node information in the target text information is displayed in the first area, such as displaying the information content near this key node. At this time, optionally, the key node information is configured to trigger the switching of the target audio data to the key node corresponding to the key node information and / or display the information content corresponding to the key node information in the target text information in the first area.

[0082] Take the information display event as a media content display event as an example, Figure 5 As shown, the preset interface may also include a media content display area 22. For example, when the displayed media content is video-type media content, this media content display area may be used to display the media content screen of the currently displayed media content; when the displayed media content is audio-type media content, this media content display area may be used to display the identification information of this media content. Thus, when a display operation for a certain media content is received from the current user, the media content screen or identification information of this media content may be displayed in the media content display area 22 of the preset interface; the information content of the target text information generated based on the audio data of this media content may be displayed in the first area 20 of the preset interface in the form of session information; and the content introduction information of this media content (such as Figure 5 The recommended information shown in 30).

[0083] In addition, the information content of the target text information displayed in the first area can support user interaction, such as sending target conversation information in the second area based on at least part of the information content of the target text information to obtain recommended information corresponding to the target conversation information, and so on.

[0084] In some embodiments, the second area displays at least one recommendation control, different recommendation controls correspond to different information recommendation topics, and the information display method also includes: in response to a triggering operation of a target recommendation control in the at least one recommendation control, displaying recommendation information corresponding to the target recommendation topic in the second area, and the target recommendation topic is the recommendation topic corresponding to the target recommendation control.

[0085] Among them, the recommendation control can be configured to trigger the execution of different information recommendation operations. Different information recommendation operations may correspond to different information recommendation topics, which are used to indicate the acquisition and display of recommended information under the corresponding information recommendation topic. In the customer service scenario, for example, different recommendation controls can be used to query different types of business information, such as different recommendation controls can support triggering calls to related information libraries for information query, so as to improve the information query efficiency of customer service personnel and reduce the waiting time for customer service and served users. The business information library may, for example, include an activity information library, a venue information library, and / or an order information library. The target recommendation control may be a recommendation control triggered by the current user. The target recommendation topic may be an information recommendation topic corresponding to the target recommendation control.

[0086] For example, Figure 6 As shown, when the preset interface is displayed, at least one recommendation control 60 can be displayed in the second area 21 of the preset interface, and different recommendation controls 60 correspond to different information recommendation topics. When it is detected that the current user triggers a recommendation control 60 (i.e., a target recommendation control) displayed in the second area 21, recommendation information 30 matching the information recommendation topic of the recommendation control 60 (i.e., the target information recommendation topic) can be obtained. For example, based on the information stored in the information library corresponding to the recommendation control 60, recommendation information 30 matching the information recommendation topic corresponding to the recommendation control can be generated, and the recommendation information 30 can be displayed in the second area 21 of the preset interface.

[0087] The display position of the recommendation control 60 is not limited. For example, the recommendation control 60 can be displayed at a preset position of the second area 21; it can also be displayed at a position associated with the information input sub-area 23 of the second area 21, such as above, below, left or right of the information input sub-area 23. Figure 6 As shown ( Figure 6 In the example, the recommended information 60 is displayed above the information input sub-area 23).

[0088] In this embodiment, a recommendation control can be displayed in the second area of ​​the preset interface to support users to make information recommendations based on this recommendation control, such as calling the relevant business system for information query with one click, which can simplify the operations required by the current user to obtain recommended information.

[0089] Figure 7A flowchart of another information display method provided for an embodiment of the present disclosure. The solution in this embodiment can be combined with one or more optional solutions in the above embodiments. Optionally, the display of recommended information in the second area of ​​the preset interface includes: in response to a preset trigger operation based on the target text information, displaying the target session information in the information display sub-area of ​​the second area; in response to the display of the target session information, displaying recommended information for the target session information in the information display sub-area.

[0090] Correspondingly, such as Figure 7 As shown, the information display method provided in this embodiment may include:

[0091] S201. Acquire target audio data corresponding to an information display event.

[0092] S202. In response to the information display event, target text information corresponding to the target audio data is displayed in a first area of ​​a preset interface, where the target text information is generated by performing speech recognition on the target audio data.

[0093] S203: In response to a preset triggering operation based on the target text information, display target conversation information in the information display sub-area of ​​the second area, where the target conversation information is generated based on at least a portion of information content of the target text information.

[0094] The preset trigger operation may be a trigger operation for indicating displaying target conversation information associated with at least part of the information content of the target text information, such as the preset trigger operation may indicate sending the target conversation information in the second area to obtain reply information of the target conversation information. The execution method of the preset trigger operation is not limited, for example, the preset trigger operation may be an operation of triggering a certain control or an operation of executing a certain sliding gesture, etc. The information display sub-area may be a sub-area for displaying conversation information sent between the current user and the virtual user corresponding to the second area.

[0095] In the embodiment of the present disclosure, the current user can be supported to obtain recommendation information associated with at least a portion of the target text information obtained by speech recognition based on target audio data by sending target conversation information.

[0096] Specifically, when a preset trigger operation based on the target text information is received, the target session information 32 generated based on at least part of the information content of the target text information can be triggered to be sent, and the target session information 32 is displayed in the information display sub-area of ​​the second area 21 of the preset interface, such as Figure 8 shown.

[0097] In this embodiment, the method for sending the target session information can be flexibly set as needed.

[0098] In some implementations, the current user may be supported to input information content to be sent into the information input sub-area of ​​the second area based on the target text information displayed in the first area, so that the current user can continue to edit the information content. At this time, optionally, in response to a preset trigger operation based on the target text information, the target session information is displayed in the information display sub-area of ​​the second area, including: in response to a first preset trigger operation for at least part of the information content in the target text information, the at least part of the information content is input into the information input sub-area of ​​the second area; in response to the first information sending operation, the content input in the information input sub-area is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0099] The first preset trigger operation may be a trigger operation for indicating that at least part of the information content of the target text information displayed in the first area is input into the information input sub-area of ​​the second area. The execution method of the first preset trigger operation is not limited. For example, the first preset trigger operation may be an operation for triggering a copy control or an operation for executing a copy gesture. The first information sending operation may be an operation for indicating sending the information content input in the information input sub-area, such as an operation for triggering a send control or an operation for executing a send gesture. The information input sub-area may be a sub-area for inputting and editing the information content of the session information to be sent.

[0100] Specifically, when a first preset trigger operation for at least part of the information content in the target text information is received, such as when it is detected that the current user triggers a copy control corresponding to at least part of the information content in the first area, this at least part of the information content can be input into the information input sub-area of ​​the second area.

[0101] After inputting at least part of the information content of the target text information into the information input sub-area of ​​the second area, the current user can be supported to directly execute the first information sending operation to send this at least part of the information content; the current user can also be supported to edit this at least part of the information content input, and after the editing is completed, send the edited information content by executing the first sending operation.

[0102] When a first information sending operation is received, such as when it is detected that the current user triggers the sending control displayed in the second area, the content currently input in the information input subarea can be used as the information content of the target session information to be sent, and the target session information can be sent to the virtual user corresponding to the second area, and the target session information can be displayed in the information display subarea of ​​the second area.

[0103] In some optional examples, taking the display of the information content of the target text information in the form of session information as an example, when it is detected that the current user triggers (such as clicks or long presses, etc.) a certain session information displayed in the first area 20 of the preset interface, or when it is detected that the current user hovers an input indicator (such as a cursor, etc.) over a display sub-area of ​​a certain session information in the first area 20, a copy control 90 corresponding to the session information can be displayed, such as displaying the copy control 90 corresponding to the session information at an associated position of the session information, such as Fig. 9 As shown ( Fig. 9 In the example, the copy control 90 corresponding to the third session information in the first area 20 is displayed. Thus, when it is detected that the current user triggers the copy control 90, the information content of the session information can be input into the information input sub-area 23 of the second area 21, such as Fig.10 When it is detected that the current user triggers the sending control 24 displayed in the second area 21, the content currently input in the information input sub-area 23 can be used as the information content of the target session information 32, and the target session information 32 can be sent to the virtual user corresponding to the second area 21, and the target session information 32 can be displayed in the information display sub-area of ​​the second area 21, as shown in FIG. Figure 8 shown.

[0104] In some implementations, the current user may be supported to directly send at least part of the information content displayed in the first area as the information content of the target session information to be sent, so as to simplify the operations required to send the target session information based on the target text information. At this time, optionally, in response to a preset trigger operation based on the target text information, the target session information is displayed in the information display sub-area of ​​the second area, including: in response to a second preset trigger operation for at least part of the information content in the target text information, the at least part of the information content is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0105] The second preset trigger operation may be a trigger operation for instructing to send at least part of the information content of the target text information displayed in the first area as the information content of the target conversation information. The execution method of the second preset trigger operation is not limited. For example, the second preset trigger operation may be an operation of triggering a recommendation control or an operation of executing a recommendation gesture.

[0106] Specifically, in cases where a second preset trigger operation for at least part of the information content in the target text information is received, such as when it is detected that the current user triggers a recommendation control corresponding to at least part of the information content in the first area, this at least part of the information content can be used as the information content of the target session information to be sent, and the target session information can be sent to the virtual user corresponding to the second area, and the target session information can be displayed in the information display sub-area of ​​the second area.

[0107] In some optional examples, taking the display of the information content of the target text information in the form of session information as an example, when it is detected that the current user triggers (such as clicks or long presses, etc.) a certain session information displayed in the first area 20 of the preset interface, or when it is detected that the current user hovers an input indicator (such as a cursor, etc.) over a display sub-area of ​​a certain session information in the first area 20, a recommendation control 91 corresponding to the session information can be displayed, such as displaying a recommendation control 91 corresponding to the session information at an associated position of the session information, such as Fig. 9 As shown ( Fig. 9 In the example, the recommendation control 91 corresponding to the third session information in the first area 20 is displayed. Thus, when it is detected that the current user triggers the recommendation control 91, the information content of the session information can be used as the information content of the target session information 32, and the target session information 32 can be sent to the virtual user corresponding to the second area 21, and the target session information 32 can be displayed in the information display sub-area of ​​the second area 21, such as Figure 8 shown.

[0108] In some implementations, the current user may be supported to select the information content of the target session information to be sent in the first area, so as to simplify the operations required to send the target session information and make the sent target session information more in line with the actual sending needs of the current user, thereby improving the accuracy of the recommended information generated based on the target session information. At this time, optionally, in response to a preset trigger operation based on the target text information, the target session information is displayed in the information display sub-area of ​​the second area, including: in response to a third preset trigger operation for at least part of the information content in the target text information, the at least part of the information content is displayed as a selected state; in response to the second information sending operation, the information content in the target text information in the selected state is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0109] Among them, the third preset trigger operation may be a trigger operation for selecting at least part of the information content displayed in the first area. The execution method of the third preset trigger operation is not limited, such as the third preset trigger operation may be an operation for selecting at least part of the information content displayed in the first area. The second information sending operation may be a trigger operation for indicating the sending of the information content in the selected state in the first area, such as an operation for triggering a send control corresponding to the information content in the selected state in the first area or an operation for performing a send gesture for the information content in the selected state in the first area.

[0110] Specifically, when a third preset trigger operation for at least part of the information content in the target text information is received, such as when it is detected that the current user selects at least part of the information content displayed in the first area, the at least part of the information content can be displayed as a selected state. When a second information sending operation for the information content in the selected state in the first area is detected, the information content in the selected state can be used as the information content of the target session information to be sent, and the target session information can be sent to the virtual user corresponding to the second area, and the target session information can be displayed in the information display sub-area of ​​the second area.

[0111] In some embodiments, when there is information content in a selected state in the first area, preset prompt information can be further displayed to prompt the information content currently in the selected state through the preset prompt information; and / or, a reply control can be further displayed so that the current user can perform a second information sending operation by triggering this reply control. At this time, optionally, the information display method also includes: in response to a third preset trigger operation for at least part of the information content in the target text information, displaying preset prompt information and / or reply controls, wherein the preset prompt information is used to prompt the information content in the target text information that is in a selected state, and the reply control is configured to trigger the execution of the second information sending operation. Among them, the display position of the preset prompt information and / or reply control is not limited, such as the preset prompt information and / or reply information can be displayed in the first area or the second area of ​​the preset interface, which can be set specifically as needed.

[0112] In some optional examples, taking the example of displaying the information content of the target text information in the form of conversation information, when it is detected that the current user selects at least part of the information content of one or more conversation information displayed in the first area, the at least part of the information content selected by the current user can be displayed as a selected state, and the preset prompt information 110 and at least one reply control 111 corresponding to the at least part of the information content are displayed, such as Fig.11 As shown in the first figure, Fig.11In the example, a part of the information content of the third conversation information in the first area 20 (such as the information content with a gray background in the third conversation information) is selected. Therefore, when it is detected that the current user triggers a displayed reply control 111, the information content in the selected state in the first area 20 can be used as the information content of the target conversation information, and the target conversation information is sent to the virtual user corresponding to the second area 21, and the target conversation information 32 is displayed in the information display sub-area of ​​the second area 21, and the information content in the selected state in the first area 20 can be further switched to an unselected state, such as Fig.11 As shown in the second figure in the figure. The number of the displayed reply controls 111 can be one or more. When multiple reply controls 111 are displayed, illustratively, different reply controls can be used to generate reply information of target information content based on information stored in different information repositories.

[0113] S204: In response to the display of the target session information, display recommended information for the target session information in the information display sub-area, where the recommended information includes reply information of the target session information.

[0114] In this embodiment, after the target session information is displayed in the information display sub-area, reply information of the target session information may be generated as recommendation information for the target session information in response to the display of the target session information, and the recommendation information may be displayed in the information display sub-area of ​​the second area.

[0115] The information display method provided in this embodiment supports the current user to send target conversation information by obtaining at least part of the information content of the target text information obtained based on voice recognition of the target audio data, thereby obtaining recommended information associated with this at least part of the information content, which can enrich the generation method of recommended information and reduce the difficulty of replying to the information content in the target audio data.

[0116] Fig.12 This is a structural block diagram of an information display device provided by an embodiment of the present disclosure. The device can be implemented by software and / or hardware, and can be configured in an electronic device, typically a computer, a mobile phone or a tablet computer, and can display recommended information based on the text content obtained by voice recognition by executing the information display method, such as conducting a conversation based on the text content obtained by voice recognition. Fig.12 As shown, the information display device provided in this embodiment may include:

[0117] The data acquisition module 1201 is used to acquire target audio data corresponding to the information display event;

[0118] A text information display module 1202, configured to display target text information corresponding to the target audio data in a first area of ​​a preset interface in response to the information display event, wherein the target text information is generated by performing speech recognition on the target audio data;

[0119] The first recommendation information display module 1203 is used to display recommendation information in the second area of ​​the preset interface, where the recommendation information is associated with at least part of the information content of the text information.

[0120] The information display device provided in this embodiment acquires the target audio data corresponding to the information display event through the data acquisition module; displays the target text information generated by voice recognition of the target audio data in the first area of ​​the preset interface in response to the information display event through the text information display module; and displays the recommended information associated with at least part of the information content of the target text information in the second area of ​​the preset interface through the first recommended information display module. This embodiment uses the above technical solution to support information recommendation based on text information obtained by voice recognition, and displays recommended information associated with at least part of the information content of this text information, which can enrich the interactive mode of text information obtained by voice recognition and simplify the operations required to obtain recommended information associated with the content mentioned in the audio data.

[0121] Optionally, the recommendation information includes reply information of target conversation information, and the target conversation information is generated based on at least part of information content of the target text information.

[0122] Optionally, the first recommended information display module 1203 includes: a session information display unit, used to display target session information in the information display sub-area of ​​the second area in response to a preset trigger operation based on the target text information; and a recommended information display unit, used to display recommended information for the target session information in the information display sub-area in response to the display of the target session information.

[0123] Optionally, the session information display unit may be specifically used to: in response to a first preset trigger operation for at least part of the information content in the target text information, input at least part of the information content into the information input sub-area of ​​the second area; in response to a first information sending operation, use the content input in the information input sub-area as the information content of the target session information, and display the target session information in the information display sub-area of ​​the second area.

[0124] Optionally, the recommended information display unit may be specifically configured to: in response to a second preset trigger operation for at least part of the information content in the target text information, use the at least part of the information content as the information content of the target session information, and display the target session information in the information display sub-area of ​​the second area.

[0125] Optionally, the session information display unit can be specifically used to: in response to a third preset trigger operation for at least part of the information content in the target text information, display the at least part of the information content as a selected state; in response to a second information sending operation, use the information content in the target text information in a selected state as the information content of the target session information, and display the target session information in the information display sub-area of ​​the second area.

[0126] Optionally, the conversation information display unit can also be used to: in response to a third preset trigger operation for at least part of the information content in the target text information, display preset prompt information and / or reply controls, wherein the preset prompt information is used to prompt the information content in the target text information that is in a selected state, and the reply control is configured to trigger the execution of the second information sending operation.

[0127] Optionally, the recommendation information includes object information of a target object, where the target object is an associated object of at least part of the information content in the target text information.

[0128] Optionally, at least part of the information content is a preset keyword, and the first recommended information display module 1203 can be specifically used to: in response to the target audio data containing a target audio segment, display the recommended information associated with the target object in the second area of ​​the preset interface, and the target audio segment is an audio segment that broadcasts the preset keyword; and / or, in response to the target text information containing the preset keyword, display the recommended information associated with the target object in the second area of ​​the preset interface.

[0129] Optionally, the preset keyword is displayed in the first area using a first display style, and the information content in the target text information other than the preset keyword is displayed in the first area using a second display style.

[0130] Optionally, the preset keyword is a keyword corresponding to an audio theme of the target audio data.

[0131] Optionally, the recommendation information includes content introduction information of the target text information, and the content introduction information includes content description information and / or key node information.

[0132] Optionally, the key node information is configured to trigger switching of the target audio data to a key node corresponding to the key node information and / or displaying information content corresponding to the key node information in the target text information in the first area.

[0133] Optionally, the first recommendation information display module 1203 may be specifically used to: display recommendation information and at least one interactive control corresponding to the recommendation information in the second area of ​​the preset interface, and the interactive control is configured to trigger the execution of an interactive operation associated with the recommendation information.

[0134] Optionally, the interactive control includes an information sending control, and the sending control is configured to send the recommended information using an information sending method corresponding to the sending control, and different sending controls correspond to different information sending methods.

[0135] Optionally, the second area displays at least one recommendation control, and different recommendation controls correspond to different information recommendation themes. The information display device may also include: a second recommendation information display module, used to respond to the triggering operation of the target recommendation control in the at least one recommendation control, and display the recommendation information corresponding to the target recommendation theme in the second area, and the target recommendation theme is the recommendation theme corresponding to the target recommendation control.

[0136] Optionally, the information display event includes a call event, and the target audio data is the audio data of the call event, and the call event includes at least one of an audio call event and a video call event; or, the information display event includes a media content display event, and the target audio data is the audio data of the target media content corresponding to the media content display event; or, the information display event includes a multi-person conference event, and the target audio data is the conference audio data of the multi-person conference event.

[0137] Optionally, the target text information and the recommended information support being displayed during the execution of the information display event.

[0138] Optionally, the information content of the target text information and / or the recommendation information is displayed in the form of session information.

[0139] The information display device provided in the embodiment of the present disclosure can execute the information display method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of executing the information display method. For technical details not described in detail in this embodiment, please refer to the information display method provided in any embodiment of the present disclosure.

[0140] Reference below Fig.13, which shows a schematic diagram of the structure of an electronic device (e.g., terminal device) 1300 suitable for implementing the embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.13 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0141] like Fig.13 As shown, the electronic device 1300 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from a storage device 1308 to a random access memory (RAM) 1303. In the RAM 1303, various programs and data required for the operation of the electronic device 1300 are also stored. The processing device 1301, the ROM 1302, and the RAM 1303 are connected to each other via a bus 1304. An input / output (I / O) interface 1305 is also connected to the bus 1304.

[0142] Typically, the following devices may be connected to the I / O interface 1305: an input device 1306 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1307 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1308 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1309. The communication device 1309 may allow the electronic device 1300 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.13 The electronic device 1300 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0143] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1309, or installed from the storage device 1308, or installed from the ROM 1302. When the computer program is executed by the processing device 1301, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0144] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0145] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0146] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0147] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: obtains target audio data corresponding to the information display event; in response to the information display event, displays target text information corresponding to the target audio data in the first area of ​​the preset interface, and the target text information is generated by performing voice recognition on the target audio data; and displays recommended information in the second area of ​​the preset interface, and the recommended information is associated with at least part of the information content of the target text information.

[0148] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0149] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0150] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a module does not, in some cases, constitute a limitation on the unit itself.

[0151] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0152] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0153] According to one or more embodiments of the present disclosure, Example 1 provides an information display method, including:

[0154] Obtain target audio data corresponding to the information display event;

[0155] In response to the information display event, displaying target text information corresponding to the target audio data in a first area of ​​a preset interface, the target text information being generated by performing speech recognition on the target audio data;

[0156] The recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least part of the information content of the target text information.

[0157] According to one or more embodiments of the present disclosure, Example 2 is based on the method described in Example 1, wherein the recommendation information includes reply information of target conversation information, and the target conversation information is generated based on at least part of the information content of the target text information.

[0158] According to one or more embodiments of the present disclosure, Example 3 is the method according to Example 2, wherein displaying the recommendation information in the second area of ​​the preset interface includes:

[0159] In response to a preset triggering operation based on the target text information, displaying the target conversation information in the information display sub-area of ​​the second area;

[0160] In response to the display of the target session information, recommended information for the target session information is displayed in the information display sub-area.

[0161] According to one or more embodiments of the present disclosure, Example 4 is the method according to Example 3, wherein in response to a preset trigger operation based on the target text information, displaying the target conversation information in the information display sub-area of ​​the second area includes:

[0162] In response to a first preset trigger operation for at least a portion of the information content in the target text information, inputting the at least a portion of the information content into the information input sub-area of ​​the second area;

[0163] In response to the first information sending operation, the content input in the information input sub-area is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

[0164] According to one or more embodiments of the present disclosure, Example 5 is a method according to Example 3, wherein in response to a preset trigger operation based on the target text information, displaying the target conversation information in the information display sub-area of ​​the second area includes:

[0165] In response to a second preset trigger operation for at least part of the information content in the target text information, the at least part of the information content is used as the information content of the target conversation information, and the target conversation information is displayed in the information display sub-area of ​​the second area.

[0166] According to one or more embodiments of the present disclosure, Example 6 is the method according to Example 3, wherein in response to a preset trigger operation based on the target text information, displaying the target conversation information in the information display sub-area of ​​the second area includes:

[0167] In response to a third preset trigger operation on at least a portion of the information content in the target text information, displaying the at least a portion of the information content as a selected state;

[0168] In response to the second information sending operation, the information content in the target text information that is in a selected state is used as the information content of the target conversation information, and the target conversation information is displayed in the information display sub-area of ​​the second area.

[0169] According to one or more embodiments of the present disclosure, Example 7 is the method according to Example 6, further comprising:

[0170] In response to a third preset trigger operation for at least part of the information content in the target text message, preset prompt information and / or reply controls are displayed, wherein the preset prompt information is used to prompt the information content in the target text message that is in a selected state, and the reply control is configured to trigger execution of the second information sending operation.

[0171] According to one or more embodiments of the present disclosure, Example 8 is based on the method described in Example 1, wherein the recommendation information includes object information of a target object, and the target object is an associated object of at least part of the information content in the target text information.

[0172] According to one or more embodiments of the present disclosure, Example 9 is the method according to Example 8, wherein at least part of the information content is a preset keyword, and displaying the recommended information in the second area of ​​the preset interface includes:

[0173] In response to the target audio data including a target audio segment, displaying recommendation information associated with the target object in the second area of ​​the preset interface, wherein the target audio segment is an audio segment that broadcasts a preset keyword; and / or

[0174] In response to the target text information containing the preset keyword, recommended information associated with the target object is displayed in the second area of ​​the preset interface.

[0175] According to one or more embodiments of the present disclosure, Example 10 is based on the method described in Example 9, wherein the preset keywords are displayed in the first area using a first display style, and the information content in the target text information other than the preset keywords is displayed in the first area using a second display style.

[0176] According to one or more embodiments of the present disclosure, Example 11 is the method according to Example 9, wherein the preset keyword is a keyword corresponding to the audio theme of the target audio data.

[0177] According to one or more embodiments of the present disclosure, Example 12 is based on the method described in Example 1, wherein the recommendation information includes content introduction information of the target text information, and the content introduction information includes content description information and / or key node information.

[0178] According to one or more embodiments of the present disclosure, Example 13 is based on the method described in Example 12, wherein the key node information is configured to trigger switching of the target audio data to a key node corresponding to the key node information and / or displaying information content corresponding to the key node information in the target text information in the first area.

[0179] According to one or more embodiments of the present disclosure, Example 14 is a method according to any one of Examples 1-13, wherein displaying the recommendation information in the second area of ​​the preset interface includes:

[0180] The recommended information and at least one interactive control corresponding to the recommended information are displayed in the second area of ​​the preset interface, and the interactive control is configured to trigger the execution of an interactive operation associated with the recommended information.

[0181] According to one or more embodiments of the present disclosure, Example 15 is based on the method described in Example 14, wherein the interactive control includes an information sending control, and the sending control is configured to send the recommended information using an information sending method corresponding to the sending control, and the information sending methods corresponding to different sending controls are different.

[0182] According to one or more embodiments of the present disclosure, Example 16 is a method according to any one of Examples 1-13, wherein the second area displays at least one recommendation control, and different recommendation controls correspond to different information recommendation topics, and the method further includes:

[0183] In response to a triggering operation on a target recommendation control among the at least one recommendation control, recommendation information corresponding to a target recommendation theme is displayed in the second area, and the target recommendation theme is a recommendation theme corresponding to the target recommendation control.

[0184] According to one or more embodiments of the present disclosure, Example 17 is a method according to any one of Examples 1-13, wherein the information display event includes a call event, the target audio data is audio data of the call event, and the call event includes at least one of an audio call event and a video call event; or

[0185] The information display event includes a media content display event, and the target audio data is audio data of a target media content corresponding to the media content display event; or

[0186] The information display event includes a multi-person conference event, and the target audio data is conference audio data of the multi-person conference event.

[0187] According to one or more embodiments of the present disclosure, Example 18 is based on the method described in Example 17, and the target text information and the recommended information support being displayed during the execution of the information display event.

[0188] According to one or more embodiments of the present disclosure, Example 19 is based on the method described in any one of Examples 1-13, and the information content of the target text information and / or the recommendation information are displayed in the form of session information.

[0189] According to one or more embodiments of the present disclosure, Example 20 provides an information display device, including:

[0190] A data acquisition module, used to acquire target audio data corresponding to the information display event;

[0191] A text information display module, configured to display target text information corresponding to the target audio data in a first area of ​​a preset interface in response to the information display event, wherein the target text information is generated by performing speech recognition on the target audio data;

[0192] The first recommendation information display module is used to display recommendation information in the second area of ​​the preset interface, where the recommendation information is associated with at least part of the information content of the text information.

[0193] According to one or more embodiments of the present disclosure, Example 21 provides an electronic device, including:

[0194] one or more processors;

[0195] a memory for storing one or more programs,

[0196] When the one or more programs are executed by the one or more processors, the one or more processors implement the information display method as described in any one of Examples 1-19.

[0197] According to one or more embodiments of the present disclosure, Example 22 provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the information display method as described in any one of Examples 1-19.

[0198] According to one or more embodiments of the present disclosure, Example 23 provides a computer program product. When the computer program product is executed by a computer, the computer implements the information display method as described in any one of Examples 1-19.

[0199] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0200] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0201] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. An information display method, characterized in that: include: Obtain target audio data corresponding to the information display event; In response to the information display event, displaying target text information corresponding to the target audio data in a first area of ​​a preset interface, the target text information being generated by performing speech recognition on the target audio data; The recommended information is displayed in the second area of ​​the preset interface, and the recommended information is associated with at least part of the information content of the target text information.

2. The method according to claim 1, characterized in that The recommendation information includes reply information of target conversation information, and the target conversation information is generated based on at least a part of information content of the target text information.

3. The method according to claim 2, characterized in that The displaying of the recommended information in the second area of ​​the preset interface includes: In response to a preset triggering operation based on the target text information, displaying the target conversation information in the information display sub-area of ​​the second area; In response to the display of the target session information, recommended information for the target session information is displayed in the information display sub-area.

4. The method according to claim 3, characterized in that The step of displaying the target conversation information in the information display sub-area of ​​the second area in response to a preset triggering operation based on the target text information includes: In response to a first preset trigger operation for at least a portion of the information content in the target text information, inputting the at least a portion of the information content into the information input sub-area of ​​the second area; In response to the first information sending operation, the content input in the information input sub-area is used as the information content of the target session information, and the target session information is displayed in the information display sub-area of ​​the second area.

5. The method according to claim 3, characterized in that: The step of displaying the target conversation information in the information display sub-area of ​​the second area in response to a preset triggering operation based on the target text information includes: In response to a second preset trigger operation for at least part of the information content in the target text information, the at least part of the information content is used as the information content of the target conversation information, and the target conversation information is displayed in the information display sub-area of ​​the second area.

6. The method according to claim 3, characterized in that The step of displaying the target conversation information in the information display sub-area of ​​the second area in response to a preset triggering operation based on the target text information includes: In response to a third preset trigger operation on at least a portion of the information content in the target text information, displaying the at least a portion of the information content as a selected state; In response to the second information sending operation, the information content in the target text information that is in a selected state is used as the information content of the target conversation information, and the target conversation information is displayed in the information display sub-area of ​​the second area.

7. The method according to claim 6, characterized in that Also includes: In response to a third preset trigger operation for at least part of the information content in the target text message, preset prompt information and / or reply controls are displayed, wherein the preset prompt information is used to prompt the information content in the target text message that is in a selected state, and the reply control is configured to trigger execution of the second information sending operation.

8. The method according to claim 1, characterized in that The recommendation information includes object information of a target object, where the target object is an associated object of at least part of the information content in the target text information.

9. The method according to claim 8, characterized in that The at least part of the information content is a preset keyword, and the displaying of the recommended information in the second area of ​​the preset interface includes: In response to the target audio data including a target audio segment, displaying recommendation information associated with the target object in the second area of ​​the preset interface, wherein the target audio segment is an audio segment that broadcasts a preset keyword; and / or In response to the target text information containing the preset keyword, recommended information associated with the target object is displayed in the second area of ​​the preset interface.

10. The method according to claim 9, characterized in that The preset keyword is displayed in the first area using a first display style, and the information content in the target text information other than the preset keyword is displayed in the first area using a second display style.

11. The method according to claim 9, characterized in that The preset keyword is a keyword corresponding to the audio theme of the target audio data.

12. The method according to claim 1, characterized in that The recommendation information includes content introduction information of the target text information, and the content introduction information includes content description information and / or key node information.

13. The method according to claim 12, characterized in that The key node information is configured to trigger switching of the target audio data to a key node corresponding to the key node information and / or displaying information content corresponding to the key node information in the target text information in the first area.

14. The method according to any one of claims 1 to 13, characterized in that: The displaying of the recommended information in the second area of ​​the preset interface includes: The recommended information and at least one interactive control corresponding to the recommended information are displayed in the second area of ​​the preset interface, and the interactive control is configured to trigger the execution of an interactive operation associated with the recommended information.

15. The method according to claim 14, characterized in that The interactive control includes an information sending control, and the sending control is configured to send the recommended information using an information sending method corresponding to the sending control, and different sending controls correspond to different information sending methods.

16. The method according to any one of claims 1 to 13, characterized in that: The second area displays at least one recommendation control, and different recommendation controls correspond to different information recommendation topics. The method further includes: In response to a triggering operation on a target recommendation control among the at least one recommendation control, recommendation information corresponding to a target recommendation theme is displayed in the second area, and the target recommendation theme is a recommendation theme corresponding to the target recommendation control.

17. The method according to any one of claims 1 to 13, characterized in that: The information display event includes a call event, the target audio data is audio data of the call event, and the call event includes at least one of an audio call event and a video call event; or The information display event includes a media content display event, and the target audio data is audio data of a target media content corresponding to the media content display event; or The information display event includes a multi-person conference event, and the target audio data is conference audio data of the multi-person conference event.

18. The method according to claim 17, characterized in that The target text information and the recommended information support being displayed during the execution of the information display event.

19. The method according to any one of claims 1 to 13, characterized in that: The information content of the target text information and / or the recommended information is displayed in the form of session information.

20. An information display device, characterized in that: include: A data acquisition module, used to acquire target audio data corresponding to the information display event; A text information display module, configured to display target text information corresponding to the target audio data in a first area of ​​a preset interface in response to the information display event, wherein the target text information is generated by performing speech recognition on the target audio data; The first recommendation information display module is used to display recommendation information in the second area of ​​the preset interface, where the recommendation information is associated with at least part of the information content of the text information.

21. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the information presentation method according to any one of claims 1 to 19.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the information display method according to any one of claims 1 to 19 when executed.

23. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the information presentation method according to any one of claims 1 to 19 is implemented.

Images