Real-time multimedia interaction processing method, device and equipment

Abstract

The embodiment of the invention provides a real-time multimedia interaction processing method, device and equipment, and the method comprises the steps: responding to the detection of a first instruction for indicating a client to exit real-time multimedia interaction, and ending the display of a real-time multimedia interaction picture in a real-time multimedia interaction window; and displaying at least part of an interaction summary in the real-time multimedia interaction window, the interaction summary being generated based on the existing content of the client during the real-time multimedia interaction. The operation of obtaining the interactive summary by the user is simplified, and the efficiency of obtaining the interactive summary by the user is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer and Internet technology, and in particular, to a method, device and equipment for processing real-time multimedia interaction. Background Art

[0002] Multiple users at different locations can conduct real-time multimedia interactions, such as video conferencing and live broadcasting, etc. In real-time multimedia interactions, different users can communicate information through voice, images, etc.

[0003] Currently, the timing for users to obtain summary information of real-time multimedia interactions is not flexible enough, and the user operation path is not friendly enough, resulting in low efficiency for users to obtain summary information of real-time multimedia interactions. Summary of the invention

[0004] The embodiments of the present disclosure provide a method, device and equipment for processing real-time multimedia interaction.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for processing real-time multimedia interaction, comprising: in response to detecting a first instruction instructing a client to exit the real-time multimedia interaction, ending the display of the real-time multimedia interaction screen in the real-time multimedia interaction window; and displaying at least a portion of the interaction summary in the real-time multimedia interaction window, wherein the interaction summary is generated based on existing content of the client during the real-time multimedia interaction.

[0006] In a second aspect, an embodiment of the present disclosure provides a method for processing real-time multimedia interaction, comprising: in response to a target client exiting the real-time multimedia interaction, stopping sending the real-time multimedia interaction screen to the target client; sending an interaction summary display instruction to the target client; wherein the interaction summary is generated based on existing real-time multimedia interaction content; and the target client displays the interaction summary in the real-time multimedia interaction window according to the display instruction.

[0007] In a third aspect, an embodiment of the present disclosure provides a processing device for real-time multimedia interaction, comprising: a first display unit, for ending display of the real-time multimedia interaction screen in the real-time multimedia interaction window in response to detecting a first instruction instructing the client to exit the real-time multimedia interaction; and a second display unit, for displaying at least a portion of the interaction summary in the real-time multimedia interaction window, wherein the interaction summary is generated based on existing content of the client during the real-time multimedia interaction.

[0008] In a fourth aspect, an embodiment of the present disclosure provides a real-time multimedia interaction processing device, comprising: a first sending unit, for stopping sending real-time multimedia interaction pictures to the target client in response to the target client exiting the real-time multimedia interaction; a second sending unit, for sending an interaction summary display instruction to the target client; wherein the interaction summary is generated based on existing real-time multimedia interaction content; and the target client displays the interaction summary in the real-time multimedia interaction window according to the display instruction.

[0009] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0010] The memory stores computer-executable instructions;

[0011] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the method described in the first aspect, the second aspect, and various possible designs of the first aspect and the second aspect.

[0012] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the method described in the first aspect, the second aspect, and various possible designs of the first aspect and the second aspect is implemented.

[0013] In a seventh aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the methods described in the first aspect, the second aspect, and various possible designs of the first aspect and the second aspect.

[0014] The processing method, device and equipment for real-time multimedia interaction provided in this embodiment, in response to detecting a first instruction instructing the client to exit the real-time multimedia interaction, ends displaying the real-time multimedia interaction screen in the real-time multimedia interaction window; and displays at least part of the interaction summary in the real-time multimedia interaction window, wherein the interaction summary is generated based on the existing content of the client during the real-time multimedia interaction. Therefore, when the client exits the real-time multimedia interaction, the interaction summary can be browsed in the window that originally displayed the real-time multimedia interaction screen, which improves the flexibility of displaying the interaction summary information. In addition, the user can browse the interaction summary corresponding to the current real-time multimedia interaction content without other operations, which simplifies the operation of the user obtaining the interaction summary and improves the efficiency of the user obtaining the interaction summary. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0016] Figure 1 A schematic diagram of an application scenario provided by the present disclosure;

[0017] Figure 2 A schematic diagram of a processing method for real-time multimedia interaction provided in an embodiment of the present disclosure Figure 1 ;

[0018] Figure 3 A schematic diagram of a processing method for real-time multimedia interaction provided in an embodiment of the present disclosure Figure 2 ;

[0019] Figure 4 A schematic diagram of a processing method for real-time multimedia interaction provided in an embodiment of the present disclosure Figure 3 ;

[0020] Figure 5 A schematic diagram of a processing method for real-time multimedia interaction provided in an embodiment of the present disclosure Figure 4 ;

[0021] Figure 6 A schematic diagram of a process flow of a real-time multimedia interaction processing method provided by an embodiment of the present disclosure;

[0022] Figure 7 A structural block diagram of a real-time multimedia interaction processing device provided in an embodiment of the present disclosure;

[0023] Figure 8 A schematic diagram of the structure of a real-time multimedia interaction processing device provided in an embodiment of the present disclosure;

[0024] Fig. 9 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0026] Figure 1A schematic diagram of an application scenario is shown, such as Figure 1 As shown, user 1, user 2 and user 3 use terminal device A, terminal device B and terminal device C respectively to perform real-time multimedia interaction. Usually, terminal devices A, B and C can run application clients that support real-time multimedia interaction. Terminal devices A, B and C are connected to each other by wired or wireless means. User 1, user 2 and user 3 use application clients on terminal devices A, B and C respectively to perform real-time multimedia interaction. Schematically, user 1 can be the host, and user 2 and user 3 can be ordinary participating users.

[0027] In some application scenarios, the host can end the real-time multimedia interaction, and the application clients used by user 1, user 2 and user 3 respectively exit the real-time multimedia interaction. When the host ends the real-time multimedia interaction, user 2 and user 3 passively exit the real-time multimedia interaction.

[0028] User 2 or user 3 can actively exit the real-time multimedia interaction during the real-time multimedia interaction, and the real-time multimedia interaction will continue.

[0029] At present, usually after the real-time multimedia interaction ends, a card of the interaction summary is pushed to the participating users (including the host), and the participating users click the link of the interaction summary in the card to enter the interaction summary browsing page. The participating users enter the historical real-time multimedia interaction record of a real-time multimedia interaction in the real-time multimedia interaction list and view the interaction summary in the historical real-time multimedia interaction.

[0030] In these application scenarios, users need to wait until the real-time multimedia interaction ends and receive the interaction summary prompt card, or enter the historical real-time multimedia interaction record to search, and the waiting time for users to obtain the interaction summary is long. Therefore, there are currently problems such as the timing of obtaining the interaction summary is not flexible enough, the operation of obtaining the interaction summary is complicated, and the efficiency of obtaining the interaction summary from the user is low.

[0031] The real-time multimedia interaction processing method, device and electronic device provided by the present disclosure generate an interaction summary corresponding to the client according to the currently existing real-time multimedia interaction content when an instruction of the client to exit the real-time multimedia interaction is detected, and the interaction summary is displayed on the client. Therefore, when the user exits the real-time multimedia interaction, the interaction summary can be browsed in the window that originally displayed the real-time multimedia interaction screen. The user can browse the interaction summary corresponding to the current real-time multimedia interaction content without other operations, which improves the flexibility of obtaining the interaction summary, simplifies the operation of the user to obtain the interaction summary, and improves the efficiency of the user to obtain the interaction summary.

[0032] Please refer to Figure 2 , Figure 2Schematic diagram of the processing method for real-time multimedia interaction provided by the present disclosure Figure 1 .like Figure 2 As shown, the method comprises the following steps:

[0033] S201: In response to detecting a first instruction instructing the client to exit the real-time multimedia interaction, ending the display of the real-time multimedia interaction screen in the real-time multimedia interaction window.

[0034] Users can use the application client (referred to as client) running in the terminal device to conduct real-time multimedia interaction with other users. Users participating in real-time multimedia interaction are considered participating users. During the real-time multimedia interaction between participating users, the client used by each participating user can display a real-time multimedia interaction window, and the real-time multimedia interaction window can display the real-time multimedia interaction screen. The real-time multimedia interaction screen can include, for example, the avatar and / or user identification of the participating user, and can also include the content screen shared by the participating users.

[0035] Real-time multimedia interaction may include but is not limited to real-time online interaction such as video conferencing and live broadcasting.

[0036] The execution subject of the processing method of real-time multimedia interaction in the present disclosure can be any terminal device used by users participating in the real-time multimedia interaction.

[0037] The execution subject (eg, terminal device) may detect whether a first instruction instructing the client to exit the real-time multimedia interaction is received during the real-time multimedia interaction.

[0038] In some implementations, the first instruction includes:

[0039] An instruction to actively exit the real-time multimedia interaction issued by the user of the client; or

[0040] An instruction to exit real-time multimedia interaction that is automatically generated due to the end of real-time multimedia interaction.

[0041] The following description takes video conferencing as an example.

[0042] In some application scenarios, the first instruction may be issued by a participant using the client, for example, the first instruction is issued by the participant performing a trigger operation on a first control in a video conference interface. The first control is a control for exiting a video conference. In these application scenarios, the first instruction is an instruction to actively exit a video conference.

[0043] The above-mentioned first instruction may also be an instruction to exit the video conference automatically generated due to the end of the video conference. For example, after a participant with preset permissions ends the video conference, the first instruction received by the client of other participants is an instruction to exit the video conference automatically generated due to the end of the video conference. It should be pointed out that when a participant with preset permissions ends the video conference, the client of the user with preset permissions receives an instruction to actively exit the video conference.

[0044] In these embodiments, the above-mentioned first instruction can be an instruction to actively exit the real-time multimedia interaction issued by the operation of the user using the client, or it can be an instruction to exit the real-time multimedia interaction automatically generated due to the end of the real-time multimedia interaction. For the above-mentioned various instructions to exit the real-time multimedia interaction, the client can present an interaction summary, which facilitates the user's summary understanding of the real-time multimedia interaction content and improves the flexibility of the interaction summary display.

[0045] When the first instruction is detected, the execution subject may stop displaying the real-time multimedia interaction screen in the real-time multimedia interaction window, but the real-time multimedia interaction window is not closed.

[0046] S202: Display at least part of the interaction summary in the real-time multimedia interaction window, wherein the interaction summary is generated based on existing content during the real-time multimedia interaction of the client.

[0047] After the real-time multimedia interaction screen is displayed due to the reception of the first instruction in step S201, the real-time multimedia interaction window is not closed, but after the display of the real-time multimedia interaction screen is finished, the interaction summary information is displayed. The above interaction summary can be obtained by summarizing the existing real-time multimedia interaction content. That is, after receiving the first instruction of the client to exit the real-time multimedia interaction, the interaction summary is presented after the real-time multimedia interaction screen is stopped from being displayed in the real-time multimedia interaction window. The user can browse the summary information of the existing real-time multimedia interaction content.

[0048] In some application scenarios, when a participating user sends the above-mentioned first instruction to the client to exit the real-time multimedia interaction during the real-time multimedia interaction process, an interaction summary corresponding to the participating user is generated based on the existing content of the client during the real-time multimedia interaction period, and presented to the participating user in the real-time multimedia interaction window, so that the participating user can quickly understand the existing content.

[0049] In some application scenarios, a participating user who has the authority to end the real-time multimedia interaction issues a first instruction to end the real-time multimedia interaction. The clients used by all participating users of the real-time multimedia interaction can end displaying the real-time multimedia interaction screen and display an interaction summary generated by all real-time multimedia interaction content in the real-time multimedia interaction window.

[0050] In this embodiment, if the first instruction instructing the client to exit the real-time multimedia interaction is detected, the display of the real-time multimedia interaction screen in the real-time multimedia interaction window ends, and the interaction summary of the existing content is displayed in the real-time multimedia interaction window. Therefore, when exiting the real-time multimedia interaction, the user can browse the interaction summary in the window that originally displayed the real-time multimedia interaction screen. The user can view the interaction summary of the real-time multimedia interaction without other operations, which simplifies the operation of the user to obtain the interaction summary and improves the efficiency of providing the interaction summary to the user. The flexibility of obtaining the interaction summary is improved.

[0051] In some embodiments, the above step S202 includes:

[0052] In response to satisfying a preset condition, displaying at least part of the interaction summary in the real-time multimedia interaction window, wherein the preset condition includes at least one of the following:

[0053] The owner of the real-time multimedia interaction turns on the interaction summary generation function;

[0054] The number of topics for which corresponding summary content has been generated in the interaction summary is greater than the preset number.

[0055] In these embodiments, the owner of the real-time multimedia interaction may be, for example, the organizer of the real-time multimedia interaction. The owner of the real-time multimedia interaction may have the right to use the interaction summary generation function and may have enabled the interaction summary generation function. If the owner of the real-time multimedia interaction has enabled the interaction summary generation function, it may be considered that the preset condition is met.

[0056] The interaction summary may include summary contents corresponding to a plurality of topics. If the number of topics for which summary contents are generated included in the interaction summary is greater than a preset number, it may be considered that the preset condition is satisfied.

[0057] In some optional implementations of this embodiment, the method further includes:

[0058] When the information of the interaction summary is displayed, in response to a real-time multimedia interaction window closing instruction, the real-time multimedia interaction window is closed.

[0059] For example, the information display interface of the interaction summary presents a second control for closing the real-time multimedia interaction window, and in response to receiving a trigger operation on the second control, the real-time multimedia interaction window is closed, which provides convenience for the user to close the real-time multimedia interaction window.

[0060] In some optional implementations of this embodiment, the method further includes:

[0061] In real-time multimedia interaction, when switching to other real-time multimedia interaction according to user operation and exiting the real-time multimedia interaction due to switching, the interaction summary of the exited real-time multimedia interaction is not displayed. It can realize fast switching to other real-time multimedia interaction.

[0062] In some optional implementations of this embodiment, the method further includes: when the client of the real-time multimedia interaction is in a sharing state and receives a first instruction triggered by the end of the real-time multimedia interaction, the client in the sharing state exits the main sharing screen, displays the real-time multimedia interaction window, and displays the information of the interaction summary in the real-time multimedia interaction window. Thus, when the client of the sharing user exits the real-time multimedia interaction due to the end of the real-time multimedia interaction, the interaction summary of the real-time multimedia interaction can also be displayed.

[0063] In some optional implementations of this embodiment, in response to the first participating user being removed from the real-time multimedia interaction, the client of the participating user directly exits the real-time multimedia interaction without displaying the interaction summary. After the first participating user is removed from the real-time multimedia interaction, the participating user identity is lost. Therefore, after the first participating user is removed from the real-time multimedia interaction, the interaction summary will not be displayed to the first participating user, thereby improving information security.

[0064] In some embodiments, the interaction summary of the real-time multimedia interaction is generated based on the following method:

[0065] One or more topics in the existing content are summarized separately to generate an interactive summary including the content summary of each topic.

[0066] Specifically, the following steps may be included:

[0067] First, based on semantic recognition, one or more topics and part of the existing content related to each topic are identified from the above existing content.

[0068] Secondly, summarize the existing content corresponding to each topic to obtain the summary content corresponding to each topic.

[0069] Finally, an interactive summary is generated that includes summary content corresponding to each topic.

[0070] The existing content of the client during the real-time multimedia interaction may be the content generated in the real-time multimedia interaction until the moment when the client receives the above-mentioned first instruction.

[0071] The above existing content can be converted into text content, and semantic analysis can be performed on the text content. One or more topics can be determined based on the semantic analysis results, and part of the existing content corresponding to each topic can be determined.

[0072] For each topic, text content processing tools can be used to summarize the existing content corresponding to the topic, such as extracting keywords from the existing content, splicing keywords, etc., to obtain the summary content of the topic.

[0073] The summary contents of each topic may be sorted according to the chronological order of the start time, and an interactive summary may be formed based on the sorted summary contents of each topic.

[0074] In some implementations, summarizing one or more topics in the existing content to generate an interactive summary including a content summary of each topic includes the following steps:

[0075] First, generate prompt information including the above existing content;

[0076] Secondly, the prompt information is input into the content generation model, and the content generation model summarizes the content of one or more topics in the existing content and outputs an interactive summary including the content summary of each topic.

[0077] The content generation model may be any model with natural language processing capabilities. The prompt information may also include topic identification logic, logic for identifying existing content corresponding to the topic, and logic for generating summary content for the topic.

[0078] After the above prompt information is input into the content generation model, the content generation model can process the existing content according to the above logic in the prompt information and output the above interaction summary.

[0079] In these embodiments, prompt information is generated and input into a content generation model, whereupon the content generation model generates an interactive summary including summary content of one or more topics based on the prompt information. This can improve the efficiency of generating the interactive summary and help improve the real-time performance of displaying the interactive summary.

[0080] Please refer to Figure 3 , Figure 3 Schematic diagram of the processing method for real-time multimedia interaction provided by the present disclosure Figure 1 .like Figure 3 As shown, the method comprises the following steps:

[0081] S301: In response to detecting a first instruction instructing the client to exit the real-time multimedia interaction, ending the display of the real-time multimedia interaction screen in the real-time multimedia interaction window.

[0082] The specific implementation of the above step S301 can refer to Figure 2 The description of step S201 of the illustrated example is not repeated here.

[0083] S302: Displaying a partial interaction summary in the real-time multimedia interaction window, wherein the partial interaction summary is obtained by folding or intercepting the entire interaction summary, and the interaction summary is generated based on existing content during the client's real-time multimedia interaction.

[0084] The interaction summary can be collapsed, and the collapsed interaction summary can display a part of the summary.

[0085] The content of the interaction summary can also be intercepted, and part of the interaction summary can be displayed in the above-mentioned real-time multimedia interaction window.

[0086] S303: In response to the detail viewing instruction, display all contents of the interaction summary; wherein the detail viewing instruction is used to view the details of the interaction summary.

[0087] In the real-time multimedia interactive window that displays a partial interactive summary, a detail viewing control may be displayed. The user may perform a trigger operation on the detail viewing control to initiate a detail viewing instruction for the interactive summary. After receiving the detail viewing instruction, the execution subject displays the entire content of the interactive summary.

[0088] In this embodiment, after receiving the first instruction, a partial interaction summary is displayed in the real-time multimedia interaction window, which is conducive to the client to quickly render and display the information of the above interaction summary. When the user views the details, the entire content of the interaction summary can be displayed, providing convenience for the user to browse the entire content of the interaction summary.

[0089] Please refer to Figure 4 , Figure 4 Schematic diagram of the processing method for real-time multimedia interaction provided by the present disclosure Figure 3 .like Figure 4 As shown, the method comprises the following steps:

[0090] S401: In response to detecting a first instruction triggering the real-time multimedia interaction floating window, closing the real-time multimedia interaction floating window and retaining the real-time multimedia interaction main window running in the background.

[0091] The above-mentioned real-time multimedia interactive floating window can be obtained by performing a small window display operation on the real-time multimedia interactive window, and can be displayed on other task windows.

[0092] The user may execute a first instruction on the real-time multimedia interactive floating window. Upon receiving the first instruction, the real-time multimedia interactive floating window may be closed, and the main window of the real-time multimedia interactive window running in the background may be retained.

[0093] S402: In response to a foreground display operation triggered on the main window, display at least part of the content of the interaction summary when the main window runs in the foreground.

[0094] The following describes video conferencing using real-time multimedia interaction.

[0095] The client can be run in a terminal device such as a desktop computer or a portable computer. In the terminal device, the video conference can be displayed in a floating window, and the floating window can display a video conference logo and one or more controls. The terminal device can display other task windows in the foreground, and the floating window can be displayed in an area of ​​the screen of the terminal device. When receiving the first instruction, the client can close the floating window and retain the main window of the video conference running in the background.

[0096] The client can load at least part of the content of the conference summary into the main window. When the main window is running in the foreground, at least part of the content of the conference summary can be displayed to the user.

[0097] In this embodiment, if the real-time multimedia interaction is displayed in a floating window when the first instruction is received, the floating window is closed and the main window is not popped up, so as not to disturb the user's processing of other tasks in the window running in the foreground. In addition, when the main window of the real-time multimedia interaction is placed in the foreground, at least part of the interaction summary of the real-time multimedia interaction can be displayed to the user, which helps the user understand the content of the real-time multimedia interaction.

[0098] Please refer to Figure 5 , Figure 5 Schematic diagram of the processing method for real-time multimedia interaction provided by the present disclosure Figure 4 .like Figure 5 As shown, the method comprises the following steps:

[0099] S501: In response to detecting a first instruction triggering the real-time multimedia interactive floating window, closing the real-time multimedia interactive floating window.

[0100] S502: Display a main window of real-time multimedia interaction, and load at least part of the content of the interaction summary into the main window.

[0101] The following description still uses video conferencing as an example.

[0102] In this embodiment, the client can be run in a mobile terminal device such as a mobile phone. In the mobile terminal device, the video conference screen can be displayed in a floating window, and other windows can also be displayed on the screen of the mobile terminal device. The floating window is suspended above the other windows, and the floating window can display a reduced screen of the video conference. Upon receiving the first instruction, the client can close the floating window and display the main window of the video conference. At least part of the conference summary is displayed in the main window.

[0103] In this embodiment, if the real-time multimedia interaction screen is displayed in a floating window when the first instruction is received, the real-time multimedia interaction floating window is closed, and the real-time multimedia interaction main window is popped up, and at least part of the interaction summary of the real-time multimedia interaction is displayed to the user in the real-time multimedia interaction main window. This helps the user understand the content of the real-time multimedia interaction.

[0104] Please refer to Figure 6 , Figure 6 The following is a flow chart of the processing method of real-time multimedia interaction provided by the present disclosure. Figure 6 As shown, the method comprises the following steps:

[0105] S601: In response to the target client exiting the real-time multimedia interaction, stop sending the real-time multimedia interaction screen to the target client.

[0106] S602: Sending an interaction summary display instruction to the target client; wherein the interaction summary is generated according to the existing real-time multimedia interaction content; the target client displays the interaction summary in the real-time multimedia interaction window according to the display instruction.

[0107] In this embodiment, the execution subject of the real-time multimedia interaction processing method may be a server. During the real-time multimedia interaction process, the execution subject may distribute multimedia data generated during the real-time multimedia interaction process to each client participating in the real-time multimedia interaction.

[0108] The target client may be any one of the multiple clients participating in the real-time multimedia interaction.

[0109] If the target client actively exits the real-time multimedia interaction, the target client can send information about exiting the real-time multimedia interaction to the server. After receiving the information, the server can stop sending the real-time multimedia interaction screen to the target client. Send an interaction summary display instruction to the target client. The target client can display the interaction summary in the real-time multimedia interaction window according to the interaction summary display instruction.

[0110] If the participating user with preset authority in the real-time multimedia interaction ends the real-time multimedia interaction, the target client may include all participating clients. The server may stop sending the real-time multimedia interaction screen to these participating clients. Send an interaction summary display instruction to these participating clients. These participating clients may display the interaction summary in the real-time multimedia interaction window according to the interaction summary display instruction.

[0111] In this embodiment, by responding to the target client exiting the real-time multimedia interaction, stopping sending the real-time multimedia interaction screen to the target client, and then sending the interaction summary display instruction to the target client, the display of the interaction summary is controlled by the server, which is conducive to the unified control of the interaction summary display of different clients.

[0112] Corresponding to the above Figure 1 The processing method of real-time multimedia interaction of the embodiment, Figure 7 A structural block diagram of a real-time multimedia interactive processing device provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 7 The device 70 includes: a first display unit 701 and a second display unit 702.

[0113] A first display unit 701 is configured to terminate displaying the real-time multimedia interaction screen in the real-time multimedia interaction window in response to detecting a first instruction instructing the client to exit the real-time multimedia interaction; and

[0114] The second display unit 702 is used to display at least part of the interaction summary in the real-time multimedia interaction window, wherein the interaction summary is generated based on existing content during the real-time multimedia interaction of the client.

[0115] In some embodiments, the first instruction includes:

[0116] An instruction to actively exit the real-time multimedia interaction issued by the user of the client; or

[0117] An instruction to exit real-time multimedia interaction that is automatically generated due to the end of real-time multimedia interaction.

[0118] In some embodiments, the interaction summary may be generated based on:

[0119] One or more topics in the existing content are summarized separately to generate an interactive summary including the content summary of each topic.

[0120] In some embodiments, content summaries are performed on one or more topics in the existing content to generate interactive summaries including content summaries of each topic, including:

[0121] Generate prompt information including existing content;

[0122] The prompt information is input into the content generation model, and the content generation model summarizes the content of one or more topics in the existing content, and outputs an interactive summary including the content summary of each topic.

[0123] In some embodiments, the first display unit 701 is further used to: in response to detecting a first instruction triggering the real-time multimedia interaction floating window, close the real-time multimedia interaction floating window, and retain the main window of the real-time multimedia interaction running in the background;

[0124] The second display unit 702 is further configured to: in response to a foreground display operation triggered on the main window, display at least part of the content of the interaction summary when the main window runs in the foreground.

[0125] In some embodiments, the first display unit 701 is further used to: in response to detecting a first instruction triggering the real-time multimedia interaction floating window, close the real-time multimedia interaction floating window; the second display unit 702 is further used to: display the main window of the real-time multimedia interaction, and load at least part of the content of the interaction summary to the main window.

[0126] In some embodiments, a portion of the interaction summary is displayed in the real-time multimedia interaction window, where the portion of the interaction summary is obtained by folding or intercepting the entire interaction summary; and the second display unit 702 is further used to:

[0127] In response to the detail viewing instruction, all contents of the interaction summary are displayed; wherein the detail viewing instruction is used to view the details of the interaction summary.

[0128] In some embodiments, the second display unit 702 is further used to:

[0129] In response to satisfying a preset condition, displaying at least part of the interaction summary in the real-time multimedia interaction window, wherein the preset condition includes at least one of the following:

[0130] The owner of the real-time multimedia interaction turns on the interaction summary generation function;

[0131] The number of topics for which corresponding summary content has been generated in the interaction summary is greater than the preset number.

[0132] Corresponding to the above Figure 6 The processing method of real-time multimedia interaction of the embodiment, Figure 8 A structural block diagram of a real-time multimedia interactive processing device provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Figure 8 The real-time multimedia interaction processing device 80 includes: a first sending unit 801 and a second sending unit 802.

[0133] The first sending unit 801 is used for the first sending unit, which is used to stop sending the real-time multimedia interaction screen to the target client in response to the target client exiting the real-time multimedia interaction;

[0134] The second sending unit 802 is used to send an interaction summary display instruction to the target client; wherein the interaction summary is generated according to the existing real-time multimedia interaction content; the target client displays the interaction summary in the real-time multimedia interaction window according to the display instruction.

[0135] In order to implement the above embodiment, the embodiment of the present disclosure also provides an electronic device.

[0136] refer to Fig. 9 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers, portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0137] like Fig. 9 As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0138] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig. 9 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0139] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0140] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0141] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0142] The computer-readable medium carries one or more programs (computer-executable instructions). When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0143] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0144] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0145] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0146] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0147] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0148] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0149] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for processing real-time multimedia interaction, comprising: In response to detecting a first instruction instructing the client to exit the real-time multimedia interaction, ending the display of the real-time multimedia interaction screen in the real-time multimedia interaction window; as well as At least a portion of the interaction summary is displayed in the real-time multimedia interaction window, wherein the interaction summary is generated based on existing content during the real-time multimedia interaction of the client.

2. The method according to claim 1, characterized in that The first instruction includes: An instruction to actively exit the real-time multimedia interaction issued by the user of the client; or An instruction to exit real-time multimedia interaction that is automatically generated due to the end of real-time multimedia interaction.

3. The method according to claim 1, characterized in that The interaction summary is generated based on the following method: Content summaries are performed on one or more topics in the existing content to generate the interactive summary including the content summaries of the topics.

4. The method according to claim 3, characterized in that The step of summarizing the content of one or more topics in the existing content to generate the interactive summary including the content summary of each topic includes: generating prompt information including the existing content; The prompt information is input into a content generation model, and the content generation model summarizes the content of one or more topics in the existing content, and outputs the interaction summary including the content summary of each topic.

5. The method according to claim 1, characterized in that In response to detecting the first instruction instructing the client to exit the real-time multimedia interaction, ending the display of the real-time multimedia interaction screen in the real-time multimedia interaction window includes: In response to detecting a first instruction triggering the real-time multimedia interaction floating window, closing the real-time multimedia interaction floating window and retaining the real-time multimedia interaction main window running in the background; And displaying at least part of the interaction summary in the real-time multimedia interaction window comprises: In response to a foreground display operation triggered on the main window, at least part of the content of the interaction summary is displayed when the main window runs in the foreground.

6. The method according to claim 1, characterized in that In response to detecting the first instruction instructing the client to exit the real-time multimedia interaction, ending the display of the real-time multimedia interaction screen in the real-time multimedia interaction window includes: In response to detecting a first instruction that triggers the real-time multimedia interactive floating window, closing the real-time multimedia interactive floating window; and displaying at least part of the interactive summary in the real-time multimedia interactive window, comprising: The main window of the real-time multimedia interaction is displayed, and at least part of the content of the interaction summary is loaded into the main window.

7. The method according to any one of claims 1 to 6, characterized in that: The real-time multimedia interactive window displays a partial interactive summary, wherein the partial interactive summary is obtained by folding or intercepting the entire interactive summary; And the method further comprises: In response to a detail viewing instruction, all contents of the interaction summary are displayed; wherein the detail viewing instruction is used to view the details of the interaction summary.

8. The method according to any one of claims 1 to 6, characterized in that: The displaying of at least part of the interaction summary in the real-time multimedia interaction window comprises: In response to satisfying a preset condition, displaying at least part of the interaction summary in the real-time multimedia interaction window, wherein the preset condition includes at least one of the following: The owner of the real-time multimedia interaction turns on the interaction summary generation function; The number of topics for which corresponding summary contents are generated in the interaction summary is greater than a preset number.

9. The method according to any one of claims 1 to 6, characterized in that: The real-time multimedia interaction includes one of the following: Video conferencing, live streaming.

10. A method for processing real-time multimedia interaction, comprising: In response to the target client exiting the real-time multimedia interaction, stopping sending the real-time multimedia interaction screen to the target client; Sending an interactive summary display instruction to the target client; wherein the interactive summary is generated according to the existing real-time multimedia interactive content; The target client displays an interaction summary in the real-time multimedia interaction window according to the display instruction.

11. A real-time multimedia interactive processing device, comprising: A first display unit, configured to terminate displaying the real-time multimedia interaction screen in the real-time multimedia interaction window in response to detecting a first instruction instructing the client to exit the real-time multimedia interaction; as well as The second display unit is used to display at least part of the interaction summary in the real-time multimedia interaction window, wherein the interaction summary is generated based on existing content during the real-time multimedia interaction of the client.

12. A real-time multimedia interactive processing device, comprising: A first sending unit, configured to stop sending the real-time multimedia interaction screen to the target client in response to the target client exiting the real-time multimedia interaction; A second sending unit is used to send an interaction summary display instruction to the target client; wherein the interaction summary is generated according to the existing real-time multimedia interaction content; The target client displays an interaction summary in the real-time multimedia interaction window according to the display instruction.

13. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the method according to any one of claims 1 to 10 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Images