Live broadcast processing method and device, equipment, medium and product

Abstract

The embodiment of the invention provides a live broadcast processing method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: displaying a live broadcast page of a live broadcast room; wherein the live broadcast room is associated with a plurality of to-be-explained objects displayed in a first mode; the live broadcast page comprises a live broadcast video stream corresponding to the live broadcast room; and determining an object being explained in the plurality of objects to be explained according to the live broadcast video stream, and displaying the object being explained in the live broadcast page in a second mode. According to the technical scheme provided by the embodiment of the invention, the explained object in the live broadcasting room can be automatically identified, the time for manually searching and setting the explained object is saved, the explained object can be distinguished and displayed in the second mode, the to-be-explained object which is explained in the live broadcasting room can be quickly positioned, and the user experience is improved. The interaction mode of the live broadcast room is optimized, and the interaction experience of the live broadcast room is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer processing technology, and in particular to a live broadcast processing method, device, equipment, medium and product. Background Art

[0002] With the continuous development of Internet technology, more and more users are interacting with information through live broadcasts, for example, by explaining the target objects related to the live broadcast. With the diversification of live broadcast interactive information, users are paying more and more attention to the interactive experience in live broadcasts.

[0003] In the related art, for the object being explained in the live broadcast, it is necessary to manually find the object being explained in the object display area, and then click the start explanation control corresponding to the object to identify the object, so that users watching the live broadcast can quickly locate the object. When it is necessary to cancel or replace the object being explained, it is necessary to first click the end explanation control corresponding to the object to cancel the identification of the identified object. Since it is a manual operation, the operation is complicated, and there may be a situation where the anchor forgets to operate or needs to pause the live broadcast to operate to click the start explanation control or the end explanation control. In this case, the object being explained cannot be identified or correctly identified, which may make it difficult for users watching the live broadcast to quickly find the object being explained, thereby affecting the live interactive experience. Summary of the invention

[0004] The embodiments of the present disclosure provide a live broadcast processing method, apparatus, device, medium, and product to simplify the interactive operations related to the object being explained in the live broadcast room.

[0005] In a first aspect, an embodiment of the present disclosure provides a live broadcast processing method, the method comprising:

[0006] A live broadcast page of a live broadcast room is displayed; wherein the live broadcast room is associated with a plurality of objects to be explained displayed in a first manner; the live broadcast page includes a live video stream corresponding to the live broadcast room;

[0007] An object being explained among the multiple objects to be explained is determined according to the live video stream, and the object being explained is displayed in the live page in a second manner.

[0008] In a second aspect, the embodiment of the present disclosure further provides a live broadcast processing device, the device comprising:

[0009] A live page display module, used to display a live page of a live broadcast room; wherein the live broadcast room is associated with a plurality of objects to be explained displayed in a first manner; the live page includes a live video stream corresponding to the live broadcast room;

[0010] The explanation object display module is used to determine the object being explained among the multiple objects to be explained according to the live video stream, add a preset mark to the object being explained, and display the object being explained in the live page in a second manner.

[0011] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0012] one or more processors;

[0013] a storage device for storing one or more programs,

[0014] When the one or more programs are executed by the one or more processors, the one or more processors implement the live broadcast processing method as described in any one of the embodiments of the present disclosure.

[0015] In a fourth aspect, the embodiments of the present disclosure further provide a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute a live broadcast processing method as described in any one of the embodiments of the present disclosure.

[0016] In a fifth aspect, the embodiments of the present disclosure further provide a computer program product, including a computer program, which, when executed by a processor, implements a live broadcast processing method as described in any one of the embodiments of the present disclosure.

[0017] The technical solution of the disclosed embodiment can intuitively present the live content related to the live broadcast room by displaying the live broadcast page of the live broadcast room, and the live broadcast page includes a live video stream corresponding to the live broadcast room, so that the audio-visual effect of the live broadcast room can be improved through the live video stream, and multiple objects to be explained displayed in a first manner are associated in the live broadcast room, so that the presentation content of the live broadcast room can be further enriched; then, by determining the object being explained among the multiple objects to be explained according to the live video stream, and displaying the object being explained in the live broadcast page in a second manner, the object being explained among the multiple objects to be explained in the live broadcast room can be automatically identified, saving the time of manually searching and setting the object being explained, and further, by adjusting the display mode of the object being explained, the object being explained can be displayed distinctively, so as to quickly locate the object to be explained in the live broadcast room, thereby solving the technical problems in the related art that the operation of setting the object being explained is relatively complicated and the positioning efficiency of the object being explained is low, simplifying the interactive operation of the live broadcast room, optimizing the interactive mode of the live broadcast room, and improving the interactive experience of the live broadcast room. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0019] Figure 1A A flowchart of a live broadcast processing method provided by an embodiment of the present disclosure;

[0020] Figure 1B A schematic diagram of an interface for presenting an object being explained in a live broadcast page in a live broadcast processing method provided in an embodiment of the present disclosure;

[0021] Figure 1C Another interface schematic diagram of presenting the object being explained in the live broadcast page in the live broadcast processing method of the embodiment of the present disclosure provided by the embodiment of the present disclosure;

[0022] Figure 2 A flowchart of another live broadcast processing method provided by an embodiment of the present disclosure;

[0023] Figure 3 A flowchart of another live broadcast processing method provided by an embodiment of the present disclosure;

[0024] Figure 4 A flowchart of another live broadcast processing method provided by an embodiment of the present disclosure;

[0025] Figure 5 A schematic diagram of the structure of a live broadcast processing device provided by an embodiment of the present disclosure;

[0026] Figure 6 A schematic diagram of the structure of an electronic device provided by the embodiment of the present disclosure for implementing the embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0030] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0031] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0032] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0033] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0034] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0035] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0036] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0037] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0038] Figure 1A The present invention provides a flow chart of a live broadcast processing method provided by an embodiment of the present invention. The present invention is applicable to automatically identifying and displaying a scene of an object to be explained in a live broadcast. The method can be executed by a live broadcast processing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server. Figure 1A As shown, the method of this embodiment may specifically include:

[0039] S110, displaying a live broadcast page of a live broadcast room; wherein the live broadcast room is associated with a plurality of objects to be explained that are displayed in a first manner; and the live broadcast page includes a live video stream corresponding to the live broadcast room.

[0040] Among them, the live broadcast room can be understood as a resource sharing space for displaying live video streams. The live broadcast room can be determined based on the push stream address of the live video stream. The live page can be understood as a page for presenting information related to the live broadcast room. The object to be explained can be understood as an object that is associated with the live broadcast room and can be explained in the live broadcast room. The object to be explained can also be understood as an object to be explained in the live broadcast room. Exemplarily, the object to be explained can include but is not limited to objects in the video screen of the live video stream, objects that interact with objects in the live video stream (such as special effects or interactive information, etc.), and objects that are associated with the live broadcast room through a preset association method (such as binding object links, etc.) (such as recommended items in the live broadcast room, etc.) and other objects that can be associated with the live broadcast room. The live video stream can be understood as media content to be displayed in the live page. Exemplarily, the live video stream can include live audio data and / or live image data. The live audio data is audio data pushed to the live broadcast room. The live audio data at least includes live voice data. More specifically, the live audio data may be live voice data of the target user or audio data collected by a preset audio collection device, etc. The live image data may be understood as image data displayed in the live page, and is used to present a live streaming screen in the live page.

[0041] In the embodiment of the present disclosure, the live page for displaying the live room may specifically include: at least one live room entrance for the live room; in response to an entrance trigger operation for the live room entrance, displaying the live page of the live room corresponding to the triggered live room entrance. The live room entrance may be understood as a control for entering the live room. Exemplarily, the live room entrance may be a link to enter the live room. The link to enter the live room may be presented in the form of an image and / or text, or may be presented through a live preview window. The live content in the live room may be played synchronously in the live preview window. The live room entrance may be presented in one or more forms such as a button, a link, a picture, and a floating window to guide into a specific live room. The live room entrance usually contains some basic information of the live room, such as the name of the live room, a cover image, and a label, so as to preliminarily understand the live content of the live room. The entrance trigger operation may be understood as an operation of triggering the live room entrance to enter the live room. For example, the entrance trigger operation may be an operation of clicking the live room entrance, etc.

[0042] Specifically, the entry trigger operation (such as the entry click operation) can be detected. After receiving the entry trigger operation, the live broadcast room entry for the entry trigger operation is obtained, and then the live broadcast room information related to the live broadcast room is obtained according to the information contained in the live broadcast room entry (such as the live broadcast room identifier and / or unified location resource identifier of the live broadcast room). The obtained live broadcast room information is then used to load and display the live broadcast page corresponding to the live broadcast room. The live broadcast page may include one or more live broadcast related components such as live video stream, chat room, object display list of live broadcast display objects, and anchor information to provide a rich live broadcast experience.

[0043] S120: Determine an object being explained among the multiple objects to be explained according to the live video stream, and display the object being explained in the live page in a second manner.

[0044] Among them, the object being explained can be understood as the object to be explained that is being explained in the live video stream. It can be understood that the object being explained determined according to the live video stream among the multiple objects to be explained is the object to be explained that has the highest matching degree or the strongest correlation with the live video stream among the multiple objects to be explained. Specifically, the data correlation between the target live data in the live video stream and the multiple objects to be explained can be determined, and then based on; the method for determining the data correlation between different objects to be explained and the live video stream can be the same or different. In the embodiment of the present disclosure, the method for determining the data correlation between the object to be explained and the live video stream can include but is not limited to: determining the consistency between the object attribute data of the object to be explained and the target live data extracted from the live video stream; and / or, determining the consistency between the object attribute data corresponding to the object to be explained and the preset matching data corresponding to the target live data, etc.

[0045] Taking the object to be explained as an item to be explained as an example, assuming that the target live data in the live video stream is a cup of brand A, at this time, it can be determined whether the object attribute data of the object to be explained is consistent with the target live data extracted from the live video stream, that is, it is necessary to find the cup of brand A in the object to be explained as the object being explained; assuming that the target live data in the live video stream is cloth, when the object to be explained does not include cloth, it can be determined whether the object attribute data corresponding to the object to be explained is consistent with the preset matching data corresponding to the target live data. At this time, the preset matching data corresponding to the target live data can be customized. When customization is included in the object attribute data corresponding to the object to be explained, the object to be explained can be determined as the object being explained.

[0046] As mentioned above, the live video stream may include live audio data and / or live image data. Optionally, determining the object being explained among the multiple objects to be explained based on the live video stream may include: determining the object being explained among the multiple objects to be explained based on the live audio data and / or live image data in the live video stream. In other words, the object to be explained that matches the live video stream may be determined from the multiple objects to be explained based on the live audio data and / or live image data in the live video stream as the object being explained.

[0047] In the embodiment of the present disclosure, the second mode is different from the display mode of the first mode, and is the display mode adopted after the object to be explained is determined to be the object being explained. Specifically, the display information corresponding to the second mode is different from at least part of the display information corresponding to the first mode. Exemplarily, the display information includes at least one of the information of display style, display position, display size, display color, and display state (such as flashing state, etc.).

[0048] Optionally, displaying the object being explained in the live page in a second manner includes: displaying the object being explained in a window at a first preset position in the live page. With this technical solution, after opening the live page, the object being explained in the live video stream can be intuitively viewed without additional operations, thereby improving the live interactive experience.

[0049] The first preset position may be a pre-set position on the live page that may be blocked. The target window for presenting the object being explained may be presented on the upper layer of the live page based on the first preset position. Exemplarily, the first preset position may be an edge position on the live page such as the lower left corner, upper right corner, or lower right corner of the live page. Generally, the main content of the live page is often presented in the center of the screen. By adopting this technical solution, the main screen content of the live page can be avoided as much as possible.

[0050] like Figure 1B As shown, the live page 10 of the live broadcast room may display a live broadcast account logo 101 corresponding to the live broadcast room and a live broadcast screen 102 of the live video stream. The upper layer of the live page 10 may also include a target window 20, and the object information of the object being explained may be displayed in the target window 20.

[0051] On the basis of the above technical solution, in order to avoid blocking the page content of the live broadcast page for too long, after the object being explained is displayed at a first preset position in the live broadcast page in the form of a window, when the display time of the object being explained reaches the preset display time, the display of the object being explained in the window can be canceled, or the display of the window can be canceled.

[0052] Optionally, the displaying of the object being explained in the live page in the second manner includes: in the case where an object display panel is displayed in the live page, displaying the object being explained at a second preset position in the object display panel. The object display panel can be understood as a display panel for displaying a plurality of objects to be explained that is presented on the upper layer of the live display page. In the case where the live room is associated with a plurality of objects to be explained that are displayed in the first manner, an object display request is received through the live page, an object display panel is displayed in the live page, and a plurality of objects to be explained are displayed in the object display panel. Exemplarily, the plurality of objects to be explained in the object display panel are displayed in the form of a list. In other words, an object display list including a plurality of objects to be explained may be displayed in the object display panel. The second preset position may be a pre-set position in the object display panel. For example, the second preset position may be a top position in the object display panel. More specifically, the second preset position may be the first position or the second position in the object display list.

[0053] As an optional implementation of the embodiment of the present disclosure, the displaying of the object being explained in the live broadcast page in a second manner includes: adding a preset identifier to the object being explained, displaying the object being explained in the live broadcast page in a second manner, and displaying the preset identifier in association with the object being explained. Among them, the preset identifier may be an identifier pre-set to indicate that the object to be explained is the object being explained. The display form of the preset identifier may be multiple, for example, it may be presented in the form of preset characters and / or preset graphics. By adopting the present technical solution, the preset identifier can more intuitively highlight that the object to be explained is the object being explained.

[0054] In the embodiment of the present disclosure, the preset logo is displayed in association with the object being explained, which may be displaying the preset logo in a display area adjacent to the display area of ​​the object being explained, or displaying the preset logo in the display area of ​​the object being explained, etc. In the case where the preset logo is displayed in association with the object being explained, the relative display information of the preset logo and the object being explained remains unchanged. The display information of the preset logo may change as the display information of the object being explained changes. For example, in the case where the display position of the object being explained changes, the display position of the preset logo also changes accordingly to keep the relative display position between the preset logo and the object being explained unchanged.

[0055] like Figure 1CAs shown, the live page 10 of the live broadcast room may display the live account logo 101 corresponding to the live broadcast room and the live screen 102 of the live video stream. An object display panel 30 is displayed on the upper layer of the live page 10, and the object display panel 30 includes multiple object display areas. The object being explained can be displayed in the object display area 301 in the object display panel 30, and a preset "explaining" logo is added to the object being explained, so as to intuitively prompt that the object displayed in the object display area 301 is the object to be explained.

[0056] As an optional technical solution of the embodiment of the present disclosure, after determining the object being explained among the multiple objects to be explained according to the live video stream, it also includes: in the case where it is determined that the time spent by the object being explained is greater than or equal to the first preset time, displaying the object being explained in the first manner. Among them, the first preset time can be a preset time threshold for determining whether the time spent by the object being explained exceeds the expected time. The specific value of the first preset time can be set according to actual needs and is not specifically limited here. The first preset time can be the same as or different from the second preset time. Considering that the object to be explained being explained in the live broadcast room may have changed within the first preset time, therefore, in the case where it is determined that the time spent by the object being explained is greater than or equal to the first preset time, for example, when the time from the time when the object being explained is determined to the time when the object being explained is identified to the time when the object being explained is identified exceeds 60 seconds, then the recognition result of this time can be discarded and not processed, and the original display mode of the object to be explained is continued to be maintained, that is, the identified object being explained is continued to be displayed in the first mode. By adopting this technical solution, it is possible to ensure a high degree of matching between the identified object being explained and the live video stream.

[0057] In an embodiment of the present disclosure, when a condition for canceling the explanation of the object being explained is met, the object being explained is displayed in a third manner. Among them, the condition for canceling the explanation can be understood as having multiple trigger conditions (cancellation) for canceling the display of the object being explained in the second manner. Exemplarily, the condition for canceling the explanation includes but is not limited to at least one of the following conditions: receiving a cancel explanation operation for the object being explained; canceling the associated display of the object being explained and the live broadcast room; receiving a new object being explained, etc.

[0058] In the embodiment of the present disclosure, the third mode is different from the second mode. That is, at least part of the information in the display information of the third mode and the display information of the second mode is different. For example, the third mode may be the same as the first mode, that is, the object being explained is restored to be displayed in the first mode. The third mode may also be different from the first mode, for example, the object being explained may be moved to the target position. In practical applications, when the object to be explained is set as the object being explained, the object being explained may be inserted above the object to be explained that was previously set as the object being explained. Following the previous example, assuming that the object being explained will be displayed in the first position of the object display list, the first mode corresponding to the object being explained (the display mode before being determined as the object being explained) is displayed in the fifth position of the object display list. In response to the cancellation of the explanation operation for the object being explained, the object being explained may be displayed in the fifth position of the object display list, or the object being explained may be moved to the second position or the last position of the object display list, etc. At this time, the moved object being explained is no longer the object being explained, and is restored to the object to be explained.

[0059] As an optional technical solution of the embodiment of the present disclosure, after the object being explained is displayed in the live page in a second manner, it may also include: in response to the explanation setting operation for the object to be explained, the object being explained is updated to the set object to be explained. Among them, the explanation setting operation can be understood as an operation of setting the object to be explained to the object being explained. In the case where the object being explained is already displayed, in response to the explanation setting operation for the object to be explained, the object being explained will be replaced with the set object to be explained, that is, the object being explained that is being displayed will no longer be displayed, and the set object to be explained will be displayed as the object being explained. The adoption of this technical solution supports the change of the object being explained in an interactive manner, supports automatic identification, and can respond to custom settings, realizes the support for the flexible display of the object being explained, enriches the interactive mode of the live broadcast room, and improves the interactive experience of the live broadcast. This technical solution is particularly suitable for the situation where the object being explained is not automatically determined or the determined object being explained is inaccurate.

[0060] On the basis of the above technical solution, further, after the object being explained is updated to the set object to be explained, it also includes: in response to the cancel explanation operation for the object being explained, displaying the object being explained in a third manner, and returning to execute the operation of determining the object being explained among the multiple objects to be explained according to the live video stream. With this technical solution, the automatic identification of the object being explained and the manual setting of the object being explained can be combined, enriching the setting methods of the object being explained in the live broadcast room and improving the live interactive experience.

[0061] In the embodiment of the present disclosure, the operation of canceling explanation can be understood as an operation of canceling displaying the object to be explained as the object being explained. After receiving the operation of canceling explanation for the object being explained, the display of the object being explained in the second manner can be canceled, and the object being explained can be displayed in the third manner. At this time, it is also possible to return to the operation of determining the object being explained among the multiple objects to be explained according to the live video stream, so as to continue to automatically identify the object being explained among the objects to be explained.

[0062] It can be understood that when the preset logo and the object being explained are displayed in association, if the conditions for canceling the explanation of the object being explained are met, the associated display of the preset logo and the object being explained is canceled, and the object being explained is displayed in a third manner.

[0063] As an optional technical solution of the embodiment of the present disclosure, after displaying the object being explained in the live page in the second manner, it also includes: when the object being explained is displayed in the live page, displaying the object being explained based on a preset display duration. The preset display duration can be understood as a single continuous duration of displaying the object being explained in the live page in advance. The advantage of such a setting is that the presentation duration of the object being explained in the live page can be customized.

[0064] In an optional embodiment, the object being explained is displayed based on a preset display duration, which may specifically be to determine the continuous display duration of the object being explained in the live page, and when the continuous display duration reaches the preset display duration, cancel the display of the object being explained in the live page. In short, when the object being explained is displayed in the live page, when the object being explained has been displayed for the preset display duration, the object being explained may no longer be displayed in the live page, that is, disappear from the live page.

[0065] Optionally, canceling the display of the object being explained in the live page includes: canceling the display of the display window for presenting the object being explained in the live page. For example, it may be to change the display state attribute of the display window for presenting the object being explained in the live page to a hidden attribute, or to destroy the display window for presenting the object being explained created in the live page, etc.

[0066] It is understandable that, when the preset display duration is greater than the live broadcast duration of the live broadcast room, the object being explained will always be displayed on the live broadcast page. It should be noted that the object being explained here is not a specific object to be explained. When the display duration of the object being explained does not reach the preset display duration and the object being explained changes, the object being explained displayed on the live broadcast page will be updated accordingly.

[0067] The technical solution of the disclosed embodiment can intuitively present the live content related to the live broadcast room by displaying the live broadcast page of the live broadcast room, and the live broadcast page includes a live video stream corresponding to the live broadcast room, so that the audio-visual effect of the live broadcast room can be improved through the live video stream, and multiple objects to be explained displayed in a first manner are associated in the live broadcast room, so that the presentation content of the live broadcast room can be further enriched; then, by determining the object being explained among the multiple objects to be explained according to the live video stream, the object being explained is displayed in the live broadcast page in a second manner, so that the object being explained among the multiple objects to be explained in the live broadcast room can be automatically identified, saving the time of manually searching and setting the object being explained, and further, by adjusting the display mode of the object being explained, the object being explained can be displayed distinctively, so as to quickly locate the object to be explained in the live broadcast room, solves the technical problems in the related art that the operation of setting the object being explained is relatively complicated and the positioning efficiency of the object being explained is low, simplifies the interactive operation of the live broadcast room, optimizes the interactive mode of the live broadcast room, and improves the interactive experience of the live broadcast room.

[0068] Figure 2A flowchart of another image processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further refines the method of determining the object to be explained that is being explained through the live video stream on the basis of the above-mentioned embodiment. Optionally, the method of determining the object to be explained among the multiple objects to be explained based on the live video stream includes: determining the explanation object data in the live video stream based on the live audio data in the live video stream, and determining the object to be explained based on the explanation object data and object attribute data corresponding to the multiple objects to be explained. The specific implementation method can be found in the description of this embodiment. Among them, the technical features that are the same or similar to those in the above-mentioned embodiments are not repeated here. Figure 2 As shown, the method of this embodiment may specifically include:

[0069] S210, displaying a live broadcast page of a live broadcast room; wherein the live broadcast room is associated with a plurality of objects to be explained that are displayed in a first manner; and the live broadcast page includes a live video stream corresponding to the live broadcast room.

[0070] S220. Determine explanation object data in the live video stream according to the live audio data in the live video stream, determine the object being explained according to the explanation object data and object attribute data corresponding to a plurality of objects to be explained, and display the object being explained in the live page in a second manner.

[0071] In the embodiment of the present disclosure, the explanation object data can be understood as the data in the live audio data that is associated with the object to be explained. The live video stream displayed in the live page usually includes live audio data. Live audio data is generally closely related to the live content. Providing audio explanations to the object to be explained in the live broadcast room is also one of the more effective and convenient ways to explain the object. Therefore, in the embodiment of the present disclosure, the live audio data in the live video stream can be analyzed to determine the explanation data related to the object to be explained in the live video stream.

[0072] As an optional implementation of the embodiment of the present disclosure, the determining of the explanation object data in the live video stream based on the live audio data in the live video stream includes: extracting audio keywords in the live audio data in the live video stream, and determining the audio keywords as the explanation object data in the live video stream. Specifically, the audio keywords in the live audio data in the live video stream can be extracted based on the object attribute data corresponding to the multiple objects to be explained. By adopting this technical solution, the keywords related to the object to be explained in the live audio data can be accurately extracted, and irrelevant information can be effectively filtered out to improve data processing efficiency.

[0073] As another optional implementation of the embodiment of the present disclosure, the determining of the explanation object data in the live video stream based on the live audio data in the live video stream includes: performing semantic recognition on the live audio data in the live video stream, and determining the explanation object data in the live video stream based on the semantic recognition result. Exemplarily, the live audio data in the live video stream can be input into a semantic recognition model to obtain the explanation object data in the live video stream. Among them, the semantic recognition model can be obtained by training a pre-established machine learning model based on sample audio data and sample explanation data.

[0074] The object attribute data can be understood as data used to characterize the features of the object to be explained and to distinguish different objects to be explained. Exemplarily, the object attribute data may specifically include object description data and / or object image data. Different from object image data, the object description data may be data used to describe the object to be explained in the form of characters. Exemplarily, the object description data may include but is not limited to at least one of object identification description data, object type description data, object content description data, object feature description data, and object appearance description data. Taking the object to be explained as an item to be explained as an example, the object identification description data may at least be used to describe the name and / or brand of the item; the object type description data may be used to describe the category to which the item to be explained belongs; the object content description data may be used to describe the data of the components and / or the number of components contained in the item to be explained; the object feature description data includes data used to describe at least one feature of the material, use, origin, variety, style, size, and texture of the item to be explained; and the object appearance description data includes at least one of information used to describe the shape, color, and taste of the item to be explained.

[0075] In the case where the object attribute data includes object description data, determining the object being explained based on the explanation object data and the object attribute data corresponding to the plurality of objects to be explained may include: matching the explanation object data with the object description data corresponding to each of the objects to be explained, and determining the object being explained based on the data matching result corresponding to each of the objects to be explained. In this case, the object being explained is the object to be explained that has the highest matching degree with the explanation object data among the plurality of objects to be explained.

[0076] In the case where the object attribute data includes object image data, the determining the object being explained based on the explanation object data and the object attribute data corresponding to the plurality of objects to be explained may include: the explanation object data is respectively matched with the object image data corresponding to each of the objects to be explained, and the object being explained is determined based on the data matching result corresponding to each of the objects to be explained. Specifically, for each of the objects to be explained, the object image data of the object to be explained may be identified to obtain the object description data corresponding to the object image data, and then the explanation object data is respectively matched with the object description data corresponding to each of the objects to be explained, and the object being explained is determined based on the data matching result corresponding to each of the objects to be explained. Alternatively, the explanation object data and the object image data of each of the objects to be explained may be respectively input into a correlation detection model to determine the correlation index between the explanation object data and each of the object image data, and then the object being explained is determined based on the correlation index corresponding to each of the objects to be explained.

[0077] In the case where the object attribute data includes object description data and object image data, determining the object being explained based on the explanation object data and the object attribute data corresponding to the multiple objects to be explained may include: for each object to be explained, determining a first correlation index between the explanation object data and the object description data corresponding to the object to be explained, determining a second correlation index between the explanation object data and the object image data corresponding to the object to be explained, determining a target correlation index based on the first correlation index and the second correlation index; and then determining the object being explained based on the target correlation index corresponding to each object to be explained.

[0078] The technical solution of the disclosed embodiment, by determining the explanation object data in the live video stream according to the live audio data in the live video stream, can effectively parse out the data associated with the object to be explained in the live broadcast through the live audio data in the live video stream, and then determine the object to be explained according to the explanation object data and object attribute data corresponding to multiple objects to be explained, and can accurately determine the object to be explained that matches the explanation object data from multiple objects to be explained through the object attribute data corresponding to multiple objects to be explained, that is, the object to be explained, thereby ensuring the matching degree between the live audio data and the object to be explained, and realizing automatic and accurate identification of the object to be explained.

[0079] Figure 3A flowchart of another image processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further refines the method of determining the object to be explained that is being explained through the live video stream on the basis of the above-mentioned embodiment. Optionally, the object being explained is determined based on the explanation object data and the object attribute data corresponding to the multiple objects to be explained, comprising: obtaining the target image data in the live image data in the live video stream, and when the target image data is obtained, determining the object being explained based on the explanation object data, the target image data and the object attribute data corresponding to the multiple objects to be explained. For specific implementation methods, please refer to the description of this embodiment. Among them, the technical features that are the same or similar to those in the above-mentioned embodiments are not repeated here. Figure 3 As shown, the method of this embodiment may specifically include:

[0080] S310, displaying a live broadcast page of a live broadcast room; wherein the live broadcast room is associated with a plurality of objects to be explained that are displayed in a first manner; and the live broadcast page includes a live video stream corresponding to the live broadcast room.

[0081] S320, determining explanation object data in the live video stream according to the live audio data in the live video stream, and obtaining target image data in the live image data in the live video stream.

[0082] In the embodiment of the present disclosure, the live video stream may include live image data, and the target image data may be understood as image data in the live image data that is associated with the object to be explained.

[0083] As an optional implementation of the disclosed embodiment, obtaining the target image data in the live image data in the live video stream may include: determining image difference information between multiple frames of live image data in the live video stream, and determining the target image data in the live image data according to the image difference information. The technical solution can quickly identify the change information in the live image data, thereby capturing the object to be explained, which is particularly suitable for situations where the object to be explained is changed in the live broadcast room for explanation.

[0084] As another optional implementation of the disclosed embodiment, obtaining the target image data in the live image data in the live video stream may include: obtaining the target image data in the live image data in the live video stream according to the explanation object data. With this technical solution, the target image data associated with the live audio data can be quickly and effectively determined based on the explanation object data in the live audio data, so as to more accurately determine the object being explained among the objects to be explained in combination with the live audio data.

[0085] Optionally, the step of acquiring target image data in the live image data in the live video stream according to the explanation object data may include: inputting the explanation object data and the live image data into an image segmentation model to obtain the target image data. The image segmentation model may be obtained by training a diffusion model using sample explanation data and sample image data.

[0086] Optionally, the acquiring of target image data in the live image data in the live video stream according to the explanation object data comprises: performing semantic recognition on the live image data in the live video stream to obtain image semantic information; acquiring target image data in the live image data in the live video stream according to the image semantic information and the explanation object data. The image semantic information is used to indicate the live display object contained in the live image data and the object type information corresponding to the live display object.

[0087] As another optional implementation of the disclosed embodiment, obtaining the target image data in the live image data in the live video stream may include: obtaining the target image data in the live image data in the live video stream according to the object attribute data corresponding to the plurality of objects to be explained. By adopting this technical solution, the target image data associated with the object to be explained in the live image data can be accurately determined based on the object attribute data corresponding to the plurality of objects to be explained, so as to more quickly and accurately determine the object being explained among the objects to be explained.

[0088] S330. When the target image data is obtained, determine the object being explained according to the explanation object data, the target image data and object attribute data corresponding to the plurality of objects to be explained, and display the object being explained in the live broadcast page in a second manner.

[0089] The object attribute data may include object description data and object image data. As can be seen from the above content, obtaining the target image data indicates that the live broadcast image data includes the object to be explained that is being explained. At this time, the object to be explained data, the target image data and the object attribute data corresponding to the multiple objects to be explained can be combined to determine the object to be explained that is being explained, that is, the object being explained, from the multiple objects to be explained.

[0090] As an optional implementation of the disclosed embodiment, when the target image data is obtained, for each of the objects to be explained, a description matching result is determined according to the explanation object data and the object description data corresponding to the object to be explained, an image matching result is determined according to the target image data and the object image data, and an object matching result is determined according to the description matching result and the image matching result; then, the object being explained is determined according to the object matching results corresponding to the multiple objects to be explained. The advantage of such a setting is that the object being explained can be matched from the multiple objects to be explained in a simple and fast manner by combining the target image data and the explanation object data, thereby improving the speed of determining the object being explained, and then quickly displaying the object being explained to enhance the live interactive experience.

[0091] As another optional implementation of the embodiment of the present disclosure, when the target image data is obtained, the display object data of the explanation object data in the live video stream can be first determined according to the target image data, and the object matching data can be determined according to the explanation object data and the target image data; then, for each object to be explained, a first matching result is determined according to the object matching data and the object description data corresponding to the object to be explained, a second matching result is determined according to the target image data and the object image data corresponding to the object to be explained, and a target matching result corresponding to the object to be explained is determined according to the first matching result and the second matching result; finally, the object being explained is determined according to the target matching results corresponding to the multiple objects to be explained. The advantage of such a setting is that the explanation object data and the target image data can be deeply combined, and the explanation object data determined in the live audio data can be further analyzed through the target image data to obtain more accurate object matching data, so as to further improve the accuracy of the determined object being explained.

[0092] In actual application scenarios, the object to be explained may or may not be captured in the screen of the live broadcast room, that is, the live image data in the live video stream may or may not include the target image data. In other words, there may be a situation where the target image data is not obtained. In the embodiment of the present disclosure, in the case where the target image data is not obtained, the object being explained can be determined based on the explanation object data and the object attribute data corresponding to the multiple objects to be explained.

[0093] The technical solution of the disclosed embodiment, based on determining the explanation object data in the live video stream according to the live audio data in the live video stream, realizes analysis of the live image data in the live video stream by acquiring the target image data in the live image data in the live video stream, so as to acquire the target image data related to the object to be explained, increase the analysis dimension of the live video stream, provide richer data basis for determining the data of the object being explained in the object to be explained, and then, by determining the object being explained according to the explanation object data, the target image data and the object attribute data corresponding to the multiple objects to be explained when the target image data is acquired, the object being explained can be determined in combination with the live audio data and the live image data, realizes cross-validation of the analysis results of the live audio data and the live image data, effectively improves the recognition accuracy of the object being explained, and further improves the live interactive experience.

[0094] Figure 4 A flowchart of another image processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further refines the manner in which the object being explained is automatically identified on the basis of the above-mentioned embodiment. Optionally, the method of determining the explanation object data in the live video stream according to the live audio data in the live video stream comprises: determining the start and stop states of an object recognition mode, wherein the object recognition mode is at least used to automatically identify the object to be explained included in the live video stream, and the start and stop states include an enabled state and a disabled state; when the object recognition mode is in the enabled state, determining the explanation object data in the live video stream according to the live audio data in the live video stream. For specific implementation methods, please refer to the description of this embodiment. Among them, technical features that are the same or similar to those in the above-mentioned embodiments will not be repeated here. Figure 4 As shown, the method of this embodiment may specifically include:

[0095] S410, displaying a live broadcast page of a live broadcast room; wherein the live broadcast room is associated with a plurality of objects to be explained that are displayed in a first manner; and the live broadcast page includes a live video stream corresponding to the live broadcast room.

[0096] S420: Determine a start / stop state of an object recognition mode, wherein the object recognition mode is at least used to automatically recognize an object to be explained included in a live video stream, and the start / stop state includes an enabled state and a disabled state.

[0097] In the disclosed embodiment, the object recognition mode can be understood as a preset mode that can automatically recognize the object to be explained included in the live video stream after being enabled. Whether to enable the object recognition mode can be customized. In other words, the start and stop state of the object recognition mode can be customized.

[0098] As an optional implementation of the embodiment of the present disclosure, the determining the start / stop state of the object recognition mode includes: obtaining the attribute value of the start / stop setting item of the object recognition mode in the target page, and determining the start / stop state of the object recognition mode according to the attribute value. Furthermore, the start / stop state of the object recognition mode can be adjusted by setting the attribute value of the start / stop setting item of the object recognition mode in the target page. Specifically, the determining the start / stop state of the object recognition mode may include: displaying the target page, wherein the target page includes the start / stop setting item of the object recognition mode; and in response to a start / stop setting operation for the start / stop setting item, determining the start / stop state of the object recognition mode according to the start / stop setting operation.

[0099] Among them, the start-stop setting item can be understood as an information item including an operable control for setting whether to enable the object recognition mode. In other words, the object recognition mode can be set to an enabled state or a disabled state by operating the start-stop setting item. Specifically, whether the object recognition mode is set to an enabled state or a disabled state can be determined by the attribute value corresponding to the start-stop setting item. The enabled state corresponds to a first attribute value, and the disabled state corresponds to a second attribute value. The start-stop setting operation of the start-stop setting item may be an operation for setting the attribute value corresponding to the start-stop setting item. On this basis, determining the start-stop state of the object recognition mode according to the start-stop setting operation may specifically include: determining the attribute value of the start-stop setting item according to the start-stop setting operation, and determining the start-stop state of the object recognition mode according to the attribute value.

[0100] In an embodiment of the present disclosure, the property value setting method of the start-stop setting item is associated with the display style of the start-stop setting item. For example, the start-stop setting item may be a switch-type control including a setting button, and the property value of the start-stop setting item may be determined by placing the setting button at a position corresponding to an on state or a position corresponding to an off state. For another example, the start-stop setting item may include a mode switching control, and in response to a control triggering operation for the mode switching control, the start-stop state of the object recognition mode is switched.

[0101] S430: When the object recognition mode is in the enabled state, determine the explanation object data in the live video stream according to the live audio data in the live video stream.

[0102] When the object recognition mode is in the enabled state, it indicates that the object to be explained in the live video stream needs to be automatically recognized. At this time, the explanation object data in the live video stream can be determined based on the live audio data in the live video stream.

[0103] S440: Determine the object being explained according to the explanation object data and the object attribute data corresponding to the plurality of objects to be explained, and display the object being explained in the live broadcast page in a second manner.

[0104] In some cases, the object being explained may not be determined within the second preset time period, in which case the object to be explained in the live video stream cannot be automatically displayed. As an optional implementation of the embodiment of the present disclosure, in the case where the object being explained is not determined within the second preset time period, the object recognition mode is switched from the enabled state to the disabled state, and / or target prompt information is generated and displayed. In the case where the object being explained is not determined, it may be that there are too many recognition requests for the object being explained and there is a backlog or there is an execution error in the recognition of the object being explained. At this time, the above technical solution is adopted to timely adjust the object recognition mode to the disabled state to reduce the recognition pressure on the object being explained; by generating and displaying the target prompt information, the reason for the non-feedback of the object being explained can be timely understood, so as to determine the subsequent execution operation, such as continuing to wait for feedback on the object being explained or turning off the object recognition mode.

[0105] Among them, the second preset time length can be a preset maximum time length (i.e., the upper limit of the time length) for determining the object being explained. The specific value of the second preset time length can be set according to actual needs and is not specifically limited here. For example, it can be 30 seconds or 60 seconds, etc. The target prompt information can be at least one of the following information: the recognition of the object being explained has timed out, the automatic recognition of the object being explained has failed, the object recognition mode has been adjusted to a disabled state, and the object recognition mode can be adjusted to a disabled state.

[0106] As an optional implementation of the embodiment of the present disclosure, when the object to be explained does not exist in the live broadcast room, the object recognition mode is switched from the enabled state to the disabled state. In this case, it is not necessary to identify the object being explained among the objects to be explained, so the object recognition mode can be disabled to save performance.

[0107] Optionally, switching the object recognition mode from the enabled state to the disabled state may specifically include: switching the object recognition mode from the enabled state to the disabled state by changing the attribute value of the start / stop setting item to an attribute value corresponding to the disabled state.

[0108] The technical solution of the embodiment of the present disclosure, on the basis of the above-mentioned optional technical solution, adds the determination of the start and stop states of the object recognition mode for automatically identifying the objects to be explained included in the live video stream. By determining the start and stop states of the object recognition mode, it is possible to accurately determine whether to automatically identify the objects to be explained included in the live video stream. Since the start and stop states include an enabled state and a disabled state, it is possible to support flexible setting of the start and stop states of the object recognition mode. Then, by determining the explanation object data in the live video stream according to the live audio data in the live video stream when the object recognition mode is in the enabled state, it is possible to automatically identify the objects to be explained included in the live video stream and then analyze the live video stream, thereby ensuring effective execution of operations and reducing unnecessary performance consumption.

[0109] Figure 5 A schematic diagram of the structure of a live broadcast processing device provided by an embodiment of the present disclosure is shown in FIG. Figure 5 As shown, the device includes: a live page display module 510 and an explanation object display module 520. The live page display module 510 is used to display the live page of the live room; wherein the live room is associated with a plurality of objects to be explained displayed in a first manner; the live page includes a live video stream corresponding to the live room; the explanation object display module 520 is used to determine the object being explained among the plurality of objects to be explained according to the live video stream, and display the object being explained in the live page in a second manner.

[0110] The technical solution of the embodiment of the present disclosure is to display the live page of the live room through the live page display module 510, so as to intuitively present the live content related to the live room. The live page includes a live video stream corresponding to the live room, so as to improve the audio-visual effect of the live room through the live video stream, and to associate multiple objects to be explained displayed in a first manner in the live room, so as to further enrich the presentation content of the live room; then, the object to be explained among the multiple objects to be explained is determined according to the live video stream by the explanation object display module 520, and the object to be explained is displayed in the live page in a second manner, so as to automatically identify the object to be explained among the multiple objects to be explained in the live room, saving the time of manually searching and setting the object to be explained, and further, by adjusting the display mode of the object to be explained, the object to be explained can be displayed distinctively, so as to quickly locate the object to be explained in the live room, thereby solving the technical problems in the related art that the operation of setting the object to be explained is relatively complicated and the positioning efficiency of the object to be explained is low, simplifying the interactive operation of the live room, optimizing the interactive mode of the live room, and improving the interactive experience of the live room.

[0111] On the basis of any of the above optional technical solutions, optionally, the explanation object display module 520 includes an audio data analysis submodule and an explanation object determination submodule, wherein the audio data analysis submodule is used to determine the explanation object data in the live video stream according to the live audio data in the live video stream; the explanation object determination submodule is used to determine the object being explained according to the explanation object data and object attribute data corresponding to a plurality of objects to be explained, wherein the object attribute data includes object description data and / or object image data.

[0112] Based on any of the above optional technical solutions, optionally, the explanation object determination submodule includes: an image data analysis unit and a sound-image combination recognition unit. The image data analysis unit is used to obtain the target image data in the live image data in the live video stream; the sound-image combination recognition unit is used to determine the object being explained according to the explanation object data, the target image data and the object attribute data corresponding to the plurality of objects to be explained, when the target image data is obtained.

[0113] On the basis of any of the above optional technical solutions, optionally, the audio-image combination recognition unit includes a matching data determination subunit, a matching result determination subunit and an explained object determination subunit. The matching data determination subunit is used to determine the display object data of the explanation object data in the live video stream according to the target image data, and determine the object matching data according to the explanation object data and the target image data; the matching result determination subunit is used to determine the first matching result for each object to be explained according to the object matching data and the object description data corresponding to the object to be explained, determine the second matching result according to the target image data and the object image data corresponding to the object to be explained, and determine the target matching result corresponding to the object to be explained according to the first matching result and the second matching result; the explained object determination subunit is used to determine the object being explained according to the target matching results corresponding to the multiple objects to be explained.

[0114] On the basis of any of the above optional technical solutions, optionally, the audio data analysis submodule includes a mode start / stop determination unit and an explanation data determination unit. The mode start / stop determination unit is used to determine the start / stop state of the object recognition mode, the object recognition mode is at least used to automatically identify the object to be explained included in the live video stream, and the start / stop state includes an enabled state and a disabled state; the explanation data determination unit is used to determine the explanation object data in the live video stream according to the live audio data in the live video stream when the object recognition mode is in the enabled state.

[0115] On the basis of any of the above optional technical solutions, optionally, the mode start / stop determination unit includes a mode setting page display unit and a mode start / stop state determination unit. The mode setting page display unit is used to display a target page, wherein the target page includes a start / stop setting item of the object recognition mode; and the mode start / stop state determination unit is used to respond to a start / stop setting operation for the start / stop setting item and determine the start / stop state of the object recognition mode according to the start / stop setting operation.

[0116] Based on any of the above optional technical solutions, optionally, the explanation object display module 520 includes a first object display submodule and / or a second object display submodule. The first object display submodule is used to display the object being explained at a first preset position in the live page in the form of a window; the second object display submodule is used to display the object being explained at a second preset position in the object display panel when an object display panel is displayed in the live page.

[0117] On the basis of any of the above optional technical solutions, optionally, the live broadcast processing device further comprises: an object being explained updating module. The object being explained updating module is used to update the object being explained to the set object to be explained in response to the explanation setting operation for the object to be explained, after displaying the object being explained in the second manner on the live broadcast page.

[0118] On the basis of any of the above optional technical solutions, optionally, the live broadcast processing device further includes an explanation cancellation display module. The explanation cancellation display module is used to, after the object being explained is updated to the set object to be explained, in response to the explanation cancellation operation for the object being explained, display the object being explained in a third manner, and return to the operation of determining the object being explained among the multiple objects to be explained according to the live video stream.

[0119] Based on any of the above optional technical solutions, optionally, the explanation object display module 520 is specifically used to add a preset identifier for the object being explained, display the object being explained in the live broadcast page in a second manner, and associate the preset identifier with the object being explained for display.

[0120] Based on any of the above optional technical solutions, optionally, the live broadcast processing device further comprises: a time-limited display unit. The time-limited display unit is used to display the object being explained based on a preset display duration when the object being explained is displayed on the live broadcast page after the object being explained is displayed on the live broadcast page in the second manner.

[0121] The live broadcast processing device provided in the embodiments of the present disclosure can execute the live broadcast processing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects for executing the live broadcast processing method.

[0122] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0123] Reference below Figure 6 , which shows a schematic diagram of the structure of an electronic device (such as a terminal device or a server) 600 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0124] like Figure 6 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 606 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0125] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 606 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0126] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 609, or installed from a storage device 606, or installed from a ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0127] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0128] The electronic device provided in the embodiment of the present disclosure and the live broadcast processing method provided in the above embodiment belong to the same inventive concept. The technical details not fully described in the embodiment of the present disclosure can be referred to the above embodiment, and the present embodiment has the same beneficial effects as the above embodiment.

[0129] An embodiment of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the live broadcast processing method provided in the above embodiment is implemented.

[0130] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0131] According to one or more embodiments of the present disclosure, [Example 1] provides a live broadcast processing method, including: displaying a live broadcast page of a live broadcast room; wherein the live broadcast room is associated with multiple objects to be explained displayed in a first manner; the live broadcast page includes a live video stream corresponding to the live broadcast room; determining an object being explained among the multiple objects to be explained based on the live video stream, and displaying the object being explained in the live broadcast page in a second manner.

[0132] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further including: optionally, determining the object being explained among the multiple objects to be explained based on the live video stream includes: determining the explanation object data in the live video stream based on the live audio data in the live video stream, and determining the object being explained based on the explanation object data and object attribute data corresponding to the multiple objects to be explained, wherein the object attribute data includes object description data and / or object image data.

[0133] According to one or more embodiments of the present disclosure, [Example Three] provides the method of Example Two, further including: optionally, determining the object being explained based on the explanation object data and the object attribute data corresponding to the multiple objects to be explained, including: obtaining target image data in the live image data in the live video stream, and when the target image data is obtained, determining the object being explained based on the explanation object data, the target image data and the object attribute data corresponding to the multiple objects to be explained.

[0134] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 3, further including: optionally, determining the object being explained based on the explanation object data, the target image data and the object attribute data corresponding to the multiple objects to be explained, including: determining the display object data of the explanation object data in the live video stream based on the target image data, and determining the object matching data based on the explanation object data and the target image data; for each object to be explained, determining a first matching result based on the object matching data and the object description data corresponding to the object to be explained, determining a second matching result based on the target image data and the object image data corresponding to the object to be explained, and determining a target matching result corresponding to the object to be explained based on the first matching result and the second matching result; determining the object being explained based on the target matching results corresponding to the multiple objects to be explained.

[0135] According to one or more embodiments of the present disclosure, [Example Five] provides the method of Example Two, further including: optionally, determining the explanation object data in the live video stream based on the live audio data in the live video stream includes: determining the start and stop states of an object recognition mode, wherein the object recognition mode is at least used to automatically identify the objects to be explained included in the live video stream, and the start and stop states include an enabled state and a disabled state; when the object recognition mode is in the enabled state, determining the explanation object data in the live video stream based on the live audio data in the live video stream.

[0136] According to one or more embodiments of the present disclosure, [Example Six] provides the method of Example Five, further including: optionally, determining the start / stop state of the object recognition mode includes: displaying a target page, wherein the target page includes a start / stop setting item of the object recognition mode; in response to a start / stop setting operation for the start / stop setting item, determining the start / stop state of the object recognition mode according to the start / stop setting operation.

[0137] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 1, further including: optionally, displaying the object being explained in the live broadcast page in a second manner, including: displaying the object being explained in a window form at a first preset position in the live broadcast page; and / or, when an object display panel is displayed in the live broadcast page, displaying the object being explained at a second preset position in the object display panel.

[0138] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 1, further including: optionally, after displaying the object being explained in the live broadcast page in the second manner, it also includes: in response to an explanation setting operation for the object to be explained, updating the object being explained to the set object to be explained.

[0139] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 8, further including: optionally, after the object being explained is updated to the set object to be explained, it also includes: in response to canceling the explanation operation for the object being explained, displaying the object being explained in a third manner, and returning to execute the operation of determining the object being explained among the multiple objects to be explained based on the live video stream.

[0140] According to one or more embodiments of the present disclosure, [Example 10] provides the method of Example 1, further including: optionally, displaying the object being explained in the live broadcast page in a second manner, including: adding a preset identifier to the object being explained, displaying the object being explained in the live broadcast page in the second manner, and displaying the preset identifier in association with the object being explained.

[0141] According to one or more embodiments of the present disclosure, [Example 11] provides the method of Example 1, further including: optionally, after displaying the object being explained in the live broadcast page in a second manner, it also includes: when the object being explained is displayed in the live broadcast page, displaying the object being explained based on a preset display time.

[0142] According to one or more embodiments of the present disclosure, [Example 12] provides a special effects processing device, including: a live page display module, used to display a live page of a live room; wherein the live room is associated with multiple objects to be explained displayed in a first manner; the live page includes a live video stream corresponding to the live room; an explanation object display module, used to determine an object being explained among the multiple objects to be explained according to the live video stream, add a preset identifier to the object being explained, and display the object being explained in the live page in a second manner.

[0143] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0144] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0145] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device:

[0146] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0147] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0148] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, an image data analysis unit may also be described as "used to obtain target image data in live image data in a live video stream".

[0149] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0150] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0151] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other.

[0152] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0153] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A live broadcast processing method, characterized in that: include: A live broadcast page of a live broadcast room is displayed; wherein the live broadcast room is associated with a plurality of objects to be explained displayed in a first manner; the live broadcast page includes a live video stream corresponding to the live broadcast room; An object being explained among the multiple objects to be explained is determined according to the live video stream, and the object being explained is displayed in the live page in a second manner.

2. The live broadcast processing method according to claim 1, characterized in that: The step of determining the object being explained among the plurality of objects to be explained according to the live video stream comprises: The explanation object data in the live video stream is determined according to the live audio data in the live video stream, and the object being explained is determined according to the explanation object data and object attribute data corresponding to a plurality of objects to be explained, wherein the object attribute data includes object description data and / or object image data.

3. The live broadcast processing method according to claim 2, characterized in that: The determining the object being explained according to the explanation object data and the object attribute data corresponding to the plurality of objects to be explained comprises: The target image data in the live image data in the live video stream is obtained, and when the target image data is obtained, the object being explained is determined according to the explanation object data, the target image data and the object attribute data corresponding to the plurality of objects to be explained.

4. The live broadcast processing method according to claim 3, characterized in that: The determining the object being explained according to the explanation object data, the target image data and the object attribute data corresponding to the plurality of objects to be explained comprises: Determine display object data of explanation object data in the live video stream according to the target image data, and determine object matching data according to the explanation object data and the target image data; For each of the objects to be explained, a first matching result is determined according to the object matching data and the object description data corresponding to the object to be explained, a second matching result is determined according to the target image data and the object image data corresponding to the object to be explained, and a target matching result corresponding to the object to be explained is determined according to the first matching result and the second matching result; The object being explained is determined according to the target matching results corresponding to the plurality of objects to be explained.

5. The live broadcast processing method according to claim 2, characterized in that: The determining of explanation object data in the live video stream according to the live audio data in the live video stream comprises: Determine a start and stop state of an object recognition mode, wherein the object recognition mode is at least used to automatically recognize an object to be explained included in a live video stream, and the start and stop state includes an enabled state and a disabled state; When the object recognition mode is in the enabled state, the explanation object data in the live video stream is determined according to the live audio data in the live video stream.

6. The live broadcast processing method according to claim 5, characterized in that: The determining the start and stop state of the object recognition mode includes: Displaying a target page, wherein the target page includes a start / stop setting item of the object recognition mode; In response to a start / stop setting operation for the start / stop setting item, a start / stop state of the object recognition mode is determined according to the start / stop setting operation.

7. The live broadcast processing method according to claim 1, characterized in that: The step of displaying the object being explained in the live broadcast page in a second manner includes: Displaying the object being explained at a first preset position in the live broadcast page in the form of a window; and / or, In a case where an object display panel is displayed in the live broadcast page, the object being explained is displayed at a second preset position in the object display panel.

8. The live broadcast processing method according to claim 1, characterized in that: After displaying the object being explained on the live broadcast page in the second manner, the method further includes: In response to an explanation setting operation for the object to be explained, the object being explained is updated to the set object to be explained.

9. The live broadcast processing method according to claim 8, characterized in that: After the object being explained is updated to the set object to be explained, the method further includes: In response to the cancelling explanation operation on the object being explained, the object being explained is displayed in a third manner, and the operation of determining the object being explained among the multiple objects to be explained according to the live video stream is returned to be executed.

10. The live broadcast processing method according to claim 1, characterized in that: The step of displaying the object being explained in the live broadcast page in a second manner includes: A preset mark is added to the object being explained, the object being explained is displayed in the live broadcast page in a second manner, and the preset mark is associated with the object being explained and displayed.

11. The live broadcast processing method according to claim 1, characterized in that: After displaying the object being explained in the live broadcast page in a second manner, the method further includes: When the object being explained is displayed in the live broadcast page, the object being explained is displayed based on a preset display duration.

12. A live broadcast processing device, characterized in that: include: A live page display module, used to display a live page of a live broadcast room; wherein the live broadcast room is associated with a plurality of objects to be explained displayed in a first manner; the live page includes a live video stream corresponding to the live broadcast room; The explanation object display module is used to determine the object being explained among the multiple objects to be explained according to the live video stream, and display the object being explained in the live page in a second manner.

13. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the live broadcast processing method as described in any one of claims 1-11.

14. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the live broadcast processing method as described in any one of claims 1-11 when executed by a computer processor.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the computer program implements the live broadcast processing method as described in any one of claims 1 to 11.

Images