Interactive processing method and apparatus for overlaid comments, electronic device, computer-readable storage medium, and computer program product

By displaying different types of bullet comments in the media interface and responding to user operations to form specific patterns, the problem of monotonous bullet comment interaction is solved, and the bullet comment display methods are enriched and the interactivity is improved.

WO2025256269A1PCT designated stage Publication Date: 2025-12-18TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/090134
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-14
Filing Date
2025-04-21
Publication Date
2025-12-18

AI Technical Summary

Technical Problem

Current technologies for bullet comments have limited movement and interaction methods, resulting in insufficient user interactivity.

Method used

By displaying different types of bullet comments in the media interface and responding to user interactions with the second bullet comment, the system displays first media information including the first bullet comment, such as forming a specific pattern through clicking or other operations, thereby enhancing the interactivity of the bullet comments.

Benefits of technology

It enriches the display methods and interactive forms of bullet comments, enhances the user's viewing experience and sense of interaction, and saves computing resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025090134_18122025_PF_FP_ABST
    Figure CN2025090134_18122025_PF_FP_ABST
Patent Text Reader

Abstract

An interactive processing method and apparatus for overlaid comments, an electronic device, a computer-readable storage medium, and a computer program product. The method comprises: displaying a first media interface; displaying at least one first overlaid comment and at least one second overlaid comment on the first media interface; and in response to an interactive operation for the second overlaid comment, displaying first media information comprising the at least one first overlaid comment.
Need to check novelty before this filing date? Find Prior Art

Description

Bullet screen interaction processing method and device, electronic equipment, computer readable storage medium and computer program product

[0001] Cross-reference of Related Applications

[0002] Embodiments of the present application are based on a Chinese patent application No. 202410775429.1, filed on June 14, 2024, and claim priority to the Chinese patent application, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0003] The present application relates to computer technology, and in particular to a bullet screen interaction processing method and device, electronic equipment, computer readable storage medium and computer program product. BACKGROUND

[0004] Bullet screen is a kind of audio and video comment subtitles. Taking video bullet screen as an example, the comment appears on the video in the form of transparent or semi-transparent text. Users can interact with other viewers in real time through bullet screen without blocking the video content. Video bullet screen moves from one side of the screen to the other side at a certain speed, or appears at the top or bottom of the screen. In related technologies, the bullet screen movement is single, and the form of interaction with users is single, lacking rich interactive forms.

[0005] In related technologies, there is no better way to improve the interactivity between bullet screen and users. SUMMARY

[0006] Embodiments of the present application provide a bullet screen interaction processing method and device, electronic equipment, computer readable storage medium and computer program product, which can improve the richness of bullet screen display form.

[0007] The technical solution of the embodiments of the present application is as follows:

[0008] The embodiments of the present application provide a bullet screen interaction processing method applied to an electronic device, the method comprising:

[0009] Displaying a first media interface;

[0010] Displaying at least one first bullet screen and at least one second bullet screen in the first media interface;

[0011] In response to an interaction operation on the second bullet screen, displaying first media information comprising the at least one first bullet screen.

[0012] The embodiments of the present application provide a bullet screen interaction processing method applied to an electronic device, the method comprising:

[0013] display a first media interface;

[0014] display at least one piece of barrage in the first media interface;

[0015] in response to an interactive operation in the first media interface, display first media information including the at least one piece of barrage.

[0016] Embodiments of the present application provide an interactive processing apparatus of barrage, comprising:

[0017] a display module configured to display a first media interface;

[0018] the display module is further configured to display at least one first barrage and at least one second barrage in the first media interface;

[0019] the display module is further configured to, in response to an interactive operation on the second barrage, display first media information including the at least one first barrage.

[0020] Embodiments of the present application provide an interactive processing apparatus of barrage, comprising:

[0021] a display module configured to display a first media interface;

[0022] the display module is further configured to display at least one piece of barrage in the first media interface;

[0023] the display module is further configured to, in response to an interactive operation in the first media interface, display first media information including the at least one piece of barrage.

[0024] Embodiments of the present application provide an electronic device, comprising:

[0025] a memory configured to store computer executable instructions or computer programs;

[0026] a processor configured to execute the computer executable instructions or computer programs stored in the memory to implement the interactive processing method of barrage provided by embodiments of the present application.

[0027] Embodiments of the present application provide a computer readable storage medium storing computer executable instructions or computer programs, for being executed by a processor to implement the interactive processing method of barrage provided by embodiments of the present application.

[0028] Embodiments of the present application provide a computer program product comprising computer programs or computer executable instructions, for being executed by a processor to implement the interactive processing method of barrage provided by embodiments of the present application.

[0029] The embodiments of the present application have the following beneficial effects:

[0030] By displaying different types of bullet screens in the first media interface, when an interaction operation for the second bullet screen is received, the first media information including the first bullet screen is displayed, which enriches the display mode of the bullet screen and enhances the interactivity of the bullet screen. At least one second bullet screen is selectively configured to trigger the first media information formed by the first bullet screen, which can save the computing resources required for displaying the bullet screen compared with the scheme that all bullet screens have the function of triggering the display of the media information. BRIEF DESCRIPTION OF DRAWINGS

[0031] FIG. 1 is a schematic diagram of an application mode of a bullet screen interaction processing method according to an embodiment of the present application;

[0032] FIG. 2 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application;

[0033] FIG. 3A is a first flowchart of a bullet screen interaction processing method according to an embodiment of the present application;

[0034] FIG. 3B is a second flowchart of a bullet screen interaction processing method according to an embodiment of the present application;

[0035] FIG. 4A is a first schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0036] FIG. 4B is a second schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0037] FIG. 4C is a third schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0038] FIG. 4D is a fourth schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0039] FIG. 4E is a fifth schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0040] FIG. 4F is a sixth schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0041] FIG. 4G is a seventh schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0042] FIG. 4H is an eighth schematic diagram of a human-computer interaction interface according to an embodiment of the present application;

[0043] FIG. 5 is a third flowchart of a bullet screen interaction processing method according to an embodiment of the present application;

[0044] FIG. 6 is an interaction flowchart of a bullet screen interaction processing method according to an embodiment of the present application.

[0045] It should be noted that the above "first", "second" are only used to distinguish different schemes, and do not represent the advantages or disadvantages of the schemes or the priority in the implementation process. DETAILED DESCRIPTION

[0046] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings, and the described embodiments should not be regarded as limitations on the present application. All other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0047] In the following description, "some embodiments" are related to a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0048] It should be noted that the relevant data collection and processing in the present application should strictly comply with the requirements of relevant laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing behavior within the scope of authorization of laws and regulations and the personal information subject.

[0049] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined target, and can be implemented entirely or partially by using software, hardware (such as processing circuitry or memory) or a combination thereof. Similarly, one processor (or multiple processors or memory) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an overall module or unit that includes the functions of the module or unit.

[0050] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0051] Before the embodiments of the present application are further described in detail, the terms and terms involved in the embodiments of the present application are explained, and the terms and terms involved in the embodiments of the present application are applicable to the following explanations.

[0052] 1) Bullet screen: also known as bullet screen message, refers to the message that the audience can send real-time comments, bullet screen, text messages and other ways to interact with the video on the video playing screen during online video and audio playing. The bullet screen is displayed on the screen in the form of scrolling, display at the top or bottom, etc., providing a way for instant communication and interaction for the audience.

[0053] 2) Special-shaped bullet screen: a special visual form formed by bullet screens, for example, a specific pattern formed by at least one bullet screen in a specific arrangement. Through algorithm control of the spatio-temporal arrangement of multiple bullet screens, a preset or dynamically generated visual form (such as text, graphics, animation, etc.) is combined on the media interface to obtain an enhanced bullet screen, also known as a special-shaped bullet screen. The technical features of the special-shaped bullet screen include: 1. Bullet screen cluster cooperation (multiple bullet screens are arranged according to coordinate, color, motion trajectory, etc. Parameter regularization); 2. Dynamic deformation capability (adjusting the pattern in real time according to media information, such as emoticons); 3. Interactive response (supporting user click or touch effect). The design of the special-shaped bullet screen breaks through the single presentation mode of the traditional bullet screen and adds visual artisticity to information transmission.

[0054] 3) Operation: a way to trigger the device to perform processing, such as a click operation, a double-click operation, a long-press operation, a swipe operation, a gesture operation, a received trigger instruction, etc. In addition, various operations in the embodiments of the present application can be a single operation, or a total of multiple operations. In addition, various interactive operations in the embodiments of the present application can be touch operations, or non-touch operations.

[0055] 4) Control: a triggerable information displayed in the form of area, button, icon, link, text, selection box, input box, and tab, etc. The trigger can be contact-based triggering, or non-contact-based triggering, or instruction-based triggering, etc. In addition, various controls in the embodiments of the present application can be a single control, or a total of multiple controls.

[0056] 5) In response to: used to represent the conditions or states on which the operations performed depend. When the dependent conditions or states are met, the one or more operations performed can be real-time, or have a set delay. Without specific description, there is no limitation on the execution sequence of multiple operations performed.

[0057] 6) Transformer: a deep neural network model based on self-attention mechanism, widely used in various tasks in the field of natural language processing, such as text classification, machine translation, and question and answer systems. The model can convert input sequences into output sequences while preserving important information in the input sequences. Because the transformer model performs well in processing long texts, it has been widely used in the field of Chinese natural language processing. Compared with traditional recurrent neural networks (RNN) and convolutional neural networks (CNN), the transformer model can be calculated in parallel, speeding up the training. It has been widely used in natural language processing, speech recognition, image generation, etc.

[0058] 7) product landing page: a page used to convey information of a product, the product landing page is also used to provide the user with a function of registration, download, purchase, etc. of the product.

[0059] In the related art, when a user watches a video or listens to audio, the bullet screen moves in a single form in the screen and automatically disappears after a period of time or is manually closed by the user. The interaction between the bullet screen and the user is single, and the bullet screen is not attractive enough.

[0060] The embodiment of the present application provides a bullet screen interaction processing method, a bullet screen interaction processing device, an electronic device, a computer readable storage medium and a computer program product, which can improve the richness of the bullet screen display form.

[0061] The following describes an exemplary application of the electronic device provided by the embodiment of the present application. The electronic device provided by the embodiment of the present application can implement a terminal, such as a notebook computer, a tablet computer, a desktop computer, a set-top box, a smart television, a vehicle-mounted terminal, a virtual reality (VR) device, an augmented reality (AR) device, and various types of terminals, and can also be implemented as a server. In the following, exemplary applications when the electronic device is implemented as a terminal or a server will be described.

[0062] Referring to FIG. 1, FIG. 1 is an application mode schematic diagram of the bullet screen interaction processing method provided by the embodiment of the present application; for example, FIG. 1 involves a server 200, a network 300, a terminal 400, and a database 500. The terminal 400 is connected to the server 200 through the network 300, and the network 300 can be a wide area network or a local area network, or a combination of the two.

[0063] The terminal 400 is configured to display a first media interface (for example, a first play interface 101 and a second play interface 102, which are play interfaces at different times) of a video application or an audio application. The first media interface can be used to play any type of data, such as audio data, image data, and video data. The server 200 is configured to send audio or video data and data of an existing bullet screen to the terminal 400. The terminal 400 is also configured to send a bullet screen input by a user input operation to the server 200 through the network 300 in response to the user input operation. The database 500 can be a database of an audio platform or a video platform.

[0064] For example, when the user watches a video or listens to audio through the terminal 400, the user can send a user-edited barrage to the server 200 through the terminal 400, the user-edited barrage is displayed in the playing interface of the terminal 400 and is synchronized to the terminals of other users through the server 200, the server 200 sends audio and video data and barrage data to the terminal 400 of the user, when multiple barrages (for example, barrage text 1, barrage text 2, and barrage text 3) are displayed in the first playing interface 101, if the user performs an interactive operation on the barrage text 2 (second barrage), in the first playing interface 102, media information 103 including the barrage text 1, the barrage text 2, and the barrage text 3 is displayed, the media information 103 is a triangular pattern formed by the arrangement of the barrage text 1, the barrage text 2, and the barrage text 3. In the above manner, the interaction form between the barrage and the user is enriched, and the display manner of the barrage is enriched, and the experience of the user watching the video or listening to the audio is enhanced.

[0065] The barrage interactive processing method provided by the embodiments of the present application can be applied in an application program with a media interface, for example, a video application program (for example, a video application program capable of watching TV series, an application program for watching shopping live broadcast, a video application program for watching news video, or an application program for watching sports event video), a music application program (for example, a music application program for listening to songs or singing), a browser application program, a broadcast or audio application program (for example, an application program for listening to audio books or broadcast dramas, or an application program for watching audio comics).

[0066] The barrage interactive processing method provided by the embodiments of the present application can be applied in an application program for watching sports event video, when the user watches a basketball game, multiple first barrages (for example, barrages in which the user encourages players, or barrages in which the user guesses the result of the game) and a second barrage carrying recommendation information (for example, an advertisement picture and an advertisement word provided by a sponsor of the basketball game) are displayed in the first media interface, the user clicks the second barrage, and the following media information is displayed in the first media interface: a basketball pattern composed of multiple first barrages, and the advertisement picture and the advertisement word provided by the sponsor. Through the above barrage interactive processing, the user's sense of identification for watching the basketball game is improved, the interaction between the barrage and the user is enriched, and the user's watching experience is improved.

[0067] The method for processing the bullet screen interaction provided in the embodiments of the present application can be applied to a music application. When a user is listening to a song, a screen displayed in a first media interface includes: a scrolling lyric of the song, a first bullet screen of user comments, and a second bullet screen carrying recommendation information. When the user performs an interaction processing on the displayed second bullet screen or first bullet screen, a first media information constituted by a plurality of first bullet screens is displayed. The media information can be presented in a fixed pattern or a dynamic pattern. Through the above-mentioned interaction processing of the bullet screen, the interaction mode between the bullet screen and the user is enriched, and the listening experience of the user is improved.

[0068] In some embodiments, the server 200 can be a standalone physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and basic cloud computing services such as big data and artificial intelligence platforms. The terminal and the server can be connected directly or indirectly through wired or wireless communication, which is not limited in the embodiments of the present application.

[0069] Referring to FIG. 2, FIG. 2 is a structural schematic diagram of an electronic device provided in the embodiments of the present application. The electronic device can be the terminal in FIG. 1. The terminal 400 shown in FIG. 2 includes at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components in the terminal 400 are coupled together through a bus system 440. It can be understood that the bus system 440 is used to realize the connection and communication between the components. In addition to the data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for the purpose of clear illustration, all kinds of buses are marked as the bus system 440 in FIG. 2.

[0070] The processor 410 can be an integrated circuit chip with signal processing capability, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0071] The user interface 430 includes one or more output devices 431 that enable presentation of media information, including one or more speakers and / or one or more visual display screens. The user interface 430 also includes one or more input devices 432 that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0072] The memory 450 can be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard drives, optical drives, and the like. The memory 450 optionally includes one or more storage devices remotely located from the processor(s) 410.

[0073] The memory 450 includes volatile memory or nonvolatile memory, or both. Nonvolatile memory can be read only memory (ROM), and volatile memory can be random access memory (RAM). The memory 450 described herein is intended to include any suitable type of memory.

[0074] In some embodiments, the memory 450 is capable of storing data to support various operations, examples of such data including programs, modules, and data structures or subsets or superset thereof, exemplarily illustrated as follows.

[0075] The operating system 451 includes systems programs for handling various basic system services and for performing hardware dependent tasks, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services as well as handling hardware dependent tasks;

[0076] The network communication module 452 is configured to communicate to other electronic devices via one or more network interfaces 420 (wired or wireless), exemplary network interfaces 420 including Bluetooth, wireless fidelity (WiFi), universal serial bus (USB), and the like;

[0077] The presentation module 453 is configured to enable presentation of information via one or more output devices 431 (e.g., display screens, speakers, and the like) associated with the user interface 430 (e.g., user interfaces for operating peripheral devices and displaying content and information);

[0078] The input processing module 454 is configured to detect and interpret one or more user inputs or interactions from one or more input devices 432.

[0079] In some embodiments, the device provided by the embodiments of the present application can be implemented in software. FIG. 2 shows a barrage interactive processing device 455 stored in a memory 450, which can be software in the form of programs and plug-ins, including the following software modules: a display module 4551, a data processing module 4552. These modules are logical, and thus can be combined or further split according to the implemented functions. In FIG. 2, all the above modules are shown at one time for the convenience of expression, but should not be regarded as excluding the implementation that the barrage interactive processing device 455 can only include the display module 4551. The functions of the various modules will be described below.

[0080] In some embodiments, the terminal or server can implement the barrage interactive processing method provided by the embodiments of the present application by running a computer program. For example, the computer executable instructions can be microprogram level commands, machine instructions or software instructions. The computer program can be a native program in the operating system or a software module; can be a native application (APP), i.e. a program that needs to be installed in the operating system to run, such as a video APP, a live broadcast APP or an instant messaging APP; or can be a small program that can be embedded into any APP, i.e. a program that only needs to be downloaded into a browser environment to run. In summary, the above computer executable instructions can be any form of instructions, and the above computer program can be any form of application program, module or plug-in.

[0081] The barrage interactive processing method provided by the embodiments of the present application will be described in conjunction with exemplary applications and implementations of the terminal provided by the embodiments of the present application.

[0082] The barrage interactive processing method provided by the embodiments of the present application will be described below. As described above, the electronic device implementing the barrage interactive processing method of the embodiments of the present application can be a terminal or a server, or a combination of the two. Therefore, the execution subject of each step will not be repeated in the following description.

[0083] It should be noted that in the following examples of barrage interactive processing, online played videos or audios are taken as examples for illustration. Those skilled in the art can apply the barrage interactive processing method provided by the embodiments of the present application to other types of scenes in which barrage can be inserted, such as live broadcast of videos or audios, according to the understanding of the following description.

[0084] Referring to FIG. 3A, which is a flowchart of the barrage interactive processing method provided by the embodiments of the present application, the steps shown in FIG. 3A will be described. The execution subject of the steps in FIG. 3A is the terminal 400 in FIG. 1.

[0085] In step 301, a first media interface is displayed.

[0086] For example, the first media interface is an interface for playing media information, and the media information includes but is not limited to audio data, video data or text and image data. The first media interface displays the media information and the barrage formed by the comments issued by the user.

[0087] In the embodiments of the present application, the first media interface is taken as a video playing interface as an example, and the same is applicable to an audio playing interface. The display form of the barrage can be divided into two categories according to the degree of integration with the video content: embedded barrage and independent barrage (for example, the barrage can be displayed in the upper layer of the video picture). These two modes have their own characteristics in technical implementation, interactive logic and user experience, and are suitable for different scene requirements. The embedded barrage is deeply combined with the video content. The embedded barrage directly integrates the barrage into the video picture through technical means, so that it becomes part of the video content, and even dynamically interacts with the picture elements, for example, the font, color and motion trail of the embedded barrage can match the video style (such as the brush calligraphy barrage in the ancient style video), the barrage is embedded in a specific area (such as the sky, wall and other backgrounds) in the video picture through image segmentation technology (such as semantic segmentation), so as to avoid blocking the main body. The independent barrage is suspended in the information layer above the video picture. The independent barrage is overlaid on the video picture in an independent layer, and is visually separated from the video content. The independent barrage usually avoids interfering with the main picture in the video picture through transparency, position or time difference. The independent barrage exists in the upper layer of the video player, and can be controlled independently (such as closing the barrage without affecting the original video). By flexibly selecting the embedded or independent mode, the barrage can not only become an extension of the content, but also serve as an independent social layer, meeting the multi-level needs from “watching” to “participating”.

[0088] In step 302, at least one first barrage and at least one second barrage are displayed in the first media interface.

[0089] For example, the type of the first barrage includes: a barrage edited by the user (for example, a barrage edited by the user for evaluating the video); and a pre-configured barrage bound to the video or audio data (for example, a text generated according to the label, title or content of the video data or audio data), and the pre-configured barrage is pre-configured by a video provider.

[0090] The second barrage is a barrage different from the first barrage, and the second barrage can be a barrage carrying recommendation information. The recommendation information can be an advertising material, for example, an advertising picture, an advertising word or an advertising video. The second barrage can be provided by an advertising provider.

[0091] Referring to FIG. 4A, FIG. 4A is a first schematic diagram of a human-computer interaction interface provided by an embodiment of the present application; the playing interface 401A (a first media interface) includes a plurality of first bullet screens 402A and a second bullet screen 403A. For example, the first bullet screen 402A is a bullet screen edited by a user, and the first bullet screen 402A expresses the aftertaste of the user for the video; and the second bullet screen 403A is a bullet screen carrying an advertisement picture and a recommended text “scatter flowers with a certain brand”, which indicates that the “certain brand” has launched an advertisement through the video.

[0092] In step 303, in response to the interactive operation on the second bullet screen, first media information including at least one first bullet screen is displayed.

[0093] For example, the interactive operation includes, but is not limited to, a touch operation such as a click operation, a long press operation, a drag operation, a double-click operation, a double-finger gathering operation or a double-finger dispersing operation, and a non-contact operation such as body sense detection, eye movement detection, voice triggering, and the like. The media information can be a pattern formed by arranging the at least one first bullet screen.

[0094] Referring to FIG. 4C, FIG. 4C is a third schematic diagram of a human-computer interaction interface provided by an embodiment of the present application; when the second bullet screen in FIG. 4A receives a click operation, a screen as shown in FIG. 4C is displayed, and the playing interface 401C includes a pattern 402C as media information, and the pattern 402C is a flower pattern formed by the first bullet screens 402A.

[0095] According to the embodiments of the present application, different types of bullet screens (i.e., the first bullet screens and the second bullet screen) are displayed in the first media interface, and when an interactive operation on the second bullet screen is received, first media information including the first bullet screens is displayed, which enriches the display mode of the bullet screens and enhances the interactivity of the bullet screens. At least one second bullet screen is selectively configured to trigger the first media information formed by the first bullet screens, which can save the computing resources required for displaying the bullet screens compared with a scheme in which all the bullet screens have the function of triggering the display of the media information.

[0096] In some embodiments, the second bullet screen includes recommendation information; and step 303 can be implemented by the following manner: in response to a first triggering operation on the recommendation information in the second bullet screen in the first media interface, the first media information including at least one first bullet screen is displayed.

[0097] For example, the first triggering operation can be a touch operation such as a click operation, a double-click operation, and the like, and a non-contact operation such as body sense detection, eye movement detection, voice triggering, and the like.

[0098] Therefore, by limiting the second barrage to include recommendation information and binding a trigger operation, the embodiments of the present application realize seamless connection of accurate content recommendation and user operation, utilize the immediacy and interactivity of the barrage, and upgrade the traditional one-way comment of the barrage to an operable recommendation portal. A user can directly jump to associated content (first media information) by triggering the recommendation information in the second barrage, while retaining the context association of the original barrage (first barrage), thereby improving the efficiency and conversion rate of content distribution, optimizing the interface space utilization rate through non-intrusive design, and enhancing user engagement and operation convenience.

[0099] In some embodiments, the first media information includes at least one pattern formed by at least one first barrage. The number of patterns presented can be at least one. The type of pattern includes at least one of the following:

[0100] Type 1: an identifier of a first object recommended by the recommendation information.

[0101] For example, the recommendation information is in the second barrage, the recommendation information can be text or a picture, and the first object is the object being recommended. The identifier of the first object can be the outline of the first object, the trademark of the first object, the first letter of the name of the first object, or the abbreviation of the name of the first object. For example, if the recommendation information is used to recommend a product, the first object is the product, and the identifier of the first object can be the trademark of the product.

[0102] For example, the recommendation information in the second barrage 403A in FIG. 4A includes an advertisement picture and recommendation text “with a certain brand to scatter flowers”, and the first object recommended by the recommendation information can be “flowers”. Therefore, the type of the pattern displayed in FIG. 4C is a flower pattern related to the content of the recommendation text.

[0103] Type 2: an element in the recommendation information.

[0104] For example, the element can be a pattern in the recommendation information or a pattern representing the semantic representation of the text in the recommendation information.

[0105] Type 3: an identifier of a second object triggering the second barrage.

[0106] For example, the second object triggering the second barrage is a user, and the identifier of the second object can be the outline of the user's avatar, the name of the user, the type of the user, etc. The type of the user can be represented by a pattern referring to the membership level.

[0107] Type 4: an identifier of a third object matched with the at least one first barrage.

[0108] The third object matched with the first barrage can be a recalled recommended object. Feature extraction is performed on the at least one first barrage to obtain an embedding vector feature of the barrage. An object feature of each of the plurality of candidate objects using the first media interface is obtained. Similarities between the object features and the embedding vector feature are determined. The candidate objects with similarities greater than a similarity threshold are determined as the recalled recommended objects.

[0109] In some embodiments, when the first media information including the at least one first barrage is displayed, in response to a second trigger operation on the first media information, the currently displayed first media information is switched to other media information, which is different from the first media information.

[0110] The other media information can be media information of a type different from that of the first media information, or third media information formed by adding content to the first media information. The second trigger operation can be a contact operation such as clicking, double-clicking, or long pressing, or a non-contact operation such as body sensing detection, eye movement detection, or voice triggering.

[0111] In this way, the embodiments of the present application achieve flexible switching between media information through the response mechanism of the second trigger operation, which not only expands the depth and continuity of the barrage interaction, but also enhances the diversity of content recommendation and the freedom of user exploration, so that the barrage system is upgraded from single content guidance to a recommendation closed loop that can be browsed in a loop, thereby improving the user experience.

[0112] When the pattern formed by the arrangement of the at least one first barrage is displayed, in response to a second trigger operation on the current type of pattern, the pattern is switched from the current type to a pattern of another type.

[0113] The second trigger operation can be the same as or different from the first trigger operation. The second trigger operation can be a clicking operation. The other type can be any type different from the current type.

[0114] For example, referring to FIG. 4E, which is a fifth schematic diagram of a human-computer interaction interface provided by an embodiment of the present application, in response to a clicking operation (i.e., a second trigger operation) on the pattern 402C (formed by the first media information) in the playing interface 401C in FIG. 4C, the pattern 402C is switched to the pattern 401E in FIG. 4E (formed by other media information). The first barrage 402A used in the pattern 401E is the same as that in the pattern 402C. The pattern 402C is a pattern in which the first barrage 402A is arranged in the shape of a flower, and the pattern 401E is a pattern in which the first barrage 402A is arranged in the shape of a diamond ring.

[0115] In some embodiments, displaying the first media information including the at least one first comment can be achieved by: in a case where the first media information is in an image format, displaying an image of a pattern constituted by the at least one first comment; and in a case where the first media information is in a video format, playing a video of a static pattern or a dynamic pattern constituted by the at least one first comment.

[0116] For example, in a case where the first media information is in an image format, the first media information is an image of a pattern constituted by the at least one first comment. In a case where the first media information is in a video format, the pattern constituted by the at least one first comment can be a static fixed pattern (i.e., a static pattern) or a dynamic pattern (i.e., a dynamic pattern).

[0117] For example, the media information is compatible with different formats. In a case where the first media information is in an image format, the first media information can be a recommended information (recommended text, recommended image) or an image constituted by comment text. Taking a case where the first media interface belongs to an interface corresponding to a video player as an example, in the video player, a layer for displaying comments is located above a layer for displaying a video. Before displaying the media information, the media information is converted into a format that can be called by a comment application programming interface (API) of the video player. The comment API calculates a moving speed and a moving track of the media information in a screen, and renders the media information to the layer for displaying comments according to the moving speed and the moving track, thereby forming an effect that the media information is displayed above the video picture.

[0118] In a case where the first media information is in a video format, the first media information can be a dynamic pattern constituted by recommended information (recommended text, recommended image) or comment text, for example, a pattern contour line is maintained unchanged, and each character in the pattern or an image of the recommended information rotates in a clockwise or counterclockwise direction. In a case where the first media interface belongs to an interface corresponding to a first video player, in the video player, a second layer for displaying the first media information is located above a first layer for displaying an original video. The first media information can be played by a second video player that is different from the first video player. The second video player renders the first media information to the second layer, and a transparent channel value of a part of the first media information other than the pattern and the character is set to 1 (representing complete transparency), thereby forming an effect that the media information is displayed above the video picture.

[0119] In the embodiments of the present application, the media information is compatible with different formats, and can be flexibly inserted into various players of different first media information to be displayed, thereby improving the universality of the embodiments of the present application.

[0120] In some embodiments, the first barrage can also be an advertising barrage, the advertising barrage comprising an advertising text and an advertising picture, and the first media information comprising the at least one first barrage can be a pattern composed of the advertising barrage.

[0121] In some embodiments, the first media information further comprises at least one of:

[0122] 1. Special effect animation associated with the recommendation information.

[0123] For example, the recommendation information is in the second barrage, and as shown in FIG. 4C, the playing interface 401C further displays a special effect element 404C, which can be a dynamic pattern, i.e., a special effect animation.

[0124] 2. The second barrage.

[0125] For example, the second barrage can be directly displayed or arranged in a pattern. In addition to the first barrage, the second barrage can also be used to arrange a pattern. Assuming that the second barrage carries recommendation text, the recommendation text is arranged in a pattern, and the arrangement manner is the same as that of the first barrage, which will not be described here.

[0126] 3. Barrage other than the first barrage and the second barrage.

[0127] For example, the first barrage and the second barrage exist before the display of the media information, and in addition to the first barrage and the second barrage, other barrages can also be displayed when the media information is displayed, for example, newly published barrages after the first barrage.

[0128] In the embodiments of the present application, by displaying multiple different contents in the first media information, the richness of the media information is improved, the visual experience of the user is improved, the interactivity between the barrage and the user is enhanced, and thus the recommendation effect of the recommendation information is improved.

[0129] In some embodiments, the at least one first barrage is arranged in the first media information in descending order or ascending order according to the specific parameter. For example, the arrangement in descending order or ascending order can be realized by the following manner: in the first media information, from top to bottom, from left to right, the specific parameter of each first barrage arranged is sequentially reduced; or in the first media information, from top to bottom, from left to right, the specific parameter of each first barrage arranged is sequentially increased.

[0130] For example, the type of the specific parameter comprises:

[0131] Type 1, the publishing time of the first barrage.

[0132] For example, if the first barrage is a barrage content published by the user, the publishing time is the time when the user publishes a barrage comment for the video.

[0133] The relevance degree of the first comment and the second comment.

[0134] In an example, the text features of the first comment and the text features of the second comment can be extracted by a neural network model for text processing, and the similarity between the text features of the first comment and the text features of the second comment can be determined, and the similarity between the features can be taken as an index representing the relevance degree. The value range of the similarity is greater than or equal to 0 and less than or equal to 1, and the closer to 1, the higher the relevance degree of the first comment and the second comment.

[0135] In the embodiments of the present application, the calculation method of the similarity between the text features of the first comment and the text features of the second comment is not limited, for example, the Euclidean distance between the text features of the first comment and the text features of the second comment is calculated, and the Euclidean distance is determined as the similarity, wherein the Euclidean distance is the straight-line distance of two feature vectors in space; the cosine similarity between the text features of the first comment and the text features of the second comment is calculated, and the cosine similarity is determined as the similarity, wherein the cosine similarity is the cosine value of the included angle of two feature vectors; the Pearson correlation coefficient between the text features of the first comment and the text features of the second comment is calculated, and the Pearson correlation coefficient is determined as the similarity, wherein the Pearson correlation coefficient is the linear correlation of two feature vectors.

[0136] Type 3, the relevance degree of the first comment and the currently played content.

[0137] In an example, assuming that the currently played content is a video, the text feature vector of the first comment and the image feature vector of the video frame of the currently played content can be extracted by a cross-modal neural network model, and the similarity (for example, cosine similarity) between the text feature vector of the first comment and the image feature vector of the currently played content is determined. The similarity is taken as an index representing the relevance degree, and the closer to 1, the higher the relevance degree of the first comment and the currently played content.

[0138] Assuming that the currently played content is an audio, the text feature vector of the first comment and the audio feature vector of the audio frame of the currently played content can be extracted by a cross-modal neural network model, and the similarity (for example, cosine similarity) between the text feature vector of the first comment and the audio feature vector of the currently played content is determined. The similarity is taken as an index representing the relevance degree, and the closer to 1, the higher the relevance degree of the first comment and the currently played content.

[0139] In the embodiments of the present application, the calculation method of the similarity between the text feature vector of the first barrage and the audio feature vector of the current playing content is not limited to the above, for example, the Euclidean distance between the text feature vector of the first barrage and the audio feature vector of the current playing content is calculated, and the Euclidean distance is determined as the similarity, wherein the Euclidean distance is the straight line distance between two feature vectors in space; the cosine similarity between the text feature vector of the first barrage and the audio feature vector of the current playing content is calculated, and the cosine similarity is determined as the similarity, wherein the cosine similarity is the cosine value of the included angle between two feature vectors; the Pearson correlation coefficient between the text feature vector of the first barrage and the audio feature vector of the current playing content is calculated, and the Pearson correlation coefficient is determined as the similarity, wherein the Pearson correlation coefficient is the linear correlation between two feature vectors.

[0140] The type 4 is the repetition degree of the first barrage and other first barrages, and the other first barrages are barrages other than the first barrage.

[0141] For example, the repetition degree can be represented by the weighted sum of the similarity and the number of character repetitions, and the similarity can be obtained as described above. The number of character repetitions can be determined by the following method: for the first barrage i and another first barrage j, each character of the first barrage i is traversed, and the traversed character is compared with the other first barrage j to determine whether the character exists in the other first barrage j. If it exists, the number of character repetitions is incremented by 1, and the next character of the first barrage i is traversed until the entire first barrage i is traversed.

[0142] For example, in the case that at least one first barrage is arranged in the first media information in descending order or ascending order according to a specific parameter, the pattern formed by the at least one first barrage includes at least one of the following: the identifier of the first object recommended by the recommendation information, wherein the recommendation information is included in the second barrage; the element in the recommendation information; the identifier of the second object triggering the second barrage; and the identifier of the third object matched with the at least one first barrage.

[0143] In some embodiments, displaying the first media information including the at least one first barrage can be achieved by the following method: in response to the number of the at least one first barrage being less than a first quantity threshold, displaying the first media information including the at least one first barrage and a copy of the at least one first barrage.

[0144] For example, the first quantity threshold can be a number of first bullet screens required to form a pattern, and the first quantity threshold can be set according to an actual application scenario. Generally, the first quantity threshold is a minimum number of first bullet screens required to ensure that the content or contour of the pattern is recognizable. The copy of the first bullet screen is obtained by copying the first bullet screen. For example, the first media information is a pattern formed by the first bullet screen. If the pattern requires 5 first bullet screens, and only 3 first bullet screens are currently displayed in the playing interface, 2 copies of any one of the 3 first bullet screens are obtained, and the 3 first bullet screens and the 2 copies of the first bullet screens form the pattern. Alternatively, any 2 of the 3 first bullet screens are copied once to obtain 2 different copies of the first bullet screen, and the 3 first bullet screens and the 2 copies of the first bullet screen form the pattern.

[0145] Referring to FIG. 4D, FIG. 4D is a fourth schematic diagram of the human-computer interaction interface provided in the embodiments of the present application. When the number of the first bullet screens displayed in FIG. 4A is less than the first quantity threshold, the first bullet screen with the content of “together towards freedom” is copied, and the pattern 402C includes the bullet screen “together towards freedom” and the copy of the bullet screen.

[0146] In the embodiments of the present application, more bullet screens are obtained by copying the first bullet screen to form a corresponding pattern, the existing first bullet screen is reused, the computing resources required to obtain the bullet screen are saved, the media information can be displayed in the case of insufficient number of bullet screens, and the versatility is improved.

[0147] In some embodiments, after receiving the interaction operation, before displaying the first media information including at least one first bullet screen, a transition animation is displayed, where the transition animation is used to show the process that each first bullet screen moves from an initial position to a position corresponding to the first media information. The initial position is a position of the first bullet screen at a time corresponding to the interaction operation.

[0148] For ease of understanding, referring to FIG. 4A and FIG. 4B, FIG. 4B is a second schematic diagram of the human-computer interaction interface provided in the embodiments of the present application; FIG. 4B shows the moving process of the bullet screen in FIG. 4A, and the playing interface 401B includes a plurality of bullet screens such as the first bullet screen 402B and the moving first bullet screen 403B. The moving first bullet screen 403B “together towards freedom” moves from one side of the screen to the other side in a straight trajectory in FIG. 4A, and the moving first bullet screen 403B “together towards freedom” converges to the center of the video picture in FIG. 4B to form a corresponding pattern.

[0149] In the embodiments of the present application, by displaying the transition animation, the process that the first bullet screen moves from the initial position to the media information is shown, so that the process of displaying the media information is smoother, and the visual experience of the user is improved.

[0150] In some embodiments, after displaying the at least one first comment and the at least one second comment in the first media interface, in response to the current playback point of the first media interface reaching a specific playback point, the first media information including the at least one first comment is displayed, wherein the specific playback point includes at least one of the following: a node including a target plot, a node including recommendation information.

[0151] For example, the media information can be a pattern formed by the at least one first comment. The current playback point is a current playback time or a segment of a video or audio; for example, for a video, the node of the target plot can be a key time point or segment in the video that meets at least one of the following conditions, for identifying a content segment (i.e., a highlight node) that attracts the attention of the audience: condition 1, the highlight node can be pre-configured by the video producer, for example, a highlight time (such as a fight, a funny point, or a key plot turning point) manually marked by the video creator during the editing stage; condition 2, the highlight node can be obtained based on user interaction behavior statistics, for example, by counting the number of interactions (such as forwarding, commenting, and liking) in the video, the part with the number of interactions greater than a pre-configured value can be regarded as a highlight node, a sliding window can also be used to analyze the mutation point of the interaction data (such as a 200% increase in the number of comments within 10 seconds), and the mutation point can be regarded as a highlight node, and a segment repeatedly played by the audience (such as a 5-second segment played more than 3 times) can also be detected, and combined with a heat map, the high-frequency playback interval can be regarded as a highlight node. For example, for a video, the node including the recommendation information can be any video segment in the display period of the second comment including the recommendation information, or a playback time.

[0152] In the embodiments of the present application, the corresponding first media information is displayed by reaching a specific playback point, without the user actively interacting with the first media interface, thereby saving the triggering process and the time required for displaying the media information.

[0153] In some embodiments, in the case where the at least one first comment in the first media information forms a pattern, before displaying the first media information including the at least one first comment, a feature extraction is performed on the current playback content of the first media interface to obtain a multimedia feature; a pattern prediction is performed on the multimedia feature to obtain a target pattern template matching the current playback content, wherein the target pattern template is used to represent the position of each comment in the pattern to be formed, and the type of the pattern includes any one of the following: an outline of a fourth object in the current playback content; an outline of a first object recommended by the recommendation information in the second comment; a symbol representing the first object; and the at least one first comment is arranged according to the target pattern template to form the pattern.

[0154] For example, the feature extraction and the pattern prediction can be implemented by a neural network model, which at least includes a feature extraction layer (for example, an encoder of a transformer model) and a classifier. The feature extraction layer is configured to extract features of the current playing content. For example, the current playing content is a video content, and the feature extraction layer extracts video features of the current playing content. The pattern prediction is a process of predicting a prediction probability of the video features belonging to a plurality of different candidate pattern templates. One of the plurality of candidate pattern templates with the highest prediction probability is selected as a target pattern template. The target pattern template is used to represent the positions of each of the bullet screens in the pattern. The target pattern template preconfigures a plurality of positions, and each of the positions is different. Each of the positions is used to fill one bullet screen.

[0155] It should be noted that, before the neural network model is applied, an initial neural network model needs to be trained, and then the trained neural network model is applied. The neural network model is trained based on a playing content sample and a pattern template. For example, based on the playing content sample, the initial neural network model is called to perform feature extraction and pattern prediction in sequence, to obtain a predicted pattern template matched with the playing content sample. After the loss function value of the neural network model is determined based on the predicted pattern template and the pattern template label, it can be determined whether the loss function value exceeds a preset threshold. When the loss function value exceeds the preset threshold, an error signal of the neural network model is determined based on the loss function, the error signal is back propagated in the neural network model, and the model parameters of each layer are updated in the process of back propagation. The form of the loss function is not limited in the embodiments of the present application. For example, the loss function can be a cross-entropy loss function or an L2 loss function.

[0156] Here, the back propagation is described. The training sample data is input to the input layer of the neural network model, passes through the hidden layer, and finally reaches the output layer and outputs the result, which is the forward propagation process of the neural network model. Since there is an error between the output result of the neural network model and the actual result, the error between the output result and the actual value is calculated, and the error is back propagated from the output layer to the hidden layer until it propagates to the input layer. In the process of back propagation, the value of the model parameter is adjusted according to the error, that is, the loss function is constructed according to the error between the output result and the actual value, and the partial derivative of the loss function with respect to the model parameter is calculated layer by layer to generate the gradient of the loss function with respect to the model parameter. Since the direction of the gradient indicates the direction of the error expansion, the gradient of the model parameter is taken as the opposite, and the sum of the original parameters of each layer model is calculated. The obtained sum result is used as the updated model parameters of each layer, so as to reduce the error caused by the model parameters. The above process is iterated until convergence.

[0157] For example, in the case that the target pattern template is obtained by pattern prediction on the multimedia features, the type of the pattern includes any one of the following: an outline of a fourth object in the currently played content; an outline of a first object recommended by recommended information in the second barrage; a symbol representing the first object.

[0158] Taking a video as an example, the fourth object can be any object or person in the frame of the currently played content, and the fourth object can be obtained by performing object recognition on the currently played frame. If there are multiple objects in the currently played content, the object with the largest proportion of the frame can be taken as the fourth object, or the object closest to the center of the frame can be the fourth object. For example, the currently played content is "a singer holding a microphone and singing", and the objects in the frame include the microphone and the singer. The microphone is the fourth object closest to the center of the frame, and the type of the pattern is the outline of the microphone.

[0159] Taking an audio as an example, the multimedia features of the currently played content at the current playing point can be obtained by feature extraction, which can be achieved by the following manner: obtaining an audio segment including the current playing point and a preset time length before the current playing point, performing speech recognition on the audio segment to obtain a speech text, and taking an object mentioned in the speech text as the fourth object. Assuming that the audio segment is pure music and does not contain speech, the object playing the pure music can be taken as the fourth object.

[0160] For example, the outline of the first object recommended by the recommended information in the second barrage; and the symbol representing the first object, which has been explained above and will not be repeated here.

[0161] In the embodiments of the present application, the pattern formed by arranging the barrage is associated with the played content, which enhances the attraction of the media information to the user and improves the interest in the process of watching the played content.

[0162] In some embodiments, after displaying at least one first barrage and at least one second barrage in the first media interface, in response to a selection operation on the at least one first barrage in the first media interface, the first media information including the selected first barrage in the selection operation is displayed.

[0163] In an example, the first media information of the first comment selected by the selection operation refers to a pattern formed by the selected first comment. The selection operation can be a long press operation on the first comment. In response to the long press operation on at least one first comment in the first media interface, the first comment subjected to the long press operation is selected as the selected first comment. In response to that no long press operation on the unselected first comment is received within a preset time, or a click operation on a blank area (an area without any comment or control) in the first media interface is received, the first media information of the first comment selected by the selection operation is displayed. It should be noted that the selection operation in the embodiments of the present application is not limited to the contact operation such as the long press operation, but can also be a non-contact operation such as the body sensing detection, eye movement detection, voice triggering, etc.

[0164] In this way, the embodiments of the present application enhance the flexibility and accuracy of the comment interaction by allowing the user to directly select the first comment and trigger the quick jump of the corresponding media information. The design upgrades the comment from a one-way comment tool to an interactive navigation medium, thereby improving the user experience and the functionality of the media interface.

[0165] In some embodiments, in the case that at least one first comment in the first media information forms a pattern, before displaying the first media information including the at least one first comment, feature extraction is performed on the at least one first comment (for example, the first comment selected by the selection operation) to obtain a text feature; pattern prediction is performed on the text feature to obtain a target pattern template matched with the selected first comment, wherein the target pattern template is used to represent the position of each comment in the pattern to be formed, and the type of the pattern includes any one of the following: the contour of a fifth object mentioned by a plurality of selected first comments; a pattern representing the commonality of a plurality of selected first comments; and the at least one first comment is arranged according to the target pattern template to form the pattern.

[0166] In an example, the feature extraction and the pattern prediction can be implemented by a neural network model, and the neural network model at least includes a feature extraction layer (for example, an encoder of a text converter model) and a classifier, and the feature extraction layer is used to perform feature extraction on the selected first comment. The pattern prediction is a process of predicting the prediction probability of the text feature belonging to a plurality of different candidate pattern templates, and one with the highest prediction probability is selected from the plurality of candidate pattern templates as the target pattern template. The target pattern template is used to represent the position of each comment in the pattern, which means that a plurality of empty positions are preconfigured in the target pattern template, and each empty position is used to fill one comment.

[0167] It should be noted that before the neural network model is applied, the initial neural network model needs to be trained, and then the trained neural network model is put into application. The neural network model is trained by the barrage sample and the pattern template label. For example, based on the barrage sample, the initial neural network model is called to perform feature extraction and pattern prediction in sequence to obtain a predicted pattern template matched with the barrage sample. After determining the value of the loss function of the neural network model through the predicted pattern template and the pattern template label, it can be determined whether the value of the loss function exceeds the preset threshold. When the value of the loss function exceeds the preset threshold, the error signal of the neural network model is determined based on the loss function, the error information is back propagated in the neural network model, and the model parameters of each layer are updated in the propagation process. The form of the loss function is not limited in the embodiments of the present application, for example, it can be a cross-entropy loss function, an L2 loss function, etc.

[0168] Here, the back propagation is described. The training sample data is input to the input layer of the neural network model, passes through the hidden layer, and finally reaches the output layer and outputs the result, which is the forward propagation process of the neural network model. Since there is an error between the output result of the neural network model and the actual result, the error between the output result and the actual value is calculated, and the error is back propagated from the output layer to the hidden layer until it propagates to the input layer. In the process of back propagation, the value of the model parameter is adjusted according to the error, that is, the loss function is constructed according to the error between the output result and the actual value, and the partial derivative of the loss function with respect to the model parameter is calculated layer by layer to generate the gradient of the loss function with respect to the model parameter. Since the direction of the gradient indicates the direction of error expansion, the gradient of the model parameter is taken as the opposite, and the sum of the original parameters of each layer model is calculated. The obtained sum result is used as the updated model parameters of each layer, so as to reduce the error caused by the model parameters. The above process is iterated until convergence.

[0169] For example, in the case of obtaining a target pattern template by pattern prediction on the text features, the type of the pattern includes any one of the following: the contour of the fifth object mentioned in the selected first barrage; and the pattern representing the commonality of the selected first barrage.

[0170] For example, the fifth object mentioned by the selected first commentaries is an object mentioned by at least two first commentaries. If there are multiple mentioned objects, the object with the highest number of mentions can be selected as the fifth object. The common pattern of the selected first commentaries can be determined by performing semantic analysis on the text features of each first commentary to obtain the object represented by each first commentary in the form of existence, and selecting the pattern of the object that is common to each first commentary as the pattern representing the commonality. For example, if the currently played content is a highlight, the content of multiple first commentaries is a positive evaluation of the highlight, and the common pattern can be a pattern representing a positive evaluation, such as “thumbs up”, “clapping”, and the like.

[0171] In the embodiments of the present application, the pattern is associated with the selected commentaries, so that the pattern and the commentaries have commonality, and the interest of users in watching the played content is improved.

[0172] In some embodiments, before displaying the first media information including at least one first commentary, in response to the number of commentaries displayed in the first media interface reaching a second number threshold, the first media information including at least one first commentary is displayed.

[0173] In this way, the embodiments of the present application automatically associate and display the first media information including the first commentaries by setting a threshold triggering mechanism for the number of commentaries, and realize intelligent content recommendation based on user interaction popularity. This design can automatically locate and jump to the first media information when the density of commentaries reaches a certain scale (i.e., the second number threshold), which not only reduces the operation burden of manual screening by users, but also improves the accuracy and timeliness of content distribution.

[0174] For example, the first media information of at least one first commentary can be a pattern composed of at least one first commentary or second commentary. The second number threshold can be set according to the actual application scenario. When the first media information is a pattern composed of at least one first commentary or second commentary, the type of the number of commentaries includes any one of the following:

[0175] Type 1, the total number of commentaries accumulated and displayed in the first media interface.

[0176] For example, the statistical range of the total number of commentaries accumulated and displayed can be the same video or audio. The total number of commentaries accumulated and displayed is accumulated from the start time of the same video or audio in which the user starts to watch or listen to the content played in the first media interface.

[0177] For example, if a user watches video 1 and continuously watches from 2 minutes and 10 seconds of video 1, the total number of displayed pop messages is calculated from 2 minutes and 10 seconds of video 1. The pop messages existing before 2 minutes and 10 seconds of the video are not counted in the total number of displayed pop messages because they are not displayed in the interface. For example, if there are 400 pop messages in the pop message data corresponding to the video, the part before 2 minutes and 10 seconds of the video corresponds to 200 pop messages. The 200 pop messages are not counted in the total number of displayed pop messages because they are not displayed in the interface.

[0178] Type 2, the number of second pop messages including recommendation information displayed in the first media interface.

[0179] For example, the second number threshold corresponding to type 2 can be smaller than the second number threshold corresponding to type 1. The statistical range of the number of second pop messages including recommendation information displayed can be within the same video or audio. If the number of second pop messages including recommendation information displayed is greater than the second number threshold, a pattern composed of at least one first pop message or second pop message is displayed.

[0180] Type 3, the number of pop messages associated with the same object displayed in the first media interface.

[0181] For example, the pop messages associated with the object refer to the names of the object included in the pop messages, or the recommendation information for recommending the object, or the positive or negative evaluation for the object. For each pop message, if the name of an object or the recommendation information for recommending the object appears in the pop message, the number of pop messages associated with the object is incremented by one. If the highest number of pop messages associated with the object among all objects is greater than the second number threshold, a pattern composed of at least one first pop message or second pop message is displayed.

[0182] Type 4, the number of same content pop messages displayed in the first media interface, wherein the pattern is composed of same content pop messages.

[0183] For example, the same content pop messages refer to the same semantics between the pop messages. The characters of the same content pop messages can have differences, for example, the content of the first pop message A is "ha ha ha", and the content of the first pop message B is "ha ha ha ha". The semantics of both is onomatopoeia for laughter. The first pop message A and the first pop message B are same content pop messages. The pattern composed of the first pop messages can be a smiley face pattern composed of multiple first pop messages.

[0184] In the embodiments of the present application, the display of the media information is triggered based on the total number of the displayed comments of a certain type, and the first media information formed by the corresponding comments is generated without the user actively interacting with the first media interface, the different types from different angles enhance the interaction between the comments and the user, save the process of comment interaction processing, improve the interest of watching the first media interface, and improve the user experience.

[0185] In some embodiments, when the first media information including at least one first comment is displayed, a trigger control associated with the recommendation information is displayed, wherein the recommendation information is included in the second comment; in response to a third trigger operation on the trigger control, a recommendation page corresponding to the recommendation information is displayed.

[0186] For example, the third trigger operation can also trigger the display of an atmosphere animation, and the recommendation page is displayed when the atmosphere animation is played. If the recommendation information is for recommending a certain product, the recommendation page can be a product landing page of the product. Referring to FIG. 4C, the playing interface 401C further includes a trigger control 403C, and the text “scatter flowers” displayed in the trigger control 403C is associated with the content “scatter flowers with a certain brand” included in the second comment 403A in FIG. 4C (recommendation information). In response to a third trigger operation on the trigger control 403C, an atmosphere animation is played, for example, the atmosphere animation can be composed of a plurality of special effect elements 404C. The special effect element 404C can be a dynamic pattern.

[0187] In this way, the embodiments of the present application realize seamless connection from comment interaction to content recommendation by synchronously displaying the trigger control associated with the recommendation information when displaying the first media information. This design not only enriches the interaction dimension of the comments, but also enables the user to conveniently obtain the extension information (i.e., the recommendation page) related to the recommendation information, thereby improving the conversion rate of the recommendation information and the content distribution efficiency, while maintaining the coherence of the user's viewing experience.

[0188] In some embodiments, when the first media information including at least one first comment is displayed, in response to a fourth trigger operation on the media information, a recommendation page corresponding to the recommendation information is displayed, wherein the recommendation information is included in the second comment.

[0189] For example, the fourth trigger operation can be a touch operation such as clicking, long pressing, double clicking, etc. on the media information, and can also be a non-contact operation. For example, if the trigger control 403C in FIG. 4C is not displayed, the display of the recommendation page can be triggered by clicking the pattern 402C. The fourth trigger operation can also trigger the display of an atmosphere animation, and the recommendation page is displayed when the atmosphere animation is played.

[0190] In the embodiments of the present application, the first media information formed by the display of the barrage is displayed, and the display of the recommended page is triggered by the media information or the specific trigger control, which enriches the display mode of the barrage and the display mode of the recommended page, and associates the recommended page with the barrage, thereby improving the interest of the user in watching the recommended content and improving the recommendation effect.

[0191] In some embodiments, when the first media information including at least one first barrage is displayed, the current playing content of the first media interface can be paused.

[0192] In this way, the embodiments of the present application pause the current playing content when the media information is displayed, thereby avoiding the user from missing the current playing content when watching the media information and improving the user's watching experience.

[0193] In some embodiments, when the first media information including at least one first barrage is displayed, the content can be continuously played in the first media interface, and the first media information can be displayed in a region of the first media interface where there is no dynamic object.

[0194] For example, the dynamic object can be a moving object or animal, a person in the first media interface. When the video is continuously played, the first media information formed by the barrage is displayed in the region where there is no dynamic object, thereby avoiding the occlusion of the media information to the object in the video, not affecting the user's watching experience, and improving the convenience of the barrage interaction processing.

[0195] In some embodiments, in the case where the second media information is continuously played in the first media interface, in response to the appearance of a new first barrage in the first media interface, the first media information is updated based on the new first barrage.

[0196] For example, the updating of the first media information based on the new first barrage can be implemented in any of the following ways:

[0197] Method 1: adding the new first barrage to the first media information.

[0198] For example, in the case of method 1, assuming that the first media information is a pattern arranged by the barrage, the outline of the pattern can be maintained, and the character density of the pattern outline can be increased by the new first barrage, so that the pattern is more perfect. Referring to FIG. 4H, which is an eighth schematic diagram of the human-computer interaction interface provided by the embodiments of the present application, the playing interface 401H includes a pattern 402H, the video in the playing interface 401H is continuously played, and new barrages "new barrage 1" to "new barrage 4" are displayed, the pattern 402H is updated based on one of the new barrages "new barrage 1", the updated pattern 403H is obtained, and the updated pattern 403H has "new barrage 1" in addition to the pattern 402H.

[0199] Manner 2: add the new first bullet screen to the first media information, and change the form of the first media information.

[0200] For example, assuming that the first media information is a pattern of bullet screens, the change of the form of the first media information can be implemented in the following manner: based on the new first bullet screen and the existing bullet screens in the first media information, and other types of bullet screen templates, a new first media information is generated.

[0201] In some embodiments, the at least one first bullet screen is displayed in a first display manner and a second display manner respectively; when the at least one first bullet screen is displayed in the first media interface, in response to a sixth triggering operation of the first bullet screen in the first display manner, an interaction interface corresponding to a sixth object corresponding to the triggered first bullet screen is displayed, wherein the first display manner represents that the first bullet screen matches the object information of the second object using the first media interface, and the sixth object is the object sending the triggered first bullet screen.

[0202] For example, the second object is a user using the first media interface, when the second object allows the media interface to read its own object information, the application program corresponding to the media interface can match the object information with the bullet screens displayed in the media interface, and obtain the first bullet screen matched with the second object. The first display manner and the second display manner are different display manners, and the second display manner can be a display manner in a color, font, etc. different from the first display manner. Alternatively, the second display manner is to enclose the bullet screen by a frame line (solid line or dashed line). The sixth object is the user sending the triggered first bullet screen.

[0203] Referring to FIG. 4G, FIG. 4G is a seventh schematic diagram of the human-computer interaction interface provided in the embodiments of the present application; the playing interface 401G includes a highlighted first bullet screen 402G, the highlighted first bullet screen 402G includes the bullet screen content and the avatar (user identifier) of the user sending the bullet screen, for example: the bullet screen content "the fragrance of the rose is more than the gift" and the avatar of the user presented as a smiling face pattern. In response to a triggering operation on the highlighted first bullet screen 402G, an interaction interface corresponding to the user sending the bullet screen is displayed.

[0204] In the embodiments of the present application, the bullet screen matched with the user using the media interface is displayed in a distinguished manner, and the interaction interface of the user sending the bullet screen is displayed by triggering the bullet screen, thereby enriching the social manner through the bullet screen interaction.

[0205] In some embodiments, when the first media information including the at least one first barrage is displayed, the first media information including the at least one first barrage is restored to the at least one first barrage located at the initial position in response to the gesture operation on the first media interface; or a cancel control is displayed, and the first media information including the at least one first barrage is restored to the at least one first barrage located at the initial position in response to a fifth trigger operation on the cancel control, where the initial position is a position of the first barrage at a time corresponding to the interaction operation.

[0206] For example, the gesture operation is an interaction mode for controlling an electronic device or a software interface by a hand or a body action, such as waving a hand or shaking a terminal. The gesture operation can be acquired by a sensor or a camera of a terminal used by a user.

[0207] For example, the fifth trigger operation can be a click operation. With reference to FIG. 4D, the screen of the playing interface 401C in FIG. 4D is restored to the screen of the playing interface 401A in FIG. 4A in response to the trigger operation on the cancel control 401D. Taking one barrage as an example, the first barrage "together to freedom" is restored from the position in FIG. 4D to a position at a time when the interaction operation is received in FIG. 4A.

[0208] In the embodiments of the present application, the manner of restoring the first media information constituted by the barrage is provided, the degree of freedom of the interactive processing of the barrage is improved, and the viewing experience of the user is improved.

[0209] In the embodiments of the present application, the different types of barrages are displayed in the first media interface, the first media information including the first barrage is displayed when the trigger operation on the second barrage is received, the display mode of the barrage is enriched, and the interactivity of the barrage is enhanced. The at least one second barrage is selectively configured to trigger the first media information formed by the first barrage, and compared with the scheme that all the barrages have the function of triggering the display of the media information, the computing resources required for displaying the barrage can be saved.

[0210] In some embodiments, the present application further provides a method for interactive processing of a barrage. Referring to FIG. 3B, FIG. 3B is a flowchart of a method for interactive processing of a barrage according to an embodiment of the present application. The execution subject of the steps in FIG. 3B can be the terminal 400 in FIG. 1.

[0211] In step 311, a first media interface is displayed.

[0212] For example, the implementation of step 311 can refer to step 301 of FIG. 3A, and details are not described herein again.

[0213] In step 312, at least one barrage is displayed in the first media interface.

[0214] For example, the type of the at least one barrage includes at least one of: a barrage including recommendation information, and a barrage not including recommendation information. That is, the at least one barrage can all be barrages including recommendation information; the at least one barrage can all be barrages not including recommendation information; when the number of the at least one barrage is multiple, the multiple barrages can be a mixture of barrages including recommendation information and barrages not including recommendation information.

[0215] In step 313, in response to the interactive operation in the first media interface, the first media information including the at least one barrage is displayed.

[0216] For example, assuming that the number of the at least one barrage is multiple, the multiple barrages can include barrages including recommendation information and barrages not including recommendation information, the media information can be a pattern formed by arranging the barrages including recommendation information and the barrages not including recommendation information. Referring to FIG. 4F, FIG. 4F is a sixth schematic diagram of a human-computer interaction interface provided by an embodiment of the present application. FIG. 4F is a schematic diagram of a playing interface in which media information is constituted by the barrages in FIG. 4A. The playing interface 401F includes a pattern 402F constituted by the multiple first barrages 402A (for example, a first barrage with content of “together to freedom”) and the second barrage 403A in FIG. 4A.

[0217] In some embodiments, the at least one barrage in the first media information is arranged to form a pattern, and the type of the pattern includes at least one of:

[0218] Type 1: an identifier of a first object to which the at least one barrage relates.

[0219] For example, the barrage relating to the first object means that the barrage is a comment for the first object; the identifier of the first object can be an outline, a trademark, or a first letter of a name of the first object. Assuming that the multiple barrages are positive or negative comments for a first object A, the pattern of type 1 can be the first letter A of the name of the first object A.

[0220] Type 2: an element in the at least one barrage.

[0221] For example, the element can be a pattern in recommendation information included in the barrage; if the barrage does not include recommendation information, the element in the barrage can be a character in the barrage or a morphological object involved in the barrage.

[0222] Type 3: an identifier of a second object sending the at least one barrage.

[0223] For example, the second object sending the barrage is a user, and the identification of the second object can be the user's avatar contour, name, type, and the user type can be represented by a pattern referring to a membership level. If the barrage is a barrage carrying recommendation information, the second object sending the barrage can be a brand side that provides the recommendation information, and the identification of the second object can be the name or trademark of the brand side.

[0224] In some embodiments, when the pattern formed by the arrangement of at least one barrage is displayed, the pattern is switched from the current type to a pattern of another type in response to a second triggering operation for the current type of pattern.

[0225] For example, the process of switching the pattern from the current type to a pattern of another type has been described above and will not be repeated here.

[0226] In some embodiments, the first media information including at least one barrage is displayed, and in the case where the type of the first media information is an image format, an image of the pattern formed by at least one barrage is displayed; and in the case where the type of the first media information is a video format, a video of a static pattern or a dynamic pattern formed by at least one barrage is played.

[0227] For example, the media information is compatible with different formats, and in the case where the first media information is an image format, the first media information can be an image formed by recommendation information (recommendation text, recommendation image) and barrage text. Taking an interface belonging to a video player as an example, in the video player, the layer displaying the barrage is located above the layer displaying the video. Before displaying the media information, the media information is converted into a format that can be called by a barrage application programming interface (API) of the video player. The barrage application programming interface calculates the moving speed and moving track of the media information in the screen, and renders the media information to the layer displaying the barrage according to the moving speed and moving track, thereby forming an effect that the media information is displayed above the video picture.

[0228] In a case where the first media information is in a video format, the first media information can be recommendation information (recommendation text, recommended image), a dynamic pattern composed of barrage text, for example, a pattern outline is maintained unchanged, and each character in the pattern and the image of the recommendation information rotates in a clockwise or counterclockwise direction. In a case where the first media interface belongs to an interface corresponding to the first video player, the second layer displaying the first media information is located above the first layer displaying the original video in the video player. The first media information can be played through a second video player different from the first video player. The second video player renders the first media information onto the second layer, and the transparent channel value of a part of the first media information other than the pattern and the character is set to 1 (representing complete transparency), so as to present an effect that the media information is displayed above the video picture.

[0229] In some embodiments, at least one piece of barrage is arranged in the first media information in descending order or ascending order of a specific parameter, wherein the specific parameter includes: a posting time of the barrage; a correlation degree of the barrage with other barrages, the other barrages being barrages other than the barrage; a correlation degree of the barrage with the currently played content; and a type of a pattern composed of the at least one piece of barrage, including: an identifier of a first object recommended by recommendation information in the barrage; an element in the recommendation information in the barrage; and an identifier of a third object matched with the at least one piece of barrage.

[0230] In an example, the third object matched with the barrage is a recalled recommended object. Feature extraction is performed on the at least one piece of barrage to obtain an embedding vector feature of the barrage. An object feature of each candidate object using the first media interface is obtained. A similarity between each object feature and the embedding vector feature is determined. A candidate object with a similarity greater than a similarity threshold is taken as a recalled recommended object. Other specific parameters have been explained above and will not be repeated here.

[0231] In some embodiments, when the at least one piece of barrage is a plurality of barrages, displaying the first media information including the at least one piece of barrage can be achieved by: in response to a number of the at least one piece of barrage being less than a first number threshold, displaying the first media information including the at least one piece of barrage and a copy of the at least one piece of barrage.

[0232] In an example, the first number threshold can be a number of barrages required to constitute a pattern. The first number threshold can be set according to an actual application scenario. The first number threshold can be a minimum number of barrages required to ensure that the content or outline of the pattern is recognizable. The copy of the barrage is a copy of the barrage. For example, the media information is a pattern composed of barrages. If the pattern requires 5 barrages, only 1 barrage is currently displayed in the playing interface. The 1 barrage is copied 4 times to obtain 4 copy barrages. The 1 barrage and the 4 copy barrages constitute the pattern.

[0233] In some embodiments, before displaying the first media information including the at least one barrage, a transition animation is displayed, where the transition animation is used to represent the following process: each barrage moves from an initial position to a position corresponding to the first media information, the initial position being a position of the barrage at a time corresponding to the interaction operation.

[0234] The transition animation has been explained above and will not be repeated here.

[0235] In some embodiments, after displaying the first media information including the at least one barrage, in response to the current playback point of the first media interface reaching a specific playback point, the first media information including the at least one barrage is displayed, where the specific playback point includes at least one of the following: a node including a target plot, a node including recommendation information.

[0236] In some embodiments, in a case where the at least one barrage in the first media information is arranged to form a pattern, before displaying the first media information including the at least one barrage, a multimedia feature is extracted from the current playback content of the first media interface, and a target pattern template matching the current playback content is predicted from the multimedia feature, where the target pattern template is used to represent the position of each barrage in the pattern, and the type of the pattern includes any one of the following: the contour of a fourth object in the current playback content; the contour of a first object recommended by the recommendation information; a symbol representing the first object; and the at least one barrage is arranged according to the target pattern template to form the pattern.

[0237] The principle of obtaining the pattern formed by the barrage according to the current playback content has been explained above and will not be repeated here.

[0238] In some embodiments, after displaying the first media information including the at least one barrage, in response to a selection operation on the at least one barrage in the first media interface, the first media information including the barrage selected by the selection operation is displayed.

[0239] In some embodiments, in a case where the at least one barrage in the first media information is arranged to form a pattern, before displaying the first media information including the at least one barrage, a text feature is extracted from the at least one barrage, and a target pattern template matching the selected barrage is predicted from the text feature, where the target pattern template is used to represent the position of each barrage in the pattern, and the type of the pattern includes any one of the following: the contour of a fifth object mentioned by the plurality of selected barrages; a pattern representing the commonality of the plurality of selected barrages; and the at least one barrage is arranged according to the target pattern template to form the pattern.

[0240] For example, the principle of obtaining the pattern constituted by the selected barrage according to the characteristics of the barrage has been explained above, and will not be repeated here.

[0241] In the embodiment of the application, at least one barrage is displayed in the first media interface, and when the interactive operation for the first media interface is received, the first media information including the at least one barrage is displayed, which enriches the display mode of the barrage and enhances the interactivity of the barrage.

[0242] In the following, an exemplary application of the interactive processing method of the barrage in an actual application scenario will be described.

[0243] In the related art, the barrage in the video or audio is displayed in a fixed form, for example, displayed at the top, bottom, or moved from one side to the other side; and the display mode of the recommended information (for example, an advertisement) in the audio or video is mainly a pop-up window, multimedia information displayed in the center of the screen when the multimedia information is paused, etc. For example, when a user is watching a video or using an application, an advertisement is displayed in the form of a banner, which automatically disappears after a period of time or is manually closed by the user. However, the interactive mode of these advertisements is relatively single, mainly by switching to a specified page after the user clicks the advertisement, which limits the depth of interaction between the advertisement and the user. These advertisements do not take into account the real-time behavior of the user, such as clicking the barrage as a condition for triggering the advertisement, which to some extent makes the advertisement display out of touch with the actual experience of the user. The advertisement technology in the related art lacks diversity in advertisement display and interactive mode, and relies too much on time and location triggering conditions, and fails to fully utilize the information associated with the user. The advertisement form in the related art does not fully utilize the strong atmosphere display, does not form interaction with the user, and lacks more attractive and interactive advertisement forms.

[0244] The interactive processing method of the barrage provided in the embodiment of the application can display the rearranged media information by triggering the barrage, the media information can be combined with the advertisement, the user can interact with the special barrage pattern, and the product landing page can be correspondingly displayed, thereby enhancing the interactivity of the advertisement and the participation of the user.

[0245] The interactive processing method of the barrage provided in the embodiment of the application will be described below with reference to the accompanying drawings. Referring to FIG. 5, FIG. 5 is a third flowchart of the interactive processing method of the barrage provided in the embodiment of the application. The execution subject of FIG. 5 can be the terminal 400 in FIG. 1.

[0246] In step 501, a content player is displayed.

[0247] For example, the content player is displayed in the screen of the terminal 400, and the content player can be an audio or video player. The video player is taken as an example for description in the embodiment of the application.

[0248] In step 502, it is judged whether the bullet screen data associated with the video data is associated with a special bullet screen advertisement.

[0249] For example, the special bullet screen advertisement includes a bullet screen carrying recommendation information (the second bullet screen in the foregoing), a transition animation, a special bullet screen template (the pattern template in the foregoing), and a link of a product landing page corresponding to the recommendation information. The special bullet screen template is used to represent the position of each bullet screen in the pattern, and filling the user-edited bullet screen (the first bullet screen in the foregoing) in the special bullet screen target can form a special bullet screen, which refers to a pattern formed by arranging a plurality of bullet screens. The bullet screen carrying the recommendation information is used to trigger the display of the transition animation, and when the transition animation is played, the pattern formed by arranging a plurality of user-edited bullet screens is displayed. The link of the product landing page corresponding to the recommendation information is bound to the special bullet screen, and is used to switch the current playing interface to the product landing page corresponding to the recommendation information based on the link of the product landing page corresponding to the recommendation information when the special bullet screen is triggered by an interactive operation or the trigger control associated with the special bullet screen is triggered.

[0250] The judgment of whether the bullet screen data associated with the video data is associated with a special bullet screen advertisement can be implemented in the following manner: the terminal 400 detects, from the bullet screen carried by the video data, whether the bullet screen data of the video includes a bullet screen carrying recommendation information. If the bullet screen carrying recommendation information exists, it is indicated that the bullet screen data is associated with a special bullet screen advertisement. Conversely, if the bullet screen carrying recommendation information does not exist, it is indicated that the bullet screen data is not associated with a special bullet screen advertisement.

[0251] When the judgment result of step 502 is no, in step 503, a regular bullet screen is displayed.

[0252] For example, if the video is not configured with a corresponding special bullet screen, the regular bullet screen is continuously displayed. The regular bullet screen refers to a bullet screen displayed in the video in a preconfigured straight-line track or a preconfigured position.

[0253] When the judgment result of step 502 is yes, in step 504, a bullet screen carrying recommendation information is displayed.

[0254] During the video playing process, the bullet screen carrying the advertisement material, such as the bullet screen named after the sponsor, appears following the ordinary bullet screen, reminding the user that the corresponding operation can be performed on the bullet screen. Referring to FIG. 4A, which is a first schematic diagram of a human-computer interaction interface provided by an embodiment of the present application, the playing interface 401A includes a plurality of first bullet screens 402A and a second bullet screen 403A carrying recommendation information. The recommendation information is an advertisement picture and a recommendation text “with a certain brand to scatter flowers”. The recommendation text can remind the user.

[0255] In step 505, in response to the trigger operation on the bullet screen carrying the recommendation information, a transition animation is played, and a special-shaped bullet screen is displayed.

[0256] For example, the trigger operation can be an operation of the following types: a click operation, a long press operation, a drag operation, or a double-click operation, and of course can also be other types of operations. The transition animation is a process animation in which the bullet screens arranged in a regular manner move and combine into a specific arrangement, and the transition animation can also include ambient special effects, such as an advertisement picture material. When the transition animation is played, the special-shaped bullet screen is displayed.

[0257] For example, the content of the transition animation is a process in which the normal bullet screens surround the center of the video screen to form a flower-shaped pattern. Referring to FIG. 4B, FIG. 4B is a second schematic diagram of a human-computer interaction interface provided in an embodiment of the present application; FIG. 4B shows the moving process of the bullet screens in FIG. 4A, and the playing interface 401B includes a plurality of bullet screens such as the first bullet screen 402B and the moving first bullet screen 403B. The moving first bullet screen 403B “goes together to freedom” moves in a straight line from one side of the screen to the other side in FIG. 4A, and the moving first bullet screen 403B “goes together to freedom” converges to the center of the video screen in FIG. 4B to form a corresponding pattern.

[0258] Referring to FIG. 4C, FIG. 4C is a third schematic diagram of a human-computer interaction interface provided in an embodiment of the present application; FIG. 4C is a screen on which the animation in FIG. 4B is played to form a pattern. The playing interface 401C includes media information (the pattern 402C), and the pattern 402C is a flower pattern formed by a plurality of first bullet screens 402A.

[0259] In step 506, in response to the trigger operation on the superscript, an ambient animation is played.

[0260] For example, when the special-shaped bullet screen (the pattern formed by the bullet screens) is displayed, the video content can be paused or continue to be played. Referring to FIG. 4C, the playing interface 401C further includes a trigger control 403C, that is, a superscript. In response to a trigger operation on the trigger control 403C, an ambient animation is played, for example, the ambient animation can be composed of a plurality of special effect elements 404C. The special effect elements 404C can be dynamic patterns.

[0261] In step 507, a product landing page is displayed.

[0262] Referring to FIG. 4C, when the ambient animation is played, the interface in FIG. 4C is switched to a product landing page of a product recommended by the recommendation information. That is, based on a link of a product landing page corresponding to the recommendation information included in the special-shaped bullet screen advertisement, the corresponding product landing page is called, and a screen of the product landing page is displayed.

[0263] The method for processing the interaction of the barrage provided by the embodiment of the application has the following advantages: 1. The form of the advertisement is improved. During the process of watching the video, the interaction between the user and the barrage carrying the recommendation information forms a pattern of multiple barrages arranged, so that the advertisement display is closely related to the current video content of the user, the visual impact and attractiveness of the advertisement are enhanced, and the recommendation effect is better. Because the recommendation process is closely combined with the audio-visual process, the user is more likely to remember the recommended content, and the experience of the user in the recommendation process and the recommendation effect are reflected. 2. The influence on the user's watching experience is reduced. The display of the recommendation information is triggered in the natural watching process of the user, and the watching experience of the user is not interrupted, so that a smooth and uninterrupted user experience is provided. 3. The interest and interactivity of the recommendation process are increased. The pattern of barrage arrangement is generated through the interaction between the user and the special-shaped barrage, and the interactivity of the recommendation process and the participation of the user are enhanced.

[0264] The method for processing the interaction of the barrage provided by the embodiment of the application is explained below in combination with an interaction flowchart. Referring to FIG. 6, FIG. 6 is an interaction flowchart of the method for processing the interaction of the barrage provided by the embodiment of the application. FIG. 6 includes a first terminal 601, a media server 602, an advertisement engine server 603, and a second terminal 604.

[0265] In step 601, the second terminal 604 configures a special-shaped barrage advertisement.

[0266] For example, the second terminal 604 is a terminal used by an advertiser and can be a delivery end. The special-shaped barrage advertisement includes a barrage carrying advertisement materials, a transition animation of the process of forming a special-shaped barrage by the barrage, a special-shaped barrage formed by the arrangement of multiple barrages, and a corner image material for display in a corner control. Configuring the special-shaped barrage advertisement includes selecting a transition animation template (the template includes: a process animation of forming a special-shaped pattern by a barrage subtitle), a pattern template representing the arrangement position of the text in the special-shaped pattern), obtaining related advertisement materials, scripts, and atmosphere animations.

[0267] In step 602, the second terminal 604 configures the advertisement material binding content information.

[0268] For example, the information of the content to be bound by the special-shaped barrage advertisement is determined, and the association relationship between the two is established, so that the special-shaped barrage advertisement is displayed when the content is played.

[0269] In step 603, the second terminal 604 sends the special-shaped barrage advertisement to the advertisement engine server 603.

[0270] The second terminal 604 sends the configured special-shaped bullet screen advertisement to the advertisement engine server 603. The advertisement engine server 603 is a server specially used for managing, processing and delivering advertisements. The advertisement engine server 603 stores the special-shaped bullet screen advertisement until receiving a request for displaying the special-shaped bullet screen advertisement.

[0271] In step 604, the first terminal 601 plays the media information in a content player.

[0272] The first terminal 601 is a terminal used by a user, for example, a mobile phone or a computer of the user. The principle of step 604 can refer to step 501 above.

[0273] In step 605, the first terminal 601 requests the special-shaped bullet screen advertisement from the media server 602.

[0274] The first terminal 601 sends a request for displaying the special-shaped bullet screen advertisement to the media server 602. The media server 602 is used to send media data to the first terminal 601 to play online video or audio in the first terminal 601. The request for displaying the special-shaped bullet screen advertisement includes an identification of the currently played video and an instruction for detecting whether the currently played video includes the special-shaped bullet screen advertisement.

[0275] In step 606, the media server 602 requests the special-shaped bullet screen advertisement from the advertisement engine server 603.

[0276] The media server 602 forwards the request for displaying the special-shaped bullet screen advertisement to the advertisement engine server 603.

[0277] In step 607, the advertisement engine server 603 returns the special-shaped bullet screen advertisement to the media server 602.

[0278] The advertisement engine server 603 queries whether there is the special-shaped bullet screen advertisement associated with the currently played video according to the request, and returns the special-shaped bullet screen advertisement to the media server 602 if there is.

[0279] In step 608, the media server 602 returns the special-shaped bullet screen advertisement to the first terminal 601.

[0280] The media server 602 forwards the special-shaped bullet screen advertisement to the first terminal 601. The special-shaped bullet screen advertisement includes the following contents: bullet screen carrying recommendation information, special-shaped bullet screen template, transition animation and atmosphere animation.

[0281] In step 609, the first terminal 601 displays the bullet screen carrying the recommendation information.

[0282] The execution of step 609 can refer to step 504 above, which will not be described here.

[0283] In step 610, the first terminal 601 plays a transition animation and displays a special-shaped barrage in response to a trigger operation for the barrage carrying the recommendation information.

[0284] For example, the execution of step 610 can refer to step 505 above, and the special-shaped barrage is a pattern based on the barrage displayed in the first terminal 601 to fill the special-shaped barrage template, which will not be repeated here.

[0285] In step 611, the first terminal 601 plays an atmosphere animation in response to a trigger operation for the superscript.

[0286] For example, the execution of step 611 can refer to step 506 above, which will not be repeated here.

[0287] In step 612, the first terminal 601 displays a product landing page.

[0288] For example, when the atmosphere animation is played, the first terminal 601 switches the video playing interface to the product landing page.

[0289] In the embodiments of the present application, by adding interaction with the special-shaped barrage during video playing, the user can generate text related to the video content while watching the video, providing a new and lively interactive experience for the user, improving user attention, and thus improving the recommendation effect. By closely combining the barrage form with the user's viewing behavior, the user's interest and viewing experience are improved.

[0290] The following continues to illustrate an exemplary structure of the implementation of the interaction processing apparatus 455 of the barrage provided in the embodiments of the present application as a software module. In some embodiments, as shown in FIG. 2, the software module stored in the interaction processing apparatus 455 of the barrage in the memory 450 can include: a display module 4551, configured to display a first media interface; the display module 4551 is further configured to display at least one first barrage and at least one second barrage in the first media interface; the display module 4551 is further configured to display first media information including at least one first barrage in response to an interaction operation for the second barrage.

[0291] In some embodiments, the second barrage includes recommendation information; the display module 4551 is configured to display the first media information including at least one first barrage in response to a first trigger operation for the recommendation information in the first media interface.

[0292] In some embodiments, the at least one first comment in the first media information is arranged in a pattern, and the pattern is of at least one of the following types: an identifier of a first object recommended by recommendation information, wherein the recommendation information is included in the second comment; an element in the recommendation information; an identifier of a second object triggering the second comment; and an identifier of a third object matching the at least one first comment.

[0293] In some embodiments, the display module 4551 is configured to switch the currently displayed first media information to other media information in response to a second triggering operation on the first media information, the other media information being different from the first media information.

[0294] In some embodiments, the display module 4551 is configured to display an image of a pattern composed of the at least one first comment if the first media information is of an image format; and play a video of a static pattern or a dynamic pattern composed of the at least one first comment if the first media information is of a video format.

[0295] In some embodiments, the media information further includes at least one of the following: a special effect animation associated with recommendation information, wherein the recommendation information is included in the second comment; the second comment; and other comments in addition to the first comment and the second comment.

[0296] In some embodiments, the at least one first comment is arranged in the first media information in descending or ascending order of a specific parameter, and the specific parameter includes at least one of the following: a posting time of the first comment; a relevance between the first comment and the second comment; a relevance between the first comment and currently played content; a repetition degree of the first comment with respect to other first comments, the other first comments being comments other than the first comment.

[0297] In some embodiments, the display module 4551 is configured to display the first media information including the at least one first comment and a copy of the at least one first comment in response to a number of the at least one first comment being less than a first quantity threshold.

[0298] In some embodiments, the display module 4551 is configured to display a transition animation before displaying the first media information including the at least one first comment, and the transition animation is used to show a process in which each first comment moves from an initial position to a position corresponding to the first media information, the initial position being a position of the first comment at a time corresponding to the interactive operation.

[0299] In some embodiments, the display module 4551 is configured to, after displaying the at least one first comment and the at least one second comment in the first media interface, display first media information including the at least one first comment in response to a current playback point of the first media interface reaching a specific playback point, where the specific playback point includes at least one of: a node including a target plot, a node including recommendation information.

[0300] In some embodiments, the data processing module 4552 is configured to: perform feature extraction on current playback content of the first media interface to obtain multimedia features; and perform pattern prediction on the multimedia features to obtain a target pattern template matching the current playback content, where the target pattern template is used to represent a position of each comment in a to-be-formed pattern, and the type of the pattern includes any one of: an outline of a fourth object in the current playback content; an outline of a first object recommended by recommendation information in the second comment; a symbol representing the first object; and arrange the at least one first comment according to the target pattern template to form the pattern.

[0301] In some embodiments, the display module 4551 is configured to, after displaying the at least one first comment and the at least one second comment in the first media interface, display first media information including the first comment selected by a selection operation in the first media interface in response to the selection operation.

[0302] In some embodiments, the data processing module 4552 is configured to: perform feature extraction on the at least one first comment to obtain text features; and perform pattern prediction on the text features to obtain a target pattern template matching the selected first comment, where the target pattern template is used to represent a position of each comment in a to-be-formed pattern, and the type of the pattern includes any one of: an outline of a fifth object mentioned by a plurality of selected first comments; a pattern representing commonality of the plurality of selected first comments; and arrange the at least one first comment according to the target pattern template to form the pattern.

[0303] In some embodiments, the display module 4551 is configured to, before displaying the first media information including the at least one first comment, display the first media information including the at least one first comment in response to a number of comments displayed in the first media interface reaching a second quantity threshold.

[0304] In some embodiments, the type of the number of the barrage includes any one of the following: a total number of barrages displayed in the first media interface; a number of second barrages including recommendation information displayed in the first media interface; a number of barrages associated with a same object displayed in the first media interface; and a number of barrages of a same content displayed in the first media interface, wherein the pattern is formed by barrages of the same content.

[0305] In some embodiments, the display module 4551 is configured to, when displaying the first media information including at least one first barrage, display a trigger control associated with recommendation information, wherein the recommendation information is included in a second barrage; and in response to a third trigger operation on the trigger control, display a recommendation page corresponding to the recommendation information.

[0306] In some embodiments, the display module 4551 is configured to, when displaying the first media information including at least one first barrage, in response to a fourth trigger operation on the media information, display a recommendation page corresponding to recommendation information, wherein the recommendation information is included in a second barrage.

[0307] In some embodiments, the display module 4551 is configured to, when displaying the first media information including at least one first barrage, pause playing of a currently played content of the first media interface.

[0308] In some embodiments, the display module 4551 is configured to continuously play the second media information in the first media interface, and display the media information in a region in which there is no dynamic object in the first media interface.

[0309] In some embodiments, the display module 4551 is configured to, in a case where the second media information is continuously played in the first media interface, in response to appearance of a new first barrage in the first media interface, update the first media information based on the new first barrage.

[0310] In some embodiments, the at least one first barrage is displayed in a first display manner and a second display manner respectively; and the display module 4551 is configured to, when displaying the at least one first barrage in the first media interface, the method further includes:

[0311] In response to a sixth trigger operation on the first barrage displayed in the first display manner, displaying an interaction interface corresponding to a sixth object corresponding to the triggered first barrage, wherein the first display manner represents that the first barrage matches object information of a second object using the first media interface, and the sixth object is an object sending the triggered first barrage.

[0312] In some embodiments, the display module 4551 is configured to, when displaying the first media information including the at least one first barrage, in response to the gesture operation on the first media interface, restore the first media information including the at least one first barrage to the at least one first barrage located at the initial position, wherein the initial position is the position of the first barrage at the time corresponding to the interaction operation.

[0313] In some embodiments, the display module 4551 displays the release control, and in response to a fifth trigger operation on the release control, restores the first media information including the at least one first barrage to the at least one first barrage located at the initial position, wherein the initial position is the position of the first barrage at the time corresponding to the interaction operation.

[0314] The embodiments of the present application also provide an interaction processing apparatus for a barrage, which comprises a display module 4551 configured to display a first media interface; the display module 4551 is further configured to display at least one barrage in the first media interface; and the display module 4551 is further configured to display first media information including the at least one barrage in response to an interaction operation in the first media interface.

[0315] In some embodiments, the at least one barrage is arranged to form a pattern in the first media information, and the type of the pattern includes at least one of the following: an identifier of a first object involved in the at least one barrage; an element in the at least one barrage; and an identifier of a second object sending the at least one barrage.

[0316] In some embodiments, the display module 4551 is configured to, when displaying the first media information including the at least one barrage, in response to a second trigger operation on the first media information, switch the currently displayed first media information to other media information. When the at least one barrage is arranged to form a pattern, in response to a second trigger operation on the current type of pattern, the pattern is switched from the current type to another type of pattern.

[0317] In some embodiments, the display module 4551 is configured to, when the type of the first media information is an image format, display an image of the pattern composed of the at least one barrage; and when the type of the first media information is a video format, play a video of a fixed pattern or a dynamic pattern composed of the at least one barrage.

[0318] In some embodiments, the at least one BRS is arranged in the first media information according to a descending order or an ascending order of a specific parameter, where the specific parameter includes: a publishing time of the BRS; a relevance of the BRS to other BRSs, the other BRSs being BRSs other than the BRS; a relevance of the BRS to a currently played content; a type of a pattern formed by the at least one BRS, the type including: an identifier of a first object recommended by recommendation information in the BRS; an element in the recommendation information in the BRS; an identifier of a third object matching the at least one BRS.

[0319] In some embodiments, the display module 4551 is configured to, when the at least one BRS is a plurality of BRSs, display the first media information including the at least one BRS and a copy of the at least one BRS, in response to a number of the at least one BRS being less than a first number threshold.

[0320] In some embodiments, the display module 4551 is configured to, before displaying the first media information including the at least one BRS, display a transition animation, where the transition animation is used to represent a process in which each BRS moves from an initial position to a position corresponding to the first media information, the initial position being a position of the BRS at a time corresponding to the interactive operation.

[0321] In some embodiments, the display module 4551 is configured to, after displaying the first media information including the at least one BRS, display the first media information including the at least one BRS, in response to a current playback point of the first media interface reaching a specific playback point, where the specific playback point includes at least one of: a node including a target plot, a node including recommendation information.

[0322] In some embodiments, the data processing module 4552 is configured to, when the at least one BRS is arranged to form a pattern in the first media information, before displaying the first media information including the at least one BRS, perform feature extraction on a currently played content of the first media interface to obtain a multimedia feature; perform pattern prediction on the multimedia feature to obtain a target pattern template matching the currently played content, where the target pattern template is used to represent a position of each BRS in a to-be-formed pattern, and the type of the pattern includes any one of: an outline of a fourth object in the currently played content; an outline of a first object recommended by recommendation information; a symbol representing the first object; and arranging the at least one BRS according to the target pattern template to form the pattern.

[0323] In some embodiments, the display module 4551 is configured to, after displaying the first media information including the at least one BRS, display the first media information including the at least one BRS selected by a selection operation on the at least one BRS in the first media interface, in response to the selection operation.

[0324] In some embodiments, the data processing module 4552 is configured to, in a case where at least one piece of the bullet screen comment in the first media information is arranged to form a pattern, perform feature extraction on the at least one piece of the bullet screen comment before displaying the first media information including the at least one piece of the bullet screen comment, to obtain a text feature; perform pattern prediction on the text feature, to obtain a target pattern template matching the selected bullet screen comment, wherein the target pattern template is used to represent a position of each bullet screen comment in the pattern to be formed, and the type of the pattern includes any one of the following: an outline of a fifth object mentioned by the selected bullet screen comment; a pattern representing commonality of the selected bullet screen comment; and arranging the at least one piece of the bullet screen comment according to the target pattern template to form the pattern.

[0325] The embodiments of the present application provide a computer program product, which includes a computer program or computer executable instructions stored in a computer readable storage medium. A processor of an electronic device reads the computer program or computer executable instructions from the computer readable storage medium, and the processor executes the computer program or computer executable instructions, so that the electronic device performs the interactive processing method of the bullet screen comment provided by the embodiments of the present application.

[0326] The embodiments of the present application provide a computer readable storage medium storing computer executable instructions, wherein the computer executable instructions or computer programs are stored, and when the computer executable instructions or computer programs are executed by a processor, the processor will execute the interactive processing method of the bullet screen comment provided by the embodiments of the present application, for example, the interactive processing method of the bullet screen comment as shown in FIG. 3A or FIG. 3B.

[0327] In some embodiments, the computer readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; or various devices including one or any combination of the above memories.

[0328] In some embodiments, the computer executable instructions can be in the form of programs, software, software modules, scripts or codes, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and can be deployed in any form, including being deployed as independent programs or being deployed as modules, components, subroutines or other units suitable for use in a computing environment.

[0329] By way of example, computer-executable instructions can be, but need not be, related to the application software that runs on the website server. By way of further example, computer- executable instructions can be, but need not be, related to the application software that runs on a server that exchanges data with the website server. Such servers can be located in the same physical location as the website server, or can be remotely located from the website server. Where a system of servers is used, it will be appreciated that the functionality associated with the website server can be distributed among one or more servers located at one or more physical locations.

[0330] By way of example, the computer-executable instructions can be deployed to be executed on one electronic device or on multiple electronic devices that are located at one site or that are distributed over multiple sites and that are interconnected by a communication network.

[0331] To sum up, through the embodiments of the present application, by displaying different types of bullet screen in the first media interface, when receiving the interactive operation for the second bullet screen, the first media information including the first bullet screen is displayed, which enriches the display mode of the bullet screen and enhances the interactivity of the bullet screen. At least one second bullet screen is selectively configured to trigger the first media information formed by the first bullet screen, compared with the scheme that all the bullet screens have the function of triggering the display of the media information, the required computing resources for displaying the bullet screen can be saved.

[0332] The above merely describes the embodiments of the present application, but is not used to limit the protection scope of the present application. Any modification, equivalent replacement and improvement made within the spirit and scope of the present application shall be included in the protection scope of the present application.

Claims

1. A method for processing interaction of a barrage, applied to an electronic device, the method comprising: displaying a first media interface; displaying at least one first barrage and at least one second barrage in the first media interface; in response to an interaction operation on the second barrage, displaying first media information comprising the at least one first barrage.

2. The method of claim 1, wherein, The second barrage comprises recommendation information; The response to the interaction operation on the second barrage, displaying first media information comprising the at least one first barrage, comprises: in response to a first trigger operation on the recommendation information in the first media interface, displaying first media information comprising the at least one first barrage.

3. The method of any one of claims 1 to 2, wherein, The at least one first barrage in the first media information is arranged to form a pattern, and the type of the pattern comprises at least one of: an identifier of a first object recommended by the recommendation information, wherein the recommendation information is included in the second barrage; an element in the recommendation information; an identifier of a second object triggering the second barrage; an identifier of a third object matched with the at least one first barrage.

4. The method according to any one of claims 1 to 3, wherein, When displaying the first media information comprising the at least one first barrage, the method further comprises: in response to a second trigger operation on the first media information, switching the currently displayed first media information to other media information, which is different from the first media information.

5. The method according to any one of claims 1 to 4, wherein, The display of the first media information comprising the at least one first barrage comprises: in a case where the type of the first media information is an image format, displaying an image of a pattern composed of the at least one first barrage; in a case where the type of the first media information is a video format, playing a video of a static pattern or a dynamic pattern composed of the at least one first barrage.

6. The method according to any one of claims 1 to 5, wherein, The first media information further comprises at least one of: a special effect animation associated with the recommendation information, wherein the recommendation information is included in the second barrage; the second barrage; other barrages in addition to the first barrage and the second barrage.

7. The method of any one of claims 1-6, wherein: The at least one first barrage is arranged in the first media information in descending order or ascending order of a specific parameter, wherein the specific parameter comprises: a posting time of the first barrage; a correlation degree of the first barrage with the second barrage; a correlation degree of the first barrage with currently played content; a repetition degree of the first barrage with other first barrages, the other first barrages being barrages other than the first barrage.

8. The method according to any one of claims 1 to 7, wherein, The display of the first media information comprising the at least one first barrage comprises: in response to the number of the at least one first barrage being less than a first quantity threshold, displaying first media information comprising the at least one first barrage and a copy of the at least one first barrage.

9. The method according to any one of claims 1 to 8, wherein, Before the display of the first media information comprising the at least one first barrage, the method further comprises: display a transition animation, wherein the transition animation is used to show a process that each first barrage moves from an initial position to a position corresponding to the first media information.

10. The method according to any one of claims 1 to 9, wherein, After displaying the at least one first barrage and the at least one second barrage in the first media interface, the method further includes: In response to a current playback point of the first media interface reaching a specific playback point, displaying first media information including the at least one first barrage, wherein the specific playback point includes at least one of the following: a node including a target plot, a node including recommendation information.

11. The method according to any one of claims 1 to 10, wherein, In a case where the at least one first barrage in the first media information is arranged to form a pattern, before displaying the first media information including the at least one first barrage, the method further includes: performing feature extraction on current playback content of the first media interface to obtain multimedia features; performing pattern prediction on the multimedia features to obtain a target pattern template matching the current playback content, wherein the target pattern template is used to represent a position of each barrage in a to-be-formed pattern, and a type of the pattern includes any one of the following: an outline of a fourth object in the current playback content; an outline of a first object recommended by recommendation information in the second barrage; a symbol representing the first object; arranging the at least one first barrage according to the target pattern template to form the pattern.

12. The method according to any one of claims 1 to 11, wherein, After displaying the at least one first barrage and the at least one second barrage in the first media interface, the method further includes: In response to a selection operation on at least one first barrage in the first media interface, displaying first media information including the first barrage selected by the selection operation.

13. The method according to any one of claims 1 to 12, wherein, In a case where the at least one first barrage in the first media information is arranged to form a pattern, before displaying the first media information including the at least one first barrage, the method further includes: performing feature extraction on the at least one first barrage to obtain text features; performing pattern prediction on the text features to obtain a target pattern template matching the selected first barrage, wherein the target pattern template is used to represent a position of each barrage in a to-be-formed pattern, and a type of the pattern includes any one of the following: an outline of a fifth object mentioned by a plurality of selected first barrages; a pattern representing commonality of the plurality of selected first barrages; arranging the at least one first barrage according to the target pattern template to form the pattern.

14. The method according to any one of claims 1 to 13, wherein, The method further includes: In response to a number of barrages displayed in the first media interface reaching a second quantity threshold, displaying first media information including the at least one first barrage.

15. The method of claim 14, wherein, The type of the number of barrages includes any one of the following: a total number of barrages accumulated and displayed in the first media interface; a number of second barrages including recommendation information accumulated and displayed in the first media interface; a number of barrages associated with a same object accumulated and displayed in the first media interface; A number of identical content bullet screens accumulated in the first media interface, wherein the pattern is formed by the identical content bullet.

16. The method of any one of claims 1 to 15, wherein, When the first media information including the at least one first bullet is displayed, the method further includes: displaying a trigger control associated with the recommendation information, wherein the recommendation information is included in the second bullet; in response to a third trigger operation on the trigger control, displaying a recommendation page corresponding to the recommendation information.

17. The method of any one of claims 1 to 16, wherein, When the first media information including the at least one first bullet is displayed, the method further includes: in response to a fourth trigger operation on the first media information, displaying a recommendation page corresponding to the recommendation information, wherein the recommendation information is included in the second bullet.

18. The method of any one of claims 1 to 17, wherein, When the first media information including the at least one first bullet is displayed, the method further includes: pause playing the current playing content of the first media interface.

19. The method of any one of claims 1 to 18, wherein, When the first media information including the at least one first bullet is displayed, the method further includes: continuously playing the second media information in the first media interface, and displaying the first media information in a region of the first media interface where there is no dynamic object.

20. The method of claim 19, wherein, When the second media information is continuously played in the first media interface, the method further includes: in response to the appearance of a new first bullet in the first media interface, updating the first media information based on the new first bullet.

21. The method of any one of claims 1 to 20, wherein, The at least one first bullet is displayed in a first display mode and a second display mode respectively. When the at least one first bullet is displayed in the first media interface, the method further includes: in response to a sixth trigger operation on the first bullet displayed in the first display mode, displaying an interaction interface corresponding to a sixth object corresponding to the triggered first bullet, wherein the first display mode represents that the first bullet matches the object information of the second object using the first media interface, and the sixth object is the object that sent the triggered first bullet.

22. The method of any one of claims 1 to 21, wherein, When the first media information including the at least one first bullet is displayed, the method further includes: in response to a gesture operation on the first media interface, restoring the first media information including the at least one first bullet to the at least one first bullet located at an initial position, wherein the initial position is the position of the first bullet at the time corresponding to the interaction operation.

23. The method of any one of claims 1 to 22, wherein, When the first media information including the at least one first bullet is displayed, the method further includes: displaying a release control, and in response to a fifth trigger operation on the release control, restoring the first media information including the at least one first bullet to the at least one first bullet located at an initial position, wherein the initial position is the position of the first bullet at the time corresponding to the interaction operation.

24. A bullet interaction processing method applied to an electronic device, the method comprising: displaying a first media interface; displaying at least one bullet in the first media interface; in response to an interaction operation in the first media interface, displaying first media information including the at least one bullet.

25. The method of claim 24, wherein, The at least one comment in the first media information forms a pattern, and a type of the pattern includes at least one of the following: an identifier of a first object related to the at least one comment; an element in the at least one comment; an identifier of a second object that sends the at least one comment.

26. The method of any one of claims 24-25, wherein, When the first media information including the at least one comment is displayed, the method further includes: in response to a second trigger operation on the first media information, switching the currently displayed first media information to other media information.

27. The method of any one of claims 24 to 26, wherein, The display of the first media information including the at least one comment includes: in a case where a type of the first media information is an image format, displaying an image of a pattern formed by the at least one comment; in a case where the type of the first media information is a video format, playing a video of a static pattern or a dynamic pattern formed by the at least one comment.

28. The method of claim 27, wherein: the at least one comment is arranged in the first media information in descending order or ascending order of a specific parameter, and the specific parameter includes: a posting time of the comment; a relevance of the comment to other comments, the other comments being comments other than the comment; a relevance of the comment to currently played content; a type of the pattern formed by the at least one comment includes: an identifier of a first object recommended by recommendation information in the comment; an element in the recommendation information in the comment; an identifier of a third object matched with the at least one comment.

29. The method of any one of claims 24 to 28, wherein, When the at least one comment is a plurality of comments, the display of the first media information including the at least one comment includes: in response to a number of the at least one comment being less than a first number threshold, displaying the first media information including the at least one comment and a copy of the at least one comment.

30. The method of any one of claims 24 to 29, wherein, Before the display of the first media information including the at least one comment, the method further includes: displaying a transition animation, wherein the transition animation is used to show a process that each of the comments moves from an initial position to a position corresponding to the first media information, and the initial position is a position of the comment at a time corresponding to the interactive operation.

31. The method of any one of claims 24 to 30, wherein, After the display of the first media information including the at least one comment, the method further includes: in response to a current playback point of the first media interface reaching a specific playback point, displaying the first media information including the at least one comment, wherein the specific playback point includes at least one of the following: a node including a target plot, a node including recommendation information.

32. The method of claim 31, wherein, In a case where the at least one comment in the first media information forms a pattern, before the display of the first media information including the at least one comment, the method further includes: performing feature extraction on current played content of the first media interface to obtain multimedia features; The multimedia feature is pattern predicted to obtain a target pattern template matching the current playing content, wherein the target pattern template is used to represent the position of each barrage in the pattern to be formed, and the type of the pattern includes any one of the following: the contour of a fourth object in the current playing content; the contour of a first object recommended by the recommendation information; a symbol representing the first object; The at least one barrage is arranged according to the target pattern template to form the pattern.

33. The method of any one of claims 24 to 32, wherein, After the first media information including the at least one barrage is displayed, the method further includes: In response to a selection operation on at least one of the barrages in the first media interface, first media information including the barrage selected by the selection operation is displayed.

34. The method of claim 33, wherein, In a case where the at least one barrage in the first media information is arranged to form a pattern, before the first media information including the at least one barrage is displayed, the method further includes: The at least one barrage is subjected to feature extraction to obtain text features; The text features are subjected to pattern prediction to obtain a target pattern template matching the selected barrage, wherein the target pattern template is used to represent the position of each barrage in the pattern to be formed, and the type of the pattern includes any one of the following: the contour of a fifth object mentioned by a plurality of selected barrages; a pattern representing the commonality of a plurality of selected barrages; The at least one barrage is arranged according to the target pattern template to form the pattern.

35. An interaction processing apparatus for a barrage, the apparatus comprising: a display module configured to display a first media interface; the display module is further configured to display at least one first barrage and at least one second barrage in the first media interface; the display module is further configured to display first media information including the at least one first barrage in response to an interaction operation on the second barrage.

36. An interaction processing apparatus for a barrage, the apparatus comprising: a display module configured to display a first media interface; the display module is further configured to display at least one barrage in the first media interface; the display module is further configured to display first media information including the at least one barrage in response to an interaction operation in the first media interface.

37. An electronic device, the electronic device comprising: a memory configured to store computer executable instructions or computer programs; a processor configured to execute the computer executable instructions or computer programs stored in the memory to implement the interaction processing method for a barrage according to any one of claims 1 to 34.

38. A computer readable storage medium storing computer executable instructions or computer programs, the computer executable instructions or computer programs being executed by a processor to implement the interaction processing method for a barrage according to any one of claims 1 to 34.

39. A computer program product comprising computer executable instructions or computer programs, the computer executable instructions or computer programs being executed by a processor to implement the interaction processing method for a barrage according to any one of claims 1 to 34.

Citation Information

Patent Citations

  • Bullet screen display method and device thereof, electronic equipment and computer storage medium

    CN111479156A

  • Bullet screen processing method and electronic equipment

    CN114938474A

  • Bullet screen display method and device, equipment and storage medium

    CN115167724A

  • Bullet screen generation method and device, electronic equipment and storage medium

    CN115623280A

  • Bullet screen display method and device, equipment and storage medium

    CN115734015A