Bullet screen interaction processing method and device, equipment, storage medium and program product

Abstract

The invention provides a bullet screen interaction processing method and device, electronic equipment, a computer program product and a computer readable storage medium. The method comprises the steps of displaying a first media interface; displaying at least one first bullet screen and at least one second bullet screen in the first media interface; and displaying second media content including the at least one first bullet screen in response to an interaction operation for the second bullet screen. According to the invention, the rich degree of bullet screen display forms can be improved.

Description

Technical Field

[0001] This application relates to computer technology, and more particularly to an interactive processing method, apparatus, device, storage medium, and program product for bullet comments. Background Technology

[0002] Bullet comments are audio and video commentary text. Taking video bullet comments as an example, the comments appear as transparent or semi-transparent text on the video. Users can interact with other viewers in real time through bullet comments without obscuring the video content. Video bullet comments move from one side of the screen to the other at a certain speed, or appear at the top or bottom of the screen. However, current technologies for bullet comments have limited movement methods and simple forms of interaction with users, lacking diverse interactive experiences.

[0003] Currently, there is no good way to improve the interactivity between bullet comments and users. Summary of the Invention

[0004] This application provides an interactive processing method, apparatus, electronic device, computer-readable storage medium, and computer program product for bullet comments, which can enhance the richness of bullet comment display formats.

[0005] The technical solution of this application embodiment is implemented as follows:

[0006] This application provides an interactive processing method for bullet comments, the method including:

[0007] Display the first media interface;

[0008] Display at least one first bullet comment and at least one second bullet comment in the first media interface;

[0009] In response to an interactive action on the second bullet comment, second media content including the at least one first bullet comment is displayed.

[0010] This application provides an interactive processing method for bullet comments, the method including:

[0011] Display the first media interface;

[0012] Display at least one bullet comment on the first media interface;

[0013] In response to an interactive operation in the first media interface, second media content including the at least one bullet comment is displayed.

[0014] This application provides an interactive processing device for bullet comments, including:

[0015] The display module is used to display the first media interface;

[0016] The display module is also used to display at least one first bullet comment and at least one second bullet comment in the first media interface;

[0017] The display module is also configured to display second media content including the at least one first comment in response to an interactive operation on the second comment.

[0018] This application provides an interactive processing device for bullet comments, including:

[0019] The display module is used to display the first media interface;

[0020] The display module is also used to display at least one bullet screen in the first media interface;

[0021] The display module is also configured to display second media content, including the at least one bullet screen, in response to an interactive operation in the first media interface.

[0022] This application provides an electronic device, the electronic device comprising:

[0023] Memory is used to store executable instructions or computer programs.

[0024] The processor, when executing computer-executable instructions or computer programs stored in the memory, implements the interactive processing method for bullet comments provided in the embodiments of this application.

[0025] This application provides a computer-readable storage medium storing computer-executable instructions or computer programs, which, when executed by a processor, implement the interactive processing method for bullet comments provided in this application.

[0026] This application provides a computer program product, including a computer program or computer executable instructions. When the computer program or computer executable instructions are executed by a processor, they implement the interactive processing method for bullet comments provided in this application.

[0027] The embodiments of this application have the following beneficial effects:

[0028] By displaying different types of bullet comments in the first media interface, and then displaying second media content including the first bullet comment when a trigger operation for the second bullet comment is received, the display methods of bullet comments are enriched and the interactivity of bullet comments is enhanced. Selectively configuring at least one second bullet comment to trigger the second media content formed by the first bullet comment saves computing resources required for displaying bullet comments compared to a scheme where all bullet comments have the function of triggering media content display. Attached Figure Description

[0029] Figure 1This is a schematic diagram illustrating the application mode of the interactive processing method for bullet comments provided in the embodiments of this application;

[0030] Figure 2 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0031] Figure 3A This is a first flowchart illustrating the interactive processing method for bullet comments provided in this application embodiment;

[0032] Figure 3B This is a second flowchart illustrating the interactive processing method for bullet comments provided in the embodiments of this application;

[0033] Figure 4A This is a first schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0034] Figure 4B This is a second schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0035] Figure 4C This is a third schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0036] Figure 4D This is a fourth schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0037] Figure 4E This is the fifth schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0038] Figure 4F This is the sixth schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0039] Figure 4G This is the seventh schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0040] Figure 4H This is the eighth schematic diagram of the human-computer interaction interface provided in the embodiments of this application;

[0041] Figure 5 This is a schematic diagram of the third process of the interactive processing method for bullet comments provided in the embodiments of this application;

[0042] Figure 6 This is a schematic diagram of the interactive process of the bullet screen interactive processing method provided in the embodiments of this application.

[0043] It should be noted that the terms "first" and "second" mentioned above are only used to distinguish between different options and do not represent the degree of superiority or inferiority of the options or their priority in the implementation process. Detailed Implementation

[0044] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0045] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0046] It should be noted that the data collection and processing in this application should strictly comply with the requirements of relevant laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of laws and regulations and the authorization of the personal information subject.

[0047] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functions of that module or unit.

[0048] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0049] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0050] 1) Bullet comments: Also known as bullet screen messages, these are messages that viewers can send in real-time to interact with during online video or audio playback, such as comments, bullet screen messages, and text messages. Bullet comments are displayed on the screen in scrolling, top, or bottom formats, providing viewers with a way to communicate and interact instantly.

[0051] 2) Irregular bullet screen: This is a special visual form formed by bullet screens. For example, it can be formed by at least one bullet screen in a specific arrangement to form a specific pattern.

[0052] 3) Operation: is a method used to trigger the device to perform processing, such as click operation, double click operation, long press operation, swipe operation, gesture operation, received trigger command, etc.; in addition, the various operations in the embodiments of this application can be a single operation or a collective term for multiple operations; and the various interactive operations in the embodiments of this application can be touch operation or non-touch operation.

[0053] 4) Control: A control is a triggerable piece of information displayed in the form of a region, button, icon, link, text, selection box, input box, and tab; the triggering method can be contact triggering, non-contact triggering, or instruction-based triggering, etc.; in addition, the various controls in the embodiments of this application can be a single control or a collective term for multiple controls.

[0054] 5) Responding to: used to indicate the conditions or states on which the operation is performed depends. When the conditions or states on which it depends are met, one or more operations may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0055] 6) Transformer Model: A deep neural network model based on self-attention mechanism, widely used in various tasks in natural language processing, such as text classification, machine translation, and question answering systems. This model can transform an input sequence into an output sequence while retaining important information from the input sequence. Because of its excellent performance in processing long texts, the transformer model has been widely used in Chinese natural language processing. Compared to traditional recurrent neural networks (RNNs) and convolutional neural networks (CNNs), the transformer model can be computed in parallel, accelerating training. It has wide applications in tasks such as natural language processing, speech recognition, and image generation.

[0056] 7) Product landing page: A page used to convey product information. The product landing page is also used to provide users with functions such as product registration, download, and purchase.

[0057] In related technologies, when users watch videos or listen to audio, bullet comments move across the screen in a single form, disappearing automatically after a period of time or being manually closed by the user. The interaction between bullet comments and users is simplistic, resulting in insufficient appeal.

[0058] This application provides an interactive processing method for bullet comments, an interactive processing device for bullet comments, an electronic device, a computer-readable storage medium, and a computer program product, which can enhance the richness of bullet comment display formats.

[0059] The following describes exemplary applications of the electronic devices provided in the embodiments of this application. These electronic devices can be implemented as terminal devices, such as laptops, tablets, desktop computers, set-top boxes, smart TVs, in-vehicle terminals, virtual reality (VR) devices, augmented reality (AR) devices, and other various types of terminals. They can also be implemented as servers. The following will describe exemplary applications when the electronic device is implemented as a terminal device or a server.

[0060] refer to Figure 1 , Figure 1 This is a schematic diagram illustrating the application mode of the interactive processing method for bullet comments provided in the embodiments of this application; for example, Figure 1 The system involves server 200, network 300, terminal device 400, and database 500. Terminal device 400 is connected to server 200 through network 300, which can be a wide area network, a local area network, or a combination of both.

[0061] Terminal device 400 is used to display a first media interface for video or audio applications (e.g., a first playback interface 101 and a second playback interface 102, where the first playback interface 101 and the second playback interface 102 are playback interfaces at different times). The first media interface can be used to play any type of data: audio data, image data, and video data. Server 200 is used to send audio or video data and existing bullet comments to terminal device 400. Terminal device 400 can also respond to user input operations and send the bullet comments entered by the input operation to server 200 via network 300. Database 500 can be a database of an audio platform or a video platform.

[0062] For example, when a user watches a video or listens to audio through terminal device 400, the user can send user-edited bullet comments to server 200 through terminal device 400. The user-edited bullet comments are displayed on the playback interface of terminal device 400 and synchronized to other users' terminal devices through server 200. Server 200 sends audio and video data and bullet comment data to user's terminal device 400. When multiple bullet comments are displayed in the first playback interface 101 (e.g., bullet comment text 1, bullet comment text 2, and bullet comment text 3), if the user performs an interactive operation on bullet comment text 2 (the second bullet comment), media content 103 including bullet comment text 1, bullet comment text 2, and bullet comment text 3 is displayed in the first playback interface 102. Media content 103 is a triangular pattern formed by the arrangement of bullet comment text 1, bullet comment text 2, and bullet comment text 3. Through the above method, the interaction between bullet comments and users is enriched, as is the display method of bullet comments, which can enhance the user's experience of watching videos or listening to audio.

[0063] The interactive processing method for bullet comments provided in this application embodiment can be applied to applications with media interfaces, such as: video applications (e.g., video applications that can watch TV series, applications that can watch live shopping, video applications that can watch news videos, or applications that can watch sports event videos), music applications (e.g., music applications for listening to songs or singing), browser applications, and broadcast or audio applications (e.g., applications for listening to audiobooks or radio dramas, or applications for watching audio comics).

[0064] The interactive processing method for bullet comments provided in this application can be applied to applications for watching sports event videos. When a user watches a basketball game, multiple first bullet comments (e.g., bullet comments encouraging players, bullet comments predicting the game's outcome) and second bullet comments carrying recommendation information (e.g., advertising images and slogans provided by the basketball game's sponsors) are displayed on the first media interface. When the user clicks on a second bullet comment, the following media content is displayed on the first media interface: a basketball image composed of multiple first bullet comments, and advertising images and slogans provided by the sponsors. Through the above interactive processing of bullet comments, the user's immersion in watching basketball games is enhanced, the interaction between bullet comments and the user is enriched, and the user's viewing experience is improved.

[0065] The interactive processing method for bullet comments provided in this application can be applied to music applications. When a user listens to a song, the screen displayed on the first media interface includes: scrolling lyrics of the song, first bullet comments from the user, and second bullet comments carrying recommendation information. When the user interacts with the displayed second or first bullet comments, second media content consisting of multiple first bullet comments is displayed. The media content can be presented in the form of fixed patterns or dynamic patterns. Through the above-mentioned interactive processing of bullet comments, the interaction between bullet comments and users is enriched, and the user's listening experience is improved.

[0066] In some embodiments, server 200 may be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. Terminals and servers can be connected directly or indirectly via wired or wireless communication, which is not limited in this embodiment.

[0067] This application embodiment can be implemented using database technology. A database, simply put, can be viewed as an electronic filing cabinet storing electronic files, where users can perform operations such as adding, querying, updating, and deleting data. A "database" is a collection of data stored together in a certain way, capable of being shared by multiple users, having minimal redundancy, and being independent of application programs.

[0068] A Database Management System (DBMS) is a computer software system designed to manage databases, generally possessing basic functions such as storage, retrieval, security, and backup. DBMSs can be classified according to the database model they support, such as relational or XML (Extensible Markup Language); or according to the type of computer they support, such as server clusters or mobile devices; or according to the query language used, such as Structured Query Language (SQL) or XQuery; or according to performance priorities, such as maximum scale or maximum operating speed; or other classification methods. Regardless of the classification method used, some DBMSs can cross categories, for example, simultaneously supporting multiple query languages.

[0069] This application embodiment can also be implemented using cloud technology. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on cloud computing business models. It can form a resource pool, available on demand, offering flexibility and convenience. Cloud computing technology will become a crucial support. Backend services of technical network systems require substantial computing and storage resources, such as video websites, image websites, and many portal websites. With the rapid development and application of the internet industry, and driven by demands for search services, social networks, mobile commerce, and open collaboration, every item may eventually possess its own hash-coded identification mark, requiring transmission to a backend system for logical processing. Data at different levels will be processed separately, and various industry data will require robust system support, which can only be achieved through cloud computing.

[0070] This application embodiment can also be implemented using Artificial Intelligence (AI) technology. AI is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce a new type of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess perception, reasoning, and decision-making capabilities.

[0071] Artificial intelligence (AI) is a comprehensive discipline encompassing a wide range of fields, including both hardware and software technologies. Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, pre-trained model technology, operating / interactive systems, and mechatronics. Among these, pre-trained models, also known as large-scale models or foundational models, can be widely applied to downstream tasks across various AI fields after fine-tuning. AI software technologies primarily include computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0072] See Figure 2 , Figure 2 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device may be... Figure 1 Terminal devices in the middle, Figure 2 The terminal device 400 shown includes at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components in the terminal device 400 are coupled together via a bus system 440. It is understood that the bus system 440 is used to implement communication between these components. In addition to a data bus, the bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 2 The general labeled all buses as Bus System 440.

[0073] The processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0074] User interface 430 includes one or more output devices 431 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0075] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 450 may optionally include one or more storage devices physically located away from the processor 410.

[0076] The memory 450 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 450 described in this application embodiment is intended to include any suitable type of memory.

[0077] In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0078] Operating system 451 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks;

[0079] The network communication module 452 is used to reach other electronic devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc.

[0080] Presentation module 453 is configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 (e.g., a display screen, a speaker, etc.) associated with user interface 430;

[0081] The input processing module 454 is used to detect and translate one or more user inputs or interactions from one or more input devices 432.

[0082] In some embodiments, the apparatus provided in this application can be implemented in software. Figure 2 An interactive processing device 455 for displaying bullet comments stored in memory 450 is shown. This device can be software in the form of programs and plugins, including the following software modules: a display module 4551 and a data processing module 4552. These modules are logically linked and can therefore be arbitrarily combined or further separated according to the functions they implement. Figure 2 For ease of explanation, all the above modules are shown at once, but this should not be interpreted as excluding the implementation of the display module 4551 in the interactive processing device 455 for bullet comments. The functions of each module will be explained below.

[0083] In some embodiments, the terminal device or server can implement the interactive processing method for bullet comments provided in this application by running a computer program. For example, the computer executable instructions can be microprogram-level commands, machine instructions, or software instructions. The computer program can be a native program or software module in the operating system; it can be a native application (APP), that is, a program that needs to be installed in the operating system to run, such as a video APP, a live streaming APP, or an instant messaging APP; or it can be a mini-program that can be embedded in any APP, that is, a program that only needs to be downloaded to the browser environment to run. In summary, the above-mentioned computer executable instructions can be any form of instruction, and the above-mentioned computer program can be any form of application, module, or plugin.

[0084] The interactive processing method for bullet comments provided in this application will be described in conjunction with exemplary applications and implementations of the terminal devices provided in the embodiments of this application.

[0085] The following describes the interactive processing method for bullet comments provided in the embodiments of this application. As mentioned above, the electronic device implementing the interactive processing method for bullet comments in the embodiments of this application can be a terminal device or a server, or a combination of both. Therefore, the executing entity of each step will not be described again below.

[0086] It should be noted that the examples of interactive processing of bullet comments in the following text are based on online video or audio playback. Those skilled in the art can apply the interactive processing method of bullet comments provided in the embodiments of this application to other scenarios in which bullet comments can be inserted, such as live video or audio streaming, based on their understanding of the following text.

[0087] See Figure 3A , Figure 3A This is a flowchart illustrating the interactive processing method for bullet comments provided in the embodiments of this application, which will be combined with... Figure 3A The steps shown are explained. Figure 3AThe entity responsible for executing the steps is Figure 1 The terminal device in the middle is 400.

[0088] In step 301, the first media interface is displayed.

[0089] For example, the first media interface is used to play first media content, which includes, but is not limited to, audio data, video data, or graphic data. The first media interface displays the first media content and user comments forming a bullet screen. This embodiment uses a video playback interface as an example, but the same applies to audio playback interfaces. The bullet screen can be displayed in a layer above the video screen.

[0090] In step 302, at least one first bullet comment and at least one second bullet comment are displayed on the first media interface.

[0091] For example, the first type of bullet comments includes: user-edited bullet comments, such as bullet comments edited by users to comment on the video; and pre-configured bullet comments that are bound to video or audio data, such as text generated based on tags, titles, or content of video or audio data. Pre-configured bullet comments are pre-configured by the video delivery party.

[0092] The second bullet comment is distinct from the first bullet comment; it can contain recommendation information. This recommendation information can be advertising material, such as advertising images, advertising text, or advertising videos. The second bullet comment can be provided by the advertiser.

[0093] refer to Figure 4A ,refer to Figure 4A , Figure 4A This is a first schematic diagram of the human-computer interaction interface provided in the embodiments of this application; the playback interface 401A (first media interface) includes multiple first bullet comments 402A and second bullet comments 403A.

[0094] In step 303, in response to an interactive operation on the second bullet comment, second media content including at least one first bullet comment is displayed.

[0095] For example, interactive actions include, but are not limited to, clicking, long-pressing, dragging, double-tapping, and pinching or spreading two fingers together. The media content can be a pattern formed by at least one initial barrage of comments.

[0096] refer to Figure 4C , Figure 4C This is a third schematic diagram of the human-computer interaction interface provided in the embodiments of this application; when Figure 4A The second comment in the video received a click and displayed... Figure 4CThe playback interface 401C includes a pattern 402C as media content, which is a flower pattern composed of multiple first bullet comments 402A.

[0097] In some embodiments, the second bullet screen includes recommendation information; step 303 can be implemented by: in response to a first triggering operation on the recommendation information in the second bullet screen of the first media interface, displaying second media content including at least one first bullet screen.

[0098] For example, the first triggering action can be a click or a double-click. The second media content must include at least one pattern formed by the arrangement of the first bullet comments. The presented pattern can be at least one. The pattern type includes at least one of the following:

[0099] Type 1: The identifier of the first object recommended in the recommendation information.

[0100] For example, the recommendation information is in the second comment section. The recommendation information can be text or an image, and the first object is the recommended object. The identifier of the first object can be its outline, trademark, initials, or abbreviations. For instance, if the recommendation information is used to recommend a certain product, then the first object is that product, and the identifier of the first object can be the product's trademark.

[0101] by Figure 4A as well as Figure 4C Let's take an example to illustrate. Figure 4A The second comment, 403A, includes an advertisement image and the text "Sprinkle flowers with a certain brand." Figure 4C The pattern displayed is a flower pattern related to the recommended text content.

[0102] Type 2: Elements in recommendation information.

[0103] For example, elements can be patterns in the recommendation information or patterns representing the semantic representation of the text in the recommendation information.

[0104] Type 3: Identifier of the second object that triggers the second bullet screen.

[0105] For example, the second object that triggers the second bullet screen is the user. The identifier of the second object can be the user's avatar outline, name, and type. The user type can be represented by a pattern that indicates the membership level.

[0106] Type 4: Identifier of a third object that matches at least one first comment.

[0107] For example, the third object matching the first bullet comment is the object to be recalled and recommended. Feature extraction processing is performed on at least one first bullet comment, the bullet comment's embedding feature is obtained, the object features of multiple candidate objects using the first media interface are obtained, the similarity between each object feature and the embedding feature is determined, and the candidate objects with a similarity greater than the similarity threshold are the objects to be recalled and recommended.

[0108] In some embodiments, when displaying second media content including the at least one first bullet comment, in response to a second triggering operation on the second media content, the currently displayed second media content is switched to other media content.

[0109] For example, other media content can be media content of a different type than the second media content, or third media content formed by adding content to the second media content. The second triggering action can be an action such as clicking, double-clicking, or long-pressing.

[0110] For example, when at least one pattern formed by the arrangement of first bullet comments is displayed, in response to a second trigger operation for the current type of pattern, the pattern is switched from the current type to another type of pattern.

[0111] For example, the second triggering action can be the same as or different from the first triggering action, and the second triggering action can be a click action. Other types can be any type different from the current type.

[0112] For example: Reference Figure 4E , Figure 4E This is the fifth schematic diagram of the human-computer interaction interface provided in the embodiments of this application; in response to... Figure 4C Clicking on pattern 402C in the playback interface 401C switches pattern 402C to... Figure 4E Pattern 401E uses the same first barrage 402A as pattern 402C. Pattern 402C is a pattern in which the first barrage 402A is arranged in the shape of a flower, while pattern 401E is a pattern in which the first barrage 402A is arranged in the shape of a diamond ring.

[0113] In some embodiments, displaying second media content including at least one first bullet comment can be achieved by: displaying an image of a pattern composed of at least one first bullet comment when the second media content is in an image format; or playing a video of a fixed or dynamic pattern composed of at least one first bullet comment when the second media content is in a video format.

[0114] For example, if the second media content is in image format, the media content is displayed as an image of a pattern consisting of at least one first comment. If the second media content is in video format, the pattern consisting of at least one first comment can be a static fixed pattern or a dynamic pattern.

[0115] For example, the media content is compatible with different formats. When the second media content is an image format, it can be an image composed of recommendation information (recommendation text, recommendation image) and bullet screen text. Taking a video player as an example, in a video player, the layer displaying bullet screens is located above the layer displaying the video. Before displaying the media content, the media data corresponding to the media content is converted into a format that can be called by the video player's bullet screen application programming interface (API). The bullet screen API calculates the movement speed and trajectory of the media content on the screen, and renders the media content onto the layer displaying bullet screens based on the movement speed and trajectory, forming the effect of the media content being displayed on top of the video screen.

[0116] When the second media content is in video format, the second media content can be a dynamic pattern composed of recommendation information (recommended text, recommended images) and bullet screen text. For example, the outline of the pattern remains unchanged, and each character in the pattern and the image of the recommendation information rotates in a clockwise or counterclockwise cycle. Taking the first media interface as an example where the first video player is the first media interface, the second layer displaying the second media content is located above the first layer displaying the original video. The second media content can be played through a second video player that is different from the first video player. The second video player renders the second media content onto the second layer, and the transparency channel value of the parts of the second media content other than the patterns and characters is set to 1 (representing complete transparency) to present the effect of the media content displayed on top of the video screen.

[0117] In this embodiment, the media content is compatible with different formats and can be flexibly inserted into various players of different second media content for display, thereby improving the versatility of this embodiment.

[0118] In some embodiments, the first bullet screen may also be an advertising bullet screen, which includes advertising text and advertising images. The second media content including the at least one first bullet screen may be a pattern composed of advertising bullet screens.

[0119] In some embodiments, the media content also includes at least one of the following:

[0120] 1. Special effects animations associated with the recommended information.

[0121] For example, the recommendation information is in the second comment; see reference. Figure 4C The playback interface 401C also displays special effects element 404C, which can be a dynamic pattern, i.e., special effects animation.

[0122] 2. Second barrage.

[0123] For example, the second comment can be displayed directly or arranged as a pattern. Besides the first comment being able to be arranged into a pattern, the second comment can also be used to form a pattern. For instance, if the second comment carries recommended text, the recommended text will be arranged into a pattern. The arrangement method is the same as the arrangement method of the first comment, and will not be elaborated further here.

[0124] 3. All other bullet comments except for the first and second bullet comments.

[0125] For example, if the first and second bullet comments are bullet comments that existed before the media content was displayed, then when the media content is displayed, bullet comments other than the first and second bullet comments can also be displayed, such as bullet comments that are newly published after the first bullet comment.

[0126] In this embodiment of the application, by displaying a variety of different contents in the second media content, the richness of the media content is enhanced, the user's visual experience is improved, the interactivity between bullet comments and users is strengthened, and the recommendation effect of the recommendation information is improved.

[0127] In some embodiments, at least one first bullet comment is arranged in descending or ascending order according to a specific parameter in the second media content. For example, the descending or ascending order can be achieved by: in the second media content, from top to bottom and from left to right, the specific parameter of each first bullet comment decreases sequentially; or, in the second media content, in the second media content, the specific parameter of each first bullet comment increases sequentially from top to bottom and from left to right.

[0128] For example, the types of specific parameters include:

[0129] Type 1: The time when the first comment was posted.

[0130] For example, if the first comment is a comment posted by a user, then the posting time is the time when the user posted the comment on the video.

[0131] Type 2: The degree of correlation between the first and second bullet comments.

[0132] For example, a neural network model for text processing can be used to extract the text features of the first and second bullet comments, determine the similarity between the text features of the first and second bullet comments, and use the similarity between the features as an indicator of the degree of correlation. The similarity value ranges from greater than or equal to 0 to less than or equal to 1. The closer the similarity is to 1, the higher the correlation between the first and second bullet comments.

[0133] Type 3: The degree of relevance between the first comment and the currently playing content.

[0134] For example, assuming the currently playing content is a video, a cross-modal neural network model can be used to extract the text feature vector of the first comment and the image feature vector of the video frame of the currently playing content, and determine the similarity (e.g., cosine similarity) between the text feature vector of the first comment and the image feature vector of the currently playing content. Using similarity as an indicator of relevance, the closer the similarity is to 1, the higher the relevance between the first comment and the currently playing content.

[0135] Assuming the currently playing content is audio, a cross-modal neural network model can be used to extract the text feature vector of the first comment and the audio feature vector of the audio frame of the currently playing content, and then determine the similarity (e.g., cosine similarity) between the text feature vector of the first comment and the audio feature vector of the currently playing content. This similarity is used as an indicator of the degree of relevance; the closer the similarity is to 1, the higher the relevance between the first comment and the currently playing content.

[0136] Type 4: The degree of repetition between the first bullet comment and other first bullet comments.

[0137] For example, the degree of repetition can be represented by the weighted sum of similarity and the number of repeated characters. The method of obtaining similarity is as described above. The number of repeated characters can be determined as follows: For the first bullet comment i and another first bullet comment j, traverse each character of the first bullet comment i and compare the traversed character with the other first bullet comment j to determine whether the character exists in the other first bullet comment j. If it exists, increment the number of repeated characters by 1 and traverse the next character of the first bullet comment i until the entire first bullet comment i has been traversed.

[0138] For example, when at least one first comment is arranged in descending or ascending order according to a specific parameter in the second media content, the type of the pattern formed by the at least one first comment includes at least one of the following: the identifier of the first object recommended by the recommendation information, wherein the recommendation information is included in the second comment; an element in the recommendation information; the identifier of the second object that triggered the second comment; and the identifier of the third object that matches the at least one first comment.

[0139] In some embodiments, displaying second media content including at least one first bullet comment can be achieved by: in response to the number of at least one first bullet comment being less than a first quantity threshold, displaying second media content including at least one first bullet comment and at least one copy of the first bullet comment.

[0140] For example, the first quantity threshold can be the number of bullet comments required to form a pattern. This threshold can be set according to the actual application scenario. Generally, the first quantity threshold is the minimum number of bullet comments required to ensure the content or outline of the pattern is recognizable. A copy of the first bullet comment is a replica of the first bullet comment. For example, if the second media content is a pattern composed of the first bullet comments, and the pattern requires 5 first bullet comments, but only 3 are currently displayed on the playback interface, then any one of the 3 first bullet comments can be copied twice, resulting in 2 copies of the first bullet comment, thus forming the pattern from the 3 first bullet comments and the 2 copies. Alternatively, any two of the 3 first bullet comments can be copied once each, resulting in 2 different copies of the first bullet comment, thus forming the pattern from the 3 first bullet comments and the 2 copies.

[0141] refer to Figure 4D , Figure 4D This is a fourth schematic diagram of the human-computer interaction interface provided in the embodiments of this application. When Figure 4A If the number of first bullet comments displayed is less than the first quantity threshold, and the first bullet comment with the content "Let's run towards freedom together" is copied, then pattern 402C includes the bullet comment "Let's run towards freedom together" and a copy of that bullet comment.

[0142] In this embodiment, more bullet comments are obtained by copying the first bullet comment to form a corresponding pattern. The existing first bullet comment is reused, saving the computing resources required to obtain bullet comments. This allows the media content to be displayed even when the number of bullet comments is insufficient, thus improving versatility.

[0143] In some embodiments, after receiving an interactive operation, before displaying second media content including at least one first comment, a transition animation is displayed, wherein the transition animation is used to represent the following process: each first comment moves from an initial position to a position corresponding to the second media content, the initial position being the position of the first comment at the moment corresponding to the interactive operation.

[0144] For ease of understanding, please refer to Figure 4A as well as Figure 4B , Figure 4B This is a second schematic diagram of the human-computer interaction interface provided in the embodiments of this application; Figure 4B Showing Figure 4AThe movement of the bullet comments in the video is shown on playback interface 401B, which includes multiple bullet comments such as the first bullet comment 402B and the moving first bullet comment 403B. The moving first bullet comment 403B reads "Let's run towards freedom together." Figure 4A The first bullet, 403B, moves from one side of the screen to the other in a straight line. The first bullet, "Run towards freedom together," converges towards the center of the video screen in 4B to form a corresponding pattern.

[0145] In this embodiment of the application, a transition animation is displayed to show the process of the first bullet screen moving from its initial position into the media content, making the display of the media content smoother and improving the user's visual experience.

[0146] In some embodiments, after at least one first bullet comment and at least one second bullet comment are displayed in the first media interface, in response to the current playback point of the first media interface reaching a specific playback point, second media content including at least one first bullet comment is displayed, wherein the specific playback point includes at least one of the following: a node including exciting plot points, a node including recommendation information.

[0147] For example, media content can be at least one first bullet comment arranged to form a pattern. The current playback point is the current playback moment or segment of the video or audio; taking video as an example, a node of exciting plot can be a segment in the video that attracts viewers, or a playback moment within a segment. Exciting nodes can be pre-configured by the video creator, or, by counting the number of interactive behaviors (e.g., forwarding, commenting, and liking) in the video, the portion with an interaction number greater than the pre-configured value is considered an exciting node. Taking video as an example, a node including recommendation information can be any video segment or playback moment within the display period of the second bullet comment including recommendation information.

[0148] In this embodiment, the corresponding second media content is displayed by reaching a specific playback point, without requiring the user to actively interact with the first media interface, thus saving the triggering process and the time required to display the media content.

[0149] In some embodiments, when at least one first bullet comment is arranged to form a pattern in the second media content, before displaying the second media content including at least one first bullet comment, feature extraction processing is performed on the currently playing content of the first media interface to obtain multimedia features; pattern prediction processing is performed on the multimedia features to obtain a target pattern template that matches the currently playing content, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and at least one first bullet comment is arranged according to the target pattern template to form a pattern.

[0150] For example, feature extraction and pattern prediction can be implemented using a neural network model. This model includes at least a feature extraction layer (e.g., the encoder in a converter model) and a classifier. The feature extraction layer extracts features from the currently playing content. Taking video content as an example, the feature extraction layer extracts the video features of the currently playing content. Pattern prediction involves predicting the probability that video features belong to multiple different candidate pattern templates. The template with the highest prediction probability is selected as the target pattern template. The target pattern template represents the position of each comment within the pattern. It pre-configures multiple empty spaces, each with a different position, and each empty space is used to fill one comment.

[0151] For example, in the case of a target pattern template through pattern prediction processing of multimedia features, the pattern type includes any of the following: the outline of a fourth object in the currently playing content; the outline of a first object recommended by the recommendation information in the second bullet screen; a symbol representing the first object.

[0152] Taking video as an example, the fourth object can be any object or person in the currently playing content. The fourth object can be identified by performing object recognition on the current playing content. If there are multiple objects in the current playing content, the object occupying the largest proportion of the screen can be designated as the fourth object, or the object closest to the center of the screen can be considered the fourth object. For example, if the current playing content is "a singer singing with a microphone," the objects in the screen include either a microphone or the singer. The microphone is the fourth object closest to the center of the screen, and the image type is the outline of the microphone.

[0153] Taking audio as an example, feature extraction processing is performed on the currently playing content at the current playback point. Multimedia features can be achieved through the following methods: acquiring an audio segment including the current playback point and a preset duration preceding it; performing speech recognition on the audio segment; and converting the audio segment into speech-text, with the objects mentioned in the speech-text being treated as the fourth object. For example, if the audio segment is purely instrumental music without speech, the object playing the instrumental music can be used as the fourth object.

[0154] For example, the outline of the first object recommended in the recommendation information of the second bullet screen; the symbol representing the first object has been explained above and will not be repeated here.

[0155] In this embodiment, the pattern formed by the arrangement of bullet comments is associated with the playback content, which enhances the attractiveness of the media content to users and increases the fun of watching the playback content.

[0156] In some embodiments, after at least one first bullet comment and at least one second bullet comment are displayed in the first media interface, in response to a selection operation on at least one first bullet comment in the first media interface, second media content including the first bullet comment selected by the selection operation is displayed.

[0157] For example, the second media content selected by the selection operation refers to the pattern formed by the arrangement of the selected first bullet comments. The selection operation can be a long press operation on the first bullet comment, responding to a long press operation on at least one first bullet comment in the first media interface, where the long-pressed first bullet comment is taken as the selected first bullet comment, responding to no long press operation on an unselected first bullet comment within a preset time, or a click operation on a blank area (an area where no bullet comments or controls are displayed) in the first media interface, where the second media content of the first bullet comment selected by the selection operation is displayed.

[0158] In some embodiments, when at least one first bullet comment is arranged to form a pattern in the second media content, before displaying the second media content including at least one first bullet comment, feature extraction processing is performed on at least one first bullet comment (e.g., the first bullet comment selected by the selection operation), text features are extracted; pattern prediction processing is performed on the text features, and a target pattern template matching the selected first bullet comment is generated, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and at least one first bullet comment is arranged according to the target pattern template, forming a pattern.

[0159] For example, feature extraction and pattern prediction can be implemented using a neural network model. This model includes at least a feature extraction layer (e.g., the encoder in a text converter model) and a classifier. The feature extraction layer is used to extract features from the selected first bullet screen. Pattern prediction involves predicting the probability that text features belong to multiple different candidate pattern templates, and then selecting the one with the highest predicted probability from these candidate templates as the target pattern template. The target pattern template represents the position of each bullet screen within the pattern; it pre-configures multiple empty spaces, each of which is used to fill a bullet screen.

[0160] For example, in the case of a target pattern template processed by pattern prediction on text features, the pattern type includes any of the following: the outline of the fifth object mentioned by multiple selected first comments; a pattern representing the commonality of multiple selected first comments.

[0161] For example, the fifth object mentioned by multiple selected first comments refers to an object that is included by at least two first comments. Assuming there are multiple mentioned objects, the object mentioned most frequently can be selected as the fifth object. The common pattern among multiple selected first comments can be determined as follows: semantic analysis of the text features of each first comment is performed to identify the existing form of the object represented by each first comment, and the pattern of the object that is present in every comment is selected as the pattern representing the commonality. For example, if the currently playing content is a highlight reel, and multiple first comments are all positive evaluations of that highlight reel, then the common pattern could be a pattern representing positive evaluation such as "thumbs up" or "clapping."

[0162] In this embodiment, the pattern is associated with the selected bullet screen, so that there is a commonality between the pattern and the bullet screen, which enhances the user's enjoyment of watching the content.

[0163] In some embodiments, before displaying second media content including at least one first bullet comment, in response to the number of bullet comments displayed in the first media interface reaching a second quantity threshold, the second media content including at least one first bullet comment is displayed.

[0164] For example, the second media content, which includes at least one first comment, can be a pattern consisting of at least one first comment or a second comment. The second quantity threshold can be set according to the actual application scenario. When the second media content consists of a pattern consisting of at least one first comment or a second comment, the type of comment quantity includes any of the following:

[0165] Type 1: The total number of bullet comments displayed in the first media interface.

[0166] For example, the total number of displayed bullet comments can be within the same video or audio file. The total number of displayed bullet comments is accumulated from the start time of the same video or audio file played in the primary media interface when the user begins watching or listening to it.

[0167] For example, if a user watches video 1 continuously from 2 minutes and 10 seconds onwards, then 2 minutes and 10 seconds will be used as the starting point for calculating the total number of displayed bullet comments. Bullet comments existing before 2 minutes and 10 seconds are not included in the total number of displayed bullet comments because they are not displayed on the screen. To illustrate, if there are 400 bullet comments in the video's bullet comment data, and the portion of the video before 2 minutes and 10 seconds corresponds to 200 bullet comments, these 200 bullet comments will not be included in the total number of displayed bullet comments because they are not displayed on the screen.

[0168] Type 2: The cumulative number of second bullet comments, including recommendation information, displayed in the first media interface.

[0169] For example, the second quantity threshold for type 2 can be less than the second quantity threshold for type 1. The statistical range of the cumulative number of displayed second bullet comments including recommendation information can be within the same video or audio. If the cumulative number of displayed second bullet comments including recommendation information is greater than the second quantity threshold, then a pattern consisting of at least one first bullet comment or a second bullet comment is displayed.

[0170] Type 3: The cumulative number of bullet comments associated with the same object displayed in the first media interface.

[0171] For example, a bullet comment associated with an object refers to a bullet comment that includes the name of the object, or recommendation information for the object, or a positive or negative evaluation of the object. For each bullet comment, if the name of an object or recommendation information for the object appears in the bullet comment, the number of bullet comments associated with that object is incremented by one. If the highest number of bullet comments associated with an object among all objects is greater than a second threshold, then a pattern consisting of at least one first bullet comment or a second bullet comment is displayed.

[0172] Type 4: The cumulative number of identical content bullet comments displayed in the first media interface, where the pattern is composed of bullet comments with identical content.

[0173] For example, "same content bullet comments" refers to bullet comments with the same semantic meaning. The characters in bullet comments with the same content can differ. For example, the content of the first bullet comment A is "hahaha" and the content of the first bullet comment B is "hahahaha". Both of them are onomatopoeic expressions of laughter, and the first bullet comment A and the first bullet comment B are bullet comments with the same content. The pattern formed by the first bullet comments can be a smiley face pattern formed by multiple first bullet comments.

[0174] In this embodiment, the display of media content is triggered based on the total number of displayed bullet comments of a certain type. The second media content consisting of corresponding bullet comments can be generated without the user actively interacting with the first media interface. The different types mentioned above enhance the interaction between bullet comments and users from different perspectives, save the bullet comment interaction processing process, improve the fun of watching the first media interface, and enhance the user experience.

[0175] In some embodiments, when displaying second media content including at least one first bullet comment, a trigger control associated with recommendation information is displayed, wherein the recommendation information is included in the second bullet comment; in response to a third trigger operation on the trigger control, a recommendation page corresponding to the recommendation information is displayed.

[0176] For example, the third trigger action can also trigger the display of an ambient animation, and then display the recommendation page when the animation finishes playing. If the recommendation information is used to recommend a specific product, the recommendation page can be the product's landing page. See further details. Figure 4C The playback interface 401C also includes a trigger control 403C, which displays the text "Sprinkling Flowers" and... Figure 4C The recommended text (recommendation information) included in the second bullet comment 403A is associated with the phrase "Sprinkle flowers with a certain brand". In response to a trigger action on trigger control 403C, an ambient animation is played; for example, the ambient animation can be composed of multiple special effects elements 404C. Special effects elements 404C can be dynamic patterns.

[0177] In some embodiments, when displaying second media content including at least one first bullet comment, in response to a fourth triggering operation on the media content, a recommendation page corresponding to the recommendation information is displayed, wherein the recommendation information is included in the second bullet comment.

[0178] For example, the fourth trigger action could be a click, long press, double tap, or other action targeting media content. For instance: If Figure 4C If trigger control 403C is not displayed, the recommended page can be displayed by clicking pattern 402C. The fourth trigger operation can also trigger the display of an ambient animation, and the recommended page will be displayed when the animation finishes playing.

[0179] In this embodiment, by displaying second media content composed of bullet comments and triggering the media content or a specific trigger control to display the recommendation page, the display methods of bullet comments and recommendation pages are enriched. By associating the recommendation page with bullet comments, the user's interest in watching recommended content can be increased, thus improving the recommendation effect.

[0180] In some embodiments, when displaying second media content including at least one first bullet comment, the currently playing content of the first media interface is paused; or, the content is continuously played in the first media interface, and the media content is displayed in an area of ​​the first media interface where no dynamic objects exist.

[0181] For example, by pausing the currently playing content while displaying media content, the user's viewing experience is improved, preventing them from missing the current content.

[0182] For example, dynamic objects can be moving objects, animals, or people in the first media interface. While the video is playing continuously, the second media content, consisting of bullet comments, is displayed in an area where no dynamic objects exist. This avoids the media content obscuring objects in the video, does not affect the user's viewing experience, and improves the convenience of bullet comment interaction.

[0183] In some embodiments, when the first media content is continuously played in the first media interface, the second media content is updated based on the new first comment when a new first comment appears in the first media interface.

[0184] For example, updating the second media content based on the new first bullet screen can be achieved in any of the following ways:

[0185] Method 1: Add the new first bullet comment to the second media content.

[0186] For example, in method 1, assuming the second media content is a pattern of bullet comments, the outline of the pattern can be maintained, and the character density of the pattern outline can be increased by adding new bullet comments, making the pattern more complete. (Reference) Figure 4H , Figure 4H This is the eighth schematic diagram of the human-computer interaction interface provided in the embodiments of this application; the playback interface 401H includes pattern 402H, the video in the playback interface 401H is continuously played, and new bullet comments "new bullet comment 1" to "new bullet comment 4" are displayed. Based on one of the new bullet comments "new bullet comment 1", pattern 402H is updated, and pattern 403H is updated. Compared with pattern 402H, updated pattern 403H has "new bullet comment 1" added.

[0187] Method 2: Add the new first bullet screen to the second media content and change the form of the second media content.

[0188] For example, assuming the second media content is a pattern of bullet comments, changing the form of the second media content can be achieved in the following way: generating new second media content based on the existing bullet comments and other types of bullet comment templates in the new first bullet comment and the second media content.

[0189] In some embodiments, the at least one first bullet comment is displayed in a first display mode and a second display mode respectively; when at least one first bullet comment is displayed in the first media interface, in response to a sixth trigger operation for the first bullet comment in the first display mode, the chat interface corresponding to the sixth object corresponding to the triggered first bullet comment is displayed, wherein the first display mode indicates that the first bullet comment matches the object information of the second object using the first media interface, and the sixth object is the object that sent the triggered first bullet comment.

[0190] For example, the second object is the user using the first media interface. When the second object allows the media interface to read its own object information, the application corresponding to the media interface can match the object information with the bullet comments displayed on the media interface, and the first bullet comment that matches the second object. The first display method and the second display method are different display methods. The second display method can be displayed with a color and font that are different from the first display method. Alternatively, the second display method can be to circle the bullet comment with a frame (solid line or dashed line). The sixth object is the user who sent the triggered first bullet comment.

[0191] refer to Figure 4G , Figure 4G This is the seventh schematic diagram of the human-computer interaction interface provided in this application embodiment; the playback interface 401G includes a highlighted first bullet screen 402G, which includes bullet screen content and the avatar (user identifier) ​​of the user who sent the bullet screen, for example: the bullet screen content "Giving roses leaves a lingering fragrance" and the avatar of the user presented as a smiley face. In response to a trigger operation on the highlighted first bullet screen 402G, the chat interface corresponding to the user who sent the bullet screen is displayed.

[0192] In this embodiment, bullet comments matching the user using the media interface are displayed in a differentiated manner, and the chat interface of the user who sent the bullet comments is displayed by triggering the bullet comments, thus enriching the social interaction through bullet comment interaction.

[0193] In some implementations, when displaying second media content including at least one first bullet comment, in response to a gesture operation on the first media interface, the second media content including the at least one first bullet comment is restored to the at least one first bullet comment in its initial position; or a release control is displayed, and in response to a fifth trigger operation on the release control, the second media content including at least one first bullet comment is restored to the at least one first bullet comment in its initial position, wherein the initial position is the position of the first bullet comment at the moment corresponding to the interactive operation.

[0194] For example, gesture control is an interactive method of controlling electronic devices or software interfaces through hand or body movements, such as waving or shaking the terminal device. Gesture control can be captured by sensors or cameras on the user's terminal device.

[0195] For example, the fifth trigger action could be a click action. See also... Figure 4D In response to the trigger operation on the release control 401D, Figure 4D The playback interface of 401C was restored to its original state. Figure 4A The image shown is from the playback interface 401A. Taking one of the bullet comments as an example, the first bullet comment, "Let's run towards freedom together," is... Figure 4D The position in the middle is restored to Figure 4A The location at which the interactive operation is received.

[0196] In this embodiment of the application, a method for restoring the second media content constituted by bullet comments is provided, which enhances the freedom of bullet comment interaction processing and improves the user's viewing experience.

[0197] In this embodiment, by displaying different types of bullet comments on the first media interface, and upon receiving a trigger operation for the second bullet comment, second media content including the first bullet comment is displayed, thus enriching the bullet comment display methods and enhancing the interactivity of the bullet comments. Selectively configuring at least one second bullet comment to trigger the second media content formed by the first bullet comment saves computational resources required for displaying bullet comments compared to a scheme where all bullet comments have the function of triggering media content display.

[0198] In some embodiments, this application also proposes an interactive processing method for bullet comments, see [link to relevant documentation]. Figure 3B , Figure 3B This is a flowchart illustrating the interactive processing method for bullet comments provided in the embodiments of this application. Figure 3B The entity executing the steps in the process can be Figure 1 Terminal device 400.

[0199] In step 311, the first media interface is displayed.

[0200] For example, the implementation of step 311 can be found in [reference]. Figure 3A Step 301 will not be repeated here.

[0201] In step 312, at least one bullet comment is displayed on the first media interface.

[0202] For example, at least one bullet comment can be of at least one of the following types: bullet comments that include recommendation information, and bullet comments that do not include recommendation information. That is, at least one bullet comment can be entirely composed of bullet comments that include recommendation information; at least one bullet comment can be entirely composed of bullet comments that do not include recommendation information; when there are multiple bullet comments, the multiple bullet comments can be a mixture of bullet comments that include recommendation information and bullet comments that do not include recommendation information.

[0203] In step 313, in response to an interactive operation on the first media interface, second media content including at least one bullet comment is displayed.

[0204] For example, assuming there are multiple instances of at least one type of bullet comment, and these multiple bullet comments can include bullet comments containing recommendation information as well as those that do not, then the media content can be a pattern formed by arranging bullet comments that include and do not contain recommendation information. (Reference) Figure 4F , Figure 4F This is the sixth schematic diagram of the human-computer interaction interface provided in the embodiments of this application. Figure 4F Based on Figure 4A The diagram above illustrates the playback interface of the media content, composed of bullet comments. The playback interface 401F includes pattern 402F, which is... Figure 4A It consists of multiple first bullet comments 402A (e.g., the first bullet comment with the content "Let's run towards freedom together") and second bullet comments 403A.

[0205] In some embodiments, at least one bullet comment is arranged to form a pattern in the second media content, and the pattern type includes at least one of the following:

[0206] Type 1: The identifier of the first object involved in at least one bullet comment.

[0207] For example, "bullet comments involving the first object" means that the bullet comments are comments directed at the first object; the identifier of the first object can be its outline, trademark, or the first letter of its name. For instance, if multiple bullet comments are positive or negative comments about the first object A, the type 1 icon could be the first letter A of the first object A's name.

[0208] Type 2: At least one element in a bullet comment.

[0209] For example, elements can be patterns in the recommendation information included in the bullet comments; if the bullet comments do not include recommendation information, elements in the bullet comments can be characters in the bullet comments or objects with shapes mentioned in the bullet comments.

[0210] Type 3: Identifier of the second object that sends at least one bullet comment.

[0211] For example, if the second recipient of the bullet comment is a user, the identifier for the second recipient could be the user's avatar outline, name, or type. The user type could be represented by a pattern indicating their membership level. If the bullet comment carries recommendation information, the second recipient could be the brand that is placing the recommendation information, and the identifier for the second recipient could be the brand's name or trademark.

[0212] In some implementations, when at least one pattern formed by a barrage of comments is displayed, the pattern is switched from the current type to another type of pattern in response to a second trigger operation for the current type of pattern.

[0213] For example, the process of switching a pattern from the current type to another type has already been explained above and will not be repeated here.

[0214] In some implementations, a second media content including at least one bullet comment is displayed; if the second media content is in image format, an image of a pattern consisting of at least one bullet comment is displayed; if the type of the second media content is video format, a video consisting of a fixed pattern or a dynamic pattern consisting of at least one bullet comment is played.

[0215] For example, the media content is compatible with different formats. When the second media content is an image format, it can be an image composed of recommendation information (recommendation text, recommendation image) and bullet screen text. Taking a video player as an example, in a video player, the layer displaying bullet screens is located above the layer displaying the video. Before displaying the media content, the media data corresponding to the media content is converted into a format that can be called by the video player's bullet screen application programming interface (API). The bullet screen API calculates the movement speed and trajectory of the media content on the screen, and renders the media content onto the layer displaying bullet screens based on the movement speed and trajectory, forming the effect of the media content being displayed on top of the video screen.

[0216] When the second media content is in video format, the second media content can be a dynamic pattern composed of recommendation information (recommended text, recommended images) and bullet screen text. For example, the outline of the pattern remains unchanged, and each character in the pattern and the image of the recommendation information rotates in a clockwise or counterclockwise cycle. Taking the first media interface as an example where the first video player is the first media interface, the second layer displaying the second media content is located above the first layer displaying the original video. The second media content can be played through a second video player that is different from the first video player. The second video player renders the second media content onto the second layer, and the transparency channel value of the parts of the second media content other than the patterns and characters is set to 1 (representing complete transparency) to present the effect of the media content displayed on top of the video screen.

[0217] In some embodiments, at least one bullet comment is arranged in descending or ascending order in the second media content according to specific parameters, wherein the specific parameters include: the time of publication of the bullet comment; the relevance of the bullet comment to other bullet comments; the relevance of the bullet comment to the currently played content; the type of the pattern formed by the at least one bullet comment includes: the identifier of the first object recommended by the recommendation information in the bullet comment; the elements in the recommendation information in the bullet comment; and the identifier of the third object that matches the at least one bullet comment.

[0218] For example, the third object matched with the bullet comment is the recalled recommended object. Feature extraction processing is performed on at least one bullet comment, the embedding vector features of the bullet comment are obtained, and the object features of multiple candidate objects using the first media interface are obtained. The similarity between each object feature and the embedding vector features is determined, and the candidate objects with a similarity greater than a similarity threshold are used as the recalled recommended objects. Other specific parameters have been explained above and will not be repeated here.

[0219] In some embodiments, when at least one bullet comment is multiple bullet comments, displaying second media content including at least one bullet comment can be achieved by: in response to the number of at least one bullet comments being less than a first quantity threshold, displaying second media content including at least one bullet comment and at least one copy of the bullet comment.

[0220] For example, the first quantity threshold can be the number of bullet comments required to form the pattern. This threshold can be set according to the actual application scenario. The first quantity threshold can be the minimum number of bullet comments required to ensure the content or outline of the pattern is recognizable. A bullet comment copy is a replica of the bullet comment. For example, if the media content is a pattern composed of bullet comments, and the pattern requires 5 bullet comments, but only 1 bullet comment is currently displayed on the playback interface, then 1 bullet comment is copied 4 times, resulting in 4 copy bullet comments. This 4 copy bullet comments then form the pattern.

[0221] In some embodiments, before displaying second media content including at least one bullet comment: a transition animation is displayed, wherein the transition animation is used to represent the following process: each bullet comment moves from an initial position to a position corresponding to the second media content, the initial position being the position of the bullet comment at the moment corresponding to the interactive operation.

[0222] As an example, the transition animation has been explained above and will not be repeated here.

[0223] In some embodiments, after displaying second media content including at least one bullet comment, in response to the current playback point of the first media interface reaching a specific playback point, the second media content including at least one bullet comment is displayed, wherein the specific playback point includes at least one of the following: a node including exciting plot points, a node including recommendation information.

[0224] In some embodiments, when at least one bullet comment is arranged to form a pattern in the second media content, before displaying the second media content including at least one bullet comment, feature extraction processing is performed on the currently playing content of the first media interface to obtain multimedia features; pattern prediction processing is performed on the multimedia features to obtain a target pattern template that matches the currently playing content, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and the pattern type includes any of the following: the outline of a fourth object in the currently playing content; the outline of a first object recommended by the recommendation information; a symbol characterizing the first object; and at least one bullet comment is arranged according to the target pattern template to form a pattern.

[0225] For example, the principle of obtaining the pattern formed by the bullet comments based on the currently playing content has been explained above and will not be repeated here.

[0226] In some embodiments, after displaying second media content including at least one bullet comment, in response to a selection operation on at least one bullet comment in the first media interface, second media content including the bullet comment selected by the selection operation is displayed.

[0227] In some embodiments, when at least one bullet comment is arranged to form a pattern in the second media content, before displaying the second media content including at least one bullet comment, feature extraction processing is performed on the at least one bullet comment, namely text features; pattern prediction processing is performed on the text features, namely a target pattern template that matches the selected bullet comments, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and the pattern type includes any of the following: the outline of a fifth object mentioned by multiple selected bullet comments; a pattern characterizing the commonality of multiple selected bullet comments; or a pattern in which at least one bullet comment is arranged according to the target pattern template.

[0228] For example, the principle of obtaining the pattern formed by the selected bullet comments based on their characteristics has been explained above and will not be repeated here.

[0229] In this embodiment of the application, by displaying at least one bullet comment in the first media interface, and when an interactive operation is received for the first media interface, second media content including at least one bullet comment is displayed, which enriches the display mode of the bullet comments and enhances the interactivity of the bullet comments.

[0230] The following will describe an exemplary application of the interactive processing method for bullet comments in a real-world application scenario.

[0231] In related technologies, bullet comments in videos or audio are displayed in a fixed format, such as appearing at the top, bottom, or moving from one side to the other; while recommended information (e.g., advertisements) in audio or video are mainly displayed as pop-ups or in the center of the screen when multimedia content is paused. For example, when a user is watching a video or using an application, an advertisement appears as a banner that disappears automatically after a period of time or is manually closed by the user. However, the interaction methods of these advertisements are relatively simple, mainly relying on the user clicking on the advertisement to be redirected to a designated page, which limits the depth of interaction between the advertisement and the user. These advertisements do not consider the user's real-time behavior, such as clicking on bullet comments as a condition for triggering the advertisement, which to some extent makes the advertisement display disconnected from the user's actual experience. The advertising technology of related technologies lacks diversity in advertisement display and interaction methods, relying too much on time and location trigger conditions, and failing to make full use of information associated with the user. The advertisement formats in related technologies do not make full use of strong atmosphere display, do not interact with users, and lack more attractive and interactive advertisement formats.

[0232] The interactive processing method for bullet comments provided in this application embodiment can display media content that has been rearranged by triggering bullet comments. The media content can be combined with advertisements. Users can interact with the irregularly shaped bullet comment patterns and display product landing pages accordingly, thereby enhancing the interactivity of advertisements and user participation.

[0233] The interactive processing method for bullet comments provided in the embodiments of this application will be described below with reference to the accompanying drawings. Figure 5 , Figure 5 This is a schematic diagram of the third process of the interactive processing method for bullet comments provided in the embodiments of this application. Figure 5 The implementing entity can be Figure 1 Terminal device 400.

[0234] In step 501, the content player is displayed.

[0235] For example, a content player is displayed on the screen of terminal device 400. The content player can be an audio or video player. In this embodiment, a video player is used as an example for illustration.

[0236] In step 502, it is determined whether the bullet screen data associated with the video data is associated with irregularly shaped bullet screen advertisements.

[0237] For example, the irregularly shaped bullet screen ad includes: bullet screens carrying recommendation information (the second bullet screen mentioned above), transition animations, irregularly shaped bullet screen templates (the pattern templates mentioned above), and links to the product landing pages corresponding to the recommendation information. The irregularly shaped bullet screen template represents the position of each bullet screen within the pattern. Filling the irregularly shaped bullet screen target with user-edited bullet screens (the first bullet screen mentioned above) creates an irregularly shaped bullet screen, which is a pattern formed by multiple bullet screens arranged together. The bullet screens carrying recommendation information trigger the display of the transition animation. When the transition animation finishes playing, the pattern formed by the arrangement of multiple user-edited bullet screens is displayed. The link to the product landing page corresponding to the recommendation information is bound to the irregularly shaped bullet screen. When the irregularly shaped bullet screen is triggered by an interactive operation, or when a trigger control associated with the irregularly shaped bullet screen is triggered, the current playback interface is switched to the product landing page corresponding to the recommendation information based on the link to the product landing page corresponding to the recommendation information.

[0238] To determine whether irregularly shaped bullet screen ads are associated with the video data, the terminal device 400 detects whether the bullet screen data carried by the video data includes bullet screens containing recommendation information. If bullet screens carrying recommendation information are present, it indicates that the bullet screen data is associated with irregularly shaped bullet screen ads. Conversely, if bullet screens carrying recommendation information are not present, it indicates that the bullet screen data is not associated with irregularly shaped bullet screen ads.

[0239] If the judgment result of step 502 is negative, in step 503, the bullet screen in the normal form is displayed.

[0240] For example, if the video is not configured with corresponding irregularly shaped bullet comments, then the regular bullet comments will continue to be displayed. Regular bullet comments refer to bullet comments displayed in the video with a pre-configured straight line trajectory or a pre-configured position.

[0241] If the judgment result of step 502 is yes, in step 504, a bullet screen carrying recommendation information is displayed.

[0242] During video playback, bullet comments carrying advertising materials, such as those sponsored by advertisers, will appear alongside regular bullet comments, prompting users to perform corresponding actions based on these comments. (Reference) Figure 4A , Figure 4A This is a first schematic diagram of the human-computer interaction interface provided in this application embodiment; the playback interface 401A includes multiple first bullet comments 402A and second bullet comments 403A carrying recommendation information. The recommendation information consists of an advertisement image and the recommendation text "Sprinkle flowers with a certain brand". The recommendation text can serve as a reminder to the user.

[0243] In step 505, in response to a trigger operation on a bullet comment carrying recommendation information, a transition animation is played and an alien-shaped bullet comment is displayed.

[0244] For example, the trigger action can be one of the following types of actions: click, long press, drag, or double-click. The transition animation is a process animation of bullet comments moving and combining in a conventional manner into a specific arrangement. Transition animations can also include ambient effects, such as advertising image materials. When the transition animation finishes playing, irregularly shaped bullet comments are displayed.

[0245] Transition animation content, for example: the process of ordinary bullet comments surrounding the center of the video screen to form a flower-shaped pattern. (See reference) Figure 4B , Figure 4B This is a second schematic diagram of the human-computer interaction interface provided in the embodiments of this application; Figure 4B Showing Figure 4A The movement of the bullet comments in the video is shown on playback interface 401B, which includes multiple bullet comments such as the first bullet comment 402B and the moving first bullet comment 403B. The moving first bullet comment 403B reads "Let's run towards freedom together." Figure 4A The first bullet, 403B, moves from one side of the screen to the other in a straight line. The first bullet, "Run towards freedom together," converges towards the center of the video screen in 4B to form a corresponding pattern.

[0246] refer to Figure 4C , Figure 4C This is a third schematic diagram of the human-computer interaction interface provided in the embodiments of this application; Figure 4C yes Figure 4BOnce the animation finishes playing, a pattern is formed on the screen. The playback interface 401C includes media content (pattern 402C), and pattern 402C is a flower pattern composed of multiple first bullet comments 402A.

[0247] In step 506, in response to a triggering operation on the badge, an ambient animation is played.

[0248] For example, when displaying irregularly shaped bullet comments (patterns formed by bullet comments), the video content can be paused or resumed. See further reference. Figure 4C The playback interface 401C also includes a trigger control 403C, which is also a badge. In response to a trigger operation on the trigger control 403C, an ambient animation is played. For example, the ambient animation can be composed of multiple special effect elements 404C. The special effect element 404C can be a dynamic pattern.

[0249] In step 507, the product landing page is displayed.

[0250] Continue to refer to Figure 4C When the ambient animation finishes playing, Figure 4C The interface switches to the landing page of the recommended product in the recommendation information. That is, based on the link to the product landing page corresponding to the recommendation information included in the irregular bullet screen ad, the corresponding product landing page is called and the product landing page screen is displayed.

[0251] The interactive processing method for bullet comments provided in this application embodiment: 1. Improves the advertising format. During the user's video viewing process, the interaction between the user and bullet comments carrying recommendation information forms a pattern of multiple bullet comment arrangements, making the advertisement display closely related to the user's current video content, enhancing the visual impact and attractiveness of the advertisement, and resulting in better recommendation effects. Due to the close integration of the recommendation process with the audiovisual process, users are more likely to remember the recommended content, reflecting the user experience and recommendation effect during the recommendation processing. 2. Reduces the impact on the user's viewing experience: The display of recommendation information is triggered during the user's natural viewing process, without interrupting the user's viewing experience, thus providing a smooth and uninterrupted user experience. 3. Increases the fun and interactivity of the recommendation process: The bullet comment arrangement pattern is generated through the user's interaction with irregularly shaped bullet comments, enhancing the interactivity of the recommendation process and user participation.

[0252] The following explanation, in conjunction with the interactive flowchart, illustrates the interactive processing method for bullet comments provided in the embodiments of this application. (Refer to...) Figure 6 , Figure 6 This is a schematic diagram of the interactive process of the bullet screen interactive processing method provided in the embodiments of this application. Figure 6 It includes a first terminal 601, a media server 602, an advertising engine server 603, and a second terminal 604.

[0253] In step S601, the second terminal 604 is configured with irregularly shaped bullet screen advertisements.

[0254] For example, the second terminal 604 is the terminal device used by the advertiser, which can be the delivery terminal. The irregularly shaped bullet screen ad includes bullet screens carrying advertising materials, transition animations showing the process of bullet screens forming an irregularly shaped bullet screen, the irregularly shaped bullet screen formed by multiple bullet screens arranged, and corner image materials used to display in the corner control. Configuring the irregularly shaped bullet screen ad includes selecting a transition animation template (the template includes: animation of the process of bullet screen subtitles forming an irregularly shaped pattern), a pattern template representing the arrangement position of text in the irregularly shaped pattern), and obtaining relevant advertising materials, copy, and ambient animations.

[0255] In step S602, the second terminal 604 configures the content information to be bound to the advertising material.

[0256] For example, determine the information of the content to be bound to the irregular bullet screen ad, establish the association between the two, so that the irregular bullet screen ad can be displayed when the content is played.

[0257] In step S603, the second terminal 604 sends irregularly shaped bullet screen advertisements to the advertising engine server 603.

[0258] For example, the second terminal 604 sends the configured irregularly shaped bullet screen advertisement to the advertising engine server 603. The advertising engine server 603 is a server specifically used for managing, processing, and serving advertisements. The advertising engine server 603 stores the irregularly shaped bullet screen advertisement until it receives a request to display it.

[0259] In step S604, the first terminal 601 plays media content in the content player.

[0260] For example, the first terminal 601 is the terminal device used by the user, such as the user's mobile phone or computer. The principle of step S604 can be referred to step 501 above.

[0261] In step S605, the first terminal 601 requests the irregular bullet screen advertisement from the media server 602.

[0262] For example, the first terminal 601 sends a request to display irregularly shaped bullet screen advertisements to the media server 602. The media server 602 sends media data to the first terminal 601 so that video or audio can be played online on the first terminal 601. The request to display irregularly shaped bullet screen advertisements includes: an identifier of the currently playing video and an instruction to detect whether the currently playing video includes irregularly shaped bullet screen advertisements.

[0263] In step S606, the media server 602 requests the irregular bullet screen advertisement from the advertising engine server 603.

[0264] For example, media server 602 forwards a request to ad engine server 603 to display the irregularly shaped bullet screen ad.

[0265] In step S607, the advertising engine server 603 returns the irregularly shaped bullet screen advertisement to the media server 602.

[0266] For example, the ad engine server 603 queries whether there is an irregularly shaped bullet screen ad associated with the currently playing video based on the request. If it exists, the irregularly shaped bullet screen ad is returned to the media server 602.

[0267] In step S608, the media server 602 returns the irregularly shaped bullet screen advertisement to the first terminal 601.

[0268] For example, media server 602 forwards the irregularly shaped bullet screen advertisement to first terminal 601. The irregularly shaped bullet screen advertisement includes the following: bullet screens carrying recommendation information, irregularly shaped bullet screen templates, transition animations, and ambient animations.

[0269] In step S609, the first terminal 601 displays a bullet screen carrying recommendation information.

[0270] For example, the execution of step S609 can be referred to step 504 above, and will not be repeated here.

[0271] In step S610, the first terminal 601 responds to the trigger operation for the bullet comments carrying recommendation information by playing a transition animation and displaying the irregular bullet comments.

[0272] For example, the execution of step S610 can refer to step 505 above. The irregular barrage is based on the barrage pattern displayed in the first terminal 601 and filled with the irregular barrage template pattern, which will not be described again here.

[0273] In step S611, the first terminal 601 responds to the trigger operation for the badge by playing an ambient animation.

[0274] For example, the execution of step S611 can be referred to step 506 above, and will not be repeated here.

[0275] In step S612, the first terminal 601 displays the product landing page.

[0276] For example, when the ambient animation finishes playing, the first terminal 601 switches the video playback interface to the product landing page.

[0277] In this embodiment, by incorporating interaction with uniquely shaped bullet comments during video playback, users can generate text related to the video content while watching, providing a novel and vivid interactive experience, enhancing user attention, and thus improving recommendation effectiveness. By closely integrating bullet comments with user viewing behavior, user interest and viewing experience are increased.

[0278] The following description continues to illustrate the exemplary structure of the interactive processing device 455 for bullet comments provided in this application embodiment as a software module. In some embodiments, such as... Figure 2 As shown, the software module in the interactive processing device 455 for displaying bullet comments stored in the memory 450 may include: a display module 4551 for displaying a first media interface; the display module 4551 is also used to display at least one first bullet comment and at least one second bullet comment in the first media interface; the display module 4551 is also used to display second media content including at least one first bullet comment in response to an interactive operation on the second bullet comment.

[0279] In some embodiments, the second bullet screen includes recommendation information; the display module 4551 is configured to display second media content including at least one first bullet screen in response to a first trigger operation on the recommendation information in the first media interface.

[0280] In some embodiments, the arrangement of at least one first bullet comment in the second media content forms a pattern, and the type of the pattern includes at least one of the following:

[0281] The identifier of the first object recommended by the recommendation information;

[0282] Elements in the recommended information;

[0283] The identifier of the second object that triggered the second bullet screen;

[0284] The identifier of the third object that matches the at least one first bullet comment.

[0285] In some embodiments, the display module 4551 is configured to, when displaying second media content including the at least one first bullet comment, switch the currently displayed second media content to other media content in response to a second trigger operation on the second media content. When displaying a pattern formed by the arrangement of at least one first bullet comment, the module is configured to, in response to a second trigger operation on a pattern of the current type, switch the pattern from the current type to another type of pattern.

[0286] In some embodiments, the display module 4551 is configured to display an image of a pattern consisting of at least one first bullet screen when the second media content is an image format; and to play a video of a fixed pattern or dynamic pattern consisting of at least one first bullet screen when the second media content is a video format.

[0287] In some embodiments, the media content further includes at least one of the following: special effects animations associated with the recommendation information, wherein the recommendation information is included in the second bullet screen; the second bullet screen; and other bullet screens besides the first bullet screen and the second bullet screen.

[0288] In some embodiments, at least one first bullet comment is arranged in descending or ascending order in the second media content according to specific parameters, wherein the specific parameters include: the publication time of the first bullet comment; the relevance between the first bullet comment and the second bullet comment; the relevance between the first bullet comment and the currently playing content; the degree of repetition between the first bullet comment and other first bullet comments; the type of the pattern formed by the at least one first bullet comment includes: the identifier of the first object recommended by the recommendation information, wherein the recommendation information is included in the second bullet comment; elements in the recommendation information; the identifier of the second object that triggered the second bullet comment; and the identifier of the third object that matches the at least one first bullet comment.

[0289] In some embodiments, the display module 4551 is configured to display second media content including at least one first comment and at least one copy of the first comment in response to the number of at least one first comment being less than a first quantity threshold.

[0290] In some embodiments, the display module 4551 is used to display a transition animation before displaying second media content including at least one first bullet comment, wherein the transition animation is used to represent the following process: each first bullet comment moves from an initial position to a position corresponding to the second media content, the initial position being the position of the first bullet comment at the moment corresponding to the interactive operation.

[0291] In some embodiments, the display module 4551 is configured to, after displaying at least one first bullet comment and at least one second bullet comment in the first media interface, display second media content including at least one first bullet comment in response to the current playback point of the first media interface reaching a specific playback point, wherein the specific playback point includes at least one of the following: a node including exciting plot points, a node including recommendation information.

[0292] In some embodiments, the data processing module 4552 is configured to, when at least one first bullet comment is arranged to form a pattern in the second media content, perform feature extraction processing on the currently playing content of the first media interface before displaying the second media content including at least one first bullet comment, to obtain multimedia features; perform pattern prediction processing on the multimedia features to obtain a target pattern template that matches the currently playing content, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and the pattern type includes any of the following: the outline of a fourth object in the currently playing content; the outline of a first object recommended by the recommendation information in the second bullet comment; a symbol characterizing the first object; and arrange at least one first bullet comment according to the target pattern template to form a pattern.

[0293] In some embodiments, the display module 4551 is configured to, after displaying at least one first bullet comment and at least one second bullet comment in the first media interface, display second media content including the first bullet comment selected by the selection operation in response to a selection operation on at least one first bullet comment in the first media interface.

[0294] In some embodiments, the data processing module 4552 is configured to, when at least one first bullet comment is arranged to form a pattern in the second media content, perform feature extraction processing on at least one first bullet comment to obtain text features before displaying the second media content including at least one first bullet comment; perform pattern prediction processing on the text features to obtain a target pattern template matching the selected first bullet comments, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and the pattern type includes any of the following: the outline of a fifth object mentioned by multiple selected first bullet comments; a pattern characterizing the commonality of multiple selected first bullet comments; and arrange at least one first bullet comment according to the target pattern template to obtain the pattern.

[0295] In some embodiments, the display module 4551 is configured to display the second media content including at least one first comment in response to the number of comments displayed in the first media interface reaching a second quantity threshold before displaying the second media content including at least one first comment.

[0296] In some embodiments, the type of bullet screen count includes any of the following: the total number of bullet screens displayed cumulatively in the first media interface; the number of second bullet screens including recommendation information displayed cumulatively in the first media interface; the number of bullet screens associated with the same object displayed cumulatively in the first media interface; the number of bullet screens with the same content displayed cumulatively in the first media interface, wherein the pattern is composed of bullet screens with the same content.

[0297] In some embodiments, the display module 4551 is configured to display a trigger control associated with recommendation information when displaying second media content including at least one first bullet comment, wherein the recommendation information is included in the second bullet comment; and to display a recommendation page corresponding to the recommendation information in response to a third trigger operation on the trigger control.

[0298] In some embodiments, the display module 4551 is configured to, in response to a fourth triggering operation on the media content, display a recommendation page corresponding to the recommendation information when displaying second media content including at least one first bullet comment, wherein the recommendation information is included in the second bullet comment.

[0299] In some embodiments, the display module 4551 is configured to pause the current playback content of the first media interface when displaying second media content including at least one first bullet comment; or to continue playing content in the first media interface and display media content in an area of ​​the first media interface where no dynamic objects exist.

[0300] In some embodiments, the display module 4551 is configured to update the second media content based on the new first bullet comment when the first media content is continuously played in the first media interface.

[0301] In some embodiments, the at least one first bullet comment is displayed in a first display mode and a second display mode respectively; the display module 4551 is used to, when at least one first bullet comment is displayed in the first media interface, respond to a sixth trigger operation for the first bullet comment in the first display mode, display the chat interface corresponding to the sixth object of the triggered first bullet comment, wherein the first display mode indicates that the first bullet comment matches the object information of the second object using the first media interface, and the sixth object is the object that sent the triggered first bullet comment.

[0302] In some embodiments, the display module 4551 is configured to, when displaying second media content including the at least one first bullet comment, restore the second media content including the at least one first bullet comment to the at least one first bullet comment at the initial position in response to a gesture operation on the first media interface, wherein the initial position is the position of the first bullet comment at the moment corresponding to the interactive operation; or, display a release control, and restore the second media content including the at least one first bullet comment to the at least one first bullet comment at the initial position in response to a fifth trigger operation on the release control.

[0303] This application also proposes an interactive processing device for bullet comments, the device including: a display module 4551 for displaying a first media interface; the display module 4551 is further used to display at least one bullet comment in the first media interface; the display module 4551 is further used to display second media content including at least one bullet comment in response to an interactive operation in the first media interface.

[0304] In some embodiments, at least one bullet comment is arranged in the second media content to form a pattern, and the pattern type includes at least one of the following: the identifier of the first object to which the at least one bullet comment relates; an element in the at least one bullet comment; the identifier of the second object that sent the at least one bullet comment.

[0305] In some embodiments, the display module 4551 is configured to, when displaying second media content including the at least one bullet comment, switch the currently displayed second media content to other media content in response to a second trigger operation on the second media content. When displaying a pattern formed by the arrangement of at least one bullet comment, in response to a second trigger operation on a pattern of the current type, switch the pattern from the current type to another type of pattern.

[0306] In some embodiments, the display module 4551 is configured to display an image of a pattern consisting of at least one bullet screen when the second media content is an image format; and to play a video of a fixed pattern or dynamic pattern consisting of at least one bullet screen when the second media content is a video format.

[0307] In some embodiments, at least one bullet comment is arranged in descending or ascending order in the second media content according to specific parameters, wherein the specific parameters include: the time of publication of the bullet comment; the relevance of the bullet comment to other bullet comments; the relevance of the bullet comment to the currently played content; the type of the pattern formed by the at least one bullet comment includes: the identifier of the first object recommended by the recommendation information in the bullet comment; the elements in the recommendation information in the bullet comment; and the identifier of the third object that matches the at least one bullet comment.

[0308] In some embodiments, the display module 4551 is configured to display second media content including at least one bullet comment and a copy of at least one bullet comment when at least one bullet comment is multiple bullet comments, in response to the number of at least one bullet comment being less than a first quantity threshold.

[0309] In some embodiments, the display module 4551 is used to display a transition animation before displaying second media content including at least one bullet comment, wherein the transition animation is used to represent the following process: each bullet comment moves from an initial position to a position corresponding to the second media content, the initial position being the position of the bullet comment at the moment corresponding to the interactive operation.

[0310] In some embodiments, the display module 4551 is configured to, after displaying second media content including at least one bullet comment, display the second media content including at least one bullet comment in response to the current playback point of the first media interface reaching a specific playback point, wherein the specific playback point includes at least one of the following: a node including exciting plot points, a node including recommendation information.

[0311] In some embodiments, the data processing module 4552 is configured to, when at least one bullet comment is arranged to form a pattern in the second media content, perform feature extraction processing on the currently playing content of the first media interface to obtain multimedia features before displaying the second media content including at least one bullet comment; perform pattern prediction processing on the multimedia features to obtain a target pattern template matching the currently playing content, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and the pattern type includes any of the following: the outline of a fourth object in the currently playing content; the outline of a first object recommended by the recommendation information; a symbol characterizing the first object; and arrange at least one bullet comment according to the target pattern template to obtain the pattern.

[0312] In some embodiments, the display module 4551 is configured to, after displaying second media content including at least one bullet comment, display second media content including the bullet comment selected by the selection operation in response to a selection operation on at least one bullet comment in the first media interface.

[0313] In some embodiments, the data processing module 4552 is configured to, when at least one bullet comment is arranged to form a pattern in the second media content, perform feature extraction processing on at least one bullet comment to obtain text features before displaying the second media content including at least one bullet comment; perform pattern prediction processing on the text features to obtain a target pattern template that matches the selected bullet comments, wherein the target pattern template is used to characterize the position of each bullet comment in the pattern, and the pattern type includes any of the following: the outline of a fifth object mentioned by multiple selected bullet comments; a pattern characterizing the commonality of multiple selected bullet comments; and arrange at least one bullet comment according to the target pattern template to obtain the pattern.

[0314] This application provides a computer program product, which includes a computer program or computer-executable instructions stored in a computer-readable storage medium. The processor of an electronic device reads the computer program or computer-executable instructions from the computer-readable storage medium and executes the computer program or computer-executable instructions, causing the electronic device to perform the interactive processing method for bullet comments described in this application.

[0315] This application provides a computer-readable storage medium storing computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the processor will execute the interactive processing method for bullet comments provided in this application. For example, ... Figure 3A or Figure 3B The interactive processing method for bullet comments is shown.

[0316] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0317] In some embodiments, computer-executable instructions may take the form of programs, software, software modules, scripts, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as stand-alone programs or as modules, components, subroutines, or other units suitable for use in a computing environment.

[0318] As an example, computer-executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple co-located files (e.g., files that store one or more modules, subroutines, or code sections).

[0319] As an example, computer-executable instructions can be deployed to execute on a single electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed across multiple locations and interconnected via a communication network.

[0320] In summary, the embodiments of this application, by displaying different types of bullet comments on a first media interface, and when a trigger operation for a second bullet comment is received, displaying second media content including the first bullet comment, enriches the bullet comment display methods and enhances the interactivity of the bullet comments. Selectively configuring at least one second bullet comment to trigger the second media content formed by the first bullet comment saves computational resources required for displaying bullet comments compared to a scheme where all bullet comments have the function of triggering media content display.

[0321] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A method for processing interactive bullet comments, characterized in that, The method includes: Display the first media interface; Display at least one first bullet comment and at least one second bullet comment in the first media interface; In response to an interactive action on the second bullet comment, second media content including the at least one first bullet comment is displayed.

2. The method according to claim 1, characterized in that, The second bullet screen includes recommendation information; The response to an interactive operation on the second bullet comment, displaying second media content including the at least one first bullet comment, includes: In response to a first trigger operation on the recommendation information in the first media interface, second media content including the at least one first bullet comment is displayed.

3. The method according to claim 2, characterized in that, In the second media content, at least one first bullet screen is arranged to form a pattern, and the type of the pattern includes at least one of the following: The identifier of the first object recommended by the recommendation information; Elements in the recommended information; The identifier of the second object that triggered the second bullet screen; The identifier of the third object that matches the at least one first bullet comment.

4. The method according to claim 1, characterized in that, When displaying second media content including at least one first bullet comment, the method further includes: In response to a second trigger operation on the second media content, the currently displayed second media content is switched to other media content.

5. The method according to claim 3 or 4, characterized in that, The display includes the second media content of the at least one first bullet comment, including: If the second media content is in image format, display an image of a pattern composed of at least one first bullet screen; When the type of the second media content is video format, a video consisting of a fixed pattern or a dynamic pattern composed of at least one first bullet screen is played.

6. The method according to claim 1, characterized in that, The second media content also includes at least one of the following: Special effects animations associated with recommendation information, wherein the recommendation information is included in the second bullet screen; The second barrage; Other bullet comments besides the first and second bullet comments.

7. The method according to claim 1, characterized in that, The at least one first comment is arranged in descending or ascending order in the second media content according to a specific parameter, wherein the specific parameter includes: The time the first comment was posted; The degree of correlation between the first bullet comment and the second bullet comment; The degree of relevance between the first bullet comment and the currently playing content; The degree of repetition between the first bullet comment and other first bullet comments; The pattern formed by the at least one first barrage includes at least one of the following types: The identifier of the first object recommended by the recommendation information, wherein the recommendation information is included in the second bullet screen; Elements in the recommended information; The identifier of the second object that triggered the second bullet screen; The identifier of the third object that matches the at least one first bullet comment.

8. The method according to claim 1, characterized in that, The display includes the second media content of the at least one first bullet comment, including: In response to the fact that the number of the at least one first bullet comment is less than a first quantity threshold, second media content including the at least one first bullet comment and a copy of the at least one first bullet comment is displayed.

9. The method according to claim 1, characterized in that, Before displaying the second media content including the at least one first bullet comment, the method further includes: The display transition animation is used to represent the following process: each of the first bullet comments moves from an initial position to a position corresponding to the second media content, where the initial position is the position of the first bullet comment at the moment corresponding to the interactive operation.

10. The method according to any one of claims 1 to 9, characterized in that, After displaying at least one first bullet comment and at least one second bullet comment in the first media interface, the method further includes: In response to the current playback point of the first media interface reaching a specific playback point, second media content including the at least one first bullet comment is displayed, wherein the specific playback point includes at least one of the following: a node including exciting plot points, or a node including recommendation information.

11. The method according to any one of claims 1 to 9, characterized in that, In the case where at least one first bullet comment is arranged to form a pattern in the second media content, the method further includes, before displaying the second media content including the at least one first bullet comment: Feature extraction processing is performed on the currently playing content of the first media interface to obtain multimedia features; The multimedia features are subjected to pattern prediction processing to obtain a target pattern template that matches the currently playing content. The target pattern template is used to represent the position of each bullet comment in the pattern. The pattern type includes any one of the following: the outline of the fourth object in the currently playing content; the outline of the first object recommended by the recommendation information in the second bullet comment; or a symbol representing the first object. The pattern is obtained by arranging at least one first barrage according to the target pattern template.

12. The method according to any one of claims 1 to 9, characterized in that, After displaying at least one first bullet comment and at least one second bullet comment in the first media interface, the method further includes: In response to a selection operation on at least one of the first bullet comments in the first media interface, second media content including the first bullet comment selected by the selection operation is displayed.

13. The method according to any one of claims 1 to 9, characterized in that, In the case where at least one first bullet comment is arranged to form a pattern in the second media content, the method further includes, before displaying the second media content including the at least one first bullet comment: Feature extraction processing is performed on the at least one first bullet screen to obtain text features; The text features are subjected to pattern prediction processing to obtain a target pattern template that matches the selected first bullet screen. The target pattern template is used to represent the position of each bullet screen in the pattern. The type of the pattern includes any one of the following: the outline of the fifth object mentioned by multiple selected first bullet screens; or a pattern representing the commonality of multiple selected first bullet screens. The pattern is obtained by arranging at least one first barrage according to the target pattern template.

14. The method according to any one of claims 1 to 9, characterized in that, Before displaying the second media content including the at least one first bullet comment, the method further includes: In response to the number of bullet comments displayed in the first media interface reaching a second number threshold, second media content including the at least one first bullet comment is displayed.

15. The method according to claim 14, characterized in that, The type of bullet screen quantity includes any of the following: The total number of bullet comments displayed in the first media interface; The cumulative number of second bullet comments, including recommendation information, displayed in the first media interface; The cumulative number of bullet comments associated with the same object displayed in the first media interface; The cumulative number of identical content bullet comments displayed in the first media interface, wherein the pattern is composed of the identical content bullet comments.

16. The method according to any one of claims 1 to 9, characterized in that, When displaying second media content including at least one first bullet comment, the method further includes: Display a trigger control associated with the recommendation information, wherein the recommendation information is included in the second bullet screen; In response to a third trigger operation on the trigger control, a recommendation page corresponding to the recommendation information is displayed.

17. The method according to any one of claims 1 to 9, characterized in that, When displaying second media content including at least one first bullet comment, the method further includes: In response to a fourth trigger operation on the second media content, a recommendation page corresponding to the recommendation information is displayed, wherein the recommendation information is included in the second bullet screen.

18. The method according to any one of claims 1 to 9, characterized in that, When displaying second media content including at least one first bullet comment, the method further includes: Pause playback of the currently playing content on the first media interface; or, The first media content is continuously played in the first media interface, and the second media content is displayed in the area of ​​the first media interface where there are no dynamic objects.

19. The method according to claim 18, characterized in that, When the first media content is continuously played in the first media interface, the method further includes: In response to the appearance of a new first comment in the first media interface, the second media content is updated based on the new first comment.

20. The method according to any one of claims 1 to 9, characterized in that, The at least one first bullet screen is displayed in a first display mode and a second display mode, respectively; When at least one first bullet comment is displayed in the first media interface, the method further includes: In response to a sixth trigger operation for a first bullet comment in the first display mode, a chat interface corresponding to the sixth object of the triggered first bullet comment is displayed, wherein the first display mode indicates that the first bullet comment matches the object information of the second object using the first media interface, and the sixth object is the object that sent the triggered first bullet comment.

21. The method according to any one of claims 1 to 9, characterized in that, When displaying second media content including at least one first bullet comment, the method further includes: In response to a gesture operation on the first media interface, the second media content including the at least one first bullet comment is restored to the at least one first bullet comment at the initial position, wherein the initial position is the position of the first bullet comment at the moment corresponding to the interactive operation; or, Display a release control, and in response to a fifth trigger operation on the release control, restore the second media content, including the at least one first bullet comment, to the at least one first bullet comment in its initial position.

22. A method for processing interactive bullet comments, characterized in that, The method includes: Display the first media interface; Display at least one bullet comment on the first media interface; In response to an interactive operation in the first media interface, second media content including the at least one bullet comment is displayed.

23. The method according to claim 22, characterized in that, In the second media content, at least one bullet comment is arranged to form a pattern, and the type of the pattern includes at least one of the following: The identifier of the first object involved in at least one bullet screen; The elements in at least one bullet screen; The identifier of the second object that sent the at least one bullet comment.

24. The method according to claim 23, characterized in that, When displaying second media content including the at least one bullet comment, the method further includes: In response to a second trigger operation on the second media content, the currently displayed second media content is switched to other media content.

25. The method according to claim 23 or 24, characterized in that, The display includes the second media content of the at least one bullet screen, including: If the second media content is in image format, display an image of a pattern composed of at least one bullet screen; When the type of the second media content is video format, a video consisting of a fixed pattern or a dynamic pattern formed by the at least one bullet screen is played.

26. The method according to claim 25, characterized in that, The at least one bullet comment is arranged in descending or ascending order in the second media content according to a specific parameter, wherein the specific parameter includes: The time when the bullet comments were posted; The degree of correlation between the bullet comments and the other bullet comments; The degree of relevance between the bullet comments and the currently playing content; The types of patterns formed by at least one bullet screen include: The identifier of the first object recommended in the bullet screen; The elements in the recommended information in the bullet comments; The identifier of the third object that matches the at least one bullet comment.

27. The method according to claim 22, characterized in that, When the at least one bullet comment is multiple bullet comments, the display of second media content including the at least one bullet comment includes: In response to the fact that the number of the at least one bullet comment is less than a first quantity threshold, second media content including the at least one bullet comment and a copy of the at least one bullet comment is displayed.

28. The method according to claim 22, characterized in that, Before displaying the second media content including the at least one bullet comment, the method further includes: The display transition animation is used to represent the following process: each of the bullet comments moves from an initial position to a position corresponding to the second media content, where the initial position is the position of the bullet comment at the moment corresponding to the interactive operation.

29. The method according to any one of claims 22 to 28, characterized in that, After displaying the second media content including the at least one bullet comment, the method further includes: In response to the current playback point of the first media interface reaching a specific playback point, second media content including the at least one bullet comment is displayed, wherein the specific playback point includes at least one of the following: a node including exciting plot points, a node including recommendation information.

30. The method according to claim 29, characterized in that, In the case where at least one bullet comment is arranged to form a pattern in the second media content, the method further includes, before displaying the second media content including the at least one bullet comment: Feature extraction processing is performed on the currently playing content of the first media interface to obtain multimedia features; The multimedia features are subjected to pattern prediction processing to obtain a target pattern template that matches the currently playing content. The target pattern template is used to represent the position of each bullet screen in the pattern. The type of the pattern includes any one of the following: the outline of a fourth object in the currently playing content; the outline of a first object recommended by the recommendation information; or a symbol representing the first object. The pattern is obtained by arranging at least one bullet screen according to the target pattern template.

31. The method according to any one of claims 22 to 28, characterized in that, After displaying the second media content including the at least one bullet comment, the method further includes: In response to a selection operation on at least one of the bullet comments in the first media interface, second media content including the bullet comment selected by the selection operation is displayed.

32. The method according to claim 31, characterized in that, In the case where at least one bullet comment is arranged to form a pattern in the second media content, the method further includes, before displaying the second media content including the at least one bullet comment: Feature extraction processing is performed on the at least one bullet screen to obtain text features; The text features are subjected to pattern prediction processing to obtain a target pattern template that matches the selected bullet comments. The target pattern template is used to represent the position of each bullet comment in the pattern. The type of the pattern includes any one of the following: the outline of a fifth object mentioned by multiple selected bullet comments; a pattern representing the commonality of multiple selected bullet comments. The pattern is obtained by arranging at least one bullet screen according to the target pattern template.

33. An interactive processing device for bullet comments, characterized in that, The device includes: The display module is used to display the first media interface; The display module is also used to display at least one first bullet comment and at least one second bullet comment in the first media interface; The display module is also configured to display second media content including the at least one first comment in response to an interactive operation on the second comment.

34. An interactive processing device for bullet comments, characterized in that, The device includes: The display module is used to display the first media interface; The display module is also used to display at least one bullet screen in the first media interface; The display module is also configured to display second media content, including the at least one bullet screen, in response to an interactive operation in the first media interface.

35. An electronic device, characterized in that, The electronic device includes: Memory is used to store executable instructions or computer programs. A processor, when executing computer-executable instructions or computer programs stored in the memory, implements the interactive processing method for bullet comments as described in any one of claims 1 to 32.

36. A computer-readable storage medium storing computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or computer program are executed by a processor, the interactive processing method for bullet comments as described in any one of claims 1 to 32 is implemented.

37. A computer program product comprising computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or computer program are executed by a processor, the interactive processing method for bullet comments as described in any one of claims 1 to 32 is implemented.

Images