Barrage data processing method and device, electronic equipment, medium and program product

Abstract

Embodiments of the present application disclose a method and device for processing barrage data, electronic equipment, medium and program product, which are applied to the field of cloud technology. The method comprises the following steps: displaying a multimedia playing interface, the multimedia playing interface playing multimedia data, at least one barrage data being displayed on the multimedia data played by the multimedia playing interface, and according to a trigger operation for target barrage data in the at least one barrage data, displaying multimedia interactive data indicated by a barrage type of the target barrage data in association with the multimedia data and the target barrage data on the multimedia playing interface. The embodiments of the present application can improve the richness of the presentation of the barrage effect. The embodiments of the present application can be applied to various scenes such as cloud technology, artificial intelligence, intelligent transportation and auxiliary driving.

Description

Technical Field

[0001] This application relates to the field of cloud technology, and in particular to a method, apparatus, electronic device, medium, and program product for processing bullet screen data. Background Technology

[0002] With the development of the internet, there is a growing demand for improved user experience in multimedia playback. Many existing multimedia applications include bullet screen (danmu) functionality, allowing users to enhance the entertainment value of their viewing experience by sending bullet comments. Currently, users can often enhance the enjoyment of bullet comments by customizing their own irregularly shaped displays. However, this method results in relatively simple bullet comment effects and insufficient interactivity with the played multimedia data, failing to provide a truly superior viewing experience. Therefore, how to enrich the presentation of bullet comment effects has become a pressing issue. Summary of the Invention

[0003] This application provides a method, apparatus, electronic device, medium, and program product for processing bullet screen data, which can improve the richness of bullet screen effects and enhance the interactivity between bullet screen data and multimedia data.

[0004] On one hand, embodiments of this application provide a method for processing bullet screen data, the method comprising:

[0005] The multimedia playback interface is displayed; the multimedia playback interface plays multimedia data, and at least one bullet screen message is displayed on the multimedia data played by the multimedia playback interface.

[0006] Based on the trigger operation for the target bullet screen data in at least one bullet screen data, the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data are displayed together on the multimedia playback interface.

[0007] On one hand, embodiments of this application provide a bullet screen data processing device, the device comprising:

[0008] The display module is used to display a multimedia playback interface; the multimedia playback interface plays multimedia data, and at least one bullet screen data is displayed on the multimedia data played by the multimedia playback interface.

[0009] The processing module is used to associate and display the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data on the multimedia playback interface based on the trigger operation for the target bullet screen data in at least one bullet screen data.

[0010] On one hand, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to execute some or all of the steps in the above method.

[0011] On one hand, embodiments of this application provide a computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a processor, are used to perform some or all of the steps in the above-described method.

[0012] Accordingly, according to one aspect of this application, a computer program product or computer program is provided, comprising program instructions stored in a computer-readable storage medium. A processor of a computer device reads the program instructions from the computer-readable storage medium and executes the program instructions, causing the computer device to perform the above-described bullet screen data processing method.

[0013] In this embodiment, a multimedia playback interface can be displayed, which plays multimedia data. At least one bullet comment (danmu) is displayed on the multimedia data. Based on a trigger operation on a target bullet comment among the at least one bullet comment, the multimedia playback interface associates and displays multimedia interactive data indicated by the bullet comment type of the multimedia data and the target bullet comment. Through this method, multimedia interactive data presenting different bullet comment interaction effects can be obtained according to different bullet comment types. Associating the multimedia data with multimedia interactive data enhances the richness and interactivity of the bullet comments, providing users with a better viewing experience and enjoyment. Attached Figure Description

[0014] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 A schematic diagram of an application architecture provided for an embodiment of this application;

[0016] Figure 2 A flowchart illustrating a bullet screen data processing method provided in an embodiment of this application;

[0017] Figure 3a A schematic diagram illustrating a scene of bullet screen effect provided in an embodiment of this application;

[0018] Figure 3bA schematic diagram illustrating a scene of bullet screen effect provided in an embodiment of this application;

[0019] Figure 4 A flowchart illustrating a bullet screen data processing method provided in an embodiment of this application;

[0020] Figure 5a This application provides a schematic diagram of a scenario for displaying bullet screen data.

[0021] Figure 5b This application provides a schematic diagram of a scenario for displaying bullet screen data.

[0022] Figure 5c This application provides a schematic diagram of a scenario for displaying bullet screen data.

[0023] Figure 5d This application provides a schematic diagram of a scenario for displaying bullet screen data.

[0024] Figure 5e This application provides a schematic diagram of a scenario for displaying bullet screen data.

[0025] Figure 6a A schematic diagram of an interactive display scenario based on a high-energy bullet screen type, provided for an embodiment of this application;

[0026] Figure 6b A schematic diagram of an interactive display scenario based on a high-energy bullet screen type, provided for an embodiment of this application;

[0027] Figure 7a A schematic diagram of an interactive display scenario based on a protective bullet screen type provided in an embodiment of this application;

[0028] Figure 7b A schematic diagram of an interactive display scenario based on a protective bullet screen type provided in an embodiment of this application;

[0029] Figure 8a A schematic diagram of an interactive display scenario based on an animated bullet screen type, provided for an embodiment of this application;

[0030] Figure 8b A schematic diagram of an interactive display scenario based on an animated bullet screen type, provided for an embodiment of this application;

[0031] Figure 8c A schematic diagram of an interactive display scenario based on an animated bullet screen type, provided for an embodiment of this application;

[0032] Figure 9a A schematic diagram of an interactive display scenario based on a synthesized bullet screen type, provided for an embodiment of this application;

[0033] Figure 9b A schematic diagram of an interactive display scenario based on a synthesized bullet screen type, provided for an embodiment of this application;

[0034] Figure 10a This application provides a schematic diagram of the interactive process for processing bullet screen data.

[0035] Figure 10b This application provides a schematic diagram of the interactive process for processing bullet screen data.

[0036] Figure 10c This application provides a schematic diagram of the interactive process for processing bullet screen data.

[0037] Figure 11 A schematic diagram of the structure of a bullet screen data processing device provided in an embodiment of this application;

[0038] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0039] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0040] The bullet screen data processing method proposed in this application is implemented in an electronic device, which can be a server or a terminal. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The terminal can be a smartphone, tablet, laptop, desktop computer, smart speaker, smartwatch, smart voice interaction device, smart home appliance, vehicle terminal, aircraft, etc., but is not limited to these. This invention can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, and assisted driving.

[0041] This application relates to the field of artificial intelligence (AI) technology. AI is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results. In other words, AI is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to have perception, reasoning, and decision-making functions. For example, AI technology can be used to tag multimedia data in the technical solution of this application with segment plots.

[0042] This application's embodiments may relate to cloud technology-related technical fields, specifically cloud storage technology. Cloud storage is a new concept that extends and develops from cloud computing. A distributed cloud storage system (hereinafter referred to as a storage system) refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to aggregate a large number of various types of storage devices (also called storage nodes) in a network through application software or application interfaces to work collaboratively and provide data storage and business access functions. For example, the technical solution of this application can store multimedia interactive data and / or segment plot libraries that need to be associated and displayed in a cloud storage system.

[0043] In some embodiments, see Figure 1 , Figure 1 This is a schematic diagram of an application architecture provided for an embodiment of this application, through which the bullet screen data processing method proposed in this application can be executed. For example... Figure 1 As shown, it may include an electronic device and a backend server of the playback application to which the multimedia playback interface belongs; wherein, the electronic device displays the multimedia playback interface and obtains the multimedia data to be played (such as video data, audio comic data, etc.) and at least one bullet screen data to be displayed from the backend server. After playing the multimedia data and displaying at least one bullet screen data on the multimedia playback interface, when user A clicks on the target bullet screen data, the electronic device may determine the bullet screen type indication of the clicked target bullet screen data as multimedia interactive data, or the electronic device may obtain the corresponding multimedia interactive data from the backend server and associate the multimedia data and multimedia interactive data in the multimedia playback interface viewed by user A to realize the bullet screen effect corresponding to the clicked target bullet screen data.

[0044] Understandable Figure 1This is merely an illustrative representation of a possible application architecture for the technical solution of this application, and does not limit the specific architecture of the technical solution of this application. That is, the technical solution of this application may also provide other forms of application architecture.

[0045] Optionally, in some embodiments, the electronic device can execute the bullet screen data processing method according to actual business needs to improve the richness of the bullet screen effect presentation. The technical solution of this application can be applied to bullet screen scenarios with any multimedia data. That is, the electronic device can obtain the multimedia interactive data indicated by the triggered target bullet screen data when playing multimedia data, and display the multimedia data and multimedia interactive data in association on the multimedia playback interface. For example, the technical solution of this application can be applied to bullet screen scenarios with video data. If the bullet screen type of the triggered target bullet screen data is an animated bullet screen type, then the indicated multimedia interactive data can be a preset interactive animation. Displaying the multimedia data and multimedia interactive data in association can be done by displaying the interactive animation on the playing video data, thereby improving the user's enjoyment of the bullet screen experience.

[0046] Optionally, the data involved in this application, such as multimedia interactive data and fragment plot libraries, can be stored in a database or in a blockchain. This application does not limit the storage of such data through a blockchain distributed system.

[0047] It is understood that the above scenarios are merely examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. For example, as those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0048] Based on the above description, this application proposes a method for processing bullet screen data, which can be executed by the aforementioned electronic device. Please refer to... Figure 2 , Figure 2 This is a flowchart illustrating a bullet screen data processing method provided in an embodiment of this application. Figure 2 As shown, the flow of the bullet screen data processing method in this application embodiment may include the following:

[0049] S201, Display the multimedia playback interface.

[0050] The multimedia playback interface plays multimedia data, and at least one bullet screen (danmaku) is displayed on the multimedia data played by the multimedia playback interface.

[0051] In some embodiments, the multimedia data can be media data from any multimedia scenario, such as media data from a video playback scenario, like video data, meaning the images and sounds from the video data can be played on the multimedia playback interface; it can also be media data from an image playback scenario, like audio comic data, meaning the images and sounds from the audio comic data can be played on the multimedia playback interface; or it can be media data from a text playback scenario, like audiobook data, meaning the text and sounds from the audiobook data can be played on the multimedia playback interface, and so on. The specific type of multimedia data is not limited here. Furthermore, the multimedia playback interface has a bullet screen (or "comment") function. When a user is watching the multimedia data played on the multimedia playback interface, they can input the content of the bullet screen they want to send through this function. The electronic device obtains the bullet screen data based on the user's input and displays it on the playing multimedia data.

[0052] In some embodiments, the multimedia playback interface can be a video playback interface, an image playback interface (such as a comic book playback interface), etc. The multimedia playback interface can also be the interface of a playback application (such as a video application, comic book application, etc.). Users can log in to the playback application with a registered user account and click on multimedia data within the application to play the corresponding multimedia data, thereby triggering the electronic device to display the multimedia playback interface and play the multimedia data within the displayed interface.

[0053] S202. Based on the trigger operation for the target bullet screen data in at least one bullet screen data, display the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data in the multimedia playback interface.

[0054] In some embodiments, the displayed bullet screen data may include ordinary bullet screen data displaying user input content, and special bullet screen data displaying user input content, having touch-sensitive characteristics, and corresponding to a specific bullet screen type. This special bullet screen data has a corresponding bullet screen type; one feature bullet screen data corresponds to one bullet screen type, and different feature bullet screen data may correspond to different bullet screen types. When a user performs a trigger operation on a target bullet screen data in the displayed special bullet screen data, the electronic device obtains the corresponding multimedia interaction data based on the bullet screen type of the triggered target bullet screen data, and displays the multimedia data and multimedia interaction data in association on the user's corresponding multimedia playback interface. The trigger operation may be a click operation (single click, double click), a long press operation, a swipe operation, etc., and is not limited here.

[0055] In some embodiments, multimedia interactive data can characterize the viewing interaction process between a user and multimedia data. The form of this multimedia interactive data is determined by the specific type of bullet comments and the specific scenario of the multimedia data. Multimedia data in different scenarios may contain one or more types of bullet comments; the types of bullet comments in multimedia data in different scenarios may be the same or different; the specific methods for determining the multimedia interactive data corresponding to different types of bullet comments in the same scenario may be the same or different; and the specific methods for determining the multimedia interactive data corresponding to the same type of bullet comments in different scenarios may be the same or different. The specific method for determining this multimedia interactive data can be set by relevant business personnel (such as the developers of the playback application to which the multimedia playback interface belongs) based on experience.

[0056] In some embodiments, the multimedia interactive data may be data related to the multimedia data, such as adjusting the multimedia settings of the multimedia segment to be adjusted in the multimedia data according to the type of bullet comments, or data processing of the multimedia data according to the type of bullet comments; and it may also be data to be displayed on the multimedia data, such as animation, images, text and other data displayed on the multimedia data.

[0057] In some embodiments, the electronic device may associate and display multimedia interactive data and multimedia data, which may include displaying the multimedia interactive data on the multimedia data being played, or it may directly replace a part of the multimedia data in the multimedia data being played with the multimedia interactive data and play the multimedia interactive data. After the multimedia interactive data has finished playing, the multimedia data will continue to play according to the end progress point of the replaced multimedia segment.

[0058] Therefore, the interactive display process may include, but is not limited to:

[0059] (1) When the multimedia interactive data is obtained by adjusting the multimedia settings of the multimedia segment to be adjusted in the multimedia data, the multimedia interactive data replaces the multimedia segment to be adjusted, and the multimedia interactive data is played. After the playback is completed, the multimedia data is played again according to the progress position of the endpoint progress point of the multimedia segment to be adjusted in the multimedia data. The multimedia segment to be adjusted can be obtained based on the current progress position of the multimedia data when the trigger operation is performed, that is, it can be obtained according to the current progress position and the interaction time indicated by the target bullet screen data. For example, if the multimedia data is video data, and the current progress position is that the video data has played to 1:00, and the interaction time is 30s, then the multimedia segment to be adjusted can be a video segment in the video data with a playback progress between 1:00 and 1:30. The interaction time can be the default setting time corresponding to the bullet screen type of the target bullet screen data, or it can be the time set by the user who sent the target bullet screen data.

[0060] (2) When the multimedia interactive data is obtained by processing the multimedia data as indicated by the bullet screen type, the multimedia interactive data obtained after the data processing can be displayed on the multimedia data currently being played on the multimedia playback interface, and the multimedia interactive data can be saved to the electronic device.

[0061] (3) When the multimedia interactive data is data that needs to be displayed on the multimedia data, the multimedia interactive data can be displayed on the currently playing multimedia data in the multimedia playback interface. For details regarding the association and display of multimedia data and multimedia interactive data, please refer to the relevant descriptions in the following embodiments.

[0062] It is understandable that the target bullet screen data triggered by a user can be bullet screen data sent by the user himself, or it can be bullet screen data sent by other users watching the video data.

[0063] For example, such as Figures 3a-3b As shown, Figures 3a-3bThis is a schematic diagram illustrating a scenario for presenting a bullet screen effect, provided in an embodiment of this application. A multimedia playback interface is displayed on a user's electronic device. This interface plays video data, and at least one bullet screen data is displayed on the video data. This bullet screen data includes ordinary bullet screen data and special bullet screen data. Bullet screen data with a special identifier (e.g., a double underscore) is considered special bullet screen data. This special bullet screen data is touch-sensitive and has a corresponding bullet screen type. The user can trigger the special bullet screen data to achieve the corresponding bullet screen effect. When the user triggers a target bullet screen data within the special bullet screen data, the electronic device determines the multimedia interactive data based on the bullet screen type of the target bullet screen data and displays the video data and multimedia interactive data in association on the multimedia playback interface. Figure 3a As shown; assuming the multimedia interactive data determined by the bullet screen type based on the target bullet screen data is the target animation to be displayed on the multimedia data, then the corresponding target animation can be displayed starting at the current playback progress point of the video data when the trigger operation is executed, such as... Figure 3b As shown.

[0064] In this embodiment, the electronic device can display a multimedia playback interface. Based on a trigger operation targeting target bullet screen data within at least one bullet screen data set, the multimedia playback interface associates and displays multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data. Through this method, multimedia interactive data presenting different bullet screen interaction effects can be obtained according to different bullet screen types. Associating multimedia data with multimedia interactive data enhances the richness and interactivity of the bullet screens, providing users with a better viewing experience and enjoyment.

[0065] Please see Figure 4 , Figure 4 This is a flowchart illustrating a bullet screen data processing method provided in an embodiment of this application. This method can be executed by the aforementioned electronic device. Figure 4 As shown, the process of the bullet screen data processing method in this embodiment may include the following:

[0066] S401. Display the multimedia playback interface. The specific implementation of step S401 can be found in the relevant descriptions of the above embodiments, and will not be repeated here.

[0067] S402. Display the bullet screen input interface based on the bullet screen input operation triggered on the multimedia playback interface.

[0068] In some embodiments, when an electronic device plays multimedia data on a multimedia playback interface, it can generate and display at least one bullet screen (danmu) data based on the user's bullet screen sending operation. Specifically, the electronic device can display a bullet screen input interface based on the bullet screen input operation triggered on the multimedia playback interface. This bullet screen input interface can display at least one bullet screen type control, which the user can use to select the type of bullet screen data to be sent. This bullet screen input interface is used to input the data of the bullet screen that the user wants to send, and the bullet screen input interface can be displayed on the electronic device in the form of interface jump. That is, after triggering the bullet screen input operation, the user can jump from the current multimedia playback interface to the bullet screen input interface, and when the user sends a bullet screen or closes the bullet screen input interface, the user can jump back from the bullet screen input interface to the multimedia playback interface. Alternatively, it can be displayed on the multimedia playback interface as a floating window overlay.

[0069] In one possible implementation, the bullet screen input interface displayed by the electronic device can directly include bullet screen type controls corresponding to all bullet screen types; alternatively, the bullet screen type controls to be displayed on the bullet screen input interface can be determined based on the current playback progress point and / or the data entered by the user. Specifically, this can be achieved by: determining at least one multimedia segment contained in the multimedia data and the segment plot corresponding to each transition multimedia segment in the at least one multimedia segment that satisfies the preset plot rules, and displaying the bullet screen input interface based on the transition multimedia segments contained in the multimedia data and the playback progress point when the bullet screen input operation is triggered.

[0070] In some embodiments, the electronic device determines at least one multimedia segment contained in multimedia data and the segment plot corresponding to each transition multimedia segment that satisfies a preset plot rule within the at least one multimedia segment. Specifically, this can involve: acquiring a preset segment plot library, which may contain at least one segment plot; setting a corresponding bullet screen type control for each segment plot in the segment plot library, where one segment plot may correspond to one bullet screen type and bullet screen type control; segmenting the multimedia data to obtain at least one multimedia segment contained in the multimedia data, where the lengths of the different multimedia segments may be the same or different; determining at least one transition multimedia segment from the at least one multimedia segment; and setting a corresponding segment plot for each transition multimedia segment according to the segment plot library, thereby achieving plot marking of the multimedia data. One transition multimedia segment may correspond to one or more segment plots.

[0071] The segment plot library can be determined by relevant business personnel based on the specific type of multimedia data and experience values. Different multimedia data can have different segment plots. For example, when the multimedia data is video data, the corresponding segment plots may include high-energy scenes, protective scenes, etc.; when the multimedia data is comic data, the corresponding segment plots may include climax scenes, ending scenes, etc. Optionally, a training set (which may include multiple sample multimedia data, the segment plots corresponding to sample multimedia segments in each sample multimedia data, and the plot rules corresponding to each segment plot) can be pre-created by electronic devices and / or a backend server, and plot labeling can be trained based on the training set. After training, plot labeling of multimedia data can be realized.

[0072] In some embodiments, the specific method of segmenting multimedia data can be determined by the specific type of multimedia data. For example, when the multimedia data is video data, it can be divided into a multimedia segment every 3 minutes; when the multimedia data is novel data, it can be divided into a multimedia segment for each paragraph or for each chapter; when the multimedia data is comic data, it can be divided into a multimedia segment for each chapter or for every N (N is a positive integer) images; there are no restrictions here.

[0073] In some embodiments, determining at least one transitional multimedia segment from at least one multimedia segment can specifically involve determining plot rules corresponding to each segment's plot and determining at least one transitional multimedia segment from the at least one multimedia segment that satisfies any plot rule. When a multimedia segment satisfies multiple plot rules, then the multimedia segment can correspond to multiple segment plots. The plot rules can be set by relevant business personnel based on the specific type of multimedia data and the specific segment plot; different segment plots correspond to different plot rules. For example, if the multimedia data is video data and the segment plot is a high-energy plot, the corresponding plot rule could be the appearance of fighting scenes or main characters in the multimedia segment; if the segment plot is a protective plot, the corresponding plot rule could be the appearance of horror or suspense scenes in the multimedia segment.

[0074] In some embodiments, the electronic device displays a bullet screen input interface based on transitional multimedia segments included in the multimedia data and the playback progress point when the bullet screen input operation is triggered. Specifically, if the multimedia segment to which the playback progress point belongs is a transitional multimedia segment with a corresponding segment plot, a bullet screen input interface containing a bullet screen type control with the corresponding segment plot is displayed; and if the multimedia segment to which the playback progress point belongs is not a transitional multimedia segment with a corresponding segment plot, a bullet screen input interface without any bullet screen type control is displayed. That is, the electronic device displays a first bullet screen input interface based on the bullet screen input operation triggered on the multimedia playback interface. The first bullet screen input interface contains a first bullet screen type control, which refers to the bullet screen type control indicated by the segment plot corresponding to the target multimedia segment in the multimedia data. The target multimedia segment is any one of at least one multimedia segment, and the target multimedia segment refers to the segment played in the multimedia playback interface when the bullet screen input operation is triggered; or, the electronic device displays a second bullet screen input interface based on the bullet screen input operation triggered on the multimedia playback interface. The second bullet screen input interface does not include any bullet screen type control corresponding to any segment plot. The barrage input operation can be a touch operation on the barrage input bar, or a voice instruction operation sent in response to the barrage, etc., and there are no restrictions here.

[0075] S403. Based on the bullet screen type control on the bullet screen input interface and the input data, display the bullet screen data of the bullet screen type indicated by the bullet screen type control on the multimedia playback interface.

[0076] The bullet screen input interface includes the first bullet screen input interface and the second bullet screen input interface described above, and special bullet screen data can be sent in both the first bullet screen input interface and the second bullet screen input interface.

[0077] In some embodiments, the special bullet screen data displayed by the electronic device based on the first bullet screen input interface can specifically be as follows: if the control state of the first bullet screen type control in the first bullet screen input interface is in the open state, then according to the data entered in the bullet screen input interface, the bullet screen data of the bullet screen type indicated by the first bullet screen type control is displayed on the multimedia playback interface. The content displayed by the bullet screen data includes the entered data, which may include text, characters, emoticons, etc. Furthermore, the number of first bullet screen type controls can be one or more. When the first bullet screen input interface is triggered, if the target multimedia segment played on the multimedia playback interface corresponds to multiple segment plots, the first bullet screen type control is the bullet screen type control corresponding to those multiple segment plots.

[0078] Optionally, when there are multiple first bullet comment type controls, one or more of them can be enabled. That is, the user can trigger one or multiple first bullet comment type controls simultaneously. When multiple first bullet comment type controls are triggered, bullet comment data for the bullet comment type indicated by each of the triggered first bullet comment type controls can be generated and displayed based on the entered target data. Optionally, the control state of the first bullet comment type control can be automatically enabled when the first bullet comment input interface is displayed, or it can be initially disabled and then enabled by the user's triggering operation.

[0079] In some embodiments, the special bullet screen data displayed by the electronic device based on the second bullet screen input interface may specifically involve obtaining target data entered in the second bullet screen input interface, the target data including text data, and if the text data contains at least one plot keyword associated with the target plot segment in the plot segment, then the second bullet screen type control corresponding to the target plot segment is displayed in the second bullet screen input interface, and bullet screen data of the bullet screen type indicated by the second bullet screen type control is displayed in the multimedia playback interface according to the second bullet screen type control and the target data.

[0080] Specifically, displaying the bullet comment data of the type indicated by the second bullet comment type control on the multimedia playback interface, based on the second bullet comment type control and the target data, can be as follows: If the control state of the second bullet comment type control in the second bullet comment input interface is in the on state, then based on the target data entered in the bullet comment input interface, the bullet comment data of the type indicated by the second bullet comment type control is displayed on the multimedia playback interface. The content displayed in this bullet comment data includes the entered target data, which may include text, characters, emoticons, etc. Optionally, the control state of the second bullet comment type control may be automatically in the on state when displayed in the second bullet comment input interface, or it may be in the off state first and then in the on state after being triggered by the user.

[0081] Therefore, the electronic device can obtain the latest target data from the bullet screen input interface and perform keyword recognition on the text data included in the target data. If a keyword belonging to a plot keyword related to any segment is identified, the target segment plot and the corresponding second bullet screen type control are determined. This can be understood as follows: if the input target data contains keywords related to the target segment plot, it indicates that the user may want to send special bullet screen data of the type indicated by the second bullet screen type control corresponding to that target segment plot.

[0082] The plot keywords associated with different scene segments can be the same or different, and can be set by relevant business personnel based on experience. For example, plot keywords associated with high-energy scenes can include "high energy ahead" or "high energy warning," etc. There can be one or more target scene segments. When the text data includes plot keywords associated with multiple scene segments, all of these scene segments are considered as target scene segments; or, when the keywords included in the text data belong to plot keywords associated with multiple scene segments, all of these scene segments are considered as target scene segments. When there are multiple target scene segments, there can also be multiple corresponding second bullet comment type controls, which are displayed in the bullet comment input interface. Optionally, when there are multiple second bullet comment type controls, one or more of them can be activated, meaning the user can trigger one or more second bullet comment type controls. When multiple controls are triggered, bullet comment data indicating the bullet comment type of each of the triggered controls can be generated and displayed based on the entered target data.

[0083] In some embodiments, the way an electronic device displays bullet comment data of the type indicated by a first bullet comment type control on a multimedia playback interface and bullet comment data of the type indicated by a second bullet comment type control on a multimedia playback interface is the same. That is, a special identifier matching the activated bullet comment type control is added to the entered data to obtain the bullet comment data to be displayed, and a trigger control is generated for the bullet comment data to be displayed to make it touch-sensitive. This special identifier can be set by the user or by relevant personnel, and the special identifiers corresponding to different bullet comment type controls can be the same or different.

[0084] For example, such as Figures 5a-5e As shown, Figures 5a-5e This application provides a schematic diagram of a scenario for displaying bullet screen data; wherein:

[0085] (1) As Figure 5a As shown, based on the barrage input operation triggered on the multimedia playback interface, if the multimedia segment being played at the time of triggering has a corresponding segment plot, the first barrage input interface is displayed. The first barrage input interface displays the first barrage type control for the corresponding segment plot. The displayed first barrage type control can be one or more.

[0086] (2) Figure 5bAs shown, the first bullet comment type control is activated by triggering the first bullet comment type control, and the data entered on the first bullet comment input interface is obtained; when the number of first bullet comment type controls (let's say bullet comment type control A) in the activated state is 1, bullet comment data is generated and displayed based on the entered data and the special identifier corresponding to bullet comment type control A (let's say the special identifier is bullet comment type A marked in the upper right corner); such as Figure 5c As shown, when the number of the first bullet screen type controls (let's say bullet screen type control A and bullet screen type control B) in the open state is 2, bullet screen data A is generated and displayed based on the entered data and the special identifier corresponding to bullet screen type control A (let's say the special identifier is bullet screen type A marked in the upper right corner). Bullet screen data B is generated and displayed based on the entered data and the special identifier corresponding to bullet screen type control B (let's say the special identifier is bullet screen type B marked in the upper right corner).

[0087] (3) Optionally, it can be based on Figure 5c When both bullet screen type control A and bullet screen type control B are enabled, each enabled control corresponds to a bullet screen input box. The bullet screen content displayed by bullet screen data A is the same as that displayed by bullet screen data B, and both the content displayed by bullet screen data A and the content displayed by bullet screen data B are data entered into that bullet screen input box. Alternatively, when multiple controls are enabled, a bullet screen input box is assigned to each control. That is, when a second or more controls are enabled, a bullet screen input box is generated and displayed for the newly enabled control. Figure 5d As shown, in this bullet screen input interface, when only bullet screen type control A is enabled, the bullet screen input box is the bullet screen input box corresponding to bullet screen type control A. When bullet screen type control B is enabled, a new bullet screen input box is added to the bullet screen input interface. This new bullet screen input box is the bullet screen input box corresponding to bullet screen type control B. Users can send bullet screen data corresponding to both controls simultaneously through the "one-click send" control in the bullet screen input interface, or they can send bullet screen data corresponding to both controls separately through the send control on their respective bullet screen input boxes.

[0088] (4) Figure 5eAs shown, based on the bullet screen input operation triggered on the multimedia playback interface, if the multimedia segment being played at the time of triggering does not have a corresponding segment plot, a second bullet screen input interface is displayed. This second bullet screen input interface does not display any bullet screen type control. The target data entered in the second bullet screen input interface is obtained (it can be obtained periodically (e.g., once every 0.1 seconds) or when a change in the data in the second bullet screen input interface is detected). If the text data in the entered target data contains plot keywords related to the target segment plot, for example, if the target data is "High energy ahead XXX...", the text data is "High energy ahead XXX", and the plot keyword related to the high energy plot is "High energy ahead", then the high energy bullet screen type control corresponding to the high energy plot is displayed on the second bullet screen input interface. When the text data contains plot keywords related to multiple segment plots, the bullet screen type controls corresponding to those multiple segment plots will be displayed.

[0089] (5) When the high-energy bullet screen type control is in the open state and the bullet screen sending operation is triggered, the corresponding bullet screen data is generated and displayed according to the obtained target data and the special identifier corresponding to the high-energy bullet screen type control.

[0090] It is understandable that when all displayed bullet comment type controls are closed or no bullet comment type controls are displayed, the bullet comment data generated and displayed based on the data entered in the bullet comment input interface is ordinary bullet comment data. Furthermore, before displaying the bullet comment input interface, the electronic device or backend server can analyze the content of the multimedia data to complete the plot marking of the multimedia data. During the playback of the multimedia data, a bullet comment input interface containing the corresponding bullet comment type controls can be displayed at the plot markings. Based on the operations in this bullet comment input interface, corresponding special bullet comment data can be generated and displayed. Additionally, at any time outside of plot markings, keyword recognition can be performed using the acquired target data. After identifying the plot keywords, the corresponding bullet comment type controls can be displayed, and based on the operations in this bullet comment input interface, corresponding special bullet comment data can be generated and displayed. These different special bullet comment data can present different bullet comment effects. This method can improve the user's viewing experience when watching multimedia data and enhance the richness and fun of bullet comment gameplay.

[0091] S404. Based on the trigger operation for the target bullet screen data in at least one bullet screen data, display the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data in the multimedia playback interface.

[0092] In some embodiments, when a user clicks on target bullet screen data within special bullet screen data, the electronic device can determine the multimedia interactive data with bullet screen effects based on the bullet screen type of the target bullet screen data, and display the multimedia data and multimedia interactive data in association. This can improve the interactivity and interactivity of the multimedia data and enhance the visual experience presented to the user through bullet screens. Therefore, when watching multimedia data, users can see different bullet screen effects by clicking on or sending special bullet screen data, which can provide a greater sense of accomplishment and satisfaction, thereby increasing viewing engagement and viewing experience. This can promote increased viewing time and boost overall user viewing metrics (including viewing time, user activity, user retention, etc.).

[0093] In some embodiments, the bullet comment type of the target bullet comment data may be one or more, and may be determined according to the specific type of multimedia data. Optionally, when the multimedia data is video data, the bullet comment type indicated by the target bullet comment data may include a high-energy bullet comment type, and the multimedia playback interface may contain a playback progress bar for the video data; therefore, the electronic device associates and displays the multimedia interactive data indicated by the bullet comment type of the multimedia data and the target bullet comment data in the multimedia playback interface. Specifically, it may obtain a first video segment from the video data based on the first playback duration of the video data in the playback progress bar when the trigger operation for the target bullet comment data is executed, wherein the playback start position of the first video segment refers to the playback position indicated by the first playback duration; and adjust the video playback settings of the first video segment to the high-energy playback settings corresponding to the high-energy bullet comment type, determine the first video segment with the high-energy playback settings as multimedia interactive data, and associate and display the video data and the first video segment with the high-energy playback settings.

[0094] For example, suppose the plot of the first video segment at this time corresponds to a "high-energy plot". A high-energy plot can be a scene containing special visuals such as fight scenes or main character appearances. Since users typically want to better focus on the currently playing segment when watching high-energy plots, this high-energy playback setting can achieve this effect when playing the first video segment. Specifically, the high-energy playback setting can include at least one of the following settings: increasing the playback volume of the first video segment, increasing the transparency of the displayed comments on the first video segment; optionally, it can also include increasing the brightness of the first video segment's playback screen, or increasing the clarity of the first video segment, etc.

[0095] The aforementioned setting to increase the playback volume can be done by increasing it to XX times (e.g., 1.5 times) of the current playback volume or to the target volume (if the playback volume is already greater than or equal to the target volume while playing video data, this adjustment is unnecessary), and the specific method is not limited here; similarly, the setting to increase the transparency can be done by increasing it to XX times (e.g., 1.5 times) of the current transparency or to the target transparency (if the transparency is already greater than or equal to the target transparency while playing video data, this adjustment is unnecessary), and the specific method is not limited here; and the setting to increase the brightness of the playback screen... The brightness enhancement setting can be increased to XX times the current screen brightness (e.g., 1.5 times) or to the target brightness (if the current screen brightness is already greater than or equal to the target brightness during video playback, this adjustment is unnecessary), and there are no restrictions on the specific method. Similarly, the resolution enhancement setting can be increased by one level compared to the current resolution (e.g., if the current resolution is 720P, it can be increased to 1080P) or to the target resolution (if the resolution is already greater than or equal to the target resolution during video playback, this adjustment is unnecessary). Optionally, the high-performance playback settings may also include other settings, which are not limited here.

[0096] In some embodiments, the electronic device may obtain the first video segment from the video data based on the first playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is performed. Specifically, it may obtain the interaction time indicated by the target bullet screen data, determine the first playback progress interval based on the playback progress point (i.e., the playback position in the video data) corresponding to the first playback duration in the video data and the interaction time, and determine the first video data in the video data corresponding to the first playback progress interval as the first video segment, that is, the first video data is a portion of the video data in the video data.

[0097] Optionally, the interaction time can be set by default by relevant business personnel, or it can be set by the user when sending high-energy bullet screen data. That is, it can be a first control for setting the interaction time displayed when the high-energy bullet screen type control is enabled. Furthermore, the display time of the high-energy bullet screen data on the multimedia playback interface can also be set by default by relevant business personnel, or it can be set by the user. That is, it can be a second control for setting the display time displayed when the high-energy bullet screen type control is enabled. Optionally, the first control and the second control can be different controls, or they can be the same control.

[0098] In some embodiments, the electronic device may associate video data with a first video segment having a high-energy playback setting by playing the first video segment having a high-energy playback setting, and after the playback is completed, continue playing the video data from the end position of the first video segment to achieve associated display.

[0099] For example, such as Figures 6a-6b As shown, Figures 6a-6b This application provides a schematic diagram of an interactive display scenario based on a high-energy bullet screen type; wherein:

[0100] (1) The displayed bullet screen input interface includes high-energy bullet screen type controls corresponding to the high-energy bullet screen type. The displayed bullet screen input interface can be as follows:

[0101] (a) If the high-energy bullet screen type control is enabled, the bullet screen input interface can be displayed as follows: Figure 6a As shown in (1), both the interaction time and the display time are set to default.

[0102] (b) Alternatively, the bullet screen input interface at this time can be as follows: Figure 6a As shown in (2), the interaction time indicated by the high-energy bullet screen data can be set by the user, and the display time corresponding to the high-energy bullet screen data is the default setting;

[0103] (c) Alternatively, the bullet screen input interface at this time can be as follows: Figure 6a As shown in (3), the interaction time indicated by the high-energy bullet screen data is the default setting, and the display time corresponding to the high-energy bullet screen data can be set by the user;

[0104] (d) Alternatively, the bullet screen input interface at this time can be as follows: Figure 6a As shown in (4), the interaction time and corresponding display time indicated by the high-energy bullet screen data can be set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are the same control. The interaction time and display time can be set at the same time through this control, that is, the interaction time and display time of a high-energy bullet screen data are the same at this time.

[0105] (e) Alternatively, the bullet screen input interface at this time can be as follows: Figure 6a As shown in (5), the interaction time and corresponding display time indicated by the high-energy bullet screen data can be set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are not the same control. That is, the interaction time and display time of a high-energy bullet screen data can be set separately.

[0106] (2) Figure 6bThe multimedia playback interface displays video data. When high-energy bullet screen data is triggered, the first playback duration of the video data in the playback progress bar is 1:00. That is, the multimedia playback interface is playing the video frame corresponding to 1:00 in the video data at this time. The playback progress interval is determined based on the interaction time of the triggered high-energy bullet screen data (set to 30 seconds) and the first playback time. The first video segment is obtained based on the playback progress interval, which is a portion of the video data between 1:00 and 1:30. The playback settings of the first video segment are adjusted based on the high-energy playback settings to obtain a first video segment with high-energy playback settings. The first video segment with high-energy playback settings is played, and after the playback ends, the video data continues to play based on the playback end position of the first video segment, that is, the video data starts playing from 1:30 in the playback progress bar. That is, the multimedia playback interface is playing the video frame corresponding to 1:30 in the video data at this time.

[0107] In some embodiments, when the multimedia data is video data, the bullet screen type indicated by the target bullet screen data may include a protective bullet screen type, and the multimedia playback interface may contain a playback progress bar for the video data. Therefore, the electronic device may associate and display the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data in the multimedia playback interface by obtaining a second video segment from the video data based on the second playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is executed. The playback start position of the second video segment refers to the playback position indicated by the second playback duration. The video playback settings of the second video segment are adjusted to the protective playback settings corresponding to the protective bullet screen type. The second video segment with the protective playback settings is determined as multimedia interactive data, and the video data and the second video segment with the protective playback settings are displayed in association.

[0108] For example, suppose the plot of the second video segment at this time corresponds to a protective scene. A protective scene can be a plot containing terrifying images, screaming characters, or other special scenes. Since users are often easily frightened or startled when watching protective scenes, affecting their viewing experience of the currently playing segment, this protective playback setting can minimize this situation when playing the second video segment. This protective playback setting can include at least one of the following settings: reducing the playback volume of the second video segment, reducing the clarity of the second video segment; optionally, it can also include reducing the brightness of the second video segment's playback screen.

[0109] The aforementioned settings for reducing playback volume can include reducing it to XX times (e.g., 1.5 times) of the current playback volume or reducing it to a target volume (if the current playback volume is already less than or equal to the target volume while playing video data, this adjustment is unnecessary), and the specific method is not limited here. Similarly, reducing clarity can involve lowering it by one frame level from the current clarity or lowering it to a target frame level (if the current frame level is already less than or equal to the target frame level while playing video data, this adjustment is unnecessary), and the specific method is not limited here. Furthermore, reducing playback brightness can involve lowering it to XX times (e.g., 1.5 times) of the current brightness or increasing it to a target brightness (if the current brightness is already less than or equal to the target brightness while playing video data, this adjustment is unnecessary), and the specific method is not limited here. Optionally, the playback settings may also include other settings, which are not limited here.

[0110] In some embodiments, the electronic device may obtain a second video segment from the video data based on the second playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is performed. Specifically, it may obtain the interaction time indicated by the target bullet screen data, determine the second playback progress interval based on the playback progress point (i.e., the playback position in the video data) corresponding to the second playback duration in the video data and the interaction time, and determine the second video data in the video data corresponding to the second playback progress interval as the second video segment, that is, the second video data is a portion of the video data in the video data.

[0111] Optionally, the interaction time can be set by default by relevant business personnel, or it can be set by the user when sending the protective bullet screen data. That is, it can be a first control for setting the interaction time displayed when the protective bullet screen type control is enabled. Furthermore, the display time of the protective bullet screen data on the multimedia playback interface can also be set by default by relevant business personnel, or it can be set by the user. That is, it can be a second control for setting the display time displayed when the protective bullet screen type control is enabled. Optionally, the first control and the second control can be different controls, or they can be the same control.

[0112] In some embodiments, the electronic device may associate the video data with a second video segment having a playback protection setting by playing the second video segment having the playback protection setting, and after the playback is completed, continue playing the video data from the end position of the second video segment to achieve associated display.

[0113] For example, such as Figures 7a-7b As shown, Figures 7a-7bThis application provides a schematic diagram of an interactive display scenario based on a protective bullet screen type; wherein:

[0114] (1) The displayed bullet screen input interface includes a protective bullet screen type control corresponding to the protective bullet screen type. The displayed bullet screen input interface can be as follows:

[0115] (a) If the protective barrage type control is enabled, the barrage input interface can be displayed as follows: Figure 7a As shown in (1), both the interaction time and the display time are set to default.

[0116] (b) Alternatively, the bullet screen input interface at this time can be as follows: Figure 7a As shown in (2), the interaction time indicated by the protective barrage data can be set by the user, and the display time corresponding to the protective barrage data is the default setting;

[0117] (c) Alternatively, the bullet screen input interface at this time can be as follows: Figure 7a As shown in (3), the interaction time indicated by the protective barrage data is the default setting, and the display time corresponding to the protective barrage data can be set by the user;

[0118] (d) Alternatively, the bullet screen input interface at this time can be as follows: Figure 7a As shown in (4), the interaction time and corresponding display time indicated by the protective barrage data can be set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are the same control. The interaction time and display time can be set at the same time through this control, that is, the interaction time and display time of a protective barrage data are the same at this time.

[0119] (e) Alternatively, the bullet screen input interface at this time can be as follows: Figure 7a As shown in (5), the interaction time and corresponding display time indicated by the protective barrage data can be set by the user, and the first control corresponding to the interaction time and the second control corresponding to the display time are not the same control. That is, the interaction time and display time of a protective barrage data can be set separately.

[0120] (2) Figure 7bThe multimedia playback interface displays video data. When the protective barrage data is triggered, the second playback duration of the video data in the playback progress bar is 2:00. That is, the multimedia playback interface is playing the video frame corresponding to 2:00 in the video data at this time. The playback progress interval is determined based on the interaction time of the triggered protective barrage data (set to 30s) and the second playback time. The second video segment is obtained based on the playback progress interval, that is, the second video segment is a portion of the video data between 2:00 and 2:30. The playback settings of the second video segment are adjusted based on the protective playback settings to obtain a second video segment with protective playback settings. The second video segment with protective playback settings is played, and after the playback ends, the video data continues to be played based on the playback end position of the second video segment, that is, the video data is played starting from 2:30 in the playback progress bar. That is, the multimedia playback interface is playing the video frame corresponding to 2:30 in the video data at this time.

[0121] In some embodiments, the bullet comment type indicated by the target bullet comment data may include an animated bullet comment type. Therefore, the electronic device may associate and display the multimedia interactive data indicated by the bullet comment type of the multimedia data and the target bullet comment data on the multimedia playback interface. Specifically, this may involve obtaining the interactive animation corresponding to the animated bullet comment type, using the interactive animation as multimedia interactive data, and displaying the interactive animation on the multimedia data played on the multimedia playback interface. For example, if the corresponding interactive animation represents a final animation, then the corresponding scene segment is a final scene. Optionally, the interactive animation may include a flower-sprinkling animation, an anime character dancing animation, etc., and the specific type of interactive animation is not limited here. Furthermore, depending on the interactive animation, there may be one or more corresponding animated bullet comment types. Different scene segments may correspond to different animated bullet comment types. For example, when the scene segment is a final scene, the corresponding bullet comment type may be a first animated bullet comment type, and the interactive animation corresponding to this first animated bullet comment type is a flower-sprinkling animation, which can also be called the final bullet comment type corresponding to a final animation. When the scene segment is a wedding scene, the corresponding bullet comment type may be a second animated bullet comment type, and the interactive animation corresponding to this second animated bullet comment type is an anime character dancing animation, which can also be called the wedding bullet comment type corresponding to a wedding animation; and so on. There are no restrictions here; it can be set by relevant business personnel or users.

[0122] In some embodiments, the interactive animation acquired by the electronic device can be set by default by relevant business personnel or by the user. Specifically, it can be an animation control for selecting the interactive animation displayed when the animation bullet comment type control is enabled. Optionally, the display time of the interactive animation can be set by default by relevant business personnel or by the user when sending animation bullet comment data. Specifically, it can be a display time control for setting the display time displayed when the animation bullet comment type control is enabled. Furthermore, the display time of the animation bullet comment data on the multimedia playback interface can be set by default by relevant business personnel or by the user. Specifically, it can be a display time control for setting the display time displayed when the animation bullet comment type control is enabled. Optionally, the display time control and the display duration control can be different controls or the same control.

[0123] In some embodiments, the electronic device may associate and display multimedia data and interactive animation (multimedia interactive data) by determining the playback position of the multimedia data when a trigger operation is performed on the target bullet screen data, and starting to display the interactive animation from the playback position. Optionally, the multimedia data may be played continuously while the interactive animation is displayed, or the multimedia data may be stopped while the interactive animation is displayed, and the multimedia data may be resumed from the pause point after the interactive animation is finished, so as to achieve associated display.

[0124] For example, such as Figures 8a-8c As shown, Figures 8a-8c This application provides a schematic diagram of an interactive display scenario based on an animated bullet screen type, as an embodiment of the present application; wherein:

[0125] (1) The displayed bullet screen input interface includes animation bullet screen type controls corresponding to the animation bullet screen type. The displayed bullet screen input interface can be as follows:

[0126] (a) If the animation bullet comment type control is enabled, the bullet comment input interface can be displayed as follows: Figure 8a As shown in (1), the interactive animation, display time, and display time are all set to default.

[0127] (b) Alternatively, one or more of the interactive animation, display time, and screen time can be set as default, while the rest are user-defined. For example, the bullet screen input interface could be configured as follows: Figure 8a As shown in (2), the interactive animation can be set by the user, and the display time and show time are the default settings;

[0128] (c) Alternatively, the bullet screen input interface at this time can be as follows: Figure 8a As shown in (3), the interactive animation and display time are set by default, while the display time can be set by the user;

[0129] (d) Alternatively, the bullet screen input interface at this time can be as follows: Figure 8a As shown in (4), the interactive animation and display time can be set by the user, and the display time is the default setting; etc.

[0130] (2) Assume the multimedia data played in the multimedia playback interface is video data. This video data has a playback progress bar, and when the animated bullet screen data is triggered, the playback position in the video data's playback progress bar is 3:00. That is, at this time, the multimedia playback interface is playing the video frame corresponding to 3:00 in the video data. Based on the display time of the triggered animated bullet screen data (set to 30s), the corresponding interactive animation is displayed starting from 3:00 in the playback progress bar. Here, the video data can be paused, and after the interactive animation is finished, the video data can be resumed based on the paused position. That is, at this time, the multimedia playback interface is playing the video frame corresponding to 3:00 in the video data, and the video data is played starting from 3:00 in the playback progress bar. Figure 8b As shown; or, while displaying the interactive animation, the video data continues to play, meaning that when the interactive animation finishes playing, the current playback position is 3:30 in the playback progress bar, and the multimedia playback interface is playing the video frame corresponding to 3:30 in the video data, such as... Figure 8c As shown.

[0131] In some embodiments, the multimedia playback interface belongs to the interface of the playback application corresponding to the target; the bullet screen type indicated by the target bullet screen data may include a composite bullet screen type; therefore, the electronic device may specifically associate and display the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data in the multimedia playback interface by obtaining the target data frame displayed by the multimedia playback interface when the trigger data for the target bullet screen data is executed, the target data frame refers to any one of at least one data frame contained in the multimedia data, obtaining the associated object data of the target object, performing data synthesis on the associated object data and the target data frame to obtain the composite data, determining the composite data as multimedia interactive data, and displaying the composite data on the multimedia data played by the multimedia playback interface; for example, suppose that the corresponding composite data at this time represents group photo data, the corresponding segment plot is the group photo plot; the composite data obtained by associating the object data can enhance the commemorative significance and interest of the user's viewing.

[0132] The target object can be the user of the electronic device, and the playback application can be the application obtained by the user through their registered user account. The associated object data can be the avatar, name, etc., of the logged-in user account, or it can be data uploaded by the user, such as images, text, etc. There are no restrictions on the associated object data here. It is understood that in the specific embodiments of this application, user information such as user accounts and related data are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0133] In some embodiments, the target data frame may refer to a screenshot of the content currently displayed in the multimedia playback interface taken by the electronic device when a trigger operation is performed on the target bullet screen data, and this screenshot is used as the target data frame. The multimedia data includes multiple screenshots. When the multimedia data is video data, the target data frame is a screenshot of the video being played; when the multimedia data is comics, the target data frame is an image screenshot of the comic being played.

[0134] In some embodiments, the electronic device performs data synthesis processing on the associated object data and the target data frame, which may involve adding the associated object data to a specified display area on the target data frame (such as the center, lower right corner, etc. of the target data frame).

[0135] In some embodiments, the electronic device's associated display of multimedia data and composite data (multimedia interactive data) can specifically involve determining the playback screen of the multimedia data when a trigger operation is performed on the target bullet screen data. This playback screen can be understood as the target data frame, and displaying the composite data in the target area (such as the lower right corner) on the playback screen. Optionally, after displaying the composite data for a specified display time (such as 1 second), the composite data can be removed and saved, and playback of the multimedia data can continue. Optionally, while displaying the composite data, operation controls related to the composite data can also be generated, and after detecting a trigger operation on the composite data, the operation controls can be displayed on the playing multimedia data as a floating window layer to achieve associated display. The trigger control can be a click operation, a long press operation, or a swipe operation on the composite data. The operation controls can include delete controls, save controls, data frame editing controls (such as cropping, adding borders), etc.

[0136] For example, such as Figures 9a-9b As shown, Figures 9a-9b This application provides a schematic diagram of an interactive display scenario based on a synthesized bullet screen type, as illustrated in the embodiments of this application; wherein:

[0137] (1) The displayed bullet screen input interface includes controls for the composite bullet screen type corresponding to the composite bullet screen type. The displayed bullet screen input interface can be as follows:

[0138] (a) If the composite bullet screen type control is enabled, the bullet screen input interface can be displayed as follows: Figure 9a As shown in (1), the associated object data and display area are both set to default.

[0139] (b) Alternatively, the bullet screen input interface at this time can be as follows: Figure 9a As shown in (2), the associated object data can be set by the user, the display area is the default setting, and the user can select one or more associated object data. When the user selects an image, the user can upload the image to be combined. When the user selects text, the user can input the text to be combined, i.e. Figure 9a As shown in (3);

[0140] (c) Alternatively, the bullet screen input interface at this time can be as follows: Figure 9a As shown in (4), both the associated object data and the display area can be set by the user;

[0141] (d) Alternatively, the bullet screen input interface at this time can be as follows: Figure 9a As shown in (5), the associated object data is set by default, and the display area can be set by the user;

[0142] (2) Figure 9b Suppose the multimedia data played in the multimedia playback interface is video data. This video data has a playback progress bar, and when the composite bullet screen data is triggered, the playback position in the video data's playback progress bar is 4:00. That is, at this time, the multimedia playback interface is playing the video frame corresponding to 4:00 in the video data. The current video frame is captured as the target data frame, and the associated object data (set as the user's avatar) is obtained. The associated object data and the target data frame are combined to obtain composite data (that is, the user's avatar is added to the upper right corner of the captured target data frame), and the composite data is displayed on the current screen of the video data in the multimedia playback interface. By long-pressing the composite data, a corresponding floating window layer can be displayed, and the operation controls of the composite data are displayed on the floating window layer.

[0143] It is understood that the various types of bullet comments described above are merely enumerations and not all are listed here. Depending on actual business needs, other types of bullet comments and other methods of associating and displaying multimedia data and multimedia interactive data may also exist. Furthermore, the multimedia interactive data can be determined by the electronic device, or the electronic device can send the triggered target bullet comment data to the backend server, where the backend server determines the multimedia interactive data.

[0144] For example, see Figures 10a-10c , Figures 10a-10c This application provides a schematic diagram of an interactive process for processing bullet screen data; wherein:

[0145] (1) As Figure 10a and Figure 10b As shown (here it is set) Figure 10a and Figure 10b The content in the arc-shaped solid-line diagram is executed by the backend server, while the content in the square solid-line diagram is executed by the electronic device (frontend). The backend server obtains multimedia data and a segment plot library, marks the multimedia data with plots, obtains the transition multimedia segments in the multimedia data that meet the plot rules, and sets the corresponding segment plots for each transition multimedia segment.

[0146] (2) The electronic device acquires multimedia data and the corresponding segment plot set in the multimedia data, plays the multimedia data on the multimedia playback interface, and according to the triggered barrage input operation, if the segment to which the playback progress point belongs when triggered is a transition multimedia segment with segment plot marking, that is, a marked segment plot, the electronic device displays the first barrage input interface, which displays the first barrage type control corresponding to the marked segment plot.

[0147] (3) If the segment to which the playback progress point belongs when the electronic device is triggered does not belong to a transitional multimedia segment with segment plot markings, i.e., there is no marked segment plot, the electronic device displays a second bullet screen input interface. The second bullet screen input interface does not display any bullet screen type control corresponding to any segment plot.

[0148] (4) Based on the above (3), the electronic device acquires the target data entered in the second bullet screen input interface and sends it to the backend server. The backend server acquires the text data from the target data and performs keyword recognition on the text data. If the text data contains plot keywords related to the target segment plot, the electronic device displays the second bullet screen type control corresponding to the target segment plot in the second bullet screen input interface.

[0149] (5) Based on the above (2) / (4), if the user chooses to send ordinary bullet comments (i.e., no first bullet comment type control / second bullet comment type control is enabled), the electronic device generates and displays ordinary bullet comment data based on the data entered in the first bullet comment input interface / second bullet comment input interface. The bullet comment content displayed by the ordinary bullet comment data includes the entered data.

[0150] (6) Based on the above (2) / (4), if the user chooses to send a special bullet screen (i.e., open any first bullet screen type control / second bullet screen type control), the electronic device generates and displays special bullet screen data based on the data entered in the first bullet screen input interface / second bullet screen input interface and the first bullet screen type control / second bullet screen type control that is in the open state. The bullet screen content displayed by the special bullet screen data includes the entered data and the corresponding added special identifier;

[0151] (7) When the barrage type control in the open state is the control corresponding to the composite barrage type, after the user configures the composite barrage data (such as selecting the specific type of associated object data) and clicks the barrage send control, the composite barrage data generated by the electronic device is scrolled on the multimedia data in the multimedia playback interface;

[0152] (8) When the barrage type control in the open state is the control corresponding to the animation barrage type (such as the completion barrage type corresponding to the completion animation), after the user configures the animation barrage data (such as selecting the type of interactive animation) and clicks the barrage send control, the animation barrage data generated by the electronic device is scrolled on the multimedia data in the multimedia playback interface;

[0153] (9) When the barrage type control in the open state is the control corresponding to the protective barrage type, after the user configures the protective barrage data (such as selecting the interaction time and display time) and clicks the barrage send control, the protective barrage data generated by the electronic device is scrolled and displayed on the multimedia data in the multimedia playback interface.

[0154] (10) When the barrage type control in the open state is the control corresponding to the high-energy barrage type, after the user configures the high-energy barrage data (such as selecting the interaction time and display time) and clicks the barrage send control, the high-energy barrage data generated by the electronic device is scrolled on the multimedia data in the multimedia playback interface.

[0155] (11) The electronic device sends the triggered target barrage data to the backend server, the backend server determines the multimedia interactive data, and the electronic device interactively displays the multimedia data and multimedia interactive data.

[0156] (12) Based on the above (11), when the bullet screen type of the target bullet screen data is the composite bullet screen type, the multimedia interactive data is the composite data after data synthesis processing of the associated object data and the intercepted target data frame. The electronic device can display and save the composite data on the multimedia data played on the multimedia playback interface.

[0157] (13) Based on the above (11), when the bullet screen type of the target bullet screen data is the animation bullet screen type (such as the ending bullet screen type), the multimedia interactive data is the corresponding interactive animation (ending animation), and the electronic device displays the ending animation on the multimedia data played on the multimedia playback interface.

[0158] (14) Based on the above (11), when the bullet screen type of the target bullet screen data is the high-energy bullet screen type, the multimedia interactive data can be the first multimedia segment with the playback volume increased setting and the bullet screen data transparency increased setting (e.g., the multimedia data is video data, and the first multimedia segment is the first video segment). The electronic device displays the first multimedia segment and multimedia data after the playback settings are adjusted on the multimedia playback interface.

[0159] (15) Based on the above (11), when the bullet screen type of the target bullet screen data is the protective bullet screen type, the multimedia interactive data can be the second multimedia segment with reduced playback volume and reduced clarity (e.g., the multimedia data is video data and the second multimedia segment is the second video segment). The electronic device displays the second multimedia segment and multimedia data after adjusting the playback settings on the multimedia playback interface.

[0160] Among them, the above steps (1)-(6) correspond to Figure 10a Steps (7)-(15) correspond to Figure 10b ;

[0161] Furthermore, based on the above (1), if the multimedia data is video data, the specific method for plot labeling of the multimedia data can be: pre-creating a training set, training plot labeling based on the training set to achieve content analysis of the video data and labeling of segment plots, such as segmenting the video data to obtain at least one multimedia segment, and performing plot recognition on at least one multimedia segment to complete the segment plot labeling of the video data; wherein the segment plot labeling process can be as follows Figure 10c As shown, that is:

[0162] ① Perform image recognition on at least one multimedia segment. If a candidate multimedia segment containing images related to the protection plot appears in at least one multimedia segment, such as horror or suspense, then the candidate multimedia segment is identified as a transitional multimedia segment, and a corresponding segment plot (i.e., protection plot) is set for the transitional multimedia segment.

[0163] ② If at least one multimedia segment contains a candidate multimedia segment with a scene associated with a high-energy plot, such as a fight scene or a scene related to the main character, then the candidate multimedia segment is identified as a transitional multimedia segment, and a corresponding segment plot (i.e., a high-energy plot) is set for the transitional multimedia segment; the scene related to the main character may include any of the following: obtaining the lead actor information in the video data based on the video information source of the video data (such as video information associated with the video data), and / or performing facial recognition on the characters appearing in the video data to obtain the character with the most appearances, and determining the main character based on the lead actor information and the character with the most appearances, and performing facial recognition on at least one multimedia segment to determine the scene where the main character appears as the scene related to the main character, or performing scene recognition on at least one multimedia segment to determine the scene where some special actions (such as running) of the main character appear as the scene related to the main character;

[0164] ③ If at least one multimedia segment contains a candidate multimedia segment with a scene related to the group photo plot, such as a landscape scene or a scene of the main characters together, then the candidate multimedia segment is identified as a transitional multimedia segment, and a corresponding segment plot (i.e., the group photo plot) is set for the transitional multimedia segment; the scene of the main characters together can be: after determining that there are multiple main characters, face recognition is performed on at least one multimedia segment, and if a scene of all of the multiple main characters appearing appears, then it is identified as a scene of the main characters together;

[0165] ④ If at least one multimedia segment contains a candidate multimedia segment with a scene associated with the ending plot, such as obtaining the video playback duration of the video data based on the video information source of the video data, and determining the multimedia segment as the end segment of the video based on the video playback duration, then the candidate multimedia segment is determined as a transition multimedia segment, and a corresponding segment plot (i.e., the ending plot) is set for the transition multimedia segment; or if at least one multimedia segment contains a candidate multimedia segment with a scene associated with a preset plot (such as a wedding plot), such as performing scene recognition on at least one multimedia segment and finding a wedding scene, then the candidate multimedia segment is determined as a transition multimedia segment, and a corresponding segment plot (i.e., the wedding plot) is set for the transition multimedia segment.

[0166] In this embodiment, the electronic device can display a multimedia playback interface. Based on a bullet screen input operation triggered on the multimedia playback interface, a bullet screen input interface is displayed. Based on the bullet screen type control on the bullet screen input interface and the input data, bullet screen data of the type indicated by the bullet screen type control is displayed on the multimedia playback interface. Based on a trigger operation targeting target bullet screen data in at least one bullet screen data set, the multimedia interactive data indicated by the bullet screen type of the target bullet screen data is displayed in association on the multimedia playback interface. Through this method, interactive bullet screen data can be obtained and displayed using the selected bullet screen type and input data in the bullet screen input interface. Furthermore, multimedia interactive data presenting different bullet screen interactive effects can be obtained based on different bullet screen types. The multimedia data and multimedia interactive data are displayed in association to improve the richness and interactivity of the bullet screen, and to provide users with a better viewing experience.

[0167] The methods of the embodiments of this application have been described in detail above. In order to facilitate better implementation of the above solutions of the embodiments of this application, the apparatus of the embodiments of this application is provided below.

[0168] Please see Figure 11 , Figure 11 This application provides a schematic diagram of a bullet screen data processing device; this device can be a computer program (including program code) running on an electronic device, for example, it can be an application program (such as a program capable of processing bullet screen data) on an electronic device. It should be noted that... Figure 11 The illustrated bullet screen data processing device is used to execute the present application. Figure 2 and Figure 4 Some or all of the steps in the method of the illustrated embodiment. The bullet screen data processing device 1100 may include: a display module 1101 and a processing module 1102. Wherein:

[0169] Display module 1101 is used to display a multimedia playback interface; the multimedia playback interface plays multimedia data, and at least one bullet screen data is displayed on the multimedia data played by the multimedia playback interface.

[0170] The processing module 1102 is used to display the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data in the multimedia playback interface according to the trigger operation for the target bullet screen data in at least one bullet screen data.

[0171] In some embodiments, the display module 1101 is further configured to:

[0172] Obtain a fragment plot library; the fragment plot library contains at least one fragment plot.

[0173] Set up corresponding bullet screen type controls for each type of segment in the segment library;

[0174] The display module 1101 is also used for:

[0175] Multimedia data is segmented to obtain at least one multimedia segment contained in the multimedia data.

[0176] At least one transition multimedia segment is determined from at least one multimedia segment, and corresponding segment plots are set for each transition multimedia segment according to the segment plot library.

[0177] In some embodiments, the display module 1101 is further configured to:

[0178] Based on the barrage input operation triggered on the multimedia playback interface, the first barrage input interface is displayed; the first barrage input interface includes a first barrage type control, which is a barrage type control indicated by the segment plot corresponding to the target multimedia segment in the multimedia data. The target multimedia segment is any one of at least one multimedia segment, which is the segment played in the multimedia playback interface when the barrage input operation is triggered.

[0179] If the control state of the first bullet screen type control in the first bullet screen input interface is in the open state, then the bullet screen data of the bullet screen type indicated by the first bullet screen type control will be displayed in the multimedia playback interface according to the data entered in the bullet screen input interface.

[0180] In some embodiments, the display module 1101 is further configured to:

[0181] The second bullet screen input interface is displayed based on the bullet screen input operation triggered on the multimedia playback interface.

[0182] Retrieve the target data entered in the second bullet screen input interface; this target data includes text data.

[0183] If the text data contains plot keywords associated with the target plot segment in at least one plot segment, then the second bullet screen type control corresponding to the target plot segment is displayed on the second bullet screen input interface;

[0184] Based on the second bullet comment type control and the target data, the bullet comment data of the type indicated by the second bullet comment type control is displayed on the multimedia playback interface.

[0185] In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes the high-energy bullet screen type; the multimedia playback interface includes a playback progress bar for the video data.

[0186] When processing module 1102 is used to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in the multimedia playback interface, it is specifically used for:

[0187] The first video segment is obtained from the video data based on the first playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is executed; the playback start position of the first video segment refers to the playback position indicated by the first playback duration;

[0188] Adjust the video playback settings of the first video clip to the high-energy playback settings corresponding to the high-energy bullet screen type;

[0189] The first video segment with high-energy playback settings is identified as multimedia interactive data;

[0190] The video data and the first video segment with high-energy playback settings are displayed together.

[0191] The high-energy playback settings include at least one of the following settings: increasing the playback volume of the first video segment and increasing the transparency of the bullet screen data displayed on the first video segment.

[0192] In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes the protective bullet screen type; the multimedia playback interface includes a playback progress bar for the video data.

[0193] When processing module 1102 is used to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in the multimedia playback interface, it is specifically used for:

[0194] The second video segment is obtained from the video data based on the second playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is performed; the playback start position of the second video segment refers to the playback position indicated by the second playback duration;

[0195] Adjust the video playback settings for the second video clip to the protective playback settings corresponding to the protective barrage type;

[0196] The second video segment with protective playback settings is identified as multimedia interactive data;

[0197] The video data and a second video segment with protective playback settings are displayed together;

[0198] The playback settings include at least one of the following: reducing the playback volume of the second video clip and reducing the resolution of the second video clip.

[0199] In some embodiments, the bullet screen type indicated by the target bullet screen data above includes animated bullet screen types;

[0200] When processing module 1102 is used to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in the multimedia playback interface, it is specifically used for:

[0201] Get the interactive animation corresponding to the animated bullet screen type, and use the interactive animation as multimedia interactive data;

[0202] Display interactive animations on the multimedia data being played in the multimedia playback interface.

[0203] In some embodiments, the multimedia playback interface described above belongs to the interface of the playback application of the target object; the bullet screen type includes the synthetic bullet screen type.

[0204] When processing module 1102 is used to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in the multimedia playback interface, it is specifically used for:

[0205] Retrieve the target data frame displayed on the multimedia playback interface when a trigger operation is performed on the target bullet screen data; the target data frame refers to any one of at least one data frame contained in the multimedia data;

[0206] Retrieve data of associated objects of the target object;

[0207] Data synthesis processing is performed on the associated object data and the target data frame to obtain synthesized data;

[0208] The synthesized data is identified as multimedia interactive data and displayed on the multimedia data played in the multimedia playback interface.

[0209] According to one embodiment of this application, Figure 11The various units in the illustrated bullet screen data processing device can be individually or entirely merged into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the bullet screen data processing device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by multiple units working together. According to another embodiment of this application, the device can be executed by running on a general-purpose computing device, such as a computer, which includes processing elements and storage elements such as a central processing unit (CPU), random access memory (RAM), and read-only memory (ROM). Figure 2 and Figure 4 The computer program (including program code) for each step involved in the corresponding method shown, to construct, as Figure 11 The diagram illustrates a bullet screen data processing apparatus and a bullet screen data processing method for implementing embodiments of this application. A computer program may be recorded on, for example, a computer-readable recording medium, loaded onto the aforementioned electronic device via the same medium, and executed therein.

[0210] In this embodiment, the display module displays a multimedia playback interface; the multimedia playback interface plays multimedia data, and at least one bullet screen (danmu) is displayed on the multimedia data played on the multimedia playback interface; the processing module, based on a trigger operation on a target bullet screen among the at least one bullet screen, associates and displays the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data on the multimedia playback interface. By implementing the above device, multimedia interactive data presenting different bullet screen interactive effects can be obtained according to different bullet screen types, and the multimedia data and multimedia interactive data can be associated and displayed to improve the richness and interactivity of the bullet screens, and to bring users a better sense of fun and viewing experience.

[0211] Please see Figure 12 , Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 12As shown, the electronic device 1200 includes a processor 1201, a communication interface 1202, and a computer-readable storage medium 1203. The processor 1201, communication interface 1202, and computer-readable storage medium 1203 can be connected via a bus or other means. The communication interface 1202 is used to receive and send data. The computer-readable storage medium 1203 can be stored in the memory of the electronic device and is used to store computer programs, including program instructions. The processor 1201 is used to execute the program instructions stored in the computer-readable storage medium 1203. The processor 1201 (or CPU (Central Processing Unit)) is the computing and control core of the electronic device, suitable for implementing one or more instructions, specifically suitable for loading and executing one or more instructions to achieve corresponding method flows or corresponding functions.

[0212] This application embodiment also provides a computer-readable storage medium (Memory), which is a memory device in an electronic device used to store programs and data. It is understood that the computer-readable storage medium here can include both built-in storage media in the electronic device and extended storage media supported by the electronic device. The computer-readable storage medium provides storage space that stores the processing system of the electronic device. Furthermore, the storage space also stores one or more instructions suitable for loading and execution by the processor 1201, which may be one or more computer programs (including program code). It should be noted that the computer-readable storage medium here may be high-speed RAM memory or non-volatile memory, such as at least one disk storage device; optionally, it may also be at least one computer-readable storage medium located remotely from the aforementioned processor.

[0213] In one embodiment, the computer-readable storage medium stores one or more instructions; the processor 1201 loads and executes one or more instructions stored in the computer-readable storage medium to implement the corresponding steps in the above-described document processing method embodiment; specifically, the one or more instructions in the computer-readable storage medium are loaded and executed by the processor 1201 to perform the following steps: displaying a multimedia playback interface; the multimedia playback interface plays multimedia data, and at least one bullet screen data is displayed on the multimedia data played by the multimedia playback interface;

[0214] Based on the trigger operation for the target bullet screen data in at least one bullet screen data, the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data are displayed together on the multimedia playback interface.

[0215] In some embodiments, one or more instructions in a computer-readable storage medium, when loaded and executed by processor 1201, are also used to perform the following steps:

[0216] Obtain a fragment plot library; the fragment plot library contains at least one fragment plot.

[0217] Set up corresponding bullet screen type controls for each type of segment in the segment library;

[0218] One or more instructions in a computer-readable storage medium are loaded by processor 1201 and, when executed, are also used to perform the following steps:

[0219] Multimedia data is segmented to obtain at least one multimedia segment contained in the multimedia data.

[0220] At least one transition multimedia segment is determined from at least one multimedia segment, and corresponding segment plots are set for each transition multimedia segment according to the segment plot library.

[0221] In some embodiments, one or more instructions in a computer-readable storage medium, when loaded and executed by processor 1201, are also used to perform the following steps:

[0222] Based on the barrage input operation triggered on the multimedia playback interface, the first barrage input interface is displayed; the first barrage input interface includes a first barrage type control, which is a barrage type control indicated by the segment plot corresponding to the target multimedia segment in the multimedia data. The target multimedia segment is any one of at least one multimedia segment, which is the segment played in the multimedia playback interface when the barrage input operation is triggered.

[0223] If the control state of the first bullet screen type control in the first bullet screen input interface is in the open state, then the bullet screen data of the bullet screen type indicated by the first bullet screen type control will be displayed in the multimedia playback interface according to the data entered in the bullet screen input interface.

[0224] In some embodiments, one or more instructions in a computer-readable storage medium, when loaded and executed by processor 1201, are also used to perform the following steps:

[0225] The second bullet screen input interface is displayed based on the bullet screen input operation triggered on the multimedia playback interface.

[0226] Retrieve the target data entered in the second bullet screen input interface; this target data includes text data.

[0227] If the text data contains plot keywords associated with the target plot segment in at least one plot segment, then the second bullet screen type control corresponding to the target plot segment is displayed on the second bullet screen input interface;

[0228] Based on the second bullet comment type control and the target data, the bullet comment data of the type indicated by the second bullet comment type control is displayed on the multimedia playback interface.

[0229] In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes the high-energy bullet screen type; the multimedia playback interface includes a playback progress bar for the video data.

[0230] When one or more instructions in a computer-readable storage medium are loaded by processor 1201 and executed to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in a multimedia playback interface, the following steps are specifically performed:

[0231] The first video segment is obtained from the video data based on the first playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is executed; the playback start position of the first video segment refers to the playback position indicated by the first playback duration;

[0232] Adjust the video playback settings of the first video clip to the high-energy playback settings corresponding to the high-energy bullet screen type;

[0233] The first video segment with high-energy playback settings is identified as multimedia interactive data;

[0234] The video data and the first video segment with high-energy playback settings are displayed together.

[0235] The high-energy playback settings include at least one of the following settings: increasing the playback volume of the first video segment and increasing the transparency of the bullet screen data displayed on the first video segment.

[0236] In some embodiments, the multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes the protective bullet screen type; the multimedia playback interface includes a playback progress bar for the video data.

[0237] When one or more instructions in a computer-readable storage medium are loaded by processor 1201 and executed to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in a multimedia playback interface, the following steps are specifically performed:

[0238] The second video segment is obtained from the video data based on the second playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is performed; the playback start position of the second video segment refers to the playback position indicated by the second playback duration;

[0239] Adjust the video playback settings for the second video clip to the protective playback settings corresponding to the protective barrage type;

[0240] The second video segment with protective playback settings is identified as multimedia interactive data;

[0241] The video data and a second video segment with protective playback settings are displayed together;

[0242] The playback settings include at least one of the following: reducing the playback volume of the second video clip and reducing the resolution of the second video clip.

[0243] In some embodiments, the bullet screen type indicated by the target bullet screen data above includes animated bullet screen types;

[0244] When one or more instructions in a computer-readable storage medium are loaded by processor 1201 and executed to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in a multimedia playback interface, the following steps are specifically performed:

[0245] Get the interactive animation corresponding to the animated bullet screen type, and use the interactive animation as multimedia interactive data;

[0246] Display interactive animations on the multimedia data being played in the multimedia playback interface.

[0247] In some embodiments, the multimedia playback interface described above belongs to the interface of the playback application of the target object; the bullet screen type includes the synthetic bullet screen type.

[0248] When one or more instructions in a computer-readable storage medium are loaded by processor 1201 and executed to associate and display multimedia interactive data indicated by the bullet screen type of multimedia data and target bullet screen data in a multimedia playback interface, the following steps are specifically performed:

[0249] Retrieve the target data frame displayed on the multimedia playback interface when a trigger operation is performed on the target bullet screen data; the target data frame refers to any one of at least one data frame contained in the multimedia data;

[0250] Retrieve data of associated objects of the target object;

[0251] Data synthesis processing is performed on the associated object data and the target data frame to obtain synthesized data;

[0252] The synthesized data is identified as multimedia interactive data and displayed on the multimedia data played in the multimedia playback interface.

[0253] In this embodiment, the processor 1201 can display a multimedia playback interface; the multimedia playback interface plays multimedia data, and at least one bullet screen (danmu) data is displayed on the multimedia data played by the multimedia playback interface; based on the trigger operation of a target bullet screen data in the at least one bullet screen data, the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data are displayed together on the multimedia playback interface. By implementing the above scheme, multimedia interactive data presenting different bullet screen interactive effects can be obtained according to different bullet screen types, and the multimedia data and multimedia interactive data can be displayed together to improve the richness and interactivity of the bullet screens, and bring users a better sense of fun and viewing experience.

[0254] This application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the aforementioned bullet screen data processing method.

[0255] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0256] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in or transmitted through a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0257] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this invention should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for processing bullet screen data, characterized in that, The method includes: A multimedia playback interface is displayed; the multimedia playback interface plays multimedia data, and at least one bullet screen data is displayed on the multimedia data played by the multimedia playback interface; the multimedia data includes at least one segment plot set for each transition multimedia segment according to the segment plot library, and the transition multimedia segment is a multimedia segment that meets the preset plot rules among the at least one multimedia segment contained in the multimedia data; the at least one bullet screen data includes special bullet screen data, which is generated based on the bullet screen type control set for at least one segment plot on the bullet screen input interface and the input data, and one segment plot corresponds to one bullet screen type and bullet screen type control; Based on the triggering operation for the target bullet screen data in the at least one bullet screen data, the multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data are displayed together on the multimedia playback interface, and the target bullet screen data belongs to the special bullet screen data.

2. The method according to claim 1, characterized in that, The method further includes: Obtain a fragment plot library; the fragment plot library contains at least one fragment plot; Set a corresponding bullet screen type control for each type of segment in the segment library; The method further includes: The multimedia data is segmented to obtain at least one multimedia segment contained in the multimedia data; At least one transition multimedia segment is determined from the at least one multimedia segment, and corresponding segment plots are set for each transition multimedia segment according to the segment plot library.

3. The method according to claim 2, characterized in that, The method further includes: Based on the barrage input operation triggered on the multimedia playback interface, a first barrage input interface is displayed; the first barrage input interface includes a first barrage type control, which refers to the barrage type control indicated by the segment plot corresponding to the target multimedia segment in the multimedia data, the target multimedia segment is any one of the at least one multimedia segment, and the target multimedia segment refers to the segment played on the multimedia playback interface when the barrage input operation is triggered; If the control state of the first bullet screen type control in the first bullet screen input interface is in the open state, then the bullet screen data of the bullet screen type indicated by the first bullet screen type control is displayed in the multimedia playback interface according to the data entered in the bullet screen input interface.

4. The method according to claim 2, characterized in that, The method further includes: Based on the bullet screen input operation triggered on the multimedia playback interface, a second bullet screen input interface is displayed; Acquire the target data entered in the second bullet screen input interface; the target data includes text data; If the text data contains plot keywords associated with the target plot in at least one plot segment, then the second bullet screen type control corresponding to the target plot segment is displayed on the second bullet screen input interface; Based on the second bullet screen type control and the target data, the bullet screen data of the type indicated by the second bullet screen type control is displayed on the multimedia playback interface.

5. The method according to claim 1, characterized in that, The multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes the high-energy bullet screen type; the multimedia playback interface includes a playback progress bar for the video data; The step of associating and displaying multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data on the multimedia playback interface includes: A first video segment is obtained from the video data based on the first playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is performed; the playback start position of the first video segment refers to the playback position indicated by the first playback duration; Adjust the video playback settings of the first video segment to the high-energy playback settings corresponding to the high-energy bullet screen type; The first video segment with the high-energy playback settings is identified as the multimedia interactive data; The video data and the first video segment with the high-energy playback setting are displayed together; The high-energy playback settings include at least one of the following settings: increasing the playback volume of the first video segment and increasing the transparency of the bullet screen data displayed on the first video segment.

6. The method according to claim 1, characterized in that, The multimedia data is video data, and the bullet screen type indicated by the target bullet screen data includes the protective bullet screen type; the multimedia playback interface includes a playback progress bar for the video data; The step of associating and displaying multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data on the multimedia playback interface includes: A second video segment is obtained from the video data based on the second playback duration of the video data in the playback progress bar when the trigger operation for the target bullet screen data is performed; the playback start position of the second video segment refers to the playback position indicated by the second playback duration; Adjust the video playback settings of the second video segment to the protective playback settings corresponding to the protective barrage type; The second video segment with the aforementioned protective playback settings is identified as the multimedia interactive data; The video data and the second video segment with the aforementioned protective playback settings are displayed together. The protective playback settings include at least one of the following settings: reducing the playback volume of the second video segment and reducing the clarity of the second video segment.

7. The method according to claim 1, characterized in that, The bullet screen type indicated by the target bullet screen data includes animated bullet screen types; The step of associating and displaying multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data on the multimedia playback interface includes: Obtain the interactive animation corresponding to the animated bullet screen type, and use the interactive animation as the multimedia interactive data; The interactive animation is displayed on the multimedia data being played on the multimedia playback interface.

8. The method according to claim 1, characterized in that, The multimedia playback interface belongs to the interface of the target object's playback application; the bullet screen type includes the composite bullet screen type; The step of associating and displaying multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data on the multimedia playback interface includes: The target data frame displayed by the multimedia playback interface is obtained when the trigger operation for the target bullet screen data is executed; the target data frame refers to any one of at least one data frame contained in the multimedia data; Obtain the associated object data of the target object; The associated object data and the target data frame are subjected to data synthesis processing to obtain synthesized data; The synthesized data is identified as the multimedia interactive data, and the synthesized data is displayed on the multimedia data played on the multimedia playback interface.

9. A bullet screen data processing device, characterized in that, The device includes: The display module is used to display a multimedia playback interface; the multimedia playback interface plays multimedia data, and at least one bullet screen data is displayed on the multimedia data played by the multimedia playback interface; the multimedia data includes at least one segment plot set for each transition multimedia segment according to the segment plot library, and the transition multimedia segment is a multimedia segment that meets the preset plot rules among the at least one multimedia segment contained in the multimedia data; the at least one bullet screen data includes special bullet screen data, which is generated based on the bullet screen type control set for at least one segment plot on the bullet screen input interface and the input data, and one segment plot corresponds to one bullet screen type and bullet screen type control; The processing module is used to display, in the multimedia playback interface, multimedia interactive data indicated by the bullet screen type of the multimedia data and the target bullet screen data, in association with the trigger operation of the target bullet screen data in the at least one bullet screen data, wherein the target bullet screen data belongs to the special bullet screen data.

10. An electronic device, characterized in that, The system includes a processor and a memory, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to perform the method as described in any one of claims 1-8.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-8.

12. A computer program product, characterized in that, The computer program product includes computer instructions that, when executed by a processor, implement the method as described in any one of claims 1-8.

Images