A bullet screen display method and related device

Abstract

The present application discloses a barrage display method and related devices, which can be applied to various scenarios such as cloud technology, artificial intelligence, smart transportation, assisted driving, leisure and entertainment. When a multimedia playback object wants to play a multimedia resource, the multimedia resource is played through the playback interface. Other multimedia playback objects may publish barrages for multimedia resources, so in the process of playing multimedia resources, at least one barrage of multimedia resources is displayed in the playback interface. In the process of displaying at least one barrage on the playback interface, if it is determined that a barrage special effect is triggered, the target barrage in at least one barrage is filled into the target graphic area within the duration of the special effect. By adding barrage special effects, the display effect of the barrage is enriched, the display of the barrage becomes more interesting, the interactivity and fun of the barrage are enhanced, and the interactive experience of the multimedia playback object is improved.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a bullet screen display method and related devices. Background Art

[0002] With the development of computer technology, playing multimedia resources has become a common form of entertainment in people's daily lives.

[0003] During the playback of multimedia resources, the multimedia playback object can enable the barrage function to post barrages to express its feelings about the multimedia resources being played. At the same time, it can also view the barrages posted by other multimedia playback objects during the playback of multimedia resources, achieving a real-time interactive effect.

[0004] However, in the barrage display method provided by the related art, the display effect of the barrage is too simple, and the interactivity and fun are poor, which greatly affects the interactive experience of the multimedia playback object. Summary of the Invention

[0005] In order to solve the above technical problems, the present application provides a barrage display method and related devices, which enrich the display effect of the barrage, make the display of the barrage more interesting, enhance the interactivity and fun of the barrage, and thereby improve the interactive experience of the multimedia playback object.

[0006] The embodiments of this application disclose the following technical solutions:

[0007] In one aspect, an embodiment of the present application provides a bullet screen display method, the method comprising:

[0008] Play multimedia resources through the playback interface;

[0009] During the playback of the multimedia resource, displaying at least one bullet screen of the multimedia resource in the playback interface;

[0010] During the process of displaying the at least one bullet screen on the playback interface, if it is determined that a bullet screen special effect is triggered, a target bullet screen in the at least one bullet screen is filled into a target graphic area within a duration interval of the special effect.

[0011] On the one hand, an embodiment of the present application provides a bullet screen display device, the device comprising a playback unit, a display unit, and a filling unit:

[0012] The playback unit is used to play multimedia resources through the playback interface;

[0013] The display unit is configured to display at least one bullet screen of the multimedia resource in the playback interface during playback of the multimedia resource;

[0014] The filling unit is used to fill the target graphic area with the target bullet screen in the at least one bullet screen within the duration of the special effect if it is determined that the bullet screen special effect is triggered during the process of displaying the at least one bullet screen on the playback interface.

[0015] In one aspect, an embodiment of the present application provides a computer device, comprising a processor and a memory.

[0016] The memory is used to store a computer program and transmit the computer program to the processor;

[0017] The processor is configured to execute the method described in any one of the preceding aspects according to instructions in the computer program.

[0018] In one aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program. When the computer program is executed by a processor, the processor executes the method described in any one of the aforementioned aspects.

[0019] In one aspect, an embodiment of the present application provides a computer program product, including a computer program, which implements the method described in any of the aforementioned aspects when executed by a processor.

[0020] It can be seen from the above technical solution that when a multimedia playback object wants to play a certain multimedia resource, the multimedia resource can be played through the playback interface. Other multimedia playback objects that have watched or listened to the multimedia resource may publish barrages for the multimedia resource, so in the process of playing the multimedia resource, at least one barrage of the multimedia resource can be displayed in the playback interface. In the process of displaying at least one barrage on the playback interface, the present application also provides barrage special effects. If it is determined that the barrage special effect is triggered, the target barrage in at least one barrage can be filled into the target graphic area within the duration of the special effect. Compared with the related art, the present application enriches the display effect of the barrage by adding barrage special effects, making the display of the barrage more interesting, improving the interactivity and fun of the barrage, and thus improving the interactive experience of the multimedia playback object. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technical members in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 An application scenario architecture diagram of a bullet screen display method provided in an embodiment of the present application;

[0023] Figure 2 A flowchart of a bullet screen display method provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of a playback interface provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of displaying at least one bullet comment in a playback interface provided in an embodiment of the present application;

[0026] Figure 5 A schematic diagram of a bullet screen special effect provided in an embodiment of the present application;

[0027] Figure 6a A simple schematic diagram of filling a target graphic area with a target bullet screen is provided in an embodiment of the present application;

[0028] Figure 6b A schematic diagram of an embodiment of the present application for implementing a bullet screen special effect during the playback of multimedia resources;

[0029] Figure 7 A schematic diagram of filling a target graphic area with a target bullet screen provided in an embodiment of the present application;

[0030] Figure 8 A schematic diagram of a bullet screen special effect activation control provided in an embodiment of the present application;

[0031] Figure 9 A schematic diagram of a gesture for activating a bullet screen special effect provided in an embodiment of the present application;

[0032] Figure 10 A schematic diagram of a configuration interface provided in an embodiment of the present application;

[0033] Figure 11 A schematic diagram of a target graphic area changing with a person's position provided in an embodiment of the present application;

[0034] Figure 12 A simple schematic diagram of an adsorption method provided in an embodiment of the present application;

[0035] Figure 13 A schematic diagram of a specific process of an adsorption method provided in an embodiment of the present application;

[0036] Figure 14 A schematic diagram of a method for achieving filling by dropping during playback of multimedia resources provided by an embodiment of the present application;

[0037] Figure 15 An overall flow chart of a bullet screen display method provided in an embodiment of the present application;

[0038] Figure 16 A structural diagram of a bullet screen display device provided in an embodiment of the present application;

[0039] Figure 17 A structural diagram of a terminal provided in an embodiment of the present application;

[0040] Figure 18 A structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] The embodiments of the present application are described below with reference to the accompanying drawings.

[0042] During the playback of multimedia resources, the multimedia playback object can enable the barrage function to post barrages to express its feelings about the multimedia resources being played. At the same time, it can also view the barrages posted by other multimedia playback objects during the playback of multimedia resources, achieving a real-time interactive effect.

[0043] In current bullet screen display methods, after a multimedia player posts a bullet screen, it can move across the playback interface along a preset trajectory. For example, the preset trajectory can include appearing on the left side of the playback interface and disappearing on the right, appearing on the right side of the playback interface and disappearing on the left, appearing on both sides of the playback interface and disappearing in the middle, and so on. However, in this bullet screen display method, the bullet screen simply floats across the playback interface, resulting in a monotonous display effect, poor interactivity, and low interest, which significantly affects the interactive experience of the multimedia player.

[0044] In order to solve the above technical problems, an embodiment of the present application provides a barrage display method, which is a method for displaying barrage with a word cloud effect, that is, in the process of displaying at least one barrage on the playback interface, a barrage special effect with a word cloud effect is provided. When a barrage is displayed normally, it is affected by external forces, causing at least one of its own rotation, color and movement trajectory to change, and eventually stays within a predetermined range (such as a target graphic area), which can be called a word cloud effect. In an embodiment of the present application, if it is determined that the barrage special effect is triggered, the target barrage in at least one barrage can be filled into the target graphic area within the special effect duration interval. The effect formed by filling the target barrage into the target graphic area is a barrage special effect with a word cloud effect. Among them, the embodiment of the present application does not limit the form of the external force, for example, it can be a force generated in the form of adsorption force, gravity, moving operation, click operation, etc.

[0045] A word cloud, also known as a text cloud or tag cloud, is a data visualization method used to represent frequently occurring vocabulary within text data. In a word cloud, the size of each word typically represents its frequency of occurrence within the text. More frequently occurring words appear in larger font sizes and may have different colors, allowing users to identify the main content or keywords within the text at a glance. Word clouds are widely used in fields such as web search, data mining, information retrieval, and text analysis. For example, word clouds can be generated by analyzing social media posts to understand public interest in a particular topic, or by analyzing internal corporate documents to understand a company's business priorities.

[0046] The generation of a word cloud usually requires text preprocessing (such as word segmentation, removal of stop words, etc.), word frequency statistics, word cloud layout and other steps. The barrage special effects of the word cloud-like effect in the embodiment of the present application are mainly similar to the effect of the word cloud in terms of visualization effect, but the steps of generating the barrage special effects are different from the steps of generating the word cloud.

[0047] It should be noted that the barrage display method provided in the embodiments of the present application can be applied to various scenarios such as cloud technology, artificial intelligence, smart transportation, assisted driving, leisure and entertainment. In these scenarios, multimedia resources may be played, and then barrages are displayed on the playback interface of the multimedia resources. In addition, barrage special effects can be triggered during the display of the barrage. By adding barrage special effects, the display effect of the barrage is enriched.

[0048] like Figure 1 As shown, Figure 1 The following diagram illustrates an application scenario architecture for a bullet screen display method. The application scenario architecture diagram includes a terminal 100 and a server 200. The terminal 100 can be installed with a multimedia playback platform or access the multimedia playback platform through a browser. Thus, multimedia playback objects can access the multimedia playback platform through the terminal 100 to watch or listen to multimedia resources. The terminal 100 includes, but is not limited to, smartphones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, and the like.

[0049] The server 200 can provide the terminal 100 with access to multimedia resources. The server 200 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal 100 and the server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited in this application. For example, the terminal 100 and the server 200 can be connected via a network, which can be a wired or wireless network.

[0050] A multimedia playback object may be an object that selects a multimedia resource for playback in order to watch or listen to the multimedia resource. For example, the multimedia playback object may be a user. A multimedia resource may be a multimedia resource that is triggered by a playback operation of a multimedia playback object and is waiting to be played. Multimedia resources may include various types, such as videos (e.g., short videos, movies, TV series, etc.) and audio (e.g., music, audio novels, radio dramas, etc.). The embodiments of this application are mainly described using the multimedia resource being a video as an example.

[0051] When a multimedia player object wishes to play a multimedia resource, the multimedia player object can perform a play operation on the multimedia resource, and then the terminal 100 can obtain the multimedia resource from the server 200 and play the multimedia resource through a play interface. The play interface can be the area on the screen of the terminal 100 where the multimedia resource is played, and the play interface can be a small window or a full-screen window.

[0052] Other multimedia players who have watched or listened to the multimedia resource may post barrages for the multimedia resource. Therefore, during the playback of the multimedia resource, the terminal 100 may display at least one barrage of the multimedia resource in the playback interface. Barrage refers to the commentary subtitles that pop up when watching or listening to multimedia resources. It has a positive effect on enhancing the interaction between multimedia players and improving the activity of the product. Among them, at least one barrage can refer to Figure 1 As shown in 101.

[0053] During the process of displaying at least one barrage on the playback interface, the present application also provides barrage special effects, which can be special effects for displaying barrage. If the barrage special effect is determined to be triggered, the terminal 100 can fill the target barrage in the at least one barrage into the target graphic area within the special effect duration interval. The special effect duration interval can refer to the time interval for displaying the barrage special effect, the target barrage can refer to the barrage that needs to be filled into the target graphic area, and the target graphic area can refer to a graphic used to reflect the visual effect of the barrage special effect, such as a flower shape, a cloud shape, etc.

[0054] exist Figure 1 In the example of the target graphic area being a flower shape, the resulting barrage special effects can be seen in Figure 1 As shown in Figure 102.

[0055] This application enriches the display effect of the barrage by adding barrage special effects, making the display of the barrage more interesting, improving the interactivity and fun of the barrage, and thus improving the interactive experience of the multimedia playback object.

[0056] It should be noted that in the embodiments of the present application, the computer device may be a server or a terminal, and the method provided in the embodiments of the present application may be executed by the terminal or the server alone, or may be executed by the terminal and the server in cooperation.

[0057] in, Figure 1 The corresponding embodiment mainly introduces the method provided by the embodiment of the present application by the terminal as an example. When the method provided by the embodiment of the present application is executed by the server alone, its execution method is the same as Figure 1 The corresponding embodiments are similar, except that the terminal is replaced by a server.

[0058] When the terminal and the server cooperate to execute the method provided in the embodiment of the present application, the steps that need to be reflected on the front-end interface can be executed by the terminal, such as playing the multimedia resources through the playback interface, displaying at least one barrage of the multimedia resources in the playback interface, and filling the target barrage in at least one barrage into the target graphic area; and some steps that require background calculations and do not need to be reflected on the front-end interface can be executed by the server, such as the method of determining the special effect duration interval, the specific steps of controlling the target barrage to fill into the target graphic area, etc.

[0059] It should be noted that in the specific implementation of this application, user information and other related data may be involved in the entire process. When the above embodiments of this application are applied to specific products or technologies, the user's separate consent or separate permission is required, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0060] Next, the bullet screen display method provided by the embodiment of the present application will be introduced with reference to the accompanying drawings, taking the computer device as an example. Figure 2 , Figure 2 A flow chart of a bullet screen display method is shown, the method comprising:

[0061] S201: Play multimedia resources through a playback interface.

[0062] When a multimedia player object wishes to play a multimedia resource, it can perform a play operation on the multimedia resource. The terminal can then retrieve the multimedia resource from the server and play the multimedia resource through a play interface. The play interface can be the area on the terminal screen where the multimedia resource is played. The play interface can be, for example, a small window or a full-screen window.

[0063] The embodiment of this application does not limit the type of multimedia resources, for example, it can be video (such as short video, movie, TV series, etc.), audio (such as music, audio novel, radio drama, etc.). The embodiment of this application mainly introduces the multimedia resource as video as an example. In this case, the playback interface can refer to Figure 3 shown.

[0064] S202. During playback of the multimedia resource, display at least one bullet screen of the multimedia resource in the playback interface.

[0065] Other multimedia players who have watched or listened to the multimedia resource may publish bullet comments for the multimedia resource. Therefore, during the playback of the multimedia resource, the terminal can display at least one bullet comment of the multimedia resource in the playback interface. Figure 4 As shown, there is at least one barrage such as "It's finally here", "I'm so scared that I can't move", "So handsome", etc.

[0066] When at least one barrage is displayed in the playback interface, the barrage can move in the playback interface according to a preset trajectory. For example, the preset trajectory can be appearing from the left side of the playback interface and disappearing on the right side, or appearing from the right side of the playback interface and disappearing on the left side, or appearing from the left and right sides of the playback interface and disappearing in the middle, and so on.

[0067] S203: During the process of displaying the at least one bullet screen on the playback interface, if it is determined that a bullet screen special effect is triggered, a target bullet screen in the at least one bullet screen is filled into a target graphic area within a duration of the special effect.

[0068] During the process of displaying at least one bullet screen on the playback interface, the embodiment of the present application also provides the function of displaying bullet screen special effects. The bullet screen special effects can be obtained in advance through configuration. The configured bullet screen special effects can be reflected through special effect configuration information. The server can send the special effect configuration information to the terminal. After the terminal receives the special effect configuration information, it can wait for the triggering of the bullet screen special effect during the process of displaying at least one bullet screen on the playback interface. If the terminal determines that the bullet screen special effect is triggered, the target bullet screen in the at least one bullet screen is filled into the target graphic area within the duration of the special effect.

[0069] Among them, the special effect duration interval may refer to the time interval for displaying the barrage special effect, the target barrage may refer to the barrage that needs to be filled into the target graphic area, the target graphic area may refer to the graphic used to reflect the visual effect of the barrage special effect, and the target graphic area may be of any shape, such as a flower shape, a cloud shape, etc., and the embodiments of the present application do not limit this.

[0070] It should be noted that in the embodiment of the present application, the number of target bullets can be one or more. When the number of target bullets is multiple, the target bullets that fill the target graphic area within the special effect duration interval can be part of the target bullets, or it can be all of the target bullets. The embodiment of the present application can display the process of filling the target graphic area with target bullets.

[0071] In this embodiment of the present application, if the duration corresponding to the special effect duration interval is less than or equal to the time required to fill the target graphic area with all target barrages, for example, the duration corresponding to the special effect duration interval is 3 seconds, and the time required to fill the target graphic area with all target barrages is 5 seconds. Then, during the special effect duration interval, the target graphic area will continue to be filled with the target barrage. In this case, what is displayed during the special effect duration interval is the barrage special effect that is gradually formed during the process of filling the target graphic area with the target barrage.

[0072] If the special effect duration interval is longer than the time required to fill the target graphic area with all target barrages, for example, the duration corresponding to the special effect duration interval is 5 seconds, and the time required to fill the target graphic area with all target barrages is 3 seconds. Then, within the special effect duration interval, the target graphic area will be filled with the target barrage first, and after the target graphic area is filled with all target barrages, the barrage special effects obtained based on all target barrages will continue to be displayed. In this case, what is displayed within the special effect duration interval is the barrage special effects that are gradually formed in the process of filling the target graphic area with the target barrage, and the barrage special effects obtained based on all target barrages will continue to be displayed after the target graphic area is filled with all target barrages. For example, in the first 3 seconds of the special effect duration interval, the barrage special effects that are gradually formed by continuously filling the target graphic area with the target barrage are displayed. After the target graphic area is filled with all target barrages, the barrage special effects obtained based on all target barrages will continue to be displayed in the last 2 seconds.

[0073] It is understood that in the embodiment of the present application, the barrage special effect is only displayed during the special effect duration interval. The special effect duration interval is the time interval between the start time point and the end time point. That is, when the special effect duration interval starts, the target barrage begins to fill the target graphic area to obtain the barrage special effect. When the special effect duration interval ends, the barrage special effect disappears.

[0074] In the embodiments of the present application, there is no limitation on the way in which the barrage special effect disappears. For example, it can disappear instantly or disappear slowly in a specific manner. The specific way of disappearing slowly can include shrinking the barrage special effect until it disappears, shrinking and rotating the barrage special effect until it disappears, flying out, fading out, gradually disappearing from both sides of the barrage special effect to the center, etc., and the embodiments of the present application do not limit this.

[0075] Taking the target graphic area as a flower shape as an example, the schematic diagram of the barrage special effect displayed in the playback interface can be seen in Figure 5 As shown, the barrage special effects can be found in Figure 5 As shown in 501.

[0076] It should be noted that in the embodiment of the present application, the target barrage is filled into the target graphic area to obtain the barrage special effect, which can be achieved through a physics engine. A physics engine is a computer software used to simulate and generate physical phenomena in the real world. It can calculate phenomena such as the movement, collision, deformation, and fluid dynamics of objects, thereby presenting realistic physical effects in computer graphics and animations. Physics engines are widely used in electronic games, movie special effects, virtual reality, robot simulation and other fields. A physics engine usually includes the following main parts:

[0077] Rigid body dynamics: simulates at least one of the motion, rotation, and force conditions of an object, and calculates at least one parameter of the object, such as position, velocity, and acceleration.

[0078] Collision detection and response: Detect collisions between objects in the scene, calculate at least one piece of information such as the collision point and collision normal, and calculate the post-collision response based on at least one parameter such as the mass and velocity of the objects.

[0079] Soft body dynamics: simulates at least one property of an object, such as deformation or elasticity, such as cloth, rubber, fluid, etc.

[0080] Constraint solving: Processing at least one constraint condition such as connection, friction, spring, etc. between objects so that the movement of the objects satisfies these constraints.

[0081] Optimization and stabilization: In order to improve the performance and stability of the physics engine, it is usually necessary to optimize the calculation process, such as space segmentation, collision culling and other technologies.

[0082] In the embodiment of the present application, the target bullet screen can be used as an object to be processed by the physics engine, so that the target bullet screen is filled into the target graphic area using the physics engine. In a possible implementation, the physics engine can include but is not limited to Cocos, Unity, and UE4.

[0083] It can be seen from the above technical solution that when a multimedia playback object wants to play a certain multimedia resource, the multimedia resource can be played through the playback interface. Other multimedia playback objects that have watched or listened to the multimedia resource may publish barrages for the multimedia resource, so in the process of playing the multimedia resource, at least one barrage of the multimedia resource can be displayed in the playback interface. In the process of displaying at least one barrage on the playback interface, the present application also provides barrage special effects. If it is determined that the barrage special effect is triggered, the target barrage in at least one barrage can be filled into the target graphic area within the duration of the special effect. Compared with the related art, the present application enriches the display effect of the barrage by adding barrage special effects, making the display of the barrage more interesting, improving the interactivity and fun of the barrage, and thus improving the interactive experience of the multimedia playback object.

[0084] It should be noted that when the multimedia resource is a video to be played, the video content displayed in the playback interface may be diverse, such as people, animals, plants (such as flowers or fallen leaves), objects, or visual effects of moves or skills. In this case, the shape of the target graphic area can correspond to the video content. For example, if the video content displayed in the playback interface includes many flowers or petals, the target graphic area can be in the shape of a flower.

[0085] The above method not only enriches the style of barrage by associating the video content appearing in the playback interface with the barrage special effects, but also has the barrage special effects echoing with the video content, which is conducive to users finding resonance points in the video content through the barrage special effects, allowing users to better feel the video content and experience the barrage more immersively.

[0086] It should be noted that, in the process of filling the target graphic area with the target bullet screen, the target graphic area may be displayed on the playback interface or not, and this embodiment of the present application does not limit this. When the target graphic area is displayed on the playback interface, within the special effect duration interval, the implementation method of filling the target graphic area with the target bullet screen in at least one bullet screen can be to display the target graphic area on the playback interface within the special effect duration interval, and then fill the target graphic area with the target bullet screen.

[0087] See also Figure 6a , Figure 6a This is a simple diagram for filling the target barrage into the target graphic area. Figure 6a The elements in the are the specific content of the multimedia resource, the target graphic area, and the bullet comment. If the multimedia resource is a video to be played, the specific content of the multimedia resource can be the video content of the video to be played. When the bullet comment is displayed normally, if the bullet comment special effect is determined to be triggered, the target bullet comment is filled into the target graphic area using various filling methods.

[0088] See also Figure 6b As shown, Figure 6b This is a diagram of how to implement bullet screen effects during multimedia playback. During the duration of the effect, the target graphic area is first displayed. The target graphic area can be found in the Figure 6b Then, the target barrage is continuously filled into the target graphic area, see Figure 7 As shown in 701, until all target bullet comments are filled into the target graphic area, Figure 5 The barrage special effects shown in 501.

[0089] Through the above method, the multimedia playback object can intuitively feel the formation process of the barrage special effects, thereby improving the interactivity and fun of the barrage, and thus improving the interactive experience of the multimedia playback object.

[0090] It is understandable that in the process of displaying at least one barrage on the playback interface, the triggering of the barrage special effect can be divided into automatic triggering and object interaction triggering. Object interaction triggering can refer to manual triggering based on the interactive operation of the multimedia playback object. When the triggering method of the barrage special effect is automatic triggering, the implementation method of determining the triggering of the barrage special effect can be to determine the triggering of the barrage special effect when the multimedia resource is played to the starting time point of the barrage special effect. That is, when the multimedia resource is played to the starting time point, the barrage special effect is automatically triggered, so that the target barrage starts to move toward the target graphic area, and the target barrage is filled into the target graphic area to obtain the barrage special effect.

[0091] Among them, the starting time point can be pre-configured, for example, it can be reflected through special effect configuration information. Therefore, in one possible implementation method, the terminal can first obtain the special effect configuration information, and then obtain the starting time point based on the special effect configuration information. At the same time, since the triggering method of the barrage special effect is automatic triggering, the special effect duration interval can also be pre-configured, so the special effect configuration information includes the special effect duration interval, and the special effect duration interval is determined based on the configured starting time point and end time point. For example, the starting time point is 0 hours, 3 minutes and 9 seconds, and the end time point is 0 hours, 3 minutes and 20 seconds, then the special effect duration interval is the interval between 0 hours, 3 minutes and 9 seconds and 0 hours, 3 minutes and 20 seconds.

[0092] The barrage special effects are triggered automatically, which simplifies the implementation steps of the barrage special effects and can quickly and conveniently display the barrage special effects.

[0093] When the triggering method of the barrage special effect is object interaction triggering, the implementation method for determining the triggering of the barrage special effect can be to perform a barrage special effect prompt on the playback interface when the multimedia resource is played to the starting time point of the barrage special effect. The barrage special effect prompt can be used to prompt that the barrage can be displayed in a certain barrage special effect at the starting time point, so that the barrage fills the target graphic area. After displaying the barrage special effect prompt, you can wait for the multimedia playback object to choose whether to turn on the barrage special effect. If the multimedia playback object performs a confirmation operation for the barrage special effect prompt, it can be considered that the multimedia playback object agrees to turn on the barrage special effect. Therefore, the terminal can respond to the confirmation operation for the barrage special effect prompt to determine the triggering of the barrage special effect.

[0094] Triggering the barrage special effects through object interaction can better interact with the multimedia playback object, allowing the multimedia playback object to feel that the cool barrage special effects are generated due to the operation of the multimedia playback object, expanding the gameplay of the barrage and improving the interactive experience.

[0095] The embodiment of the present application does not limit the form of the bullet screen special effect prompt, which can be in the form of text, control, gesture, etc. When the bullet screen special effect prompt is in text form, the confirmation operation for the bullet screen special effect prompt can be a multimedia playback object performing a long press, a single press, a double-click, etc. on the terminal screen, and the embodiment of the present application does not limit this.

[0096] When the barrage special effect prompt is in the form of a control, the barrage special effect prompt can be displayed on the playback interface by displaying a barrage special effect activation control. In this case, the confirmation operation is a click on the barrage special effect activation control. That is, when the start time point is reached, the barrage special effect activation control will be displayed on the playback interface. If the multimedia player clicks the barrage special effect activation control, the barrage special effect is confirmed to be triggered.

[0097] Among them, the bullet screen special effect start control can be a button, see Figure 8 As shown in 801, the embodiment of the present application does not limit the appearance of the bullet screen special effect activation control. Figure 8 801 is just an example. The bullet screen special effect start control can appear anywhere on the playback interface, such as Figure 8 In the example above, the bullet screen special effect activation control appears on the right side of the playback interface. When the multimedia player clicks the bullet screen special effect activation control, the bullet screen special effect is triggered.

[0098] When the barrage special effect prompt is in the form of a gesture, the way to prompt the barrage special effect on the playback interface can be to display the barrage special effect startup gesture on the playback interface to prompt the barrage special effect. At this time, the confirmation operation is the barrage selection operation. That is, when the starting time point is reached, the barrage special effect startup gesture will be displayed on the playback interface. If the multimedia playback object performs the barrage selection operation, it is determined that the barrage special effect is triggered. The barrage selection operation can be an operation of selecting a target barrage to fill the target graphic area, such as an operation of long pressing the barrage, an operation of double-clicking the barrage, and so on.

[0099] Among them, the barrage special effect activation gesture can be found in Figure 9 As shown in the middle gesture graphic. The barrage special effect startup gesture can appear anywhere in the playback interface, and this embodiment of the application does not limit this. When the multimedia playback object performs a barrage selection operation, it means that the multimedia playback object may use the barrage selected by the barrage selection operation as the target barrage and fill it into the target graphic area, then it can be determined that the barrage special effect is triggered.

[0100] The embodiments of the present application provide a variety of interactive methods through various possible forms of barrage special effect prompts, which can better interact with multimedia playback objects, expand the gameplay of barrage, and improve the interactive experience.

[0101] It is understandable that when the triggering method of the barrage special effect is object interaction triggering, the starting time point can be pre-configured, for example, it can be reflected through special effect configuration information. Therefore, in one possible implementation method, the terminal can first obtain the special effect configuration information, and then obtain the starting time point based on the special effect configuration information. The special effect configuration information includes an initial duration interval, which is determined based on the configured start time point and end time point. The initial duration interval is the possible duration interval of the pre-configured barrage special effect. For example, the pre-configured start time point is 0 hours, 3 minutes and 9 seconds, and the end time point is 0 hours, 3 minutes and 20 seconds. The initial duration interval is the interval between 0 hours, 3 minutes and 9 seconds and 0 hours, 3 minutes and 20 seconds.

[0102] However, since the triggering method of the barrage special effect is object interaction, the actual special effect duration interval will depend on the timing of the object interaction trigger. The timing of the object interaction trigger is the execution time point of the confirmation operation. Based on this, in one possible implementation method, the special effect duration interval can be determined by determining the time interval between the execution time point and the end time point as the special effect duration interval if the execution time point of the confirmation operation is before the end time point. For example, if the execution time point of the confirmation operation is 0:03:11, and 0:03:11 is before 0:03:20, the interval between 0:03:11 and 0:03:20 can be determined as the special effect duration interval.

[0103] In some cases, the duration of a special effect can be fixed. For example, if the duration of the special effect is preset to 5 seconds, then the barrage special effect should start when the interaction with the execution object is triggered, last for 5 seconds, and then end. In this case, the special effect duration interval can be determined based on the execution time of the confirmation operation and the duration of the special effect. For example, if the execution time of the confirmation operation is 0:03:11, and the special effect duration is 5 seconds, the interval between 0:03:11 and 0:03:16 can be determined as the special effect duration interval.

[0104] By determining the special effect duration interval based on the timing of object interaction triggering, a special effect duration interval that is more in line with the wishes of the multimedia playback object can be obtained, thereby enhancing the participation and interactive experience of the multimedia playback object.

[0105] In embodiments of the present application, the target graphic area can be determined in a variety of ways. In one possible implementation, the target graphic area can be pre-configured, specifically through special effects configuration information, i.e., the special effects configuration information can also include the target graphic area. If the multimedia resource is a video to be played, and the special effects duration interval of the video to be played includes multiple video frames, the target graphic area can be configured based on a graphic configuration operation, i.e., the operator performs a graphic configuration operation to manually configure the target graphic area.

[0106] Operators can configure bullet screen effects on the management console for specific videos to be played and within specific time intervals (such as the effect duration interval or the initial duration interval). They can select existing templates or upload new ones, and can also modify some parameters to achieve better results.

[0107] The configuration interface used by operators to configure on the management console can be found in Figure 10 As shown, for example, you can configure specific barrage special effects, which mainly include the target graphic area, starting time point and ending time point, etc. In addition, you can also choose whether to modify the special effect parameters. If you select no, the default special effect parameters will be used. If you select yes, the special effect parameters that need to be modified will be displayed so that the operator can modify them. It should be noted that the special effect parameters here can include the position parameters of the target graphic area and the position parameters of the impact range. The impact range is used to determine the target barrage.

[0108] Of course, there are also some special effect parameters related to the filling method. Different filling methods will result in different special effect parameters. Depending on the external force, the filling method may also be different. In one possible implementation method, the external force may be a force generated in the form of adsorption force, gravity, moving operation, click operation, etc. Correspondingly, the filling method may be an adsorption method (external force is adsorption force), a dropping method (external force is gravity), a manual movement method (external force is a force generated in the form of moving operation, click operation, etc.), etc. The embodiments of this application do not limit this, and various filling methods will be introduced in detail later. When the filling method is an adsorption method, the special effect parameters may also include adsorption force, position parameters of the adsorption point, etc.

[0109] It should be noted that when configuring the target graphic area through the management console, the target graphic area can be described in the form of Scalable Vector Graphics (SVG). SVG is a vector image format based on eXtensible Markup Language (XML) and is used to display scalable, resolution-independent graphics on the World Wide Web (Web). SVG can be scaled to any size without distortion. In addition, SVG images can be styled and manipulated through Cascading Style Sheets (CSS) and JavaScript. Among them, JavaScript is a scripting programming language. This SVG data can be sent from the server and configured by the operator to achieve a variety of effects.

[0110] In some cases, the target graphic area in a video to be played may be static or dynamic. If it is static, the operator can rely on the configuration capabilities to configure different target graphic areas for different episodes. However, if the target graphic area is dynamic, then in order to improve the configuration capabilities, artificial intelligence (AI) capabilities can be introduced to automatically identify possible target graphic areas, making the target graphic area to be filled variable.

[0111] In this case, the target graphic area can be determined by performing content recognition on each of the multiple video frames to obtain a content recognition result corresponding to each video frame. Then, for each video frame, the target graphic area in the video frame is determined based on the position of the target content on the playback interface indicated by the content recognition result, so that the target graphic area changes with the position of the target content.

[0112] like Figure 11 As shown, in Figure 11In the example, the target content is a character. The target graphic area changes with the position of the character. The character is still on the left side of the playback interface at the previous moment. Figure 11 As shown in Figure (a). The next moment, the character moves to the right side of the playback interface, see Figure 11 As shown in Figure (b), the target graphic area will also change with the position of the character.

[0113] To achieve this goal, you can refer to the data format of frame animation, as shown below:

[0114] {"startPosition":[0.2,0.5],

[0115] "endPosition":[0.6,0.5],

[0116] "duration": 1

[0117] }

[0118] Among them, startPosition represents the starting position of the target graphic area, for example, the coordinates are (0.2, 0.5); endPosition represents the ending position of the target graphic area, for example, the coordinates are (0.6, 0.5); duration represents the duration of the special effect, for example, 1 second. The coordinate points of the movement of each position are interpolated. For example, when it runs to 0.5 seconds, the position of the target graphic area at this time should be (0.4, 0.5). The start position, end position and duration of the special effect are automatically generated and transmitted to the terminal based on the AI ​​capability. After the terminal parses it, it can produce the corresponding target graphic area movement effect.

[0119] Through AI automatic target graphic area, the target graphic area can be accurately and quickly identified, thereby realizing the dynamic configuration of the target graphic area and producing the effect of moving the target graphic area.

[0120] The fill methods described above include adsorption, drop, and manual movement. Adsorption and drop are automatic fill methods, available for both automatic and object interaction triggers. Manual movement is a manual fill method, primarily used when triggered by object interaction. Each fill method is described in detail below.

[0121] When the filling method is adsorption, adsorption means that when a barrage is displayed normally, it is attracted by the adsorption force of a certain point (such as an adsorption point), causing at least one of its own rotation, color and its movement trajectory to change. At this time, the external force is adsorption force. In this case, the method of filling at least one target barrage in the target graphic area can be to follow the direction of the adsorption force of the adsorption point on the target barrage in the target graphic area, and adsorb the target barrage to the target graphic area through the adsorption force of the adsorption point on the target barrage, and the direction of the adsorption force is the ray direction from the target barrage to the adsorption point.

[0122] See also Figure 12 As shown, Figure 12 This is a simple schematic diagram of the adsorption method. Figure 12 The elements in the are divided into the specific content of the multimedia resource, the scope of influence, the bullet screen, the adsorption point and the target graphic area. When the multimedia resource is a video to be played, the specific content of the multimedia resource can be the video content of the video to be played. The direction of the adsorption force can be seen in Figure 12 As shown by the arrow in the middle; the influence range is used to determine the target barrage. When a barrage enters the influence range, it is determined as the target barrage, and the target barrage begins to gather towards the adsorption point under the action of the adsorption force. The adsorbed target barrage will gradually stop moving after reaching the target graphic area, forming a barrage special effect. The schematic diagram of achieving filling through adsorption during the playback of multimedia resources can be seen in Figure 5 shown.

[0123] It should be noted that the method of adsorbing the target barrage to the target graphic area through the adsorption force of the adsorption point on the target barrage can be to detect the position of the target barrage in the process of adsorbing the target barrage to the target graphic area through the adsorption force. If it is detected that the position of the target barrage is within the target graphic area, the adsorption force is stopped. At this time, the target barrage does not stop immediately, and there is still inertial motion until the position of the target barrage in the target graphic area meets the barrage special effect condition, and the target barrage is controlled to stop moving. Among them, the position of the target barrage in the target graphic area meets the barrage special effect condition can be that the target barrage overlaps with other barrages, thereby ensuring that in the process of filling the target barrage into the target graphic area, the target barrage is gradually spread over the entire target graphic area, avoiding all target barrages from filling into the same position of the target graphic area, and ensuring the smooth implementation of the barrage special effect.

[0124] Based on the above introduction, for at least one bullet screen displayed on the playback interface, the specific process of the adsorption method can be found in Figure 13 First, determine whether to trigger the bullet screen effect (see Figure 13As shown in S1301), if the bullet screen effect is determined to be triggered, all bullet screens on the playback interface are found and detected until all bullet screens have been detected. If the bullet screen effect is not triggered, the affected area is removed (see Figure 13 Determine whether there are any undetected comments on the playback interface (see Figure 13 If yes, select a bullet screen from the undetected bullet screen for detection (see Figure 13 ), perform an influence range detection on a single bullet comment to determine whether the position of the bullet comment is within the influence range (see Figure 13 If it is not within the influence range, the detection process of a single bullet screen is terminated and the next bullet screen is removed. If it is within the influence range, an adsorption force will be applied to the bullet screen based on the special effect configuration information (see Figure 13 (S1306 in the figure), the coordinates of the bullet screen are calculated and modified according to the physical engine. After the coordinates are modified, the position of the bullet screen is checked to see if it is in the target graphic area (see Figure 13 If it is not in the target graphic area, the detection process of the single bullet screen is ended. If it is in the target graphic area, the application of the adsorption force is stopped (see Figure 13 At this time, the bullet screen will not stop immediately, and there is still inertial motion. At the same time, it is detected whether the bullet screen overlaps with other bullet screens (see Figure 13 If there is, the bullet screen is controlled to stop moving (see Figure 13 If there is no bullet comment, the frame will be closed and the next frame will be repeated until the configured bullet comment effect is completed by adsorption.

[0125] When the filling method is the dropping method, dropping means that when a barrage is displayed normally, due to the effect of its own gravity, its own motion trajectory changes. At this time, the external force is gravity. In this case, the method of filling the target barrage in at least one barrage into the target graphic area can be to control the target barrage to fall into the target graphic area along the gravity direction of the target barrage, and the gravity direction is the vertical downward direction of the target barrage in the playback interface. It should be noted that the specific process of the dropping method is similar to the specific process of the adsorption method, and will not be repeated here.

[0126] See also Figure 14 As shown, Figure 14 This is a schematic diagram of how to achieve filling by dropping during the playback of multimedia resources. Figure 14 In the example, the target graphic area can be a cloud shape, and the direction of gravity can be found in Figure 14As shown by the arrow in the figure, when the target bullet comment is the bullet comment "All actors in the family", the target bullet comment can fall to the target graphic area along the arrow direction.

[0127] It should be noted that when filling the target graphic area through automatic filling methods (such as adsorption and falling), the target bullet comment can be determined through the influence range. Specifically, it can be detecting the positions of at least one bullet comment during the display of at least one bullet comment of the multimedia resource in the playback interface; determining the bullet comment whose position is within the influence range among the at least one bullet comment as the target bullet comment. By this way of automatically determining the target bullet comment, the operation of the multimedia playback object can be simplified and the target bullet comment can be quickly determined.

[0128] When the filling method is the manual movement method, manual movement means that when a bullet comment is normally displayed, due to the action of a movement operation, its own movement trajectory changes. At this time, the external force is the force generated by the movement operation. In this case, the method of filling the target bullet comment in the at least one bullet comment into the target graphic area can be to fill the target bullet comment into the target graphic area in response to the movement operation on the target bullet comment. Among them, the movement operation can be an operation that changes the movement trajectory of the target bullet comment so that the target bullet comment moves to the target graphic area. The movement operation can be, for example, a drag operation or a slide operation on the target bullet comment. The embodiments of the present application do not limit this.

[0129] By implementing the filling of the target graphic area through the manual movement method, the movement of the target bullet comment can be controlled based on the意愿 of the multimedia playback object, better interacting with the multimedia playback object, making the multimedia playback object feel that this cool bullet comment special effect is generated because of the operation of the multimedia playback object, expanding the gameplay of the bullet comment, and improving the interaction experience.

[0130] Generally, when at least one bullet comment is normally displayed in the playback interface, at least one bullet comment moves in the playback interface according to a preset trajectory, that is, the movement trajectory of at least one bullet comment is a preset trajectory. At this time, one way to fill the target bullet comment into the target graphic area in response to the movement operation on the target bullet comment can be to control the target bullet comment to move towards the target graphic area during the process of at least one bullet comment moving in the playback interface according to the preset trajectory in response to the movement operation on the target bullet comment; detecting the position of the target bullet comment during the process of controlling the target bullet comment to move towards the target graphic area; if the position of the target bullet comment is within the target graphic area when the movement operation stops, controlling the target bullet comment to stay at this position. If the position of the target bullet comment is outside the target graphic area when the movement operation stops, controlling the target bullet comment to return to the original position and continue to move along the preset trajectory from the original position, and the original position is the position where the target bullet comment is located when the movement operation is performed on the target bullet comment.

[0131] It should be noted that there is an unclear expression "意愿" in the original text. It might need to be further clarified in the actual context for a more accurate translation.It should be noted that when the target graphic area is filled by manual movement, the target barrage can be determined by the barrage selection operation of the multimedia playback object. Specifically, the multimedia playback object can select the target barrage through the barrage selection operation. After the multimedia playback object completes the barrage selection operation, the terminal responds to the barrage selection operation and determines the barrage corresponding to the barrage selection operation as the target barrage. The barrage selection operation can be an operation to select the target barrage to be filled in the target graphic area, such as a long press operation, a double-click operation, etc., which is not limited in this embodiment of the present application.

[0132] By determining the target barrage based on the barrage selection operation, the target barrage can be selected based on the intention of the multimedia playback object, thereby enhancing the participation and interactive experience of the multimedia playback object.

[0133] Based on the above introduction, when the barrage selection operation is a long press operation and the multimedia playback target is the user, the specific process of filling the target graphic area by manual movement can be that the user selects the target barrage through a long press operation. At this time, the target barrage stops moving along the preset trajectory and records the original position of the target barrage at this time. The target barrage moves along with the movement of the user's finger, and the user can complete it by releasing the finger. If the target barrage is within the target graphic area at this time, the target barrage stays at this position. If the target barrage is not within the target graphic area, the target barrage returns to its original position and continues to move along the preset trajectory.

[0134] It should be understood that in some cases, when multimedia resources are played on the playback interface, some operations may occur on the multimedia playback object, such as switching between horizontal and vertical screens, filling the full screen with multimedia resources, etc., which will cause the size of the playback interface to change accordingly. The position of the target graphic area may be closely related to the specific content of the multimedia resource. When the size of the playback interface changes, since the target graphic area saves the percentage relative to the size of the playback interface, the size of the target graphic area can be adaptively changed as the size of the playback interface changes. Specifically, when the size of the playback interface changes, the terminal can regenerate the target graphic area based on the size of the playback interface after the change, and the size of the regenerated target graphic area matches the size of the playback interface after the change.

[0135] When the size of the playback interface changes, the target graphic area is adaptively updated to avoid the loss of the barrage special effects caused by the size change of the playback interface.

[0136] The above detailed introduction to the barrage display method reveals that the overall process can be divided into the following steps: special effect configuration, server delivery, triggering barrage special effects, and effect display. Special effect configuration includes both operational configuration and AI generation. Operational configuration involves configuration by operators on the management console, while AI generation involves automatic configuration based on AI. Triggering barrage special effects primarily involves automatic triggering and object interaction triggering.

[0137] Taking the multimedia resource as an example, the overall process of the bullet screen display method can be found in Figure 15 As shown, special effect configuration information is obtained based on operation configuration and AI generation (see Figure 15 The terminal loads the video to be played from the server (see S1501). Figure 15 As shown in S1502 in the figure), before the video to be played is played, the terminal will request the server for the special effect configuration information required in the video to be played. The special effect configuration information may include the target graphic area and the initial duration interval. Since various bullet screen special effects may appear multiple times during the playback of the video to be played, each bullet screen special effect can be reflected by the special effect configuration information. The special effect configuration information of multiple bullet screen special effects can constitute a special effect list. Therefore, before the video to be played is played, the server can send the bullet screen special effect list (see Figure 15 As shown in S1503). Under normal circumstances, the terminal can download the bullet screen special effects list immediately after receiving the server response to prevent the delay in screen display caused by the time-consuming download. After the terminal obtains the special effects configuration information of various bullet screen special effects, it can parse the special effects configuration information (see Figure 15 4), thereby obtaining the target graphic area and the initial duration interval. Save the initial duration interval and the target graphic area (see Figure 15 As shown in S1505 in the figure, when the playback progress hits the configured initial duration interval, the bullet screen special effect may begin to be displayed. Since more than one server can send the initial duration interval, object interaction triggering (see Figure 15 (as shown in S1506 in the figure) can also generate a time interval. If no object interaction trigger occurs, the initial duration interval is directly used as the special effect duration interval. If an object interaction trigger occurs, the special effect duration interval is determined based on the initial duration interval and the time interval generated by the object interaction trigger. Then, wait for the playback progress to hit. Determine whether the playback progress of the video to be played hits the special effect duration interval (see Figure 15 If it hits, it means that the bullet screen effect needs to be displayed at this time, and the filling method is selected at this time (see Figure 15 ), and perform filling (see Figure 15 When each video frame starts, a new round of process will be started. If it does not hit, the frame cycle ends.

[0138] exist Figure 15 In the figure, S1501 is the step of configuring special effects, S1502-S1503 are the steps of server issuance, S1504-S1507 are the steps of triggering barrage special effects, and S1508-S1509 are the steps of effect display.

[0139] It should be noted that, based on the implementation methods provided in the above aspects, this application can also be further combined to provide more implementation methods.

[0140] based on Figure 2 Corresponding to the bullet screen display method provided in the embodiment, the embodiment of the present application also provides a bullet screen display device 1600. Figure 16 As shown, the bullet screen display device 1600 includes a playback unit 1601, a display unit 1602 and a filling unit 1603:

[0141] The playback unit 1601 is used to play multimedia resources through the playback interface;

[0142] The display unit 1602 is configured to display at least one bullet screen of the multimedia resource in the playback interface during playback of the multimedia resource;

[0143] The filling unit 1603 is used to fill the target graphic area with the target bullet screen in the at least one bullet screen within the duration of the special effect if it is determined that the bullet screen special effect is triggered during the process of displaying the at least one bullet screen in the playback interface.

[0144] In a possible implementation, the apparatus further includes a determining unit:

[0145] The determining unit is used to determine whether to trigger the barrage special effect when the multimedia resource is played to the starting time point of the barrage special effect.

[0146] In a possible implementation, the apparatus further includes an acquisition unit and a parsing unit:

[0147] The acquisition unit is configured to, when the multimedia resource is played to the start time point of the barrage special effect, determine before triggering the barrage special effect, acquire special effect configuration information, the special effect configuration information including the special effect duration interval, the special effect duration interval being determined based on the configured start time point and end time point;

[0148] The parsing unit is used to parse the special effect configuration information to obtain the starting time point and the special effect duration interval.

[0149] In a possible implementation, the apparatus further includes a determining unit:

[0150] The determination unit is used to provide a barrage special effect prompt on the playback interface when the multimedia resource is played to the starting time point of the barrage special effect; and determine to trigger the barrage special effect in response to a confirmation operation on the barrage special effect prompt.

[0151] In a possible implementation, the apparatus further includes an acquisition unit and a parsing unit:

[0152] The acquiring unit is configured to acquire special effect configuration information, where the special effect configuration information includes the initial duration interval, where the initial duration interval is determined based on the configured start time point and end time point;

[0153] The parsing unit is configured to parse the special effect configuration information to obtain the starting time point and the initial duration interval;

[0154] The special effect duration interval is determined as follows:

[0155] If the execution time point of the confirmation operation is before the end time point, the time interval between the execution time point and the end time point is determined as the special effect duration interval;

[0156] or,

[0157] The special effect duration interval is determined based on the execution time point of the confirmation operation and the duration of the special effect.

[0158] In a possible implementation manner, the determining unit is configured to:

[0159] Prompt the barrage special effects by displaying a barrage special effects start control on the playback interface;

[0160] The confirmation operation is a click operation on the bullet screen special effect activation control;

[0161] or,

[0162] Prompt the barrage special effects by displaying a barrage special effects start gesture on the playback interface;

[0163] The confirmation operation is a bullet screen selection operation.

[0164] In a possible implementation, the filling unit 1603 is configured to:

[0165] Along the direction of the adsorption force of the adsorption point in the target graphic area on the target barrage, the target barrage is adsorbed to the target graphic area through the adsorption force of the adsorption point on the target barrage, and the direction of the adsorption force is the ray direction from the target barrage to the adsorption point.

[0166] In a possible implementation, the filling unit 1603 is configured to:

[0167] In the process of adsorbing the target bullet screen to the target graphic area by the adsorption force, detecting the position of the target bullet screen;

[0168] If it is detected that the position of the target barrage is within the target graphic area, the adsorption force is stopped until the position of the target barrage within the target graphic area meets the barrage special effect condition, and the target barrage is controlled to stop moving.

[0169] In a possible implementation, the filling unit 1603 is configured to:

[0170] The target bullet screen is controlled to fall into the target graphic area along the gravity direction of the target bullet screen, where the gravity direction is the vertical downward direction of the target bullet screen in the playback interface.

[0171] In a possible implementation, the apparatus further includes a detection unit and a determination unit:

[0172] The detection unit is configured to detect a position of at least one bullet screen of the multimedia resource during the process of displaying the at least one bullet screen in the playback interface;

[0173] The determining unit is configured to determine a barrage located within an influence range among the at least one barrage as the target barrage.

[0174] In a possible implementation, the filling unit 1603 is configured to:

[0175] In response to a move operation on the target bullet screen, the target bullet screen is filled into a target graphic area.

[0176] In a possible implementation, the at least one bullet screen moves in the playback interface according to a preset trajectory, and the filling unit 1603 is configured to:

[0177] In the process of the at least one bullet screen moving along a preset trajectory in the playback interface, in response to a move operation on the target bullet screen, controlling the target bullet screen to move toward the target graphic area;

[0178] In the process of controlling the target bullet screen to move toward the target graphic area, detecting the position of the target bullet screen;

[0179] If the position of the target bullet screen is within the target graphic area when the moving operation stops, the target bullet screen is controlled to stay at the position.

[0180] In a possible implementation, the device further includes a control unit:

[0181] The control unit is used to control the target barrage to return to its original position if the position of the target barrage is outside the target graphic area when the moving operation stops, and to continue moving along the preset trajectory from the original position. The original position is the position of the target barrage when the moving operation is performed on the target barrage.

[0182] In a possible implementation, the apparatus further includes a determining unit:

[0183] The determining unit is configured to, in response to a barrage selection operation, determine the barrage corresponding to the barrage selection operation as the target barrage.

[0184] In a possible implementation, the filling unit 1603 is configured to:

[0185] During the special effect duration period, displaying the target graphic area in the playback interface;

[0186] Fill the target graphic area with the target bullet screen.

[0187] In a possible implementation, the apparatus further includes a generating unit:

[0188] The generation unit is used to fill the target graphic area with the target barrage in the at least one barrage within the special effect duration interval, and when the size of the playback interface changes, regenerate the target graphic area based on the changed size of the playback interface, and the size of the regenerated target graphic area matches the size of the changed playback interface.

[0189] In one possible implementation, the special effect configuration information further includes the target graphic area, the multimedia resource is a video to be played, the special effect duration interval of the video to be played includes multiple video frames, and the configuration method of the target graphic area includes at least one of the following:

[0190] Obtaining the target graphic area based on a graphic configuration operation;

[0191] Alternatively, content recognition is performed on each of the multiple video frames to obtain a content recognition result corresponding to each video frame; for each video frame, the target graphic area in the video frame is obtained based on the position of the target content indicated by the content recognition result on the playback interface.

[0192] It can be seen from the above technical solution that when a multimedia playback object wants to play a certain multimedia resource, the multimedia resource can be played through the playback interface. Other multimedia playback objects that have watched or listened to the multimedia resource may publish barrages for the multimedia resource, so in the process of playing the multimedia resource, at least one barrage of the multimedia resource can be displayed in the playback interface. In the process of displaying at least one barrage on the playback interface, the present application also provides barrage special effects. If it is determined that the barrage special effect is triggered, the target barrage in at least one barrage can be filled into the target graphic area within the duration of the special effect. Compared with the related art, the present application enriches the display effect of the barrage by adding barrage special effects, making the display of the barrage more interesting, improving the interactivity and fun of the barrage, and thus improving the interactive experience of the multimedia playback object.

[0193] The embodiment of the present application further provides a computer device that can execute the bullet screen display method. The computer device can be a terminal, taking a smartphone as an example:

[0194] Figure 17 The block diagram shows a partial structure of a smart phone provided by an embodiment of the present application. Figure 17 The smartphone includes components such as a radio frequency (RF) circuit 1710, a memory 1720, an input unit 1730, a display unit 1740, a sensor 1750, an audio circuit 1760, a wireless fidelity (WiFi) module 1770, a processor 1780, and a power supply 1790. The input unit 1730 may include a touch panel 1731 and other input devices 1732, the display unit 1740 may include a display panel 1741, and the audio circuit 1760 may include a speaker 1761 and a microphone 1762. It is understood that Figure 17 The structure of the smartphone shown in the figure does not constitute a limitation on the smartphone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0195] The memory 1720 can be used to store software programs and modules. The processor 1780 executes the various functional applications and data processing of the smartphone by running the software programs and modules stored in the memory 1720. The memory 1720 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created based on the use of the smartphone (such as audio data, a phone book, etc.). In addition, the memory 1720 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device.

[0196] Processor 1780 is the control center of the smartphone, connecting all components of the smartphone using various interfaces and circuits. It executes software programs and / or modules stored in memory 1720 and accesses data stored in memory 1720 to perform various smartphone functions and process data. Optionally, processor 1780 may include one or more processing units. Preferably, processor 1780 integrates an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 1780.

[0197] In this embodiment, the processor 1780 in the smartphone can execute the bullet screen display method provided in each embodiment of the present application.

[0198] The computer device provided in the embodiment of the present application may also be a server, see Figure 18 As shown, Figure 18 The structural diagram of the server 1800 provided in the embodiment of the present application, the server 1800 may have relatively large differences due to different configurations or performances, and may include one or more processors, such as a central processing unit (CPU) 1822, and a memory 1832, one or more storage media 1830 (such as one or more mass storage devices) storing application programs 1842 or data 1844. Among them, the memory 1832 and the storage medium 1830 can be temporary storage or permanent storage. The program stored in the storage medium 1830 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 1822 can be configured to communicate with the storage medium 1830 to execute a series of instruction operations in the storage medium 1830 on the server 1800.

[0199] The server 1800 may also include one or more power supplies 1826, one or more wired or wireless network interfaces 1850, one or more input and output interfaces 1858, and / or one or more operating systems 1841, such as Windows Server 2003. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0200] In this embodiment, the central processing unit 1822 in the server 1800 can execute the bullet screen display method provided in each embodiment of the present application.

[0201] According to one aspect of the present application, a computer-readable storage medium is provided, which is used to store a computer program, and the computer program is used to execute the bullet screen display method described in each of the aforementioned embodiments.

[0202] According to one aspect of the present application, a computer program product is provided, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the methods provided in various optional implementations of the above-described embodiments.

[0203] The descriptions of the processes or structures corresponding to the above figures have different emphases. For parts that are not described in detail in a certain process or structure, please refer to the relevant descriptions of other processes or structures.

[0204] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can, for example, be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0205] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0206] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0207] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0208] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a terminal, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store computer programs, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0209] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0210] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, ordinary technical members in this field should understand that they can still modify the technical solutions recorded in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A bullet screen display method, characterized in that: The method comprises: Play multimedia resources through the playback interface; During playback of the multimedia resource, displaying at least one bullet screen of the multimedia resource on the playback interface, wherein when the at least one bullet screen is displayed on the playback interface, the bullet screen moves on the playback interface according to a preset trajectory; During the process of displaying the at least one barrage on the playback interface, if it is determined that a barrage special effect is triggered, within the special effect duration interval, a target barrage in the at least one barrage is filled into a target graphic area, wherein what is displayed within the special effect duration interval is a barrage special effect gradually formed in the process of filling the target barrage into the target graphic area, and the barrage special effect is a word cloud effect-like effect, wherein when a barrage is displayed normally, its own rotation, color and movement trajectory change due to the influence of external force, and finally it stays in the target graphic area, and the shape of the target graphic area corresponds to the multimedia resource, and within the special effect duration interval, the target graphic area is displayed first, and then the target barrage is continuously filled into the target graphic area until all target barrages are filled into the target graphic area; The target barrage is filled into the target graphic area in the following ways: Determine whether to trigger a barrage special effect, wherein the barrage special effect is configured through a configuration interface, and the barrage special effect includes a target graphic area, a start time point, an end time point, and whether to modify special effect parameters. The special effect parameters include the position parameters of the target graphic area and the position parameters of the affected range. The affected range is used to determine the target barrage; If it is determined that the barrage special effect is triggered, all barrages on the playback interface are detected; If the bullet screen effect is not triggered, the affected area will be removed; Determine whether there are any undetected comments on the playback interface; If there are undetected bullet comments, select bullet comments from the undetected bullet comments for detection, and determine whether the position of the individual bullet comments is within the affected range; If it is not within the affected range, the detection process of a single bullet comment ends; If it is within the affected range, external force is applied to the bullet screen based on the special effect configuration information, and the coordinates of the bullet screen are calculated and modified using the physics engine; For the bullet screen whose coordinates have been modified, determining whether the position of the bullet screen is within the target graphic area; If it is in the target graphic area, stop applying external force and control the barrage to stop moving when it overlaps with other barrages; If it is not in the target graphic area, the detection process of a single bullet comment is ended. After all bullet comments are detected, this frame ends and the next frame is repeated until the configured bullet comment special effect is completed.

2. The method according to claim 1, characterized in that Determining to trigger the barrage special effect includes: When the multimedia resource is played to the starting time point of the barrage special effect, it is determined that the barrage special effect is triggered.

3. The method according to claim 2, characterized in that When the multimedia resource is played to the starting time point of the barrage special effect, before determining to trigger the barrage special effect, the method further includes: Acquire special effect configuration information, where the special effect configuration information includes the special effect duration interval, where the special effect duration interval is determined based on the configured start time point and end time point; The special effect configuration information is parsed to obtain the starting time point and the special effect duration interval.

4. The method according to claim 1, wherein Determining to trigger the barrage special effect includes: When the multimedia resource is played to the starting time point of the barrage special effect, a barrage special effect prompt is performed on the playback interface; In response to a confirmation operation on the barrage special effect prompt, it is determined that the barrage special effect is triggered.

5. The method according to claim 4, characterized in that When the multimedia resource is played to the starting time point of the bullet screen special effect, before the bullet screen special effect prompt is performed on the playback interface, the method further includes: Acquire special effect configuration information, where the special effect configuration information includes an initial duration interval, where the initial duration interval is determined based on the configured start time point and end time point; Parsing the special effect configuration information to obtain the starting time point and the initial duration interval; The special effect duration interval is determined as follows: If the execution time point of the confirmation operation is before the end time point, the time interval between the execution time point and the end time point is determined as the special effect duration interval; or, The special effect duration interval is determined based on the execution time point of the confirmation operation and the duration of the special effect.

6. The method according to claim 4, characterized in that The bullet screen special effect prompt on the playback interface includes: Prompt the barrage special effects by displaying a barrage special effects start control on the playback interface; The confirmation operation is a click operation on the bullet screen special effect activation control; or, The bullet screen special effect prompt on the playback interface includes: Prompt the barrage special effects by displaying a barrage special effects start gesture on the playback interface; The confirmation operation is a bullet screen selection operation.

7. The method according to claim 1, characterized in that Filling the target bullet screen in the at least one bullet screen into the target graphic area includes: Along the direction of the adsorption force of the adsorption point in the target graphic area on the target barrage, the target barrage is adsorbed to the target graphic area through the adsorption force of the adsorption point on the target barrage, and the direction of the adsorption force is the ray direction from the target barrage to the adsorption point.

8. The method according to claim 7, characterized in that Adsorbing the target bullet screen to the target graphic area by applying an adsorption force of the adsorption point to the target bullet screen includes: In the process of adsorbing the target bullet screen to the target graphic area by the adsorption force, detecting the position of the target bullet screen; If it is detected that the position of the target barrage is within the target graphic area, the adsorption force is stopped until the position of the target barrage within the target graphic area meets the barrage special effect condition, and the target barrage is controlled to stop moving.

9. The method according to claim 1, characterized in that Filling the target bullet screen in the at least one bullet screen into the target graphic area includes: The target bullet screen is controlled to fall into the target graphic area along the gravity direction of the target bullet screen, where the gravity direction is the vertical downward direction of the target bullet screen in the playback interface.

10. The method according to any one of claims 7 to 9, characterized in that: The method further comprises: During the process of displaying at least one bullet screen of the multimedia resource in the playback interface, detecting a position of the at least one bullet screen; The barrage located within the influence range in the at least one barrage is determined as the target barrage.

11. The method according to claim 1, wherein Filling the target bullet screen in the at least one bullet screen into the target graphic area includes: In response to a move operation on the target bullet screen, the target bullet screen is filled into a target graphic area.

12. The method according to claim 11, characterized in that The at least one bullet screen moves in the playback interface according to a preset trajectory, and in response to a movement operation on the target bullet screen, the target bullet screen is filled into a target graphic area, comprising: In the process of the at least one bullet screen moving along a preset trajectory in the playback interface, in response to a move operation on the target bullet screen, controlling the target bullet screen to move toward the target graphic area; In the process of controlling the target bullet screen to move toward the target graphic area, detecting the position of the target bullet screen; If the position of the target bullet screen is within the target graphic area when the moving operation stops, the target bullet screen is controlled to stay at the position.

13. The method according to claim 12, characterized in that The method further comprises: If the position of the target barrage is outside the target graphic area when the moving operation stops, the target barrage is controlled to return to its original position and continue to move along the preset trajectory from the original position. The original position is the position of the target barrage when the moving operation is performed on the target barrage.

14. The method according to claim 11, characterized in that The method further comprises: In response to a barrage selection operation, the barrage corresponding to the barrage selection operation is determined as the target barrage.

15. The method according to any one of claims 1 to 6, characterized in that The step of filling the target graphic area with the target bullet screen in the at least one bullet screen within the special effect duration interval includes: During the special effect duration period, displaying the target graphic area in the playback interface; Fill the target graphic area with the target bullet screen.

16. The method according to any one of claims 1 to 9, characterized in that Within the special effect duration interval, after filling the target graphic area with the target bullet comment in the at least one bullet comment, the method further includes: When the size of the playback interface changes, the target graphic area is regenerated based on the changed size of the playback interface, and the size of the regenerated target graphic area matches the changed size of the playback interface.

17. The method according to claim 3 or 5, characterized in that The special effect configuration information further includes the target graphic area, the multimedia resource is a video to be played, the special effect duration interval of the video to be played includes multiple video frames, and the configuration method of the target graphic area includes at least one of the following: Obtaining the target graphic area based on a graphic configuration operation; Alternatively, content recognition is performed on each of the multiple video frames to obtain a content recognition result corresponding to each video frame; for each video frame, the target graphic area in the video frame is obtained based on the position of the target content indicated by the content recognition result on the playback interface.

18. A bullet screen display device, characterized in that: The device includes a playback unit, a display unit and a filling unit: The playback unit is used to play multimedia resources through the playback interface; The display unit is configured to display at least one bullet screen of the multimedia resource on the playback interface during playback of the multimedia resource, wherein when the at least one bullet screen is displayed on the playback interface, the bullet screen moves on the playback interface according to a preset trajectory; The filling unit is configured to fill, during the process of displaying the at least one barrage on the playback interface, if it is determined that a barrage special effect is triggered, a target barrage in the at least one barrage is filled into a target graphic area within a special effect duration interval, wherein what is displayed within the special effect duration interval is a barrage special effect gradually formed in the process of filling the target barrage into the target graphic area, and the barrage special effect is a word cloud effect-like effect, wherein when a barrage is displayed normally, its own rotation, color and movement trajectory change due to the influence of external force, and finally it stays in the target graphic area, and the shape of the target graphic area corresponds to the multimedia resource, and within the special effect duration interval, the target graphic area is first displayed, and then the target barrage is continuously filled into the target graphic area until all target barrages are filled into the target graphic area; The target barrage is filled into the target graphic area in the following ways: Determine whether to trigger a barrage special effect, wherein the barrage special effect is configured through a configuration interface, and the barrage special effect includes a target graphic area, a start time point, an end time point, and whether to modify special effect parameters. The special effect parameters include the position parameters of the target graphic area and the position parameters of the affected range. The affected range is used to determine the target barrage; If it is determined that the barrage special effect is triggered, all barrages on the playback interface are detected; If the bullet screen effect is not triggered, the affected area will be removed; Determine whether there are any undetected comments on the playback interface; If there are undetected bullet comments, select bullet comments from the undetected bullet comments for detection, and determine whether the position of the individual bullet comments is within the affected range; If it is not within the affected range, the detection process of a single bullet comment ends; If it is within the affected range, external force is applied to the bullet screen based on the special effect configuration information, and the coordinates of the bullet screen are calculated and modified using the physics engine; For the bullet screen whose coordinates have been modified, determining whether the position of the bullet screen is within the target graphic area; If it is in the target graphic area, stop applying external force and control the barrage to stop moving when it overlaps with other barrages; If it is not in the target graphic area, the detection process of a single bullet comment is ended. After all bullet comments are detected, this frame ends and the next frame is repeated until the configured bullet comment special effect is completed.

19. The device according to claim 18, characterized in that The apparatus further includes a determining unit; The determining unit is used to determine whether to trigger the barrage special effect when the multimedia resource is played to the starting time point of the barrage special effect.

20. The device according to claim 19, characterized in that The device also includes an acquisition unit and a parsing unit; The acquisition unit is configured to, when the multimedia resource is played to the start time point of the barrage special effect, determine before triggering the barrage special effect, acquire special effect configuration information, the special effect configuration information including the special effect duration interval, the special effect duration interval being determined based on the configured start time point and end time point; The parsing unit is used to parse the special effect configuration information to obtain the starting time point and the special effect duration interval.

21. The device according to claim 18, characterized in that The apparatus further includes a determining unit; The determining unit is configured to provide a bullet screen special effect prompt on the playback interface when the multimedia resource is played to the starting time point of the bullet screen special effect; In response to a confirmation operation on the barrage special effect prompt, it is determined that the barrage special effect is triggered.

22. A computer device, characterized in that: The computer device includes a processor and a memory: The memory is used to store a computer program and transmit the computer program to the processor; The processor is configured to execute the method according to any one of claims 1 to 17 according to instructions in the computer program.

23. A computer-readable storage medium, characterized in that The computer-readable storage medium is used to store a computer program, which, when executed by a processor, causes the processor to perform the method according to any one of claims 1 to 17.

24. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by a processor, causes the processor to perform the method according to any one of claims 1 to 17.

Images