Bullet screen display method and related device
By displaying bullet screen effects in the multimedia playback interface and controlling the bullet screen to move and stay within the target graphic area, the problem of the monotonous display method of existing bullet screens is solved, realizing a more interactive and interesting bullet screen display and improving the user experience.
Patent Information
- Application Number
- CN202511239989.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-28
- Publication Date
- 2025-11-04
AI Technical Summary
The existing bullet screen display method is too simplistic, lacks interactivity and fun, and affects the interactive experience of multimedia viewers.
By displaying bullet screen effects on the playback interface, the bullet screen is controlled to move towards and stay in the target graphic area within the duration of the effect. The bullet screen effect adopts a word cloud-like effect and uses a physics engine to realize the filling and staying of the bullet screen.
It enriches the display effects of bullet comments, enhances their interactivity and fun, and improves the interactive experience of multimedia playback objects.
Smart Images

Figure CN120897086A_ABST
Abstract
Description
[0001] This application is a divisional application of the application with application number 2023118531790 and titled "Bullet Screen Display Method and Related Device", filed on December 28, 2023. TECHNICAL FIELD
[0002] The present application relates to the field of computers, and in particular to a bullet screen display method and related device. BACKGROUND
[0003] With the development of computer technology, playing multimedia resources has become a common form of entertainment in people's daily life.
[0004] During the playing of a multimedia resource, a bullet screen function can be started to publish bullet screens to express the feelings of a multimedia playing object about the played multimedia resource, and the multimedia playing object can also view bullet screens published by other multimedia playing objects during the playing of the multimedia resource, so as to achieve real-time interaction.
[0005] However, the display effect of the bullet screen provided in the related art is too simple, and the interactivity and interest are poor, which greatly affects the interactive experience of the multimedia playing object. SUMMARY
[0006] To solve the above technical problems, the present application provides a bullet screen display method and related device, which enriches the display effect of the bullet screen, makes the display of the bullet screen more interesting, improves the interactivity and interest of the bullet screen, and further improves the interactive experience of the multimedia playing object.
[0007] The embodiments of the present application disclose the following technical solutions:
[0008] In one aspect, the present application provides a bullet screen display method, which comprises: playing a multimedia resource through a playing interface; displaying at least one bullet screen of the multimedia resource in the playing interface during the playing of the multimedia resource; during the display of the at least one bullet screen, if it is determined that a bullet screen special effect is triggered, controlling a target bullet screen in the at least one bullet screen to move towards a target graphic area within a special effect duration interval; and after the target bullet screen moves to the target graphic area, controlling the target bullet screen to stay in the target graphic area.
[0009] In an aspect, an embodiment of the present application provides a bullet screen display device, the device comprising: a playing unit configured to play a multimedia resource through a playing interface; a display unit configured to display at least one bullet screen of the multimedia resource in the playing interface during playing of the multimedia resource; and a filling unit configured to, during display of the at least one bullet screen, if it is determined that a bullet screen special effect is triggered, control a target bullet screen in the at least one bullet screen to move towards a target graphic area within a special effect duration interval, and after the target bullet screen moves to the target graphic area, control the target bullet screen to stay in the target graphic area.
[0010] In an aspect, an embodiment of the present application provides a computer device, the computer device comprising a processor and a memory: the memory is configured to store a computer program and transmit the computer program to the processor; and the processor is configured to execute the method according to the instructions in the computer program.
[0011] In an aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium is configured to store a computer program, the computer program, when executed by a processor, causes the processor to execute the method according to any one of the preceding aspects.
[0012] In an aspect, an embodiment of the present application provides a computer program product, comprising a computer program, the computer program, when executed by a processor, implements the method according to any one of the preceding aspects.
[0013] From the above technical solution, when a multimedia playing object wants to play a certain multimedia resource, the multimedia resource can be played through a playing interface. Other multimedia playing objects that have watched or listened to the multimedia resource can publish bullet screens for the multimedia resource, so at least one bullet screen of the multimedia resource can be displayed in the playing interface during playing of the multimedia resource. During display of the at least one bullet screen in the playing interface, the present application also provides a bullet screen special effect, if it is determined that the bullet screen special effect is triggered, a target bullet screen in the at least one bullet screen can be controlled to move towards a target graphic area within a special effect duration interval, and after the target bullet screen moves to the target graphic area, the target bullet screen can be controlled to stay in the target graphic area. Compared with related technologies, the present application enriches the display effect of the bullet screen by adding the bullet screen special effect, makes the display of the bullet screen more interesting, improves the interactivity and interestingness of the bullet screen, and further improves the interactive experience of the multimedia playing object. BRIEF DESCRIPTION OF DRAWINGS
[0014] Figure 1 An application scenario architecture diagram of a bullet screen display method provided by an embodiment of the present application;
[0015] Figure 2 A flowchart of a barrage display method provided for an embodiment of the present application;
[0016] Figure 3 A schematic diagram of a play interface provided for an embodiment of the present application;
[0017] Figure 4 A schematic diagram of displaying at least one barrage in a play interface provided for an embodiment of the present application;
[0018] Figure 5 A schematic diagram of a barrage special effect provided for an embodiment of the present application;
[0019] Figure 6a A simple schematic diagram of filling a target barrage into a target graphic area provided for an embodiment of the present application;
[0020] Figure 6b A schematic diagram of implementing a barrage special effect in the process of playing a multimedia resource provided for an embodiment of the present application;
[0021] Figure 7 A schematic diagram of filling a target barrage into a target graphic area provided for an embodiment of the present application;
[0022] Figure 8 A schematic diagram of a barrage special effect starting control provided for an embodiment of the present application;
[0023] Figure 9 A schematic diagram of a barrage special effect starting gesture provided for an embodiment of the present application;
[0024] Figure 10 A schematic diagram of a configuration interface provided for an embodiment of the present application;
[0025] Figure 11 A schematic diagram of a target graphic area changing with the change of a character position provided for an embodiment of the present application;
[0026] Figure 12 A simple schematic diagram of an adsorption mode provided for an embodiment of the present application;
[0027] Figure 13 A specific flowchart of an adsorption mode provided for an embodiment of the present application;
[0028] Figure 14 A schematic diagram of filling by dropping in the process of playing a multimedia resource provided for an embodiment of the present application;
[0029] Figure 15 A whole flowchart of a barrage display method provided for an embodiment of the present application;
[0030] Figure 16 A structure diagram of a barrage display device provided for an embodiment of the present application is shown in FIG. 1.
[0031] Figure 17 A structure diagram of a terminal provided for an embodiment of the present application is shown in FIG. 2.
[0032] Figure 18 A structure diagram of a server provided for an embodiment of the present application is shown in FIG. 3. DETAILED DESCRIPTION
[0033] The embodiments of the present application are described below with reference to the accompanying drawings.
[0034] During the playing of a multimedia resource, a multimedia playing object can start a barrage function to publish barrages to express its feelings about the played multimedia resource, and can also view the barrages published by other multimedia playing objects during the playing of the multimedia resource to achieve a real-time interaction effect.
[0035] In the current barrage display mode, after a multimedia playing object publishes a barrage, the barrage can move in a preset track in the playing interface. The preset track can be, for example, appearing from the left side of the playing interface and disappearing from the right side, appearing from the right side of the playing interface and disappearing from the left side, appearing from both sides of the playing interface and disappearing in the middle, and the like. However, in this barrage display mode, the barrage only floats in the playing interface, and the display effect of the barrage is too simple, the interactivity and interestingness are poor, and the interactive experience of the multimedia playing object is greatly affected.
[0036] To solve the above technical problem, the embodiments of the present application provide a barrage display method, which is a method of displaying barrages in a word cloud-like effect. That is, during the display of at least one barrage in a playing interface, a barrage special effect in a word cloud-like effect is provided. When a barrage is normally displayed, at least one of the rotation, color, and movement track of the barrage is changed due to an external force, and the barrage finally stays in a predetermined range (for example, a target graphic area), which can be called a word cloud-like effect. In the embodiments of the present application, if it is determined that the barrage special effect is triggered, the target barrage in the at least one barrage can be filled into the target graphic area within a special effect duration interval. The effect formed by filling the target barrage into the target graphic area is the barrage special effect in a word cloud-like effect. In the embodiments of the present application, the form of the external force is not limited, which can be, for example, an attractive force, a gravitational force, a movement operation, a click operation, and the like.
[0037] A word cloud, also known as a tag cloud or word visualization, is a data visualization technique used to represent frequently occurring words in text data. In a word cloud, the size of each word typically represents its frequency of occurrence in the text; words with higher frequency appear in larger fonts and may even be colored differently, allowing for a quick overview of the main content or keywords. Word clouds are widely used in web search, data mining, information retrieval, and text analysis. For example, word clouds can be generated by analyzing social media posts to understand public interest in a particular topic; similarly, word clouds can be generated by analyzing internal company documents to understand business priorities.
[0038] The generation of word clouds usually requires text preprocessing (such as word segmentation, stop word removal, etc.), word frequency statistics, word cloud layout, etc. The bullet screen effect of the word cloud effect in this application embodiment is similar to the effect of word cloud in terms of visualization, but the steps to generate bullet screen effect are different from the steps to generate word cloud.
[0039] It should be noted that the bullet screen display method provided in this application embodiment can be applied to various scenarios such as cloud technology, artificial intelligence, smart transportation, assisted driving, and leisure and entertainment. In these scenarios, multimedia resources may be played, and bullet screens may be displayed on the playback interface of the multimedia resources. Bullet screen effects can be triggered during the display of bullet screens, thereby enriching the display effect of bullet screens by adding bullet screen effects.
[0040] like Figure 1 As shown, Figure 1 An application scenario architecture diagram of a bullet screen display method is shown. This diagram may include a terminal 100 and a server 200. The terminal 100 may have a multimedia playback platform installed or be accessed via a browser. Thus, multimedia viewers can access the multimedia playback platform through the terminal 100 to watch or listen to multimedia resources. The terminal 100 may include, but is not limited to, smartphones, computers, smart voice interaction devices, smart home appliances, in-vehicle terminals, and aircraft.
[0041] Server 200 can provide terminal 100 with access to multimedia resources. Server 200 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. Terminal 100 and server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited herein. For example, terminal 100 and server 200 can be connected via a network, which can be wired or wireless.
[0042] The multimedia playing object can be an object that selects a certain multimedia resource to be played to watch or listen to the multimedia resource. The multimedia playing object can be, for example, a user. The multimedia resource can be a multimedia resource triggered by a playing operation of the multimedia playing object to be played. The multimedia resource can include various types, such as a video (for example, a short video, a movie, an episode of a TV series, etc.), an audio (for example, music, an audio novel, a radio drama, etc.), and the embodiments of the present application mainly take the multimedia resource as a video for example.
[0043] When the multimedia playing object wants to play a certain multimedia resource, the multimedia playing object can perform a playing operation on the multimedia resource, and then the terminal 100 can obtain the multimedia resource from the server 200, and further play the multimedia resource through a playing interface. The playing interface can be a region on the screen of the terminal 100 where the multimedia resource is played, and the playing interface can be a small window, a full-screen window, etc.
[0044] Other multimedia playing objects that have watched or listened to the multimedia resource can publish a barrage for the multimedia resource, so that the terminal 100 can display at least one barrage of the multimedia resource in the playing interface during the playing of the multimedia resource. The barrage refers to a comment subtitle popped up when watching or listening to the multimedia resource, which can enhance the interaction between the multimedia playing objects and improve the activity of the product. The at least one barrage can be seen in the at least one barrage shown in 101. Figure 1
[0045] During the display of the at least one barrage in the playing interface, the present application further provides a barrage special effect, which can be a special effect for displaying the barrage. If it is determined that the barrage special effect is triggered, the terminal 100 can fill a target barrage in the at least one barrage into a target graphic area within a special effect duration interval. The special effect duration interval can be a time interval for displaying the barrage special effect, the target barrage can be a barrage that needs to be filled into the target graphic area, and the target graphic area can be a graphic for visual effects of the barrage special effect, such as a flower shape, a cloud shape, etc.
[0046] In the target graphic area is a flower shape as an example in Figure 1 The barrage special effect formed can be seen in 102 shown in Figure 1
[0047] The present application enriches the display effect of the barrage by adding the barrage special effect, makes the display of the barrage more interesting, improves the interactivity and interestingness of the barrage, and further improves the interactive experience of the multimedia playing object.
[0048] It should be noted that, in the embodiments of this application, the computer device may be a server or a terminal, and the method provided in the embodiments of this application may be executed by the terminal or the server alone, or by the terminal and the server in cooperation.
[0049] in, Figure 1 The corresponding embodiments are mainly described using the terminal executing the method provided in the embodiments of this application as an example. When the method provided in the embodiments of this application is executed by the server alone, its execution method is the same as... Figure 1 The corresponding implementation is similar, mainly replacing the terminal with a server.
[0050] When the terminal and server cooperate to execute the method provided in the embodiments of this application, the steps that need to be reflected on the front-end interface can be executed by the terminal. For example, playing multimedia resources through the playback interface, displaying at least one bullet screen of the multimedia resources in the playback interface, and filling the target bullet screen in the at least one bullet screen into the target graphic area; while some steps that need to be calculated in the background and do not need to be reflected on the front-end interface can be executed by the server, such as the method of determining the duration range of the special effect, the specific steps of controlling the target bullet screen to fill the target graphic area, etc.
[0051] It should be noted that in the specific implementation of this application, the entire process may involve user information and other related data. When the above embodiments of this application are applied to specific products or technologies, separate consent or permission from the user is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0052] Next, taking a computer device as the terminal as an example, the bullet screen display method provided in the embodiments of this application will be described in conjunction with the accompanying drawings. See also Figure 2 , Figure 2 A flowchart of a bullet screen display method is shown, the method comprising:
[0053] S201. Play multimedia resources through the playback interface.
[0054] When a multimedia playback object wants to play a multimedia resource, it can perform a playback operation on the resource. The terminal can then retrieve the multimedia resource from the server and play it through the playback interface. The playback interface can be the area on the terminal's screen where the multimedia resource is displayed; it can be a small window or a full-screen window, for example.
[0055] The type of the multimedia resource is not limited in the embodiments of the present application, for example, it can be a video (for example, a short video, a movie, an episode of a TV series, etc.), an audio (for example, it can be music, an audio novel, a radio drama, etc.). The embodiments of the present application mainly take the multimedia resource as a video for example, and the playing interface can be referred to as shown in Figure 3
[0056] S202, in the process of playing the multimedia resource, at least one barrage of the multimedia resource is displayed in the playing interface.
[0057] Other multimedia playing objects who have watched or listened to the multimedia resource can publish a barrage for the multimedia resource, so in the process of playing the multimedia resource, the terminal can display at least one barrage of the multimedia resource in the playing interface. The schematic diagram of displaying at least one barrage in the playing interface can be referred to as shown in Figure 4
[0058] When at least one barrage is displayed in the playing interface, the barrage can move in the playing interface according to a preset track, for example, it can appear from the left side of the playing interface and disappear from the right side, or it can appear from the right side of the playing interface and disappear from the left side, or it can appear from both sides of the playing interface and disappear in the middle, etc.
[0059] S203, in the process of displaying the at least one barrage in the playing interface, if it is determined that a barrage special effect is triggered, a target barrage in the at least one barrage is filled into a target graphic area within a special effect duration interval.
[0060] In the process of displaying at least one barrage in the playing interface, the embodiments of the present application also provide a function of displaying a barrage special effect. The barrage special effect can be obtained by pre-configuration, the configured barrage special effect can be embodied by special effect configuration information, the server can send the special effect configuration information to the terminal, and after the terminal receives the special effect configuration information, in the process of displaying at least one barrage in the playing interface, the terminal can wait for the trigger of the barrage special effect. If the terminal determines that the barrage special effect is triggered, a target barrage in the at least one barrage is filled into a target graphic area within a special effect duration interval.
[0061] The special effect duration interval can refer to a time interval of displaying the barrage special effect, the target barrage can refer to a barrage that needs to be filled into the target graphic area, and the target graphic area can refer to a graphic for embodying the visual effect of the barrage special effect. The target graphic area can be any shape, for example, it can be a flower shape, a cloud shape, etc., which is not limited in the embodiments of the present application.
[0062] It should be noted that the number of target bullet screens in the embodiments of the present application can be one or more. When the number of target bullet screens is multiple, the target bullet screens filled into the target graphic region in the special effect duration interval can be part of the target bullet screens or all of the target bullet screens. The embodiments of the present application can display the process of filling the target bullet screens into the target graphic region.
[0063] In the embodiments of the present application, if the duration corresponding to the special effect duration interval is less than or equal to the duration required for filling all target bullet screens into the target graphic region, for example, the duration corresponding to the special effect duration interval is 3 seconds, and the duration required for filling all target bullet screens into the target graphic region is 5 seconds. Then, in the special effect duration interval, the target graphic region will be filled with target bullet screens all the time. In this case, what is displayed in the special effect duration interval is the process of gradually forming the bullet screen effect in filling the target bullet screens into the target graphic region.
[0064] If the special effect duration interval is greater than the time required for filling all target bullet screens into the target graphic region, for example, the duration corresponding to the special effect duration interval is 5 seconds, and the duration required for filling all target bullet screens into the target graphic region is 3 seconds. Then, in the special effect duration interval, the target graphic region will be filled with target bullet screens first, and after all target bullet screens are filled into the target graphic region, the bullet screen effect based on all target bullet screens will continue to be displayed. In this case, what is displayed in the special effect duration interval is the process of gradually forming the bullet screen effect in filling the target bullet screens into the target graphic region, and the continuous display of the bullet screen effect based on all target bullet screens after all target bullet screens are filled into the target graphic region. For example, in the first 3 seconds of the special effect duration interval, the bullet screen effect gradually formed by continuously filling the target graphic region with target bullet screens is displayed. After all target bullet screens are filled into the target graphic region, the bullet screen effect based on all target bullet screens will continue to be displayed in the last 2 seconds.
[0065] It can be understood that in the embodiments of the present application, the bullet screen effect is only displayed in the special effect duration interval. The special effect duration interval is the time interval between the starting time point and the ending time point, that is, the bullet screen effect is obtained by filling the target bullet screens into the target graphic region when the starting time point of the special effect duration interval is reached, and the bullet screen effect disappears when the ending time point of the special effect duration interval is reached.
[0066] In the embodiments of the present application, the way of disappearing of the bullet screen effect is not limited, for example, it can be directly disappeared instantly, or it can be slowly disappeared in a specific way. The slowly disappeared in a specific way can be, for example, shrinking the bullet screen effect to disappear, shrinking and rotating the bullet screen effect to disappear, flying out, fading out, gradually disappearing from both sides of the bullet screen effect to the middle, and the like, which are not limited in the embodiments of the present application.
[0067] Taking the target graphic region as a flower shape for example, a schematic diagram of displaying the barrage effect in the playing interface can be seen from FIG. 6A, and the barrage effect can be seen from FIG. 6B. Figure 5 Figure 5
[0068] It should be noted that the filling of the target barrage into the target graphic region to obtain the barrage effect in the embodiments of the present application can be achieved by using a physical engine. The physical engine is a kind of computer software used for simulating and generating physical phenomena in the real world. It can calculate the motion, collision, deformation, fluid dynamics and other phenomena of objects, so as to present realistic physical effects in computer graphics and animation. The physical engine is widely used in electronic games, film special effects, virtual reality, robot simulation and other fields. The physical engine usually includes the following main parts:
[0069] Rigid body dynamics: simulating at least one of the motion, rotation and force condition of an object, calculating at least one parameter such as the position, velocity and acceleration of the object.
[0070] Collision detection and response: detecting the collision between objects in the scene, calculating at least one information such as the collision point and collision normal, and calculating the reaction after collision according to at least one parameter such as the mass and velocity of the object.
[0071] Soft body dynamics: simulating at least one property of an object such as deformation and elasticity, such as cloth, rubber, fluid and the like.
[0072] Constraint solving: handling at least one constraint condition such as connection, friction and spring between objects, so that the motion of the objects meets these constraints.
[0073] Optimization and stability: in order to improve the performance and stability of the physical engine, the calculation process usually needs to be optimized, such as space partitioning, collision culling and other techniques.
[0074] In the embodiments of the present application, the target barrage can be regarded as an object to be processed by the physical engine, so as to fill the target barrage into the target graphic region by using the physical engine. In a possible implementation manner, the physical engine can include but is not limited to Cocos, Unity and UE4.
[0075] It can be seen from the technical solution that when the multimedia playing object wants to play a certain multimedia resource, the multimedia resource can be played through the playing interface. Other multimedia playing objects that have watched or listened to the multimedia resource can publish a barrage for the multimedia resource, so at least one barrage of the multimedia resource can be displayed in the playing interface during playing of the multimedia resource. During display of the at least one barrage in the playing interface, the application also provides a barrage special effect. If it is determined that the barrage special effect is triggered, the target barrage in the at least one barrage can be filled into the target graphic area within a special effect duration interval. Compared with related technologies, the application enriches the display effect of the barrage by adding the barrage special effect, makes the display of the barrage more interesting, improves the interactivity and interest of the barrage, and thus improves the interactive experience of the multimedia playing object.
[0076] It should be noted that when the multimedia resource is a to-be-played video, the video content displayed in the playing interface during playing of the to-be-played video can be various, for example, can be a visual effect of a person, an animal, a plant (for example, a flower or a leaf), an article, a move or a skill. In this case, the shape of the target graphic area can be in harmony with the video content. For example, the video content displayed in the playing interface includes many flowers or petals, and the target graphic area can be in the shape of a flower.
[0077] The above manner associates the video content appearing in the playing interface with the barrage special effect, not only enriches the style of the barrage, but also has the barrage special effect in harmony with the video content, which is beneficial to the user to find a resonance point of the video content through the barrage special effect, so that the user can better experience the video content and have a more immersive experience of the barrage.
[0078] It should be noted that during filling of the target barrage into the target graphic area, the target graphic area can be displayed on the playing interface or can not be displayed on the playing interface, and the application embodiments do not limit this. When the target graphic area is displayed on the playing interface, the implementation manner of filling the target barrage in the at least one barrage into the target graphic area within the special effect duration interval can be to display the target graphic area in the playing interface within the special effect duration interval, and then fill the target barrage into the target graphic area.
[0079] Referring to Figure 6a , Figure 6a A simple schematic diagram for filling the target barrage into the target graphic area. It can be seen that Figure 6a The elements in the diagram are divided into specific content of the multimedia resource, the target graphic area and the barrage. When the multimedia resource is a to-be-played video, the specific content of the multimedia resource can be video content of the to-be-played video. When the barrage is normally displayed, if it is determined that the barrage special effect is triggered, the target barrage is filled into the target graphic area through various filling manners.
[0080] Referring to Figure 6b as shown in FIG. 6A, a target graphic region is displayed first in the effect duration interval. Then the target barrage is constantly filled into the target graphic region as shown in FIG. 7A, until all the target barrage is filled into the target graphic region, obtaining the barrage effect as shown in FIG. 5A. Figure 6b Figure 6b Figure 7 Figure 5
[0081] In this way, the multimedia playing object can intuitively perceive the forming process of the barrage effect, improving the interactivity and interest of the barrage, and further improving the interactive experience of the multimedia playing object.
[0082] It can be understood that in the process of displaying at least one barrage in the playing interface, the triggering of the barrage effect can be divided into automatic triggering and object interaction triggering. The object interaction triggering can be manually triggered based on the interactive operation of the multimedia playing object. When the triggering mode of the barrage effect is automatic triggering, the implementation mode of determining to trigger the barrage effect can be that when the multimedia resource plays to the starting time point of the barrage effect, the barrage effect is determined to be triggered. That is, when the multimedia resource plays to the starting time point, the barrage effect is automatically triggered, so that the target barrage starts to move to the target graphic region, the target barrage is filled into the target graphic region, and the barrage effect is obtained.
[0083] The starting time point can be pre-configured, for example, it can be embodied by effect configuration information. Therefore, in a possible implementation manner, the terminal can first acquire the effect configuration information, and then acquire the starting time point based on the effect configuration information. Meanwhile, since the triggering mode of the barrage effect is automatic triggering, the effect duration interval can also be pre-configured. Therefore, the effect configuration information includes the effect duration interval, and the effect duration interval is determined based on the pre-configured starting time point and ending time point. For example, the starting time point is 0:03:09, and the ending time point is 0:03:20, and the effect duration interval is the interval between 0:03:09 and 0:03:20.
[0084] The barrage effect is triggered in an automatic triggering manner, which simplifies the implementation steps of the barrage effect, and can quickly and conveniently display the barrage in the form of the barrage effect.
[0085] When the bullet screen effect is triggered by object interaction, the method to determine the triggering of the bullet screen effect can be to display a bullet screen effect prompt on the playback interface when the multimedia resource plays to the start time point of the bullet screen effect. The bullet screen effect prompt can be used to indicate that the start time point can display bullet screens in a certain way, causing the bullet screens to fill the target graphic area. After displaying the bullet screen effect prompt, it can wait for the multimedia playback object to select whether to enable the bullet screen effect. If the multimedia playback object performs a confirmation operation in response to the bullet screen effect prompt, it can be considered that the multimedia playback object agrees to enable the bullet screen effect. Therefore, the terminal can respond to the confirmation operation in response to the bullet screen effect prompt and determine the triggering of the bullet screen effect.
[0086] Triggering bullet screen effects through object interaction allows for better interaction with the multimedia playback object, making the multimedia playback object feel that the cool bullet screen effect is generated by the operation of the multimedia playback object, thus expanding the gameplay of bullet screens and improving the interactive experience.
[0087] This application does not limit the form of the bullet screen effect prompts. The bullet screen effect prompts can be in the form of text, controls, gestures, etc. When the bullet screen effect prompts are in the form of text, the confirmation operation for the bullet screen effect prompts can be a long press, tap, double tap, or other operation performed by the multimedia playback object on the terminal screen. This application does not limit this operation.
[0088] When the bullet comment effect is in the form of a control, it can be displayed on the playback interface by showing the bullet comment effect launch control. In this case, the confirmation action is a click on the bullet comment effect launch control. That is, when the start time is reached, the bullet comment effect launch control will be displayed on the playback interface. If the multimedia playback object clicks on the bullet comment effect launch control, the bullet comment effect will be triggered.
[0089] The bullet screen effect activation control can be a button, see [link / reference]. Figure 8 As shown in Figure 801, the embodiments of this application do not limit the shape of the bullet screen effect activation control. Figure 8 The 801 example is just one instance. The bullet screen effect activation control can appear anywhere on the playback screen, for example... Figure 8 Taking the example of a bullet screen effect activation control appearing on the right side of the playback interface, when the multimedia playback object clicks the bullet screen effect activation control, the bullet screen effect is triggered.
[0090] When the barrage effect prompt is in the form of a gesture, the barrage effect prompt on the playing interface can be performed by displaying a barrage effect starting gesture on the playing interface. At this time, the confirmation operation is a barrage selection operation. That is, when the starting time point is reached, the barrage effect starting gesture is displayed on the playing interface. If the multimedia playback object performs the barrage selection operation, it is determined that the barrage effect is triggered. The barrage selection operation can be an operation of selecting a target barrage filled into a target graphic region, such as an operation of long pressing the barrage, an operation of double-clicking the barrage, and the like.
[0091] The barrage effect starting gesture can be seen from the gesture pattern shown in Figure 9 The barrage effect starting gesture can appear at any position on the playing interface, and the embodiments of the present application do not limit this. When the multimedia playback object performs the barrage selection operation, it indicates that the multimedia playback object can fill the barrage selected by the barrage selection operation as a target barrage into a target graphic region, and it can be determined that the barrage effect is triggered.
[0092] The embodiments of the present application provide various interactive ways through various possible forms of barrage effect prompts, which can better interact with the multimedia playback object, expand the play of the barrage, and improve the interactive experience.
[0093] It can be understood that when the trigger mode of the barrage effect is object interaction triggering, the starting time point can be pre-configured, for example, it can be embodied by effect configuration information. Therefore, in one possible implementation, the terminal can first obtain the effect configuration information, and then obtain the starting time point based on the effect configuration information. The effect configuration information includes an initial duration interval, which is determined based on the pre-configured starting time point and ending time point. The initial duration interval is the possible duration interval of the pre-configured barrage effect. For example, the pre-configured starting time point is 0:03:09, and the ending time point is 0:03:20. The initial duration interval is the interval between 0:03:09 and 0:03:20.
[0094] However, since the trigger mode of the barrage effect is object interaction triggering, the actual effect duration interval will depend on the timing of the object interaction triggering. The timing of the object interaction triggering is the execution time point of the confirmation operation. Based on this, in one possible implementation, the determination mode of the effect duration interval can be that if the execution time point of the confirmation operation is before the ending time point, the time interval between the execution time point and the ending time point is determined as the effect duration interval. For example, the execution time point of the confirmation operation is 0:03:11, which is before 0:03:20. Therefore, the interval between 0:03:11 and 0:03:20 can be determined as the effect duration interval.
[0095] In some cases, the duration of a special effect can be fixed. For example, if the preset duration is 5 seconds, then the bullet screen effect should start when the interaction of the target object is triggered, last for 5 seconds, and then end. In this case, the duration range of the effect can be determined based on the execution time of the confirmation operation and the duration of the effect. For example, if the execution time of the confirmation operation is 0:03:11, and the duration of the effect is 5 seconds, then the interval between 0:03:11 and 0:03:16 can be determined as the duration of the effect.
[0096] Determining the duration range of special effects based on the timing of object interaction can yield a duration range that better aligns with the wishes of the multimedia playback object, thereby enhancing the object's sense of participation and interactive experience.
[0097] In this application embodiment, the determination of the target graphic region can include various methods. In one possible implementation, the target graphic region can be pre-configured, specifically through special effects configuration information, that is, the special effects configuration information can also include the target graphic region. If the multimedia resource is a video to be played, and the duration of the special effects in the video to be played includes multiple video frames, the configuration method of the target graphic region can be based on graphic configuration operations to obtain the target graphic region, that is, the operation personnel perform graphic configuration operations and perform manual configuration.
[0098] Operators can configure bullet screen effects in the management console for specific videos to be played and specific time intervals (such as the duration interval of special effects or the initial duration interval). The configured bullet screen effects can choose existing templates or upload new bullet screen effect templates, and some parameters can be modified to achieve better results.
[0099] The configuration interface used by operators in the management console can be found here. Figure 10 As shown, specific bullet screen effects can be configured, such as the target graphic area, start time, and end time. Additionally, users can choose whether to modify effect parameters. If "no" is selected, the default effect parameters are used; if "yes" is selected, the effect parameters that need modification will be displayed for operators to make adjustments. It should be noted that these effect parameters can include the position parameters of the target graphic area and the position parameters of the influence range. The influence range is used to determine the target bullet screen.
[0100] Of course, some special effect parameters are related to the filling method; different filling methods result in different special effect parameters. The filling method can also vary depending on the external force. In one possible implementation, the external force can be a force generated in the form of suction, gravity, movement, or clicking. Correspondingly, the filling method can be suction (external force is suction), falling (external force is gravity), manual movement (external force is a force generated in the form of movement or clicking), etc. This application does not limit this; various filling methods will be described in detail later. When the filling method is suction, the special effect parameters may also include suction force and the position parameters of the suction point.
[0101] It should be noted that when configuring the target graphic area through the management console, the target graphic area can be described using Scalable Vector Graphics (SVG). SVG is a vector image format based on extensible markup language (XML) used to display scalable, resolution-independent graphics on the World Wide Web. SVG can be scaled to any size without loss of quality. Furthermore, SVG images can be styled and manipulated using Cascading Style Sheets (CSS) and JavaScript. JavaScript is a scripting programming language. This SVG data can be distributed by the server and configured by operations personnel to achieve a customized display for each scenario.
[0102] In some cases, the target graphic area in a video to be played may be static or dynamic. If it is static, the configuration capabilities of the operators can be relied upon to configure different target graphic areas for different episodes. However, if the target graphic area is dynamic, then to improve configuration capabilities, artificial intelligence (AI) capabilities can be introduced to automatically identify possible target graphic areas, making the target graphic area to be filled variable.
[0103] In this scenario, the target graphic region can be determined by performing content recognition on each of the multiple video frames, obtaining a content recognition result for each frame. Then, for each video frame, based on the position of the target content indicated by the content recognition result on the playback interface, the target graphic region in the video frame is obtained, allowing the target graphic region to change according to the position of the target content.
[0104] like Figure 11 As shown, in Figure 11In the case of Fig. 1(a), the target content is a character, and the target graphic area changes with the change of the character position. At the previous moment, the character is still on the left side of the play interface, as shown in Fig. 1(a). Figure 11 At the next moment, the character moves to the right side of the play interface, as shown in Fig. 1(b). Then the target graphic area also changes with the change of the character position. Figure 11
[0105] To achieve this appeal, the data format of frame animation can be referred to, as follows:
[0106] {“startPosition”:[0.2,0.5],
[0107] “endPosition”:[0.6,0.5],
[0108] “duration”:1
[0109] }
[0110] In the above, startPosition represents the start position of the target graphic area, for example, the coordinates are (0.2, 0.5); endPosition represents the end position of the target graphic area, for example, the coordinates are (0.6, 0.5); and duration represents the special effect duration, for example, 1 second. The coordinate points of each position movement are interpolated, for example, when running to 0.5 seconds, the position of the target graphic area at this time should be (0.4, 0.5). And this start position and end position and special effect duration are automatically generated by the AI and transmitted to the terminal, and after the terminal parses, the corresponding target graphic area movement effect can be generated.
[0111] Through the automatic target graphic area of AI, the target graphic area can be accurately and quickly recognized, so as to realize the dynamic configuration of the target graphic area and generate the target graphic area movement effect.
[0112] The above introduces that the filling mode can include adsorption mode, falling mode, manual moving mode, etc. Among them, the adsorption mode and the falling mode are automatic filling modes, which can be used when the automatic trigger and the object interaction trigger are triggered. The manual moving mode is a manual filling mode, which is mainly used when the object interaction trigger is triggered. The various filling modes will be introduced in detail below.
[0113] When the filling mode is the adsorption mode, the adsorption refers to that when a piece of the bullet screen is normally displayed, due to the attraction of the adsorption force of a certain point (for example, the adsorption point), at least one of the rotation, color and movement track of the piece of the bullet screen changes. At this time, the external force is the adsorption force. In this case, the way of filling the target bullet screen in at least one bullet screen into the target graphic area can be that the target bullet screen is adsorbed into the target graphic area along the direction of the adsorption force of the adsorption point on the target bullet screen in the target graphic area, and the target bullet screen is adsorbed into the target graphic area by the adsorption force of the adsorption point. The direction of the adsorption force is the direction of the ray from the target bullet screen to the adsorption point.
[0114] Referring to Figure 12 , as shown, Figure 12 is a simple schematic diagram of the adsorption mode. It can be seen that Figure 12 the elements are divided into specific content of multimedia resources, influence range, bullet screen, adsorption point and target graphic area. When the multimedia resources are to-be-played videos, the specific content of the multimedia resources can be the video content of the to-be-played videos. Among them, the direction of the adsorption force can be seen in the arrow shown in Figure 12 ; the influence range is used to determine the target bullet screen. When the bullet screen enters the influence range, the bullet screen is determined as the target bullet screen, and then the target bullet screen starts to gather to the adsorption point under the action of the adsorption force. The target bullet screen that is adsorbed to the target graphic area will gradually stop moving to form the bullet screen special effect. The schematic diagram of filling by the adsorption mode during the playing of the multimedia resources can be seen in Figure 5 , as shown.
[0115] It should be noted that the way of adsorbing the target bullet screen into the target graphic area by the adsorption force of the adsorption point on the target bullet screen can be that the position of the target bullet screen is detected in the process of adsorbing the target bullet screen into the target graphic area by the adsorption force. If it is detected that the position of the target bullet screen is in the target graphic area, the adsorption force is stopped, at this time, the target bullet screen will not stop immediately, but there is inertial motion, until the position of the target bullet screen in the target graphic area meets the bullet screen special effect condition, the movement of the target bullet screen is controlled to stop. Among them, the position of the target bullet screen in the target graphic area meeting the bullet screen special effect condition can be that the target bullet screen coincides with other bullet screens, so as to gradually fill the target bullet screen to the entire target graphic area during the process of filling the target bullet screen into the target graphic area, avoid all target bullet screens filling into the same position of the target graphic area, and ensure the smooth implementation of the bullet screen special effect.
[0116] Based on the above introduction, the specific process of the adsorption mode for at least one bullet screen displayed on the playing interface can be seen in Figure 13 , as shown. First, it is determined whether the bullet screen special effect is triggered (see Figure 13If the determination result is that the barrage effect is triggered (see S1301), all barrages on the playing interface are detected until all barrages are detected, and if the barrage effect is not triggered, the influence area is removed (see S1302). It is determined whether there are undetected barrages on the playing interface (see S1303). If yes, a barrage is selected from the undetected barrages for detection (see S1304). The influence range detection is performed on the single barrage, and it is determined whether the position of the barrage is in the influence range (see S1305). If not, the detection process of the single barrage is ended, and the next barrage is taken. If yes, the barrage is subjected to the attraction force based on the effect configuration information (see S1306). The coordinates of the barrage are calculated and modified based on the physical engine. After the coordinates are modified, it is checked whether the position of the barrage is in the target graphic area (see S1307). If not, the detection process of the single barrage is ended. If yes, the attraction force is stopped (see S1308). At this time, the barrage does not stop immediately, and there is inertial motion. It is detected whether the barrage overlaps with other barrages (see S1309). If yes, the barrage is controlled to stop moving (see S1310). If not, the barrage continues to move with inertia until it stops, and the detection process of the single barrage is ended. After all the barrages are detected, this frame is ended, and the next frame is repeated until the configured barrage effect is completed by the attraction method. Figure 13 Figure 13 Figure 13 Figure 13 Figure 13 Figure 13 Figure 13 Figure 13 Figure 13
[0117]
[0118] Figure 14 Figure 14 Figure 14 Figure 14 As shown by the middle arrow, when the target barrage is the barrage "All Family Actors", the target barrage can fall along the arrow direction to the target graphic area.
[0119] It should be noted that when the filling of the target graphic area is achieved by an automatic filling manner (for example, a suction manner and a falling manner), the target barrage can be determined by an influence range. Specifically, in a process of displaying at least one barrage of a multimedia resource in a playing interface, a position of the at least one barrage can be detected; and barrages in the at least one barrage and located in the influence range can be determined as target barrages. By this way of automatically determining the target barrage, the operation of the multimedia playing object can be simplified, and the target barrage can be quickly determined.
[0120] When the filling manner is a manual moving manner, the manual moving refers to that when a barrage is normally displayed, the motion track of the barrage is changed due to a moving operation. At this time, the external force is the force generated by the moving operation. In this case, the way of filling the target barrage in the at least one barrage into the target graphic area can be that the target barrage is filled into the target graphic area in response to a moving operation on the target barrage. The moving operation can be an operation of changing the motion track of the target barrage so that the target barrage moves to the target graphic area, and the moving operation can be, for example, a drag operation, a sliding operation, and the like on the target barrage, which is not limited in the embodiments of the present application.
[0121] The filling of the target graphic area by the manual moving manner can control the moving of the target barrage based on the will of the multimedia playing object, better interact with the multimedia playing object, and make the multimedia playing object feel that the cool barrage effect is generated because of the operation of the multimedia playing object, expand the play of the barrage, and improve the interactive experience.
[0122] Generally, when the at least one barrage is normally displayed in the playing interface, the at least one barrage moves in the playing interface according to a preset track, that is, the motion track of the at least one barrage is the preset track. At this time, one way of filling the target barrage into the target graphic area in response to a moving operation on the target barrage can be that in a process of moving the at least one barrage in the playing interface according to the preset track, the target barrage is controlled to move to the target graphic area in response to the moving operation on the target barrage; in the process of controlling the target barrage to move to the target graphic area, a position of the target barrage is detected; and when the moving operation stops, if the position of the target barrage is in the target graphic area, the target barrage is controlled to stay at the position. When the moving operation stops, if the position of the target barrage is outside the target graphic area, the target barrage is controlled to return to an original position, and from the original position, the target barrage continues to move along the preset track. The original position is a position of the target barrage when the moving operation on the target barrage is performed.
[0123] It should be noted that when the filling of the target graphic area is realized by the manual moving manner, the target barrage can be determined through the barrage selection operation of the multimedia playing object. Specifically, the multimedia playing object can select the target barrage through the barrage selection operation, and after the multimedia playing object executes the barrage selection operation, the terminal determines the barrage corresponding to the barrage selection operation as the target barrage in response to the barrage selection operation. The barrage selection operation can be an operation of selecting the target barrage to be filled into the target graphic area, for example, a long press operation, a double-click operation, and the like, and the present application embodiments do not limit this.
[0124] Based on the barrage selection operation to determine the target barrage, the target barrage can be selected based on the will of the multimedia playing object, thereby improving the participation and interactive experience of the multimedia playing object.
[0125] Based on the foregoing introduction, when the barrage selection operation is a long press operation and the multimedia playing object is a user, the specific process of realizing the filling of the target graphic area by the manual moving manner can be that the user selects the target barrage through the long press operation, at this time, the target barrage stops moving according to the preset track, and the original position of the target barrage at this time is recorded. The target barrage moves following the moving operation of the user's finger, and the user can complete it by releasing the hand. If the target barrage is located in the target graphic area at this time, the target barrage stays at this position. If the target barrage is not in the target graphic area, the target barrage retreats to the original position and continues to move along the preset track.
[0126] It should be understood that in some cases, when the multimedia resource is played in the playing interface, some operations may occur to the multimedia playing object, such as horizontal and vertical screen switching, full-screen stretching of the multimedia resource, and the like, thereby causing the size of the playing interface to change accordingly. The position of the target graphic area can be closely related to the specific content of the multimedia resource. When the size of the playing interface changes, since the target graphic area saves the percentage relative to the size of the playing interface, the size of the target graphic area can change adaptively with the size change of the playing interface. Specifically, when the size of the playing interface changes, the terminal can regenerate the target graphic area based on the size of the changed playing interface, and the size of the regenerated target graphic area matches the size of the changed playing interface.
[0127] When the size of the playing interface changes, the target graphic area is adaptively updated, thereby avoiding the effect of the barrage special effect being damaged due to the size change of the playing interface.
[0128] Based on the detailed introduction to the bullet screen display method above, the overall process can be divided into the following steps: effect configuration, server deployment, triggering bullet screen effects, and effect display. Effect configuration includes operational configuration and AI generation. Operational configuration refers to configuration by operators in the management console, while AI generation involves automatic configuration based on AI. Triggering bullet screen effects mainly includes automatic triggering and object interaction triggering.
[0129] Taking a video to be played as an example, the overall process of displaying bullet comments can be found in [link to documentation]. Figure 15 As shown, the special effects configuration information is obtained based on operational configuration and AI generation (see...). Figure 15 As shown in S1501 (see section S1501). The terminal loads the video to be played from the server (see section S1501). Figure 15 As shown in S1502, before the video to be played, the terminal requests the server for the special effects configuration information required for the video. This configuration information may include the target graphic area and the initial duration range. Since various bullet screen effects may appear multiple times during the playback of the video, each bullet screen effect can be represented by its configuration information. The configuration information for multiple bullet screen effects can form an effect list. Therefore, the server can issue a bullet screen effect list before the video to be played (see [link to S1502]). Figure 15 (As shown in S1503). Normally, the terminal can immediately download the list of bullet screen effects upon receiving the server's response to prevent delays in displaying the screen due to download time. After obtaining the effect configuration information for various bullet screen effects, the terminal can parse the effect configuration information (see...). Figure 15 As shown in S1504, this yields the target graphic region and the initial duration interval. The initial duration interval and the target graphic region are then saved (see [reference]). Figure 15 As shown in S1505, when the playback progress hits the configured initial duration interval, the bullet screen effect may begin to appear. Since the initial duration interval can be issued not only by the server, but also triggered by object interaction (see [link to S1505]), the bullet screen effect may begin to appear. Figure 15 As shown in S1506, a time interval can also be generated. If no object interaction trigger occurs, the initial duration interval is directly used as the effect duration interval. If an object interaction trigger occurs, the effect duration interval is determined based on both the initial duration interval and the time interval generated by the object interaction trigger. Next, wait for the playback progress to match. Determine whether the playback progress of the video to be played matches the effect duration interval (see...). Figure 15 As shown in S1507), if it hits, it indicates that a barrage effect needs to be displayed. At this point, the fill method is selected (see...). Figure 15 As shown in S1508), and perform filling (see...). Figure 15 (As shown in S1509). A new cycle begins at the start of each video frame. If a match is missed, the frame loop ends.
[0130] In Figure 2 , S1501 is a special effect configuration step, S1502-S1503 is a server issuing step, S1504-S1507 is a step of triggering the bullet screen special effect, and S1508-S1509 is a step of effect display.
[0131] It should be noted that, on the basis of the implementation manners provided by the above aspects, the present application can be further combined to provide more implementation manners.
[0132] Based on Figure 16 the bullet screen display method provided by the corresponding embodiment, the present application embodiment further provides a bullet screen display device 1600. Referring to Figure 17 , the bullet screen display device 1600 includes a playing unit 1601, a display unit 1602, and a filling unit 1603.
[0133] The playing unit 1601 is configured to play a multimedia resource through a playing interface;
[0134] The display unit 1602 is configured to display at least one bullet screen of the multimedia resource in the playing interface during playing of the multimedia resource.
[0135] The filling unit 1603 is configured to, during displaying of the at least one bullet screen in the playing interface, if it is determined that a bullet screen special effect is triggered, fill a target bullet screen in the at least one bullet screen to a target graphic region within a special effect duration interval.
[0136] In a possible implementation manner, the device further includes a determination unit. The determination unit is configured to determine that the bullet screen special effect is triggered when the multimedia resource is played to a starting time point of the bullet screen special effect.
[0137] In a possible implementation manner, the device further includes an acquisition unit and an analysis unit. The acquisition unit is configured to, when the multimedia resource is played to the starting time point of the bullet screen special effect, acquire special effect configuration information before determining that the bullet screen special effect is triggered, the special effect configuration information including the special effect duration interval, the special effect duration interval being determined based on a configured starting time point and an ending time point; and the analysis unit is configured to analyze the special effect configuration information to obtain the starting time point and the special effect duration interval.
[0138] In a possible implementation manner, the device further includes a determination unit. The determination unit is configured to, when the multimedia resource is played to the starting time point of the bullet screen special effect, perform a bullet screen special effect prompt in the playing interface; and in response to a confirmation operation for the bullet screen special effect prompt, determine that the bullet screen special effect is triggered.
[0139] In a possible implementation, the apparatus further includes an obtaining unit and an analyzing unit. The obtaining unit is configured to obtain special effect configuration information, the special effect configuration information including the initial duration interval, the initial duration interval being determined based on the configured start time point and end time point; and the analyzing unit is configured to analyze the special effect configuration information to obtain the start time point and the initial duration interval.
[0140] The special effect duration interval is determined in the following manner:
[0141] If the execution time point of the confirmation operation is before the end time point, a time interval between the execution time point and the end time point is determined as the special effect duration interval; or
[0142] The special effect duration interval is determined based on the execution time point of the confirmation operation and the special effect duration.
[0143] In a possible implementation, the determining unit is configured to: prompt a bullet screen special effect on the playback interface by displaying a bullet screen special effect starting control; and the confirmation operation is a click operation on the bullet screen special effect starting control.
[0144] In a possible implementation, the determining unit is configured to: prompt a bullet screen special effect on the playback interface by displaying a bullet screen special effect starting gesture; and the confirmation operation is a bullet screen selection operation.
[0145] In a possible implementation, the filling unit 1603 is configured to: along a direction of an adsorption force of an adsorption point on the target bullet screen to the target bullet screen, adsorb the target bullet screen to the target graphic region by the adsorption force of the adsorption point on the target bullet screen, the direction of the adsorption force being a direction of a ray from the target bullet screen to the adsorption point.
[0146] In a possible implementation, the filling unit 1603 is configured to: in a process of adsorbing the target bullet screen to the target graphic region by the adsorption force, detect a position of the target bullet screen; if it is detected that the position of the target bullet screen is in the target graphic region, stop applying the adsorption force until a position of the target bullet screen in the target graphic region satisfies a bullet screen special effect condition, and control the target bullet screen to stop moving.
[0147] In a possible implementation, the filling unit 1603 is configured to: along a gravity direction of the target bullet screen, control the target bullet screen to fall to the target graphic region, the gravity direction being a vertically downward direction of the target bullet screen in the playback interface.
[0148] In a possible implementation, the device further includes a detecting unit and a determining unit. The detecting unit is configured to detect a position of the at least one scroll in a process in which the at least one scroll is displayed in the playing interface. The determining unit is configured to determine, as the target scroll, a scroll of the at least one scroll whose position is within the influence range.
[0149] In a possible implementation, the filling unit 1603 is configured to: in response to the movement operation on the target scroll, fill the target scroll into the target graphic region.
[0150] In a possible implementation, the at least one scroll moves in the playing interface according to a preset track, and the filling unit 1603 is configured to: in a process in which the at least one scroll moves in the playing interface according to the preset track, in response to the movement operation on the target scroll, control the target scroll to move to the target graphic region; in the process in which the target scroll is controlled to move to the target graphic region, detect a position of the target scroll; and if the position of the target scroll is within the target graphic region when the movement operation stops, control the target scroll to stay at the position.
[0151] In a possible implementation, the device further includes a control unit. The control unit is configured to: if the position of the target scroll is outside the target graphic region when the movement operation stops, control the target scroll to return to an original position and continue to move along the preset track from the original position, the original position being a position of the target scroll when the movement operation on the target scroll is performed.
[0152] In a possible implementation, the device further includes a determining unit. The determining unit is configured to: in response to a scroll selection operation, determine, as the target scroll, a scroll corresponding to the scroll selection operation.
[0153] In a possible implementation, the filling unit 1603 is configured to: display the target graphic region in the playing interface within the special effect duration interval; and fill the target scroll into the target graphic region.
[0154] In a possible implementation, the device further includes a generating unit. The generating unit is configured to: after filling, within a special effect duration interval, the target scroll of the at least one scroll into the target graphic region, when a size of the playing interface changes, regenerate the target graphic region based on the size of the playing interface after the change, the regenerated target graphic region having a size that matches the size of the playing interface after the change.
[0155] In a possible implementation, the special effect configuration information further comprises the target graphic region, the multimedia resource is a to-be-played video, the to-be-played video comprises a plurality of video frames in the special effect duration interval, and the configuration manner of the target graphic region comprises at least one of the following:
[0156] obtaining the target graphic region based on a graphic configuration operation;
[0157] performing content recognition on each video frame in the plurality of video frames to obtain a content recognition result corresponding to each video frame; and for each video frame, obtaining the target graphic region in the video frame based on a position of target content indicated by the content recognition result in the playing interface.
[0158] As can be seen from the above technical solutions, when a multimedia playing object wants to play a certain multimedia resource, the multimedia resource can be played through a playing interface. Other multimedia playing objects who have watched or listened to the multimedia resource can publish a barrage for the multimedia resource, so at least one barrage of the multimedia resource can be displayed in the playing interface during playing of the multimedia resource. During display of the at least one barrage in the playing interface, the present application further provides a barrage special effect, and if it is determined that the barrage special effect is triggered, a target barrage in the at least one barrage can be filled into a target graphic region in a special effect duration interval. Compared with related technologies, the present application enriches the display effect of the barrage by adding the barrage special effect, makes the display of the barrage more interesting, improves the interactivity and interestingness of the barrage, and further improves the interactive experience of the multimedia playing object.
[0159] The present application further provides a computer device which can execute the barrage display method. The computer device can be a terminal, and the terminal is taken as a smart phone as an example.
[0160] Figure 17 The diagram shows a block diagram of part of the structure of the smart phone provided by the present application. Referring to Figure 17 , the smart phone comprises radio frequency (English: Radio Frequency, English abbreviation: RF) circuit 1710, memory 1720, input unit 1730, display unit 1740, sensor 1750, audio circuit 1760, wireless fidelity (English abbreviation: WiFi) module 1770, processor 1780, and power supply 1790, and the like. The input unit 1730 can include a touch panel 1731 and other input devices 1732, the display unit 1740 can include a display panel 1741, and the audio circuit 1760 can include a loudspeaker 1761 and a microphone 1762. It can be understood that, Figure 18The structure of the smart phone shown in the figure is not intended to limit the smart phone, and can include more or fewer components than shown, or combine certain components, or arrange different components.
[0161] The memory 1720 can be used to store software programs and modules, and the processor 1780 executes various function applications and data processing of the smart phone by running the software programs and modules stored in the memory 1720. The memory 1720 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc.; and the data storage area can store data created according to the use of the smart phone (such as audio data, a phone book, etc.), etc. In addition, the memory 1720 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device.
[0162] The processor 1780 is the control center of the smart phone, connects all parts of the smart phone through various interfaces and lines, and executes various functions and processes data of the smart phone by running or executing the software programs and / or modules stored in the memory 1720 and calling the data stored in the memory 1720. Optionally, the processor 1780 can include one or more processing units; preferably, the processor 1780 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and an application program, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1780.
[0163] In the embodiment, the processor 1780 in the smart phone can execute the method for displaying a barrage provided by the embodiments of the present application.
[0164] The computer device provided by the embodiments of the present application can also be a server, please refer to Figure 18 shown, The server 1800 provided by the embodiments of the present application can have great differences due to different configurations or performances. The server 1800 can include one or more processors, such as a central processing unit (CPU) 1822, and a memory 1832, one or more storage media 1830 (such as one or more mass storage devices) storing applications 1842 or data 1844. The memory 1832 and the storage media 1830 can be temporary storage or persistent storage. The programs stored in the storage media 1830 can include one or more modules (not shown in the figure), each of which can include a series of instruction operations in the server. Further, the central processing unit 1822 can be configured to communicate with the storage media 1830 and execute the series of instruction operations in the storage media 1830 on the server 1800.
[0165] The server 1800 can also include one or more power supplies 1826, one or more wired or wireless network interfaces 1850, one or more input / output interfaces 1858, and / or one or more operating systems 1841, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
[0166] In the embodiments, the central processing unit 1822 in the server 1800 can execute the method for displaying a barrage provided by the embodiments of the present application.
[0167] According to an aspect of the present application, a computer readable storage medium is provided for storing a computer program for executing the method for displaying a barrage provided by the embodiments.
[0168] According to an aspect of the present application, a computer program product is provided, which includes a computer program stored in a computer readable storage medium. The processor of a computer device reads the computer program from the computer readable storage medium, and the processor executes the computer program to make the computer device execute the method provided in various optional implementation manners of the above embodiments.
[0169] The descriptions of the corresponding flow or structure of each of the above figures are each focused on. The parts not described in detail in a certain flow or structure can refer to the related descriptions of other flows or structures.
[0170] The terms "first", "second", "third", "fourth", and the like in the description of the application and in the claims of the foregoing application, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the use of these terms herein is to be construed to cover a generalised use of such terms to refer to similar elements independently of each other occurrence in the description and claims of this application. Furthermore, these terms can, but need not, be used for purposes of narrative and exposition, for example, to initiate discussion of certain embodiments. It is to be understood that the application(s) can be implemented in other ways, one of which is exemplified in the embodiments below. For example, the elements of the device can be divided into different groups or components than those shown or discussed, or a number of elements can be omitted, and / or additional elements can be added. Further, the disclosed system and method can be implemented in other ways, one of which is exemplified in the embodiments below. For example, the device embodiments described above are merely illustrative, and the division into units is merely a logical function division, and in actual implementation, another division manner can be used, for example, a plurality of units or components can be combined or integrated into another system, or some features can be omitted or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.
[0171] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the above-described device embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and in actual implementation, another division manner can be used, for example, a plurality of units or components can be combined or integrated into another system, or some features can be omitted or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.
[0172] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place or can be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0173] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.
[0174] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or say the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a terminal, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various computer program storage media that can store computer programs.
[0175] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined target, and can be implemented entirely or partially by using software, hardware (such as a processing circuit or a memory) or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an integral module or unit that includes the functions of the module or unit.
[0176] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements for some technical features; and these modifications or replacements do not cause the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for displaying bullet comments, characterized in that, include: Play multimedia resources through the playback interface; During the playback of the multimedia resource, at least one bullet screen of the multimedia resource is displayed on the playback interface; During the display of the at least one bullet screen, if it is determined that a bullet screen effect is triggered, then during the duration of the effect, the target bullet screen in the at least one bullet screen is controlled to move toward the target graphic area. After the target bullets move to the target graphic area, the target bullets are controlled to stay within the target graphic area.
2. The method according to claim 1, characterized in that, The method further includes: If the multimedia resource is played to the start time of the bullet screen effect, then the bullet screen effect is determined to be triggered.
3. The method according to claim 2, characterized in that, The method further includes: Obtain special effects configuration information, including the special effects duration range, which is determined based on the configured start and end time points; The special effect configuration information is parsed to obtain the start time point and the duration range of the special effect.
4. The method according to claim 1, characterized in that, The method further includes: When the multimedia resource is played to the start time of the bullet screen effect, a bullet screen effect prompt is displayed on the playback interface; In response to the confirmation operation for the bullet screen effect prompt, the bullet screen effect is determined to be triggered.
5. The method according to claim 4, characterized in that, The method further includes: Obtain special effects configuration information, including an initial duration interval, which is determined based on the configured start and end time points; The special effects configuration information is parsed to obtain the start time point and the initial duration interval; The method for determining the duration range of the special effect is as follows: if the execution time of the confirmation operation is before the end time, then the time interval between the execution time and the end time is determined as the duration range of the special effect; or, the duration range of the special effect is determined based on the execution time of the confirmation operation and the duration of the special effect.
6. The method according to claim 4, characterized in that, The provision of bullet screen effects on the playback interface includes: The playback interface displays a bullet screen effect activation control to indicate the presence of bullet screen effects; wherein, the confirmation operation includes clicking the bullet screen effect activation control; or The playback interface displays a gesture to activate the bullet screen effect, which serves as a prompt for the bullet screen effect; the confirmation operation includes a bullet screen selection operation.
7. The method according to claim 1, characterized in that, Controlling the target bullet in at least one bullet pattern to move toward the target graphic area includes: Along the direction of the adsorption force of the adsorption point on the target barrage in the target graphic region, the target barrage is adsorbed to the target graphic region by the adsorption force of the adsorption point on the target barrage, and the direction of the adsorption force is the ray direction from the target barrage to the adsorption point.
8. The method according to claim 7, characterized in that, The process of adsorbing the target bullet screen onto the target graphic area through the adsorption force of the adsorption point includes: During the process of adsorbing the target bullet screen to the target graphic area by the adsorption force, the position of the target bullet screen is detected; If the target bullet's position is detected within the target graphic area, the application of the suction force is stopped until the target bullet's position within the target graphic area meets the bullet effect conditions, at which point the target bullet stops moving.
9. The method according to claim 1, characterized in that, Controlling the target bullet in at least one bullet pattern to move toward the target graphic area includes: The target bullet is controlled to fall into the target graphic area along the direction of gravity of the target bullet, where the direction of gravity is the vertical downward direction of the target bullet in the playback interface.
10. The method according to claim 1, characterized in that, Displaying at least one bullet comment of the multimedia resource in the playback interface includes: displaying the movement process of at least one bullet comment of the multimedia resource according to a first trajectory in the playback interface; Controlling a target bullet in at least one bullet screen to move toward a target graphic area includes: controlling a target bullet in at least one bullet screen that has moved into the influence range to move toward the target graphic area according to a second trajectory.
11. The method according to claim 1, characterized in that, Controlling a target bullet in at least one bullet screen to move toward a target graphic area, and controlling the target bullet to remain within the target graphic area after it has moved there, includes: In response to a movement operation on the target bullet screen, the target bullet screen is filled into the target graphic area.
12. The method according to claim 11, characterized in that, The step of filling the target graphic area with the target bullet screen in response to a movement operation of the target bullet screen includes: During the movement of at least one bullet screen in the playback interface according to a preset trajectory, in response to the movement operation of the target bullet screen, the target bullet screen is controlled to move towards the target graphic area; During the process of controlling the target bullet screen to move towards the target graphic area, the position of the target bullet screen is detected; If the movement operation stops, and the target bullet screen is located within the target graphic area, the target bullet screen is controlled to remain at that position.
13. The method according to claim 12, characterized in that, The method further includes: If the target bullet is outside the target graphic area when the movement operation stops, the target bullet is controlled to return to its original position and continue to move along the preset trajectory from the original position. The original position is the position of the target bullet when the movement operation is performed on the target bullet.
14. The method according to claim 11, characterized in that, The method further includes: In response to the barrage selection operation, the barrage corresponding to the barrage selection operation is determined as the target barrage.
15. The method according to any one of claims 1-14, characterized in that, The method further includes: displaying the target graphic area in the playback interface during the duration of the special effect.
16. The method according to any one of claims 1-14, characterized in that, The method further includes: When the size of the playback interface changes, the target graphic area is regenerated based on the changed size of the playback interface, and the size of the regenerated target graphic area matches the size of the changed playback interface.
17. The method according to any one of claims 1-14, characterized in that, The multimedia resource is a video to be played, and the duration range of the special effects in the video to be played includes multiple video frames. The configuration of the target graphics area includes at least one of the following: The target graphic region is obtained based on the graphic configuration operation; Content recognition is performed on each of the plurality of video frames to obtain a content recognition result corresponding to each video frame; for each video frame, the target graphic region in the video frame is obtained based on the position of the target content indicated by the content recognition result on the playback interface.
18. A bullet screen display device, characterized in that, include: The playback unit is configured to play multimedia resources through a playback interface; The display unit is configured to display at least one bullet screen of the multimedia resource in the playback interface during the playback of the multimedia resource. The filling unit is configured to, during the display of the at least one bullet screen, if it is determined that a bullet screen effect is triggered, control the target bullet screen in the at least one bullet screen to move toward the target graphic area within the duration of the effect; and control the target bullet screen to remain in the target graphic area after the target bullet screen moves to the target graphic area.
19. A computer-readable medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 17.
20. A computer device, characterized in that, include: One or more processors; A memory for storing one or more computer programs that, when executed by one or more processors, cause the computer device to perform the method of any one of claims 1 to 17.
21. A computer program product, characterized in that, The computer program product includes a computer program stored in a computer-readable storage medium, wherein a processor of a computer device reads from the computer-readable storage medium and executes the computer program, causing the computer device to perform the method of any one of claims 1 to 17.