Bullet screen display method and device

By generating or adjusting barrage information in the barrage system to match video content and audience emotions, the problem of poor interactivity in the prior art is solved, and the viewing experience and immersion are improved.

CN120281985APending Publication Date: 2025-07-08SHANGHAI BILIBILI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510444933.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-09
Publication Date
2025-07-08

AI Technical Summary

Technical Problem

The existing barrage system lacks real-time response to video content and audience emotions, resulting in poor interaction and poor viewing experience.

Method used

By generating or adjusting the barrage information, it matches it with multimedia content and audience emotions, including generating or adjusting the barrage content based on the video plot and audience emotions, and displaying it in the barrage display area.

Benefits of technology

It enhances the interaction between barrage and multimedia content and the immersion of the audience, and enhances the viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120281985A_ABST
    Figure CN120281985A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a bullet screen display method and device, computer equipment, a computer readable storage medium and a computer program product, and relates to the technical field of bullet screens. The bullet screen display method comprises the steps of displaying a target playing interface; the target playing interface comprises a playing area for playing target multimedia content and a bullet screen display area; obtaining target bullet screen information of the target multimedia content, wherein the target bullet screen information is generated or adjusted according to the target multimedia content and / or the target object; and displaying the bullet screen content in the target bullet screen information in the bullet screen display area according to the target bullet screen information. According to the embodiment of the invention, the target bullet screen information is generated or adjusted through the target multimedia content and / or the target object, so that the bullet screen content can be matched with the target multimedia content or the target object at the same time, and the watching experience of a user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present application relate to the technical field of bullet screens, and in particular, to a bullet screen display method, apparatus, computer device, computer-readable storage medium, and computer program product. Background Art

[0002] During the process of browsing multimedia content, users can interact with other users by sending bullet screens. The bullet screen refers to the communication information that pops up when watching a video and moves along a predetermined direction, and users can express their thoughts on the video content through the bullet screen. However, these bullet screens only present the messages of the bullet screen senders, resulting in poor interactivity and viewing experience.

[0003] It should be noted that the above content is not necessarily prior art and is not used to limit the patent protection scope of the present application. Summary of the Invention

[0004] Embodiments of the present application provide a bullet screen display method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the above-mentioned technical problems.

[0005] One aspect of the embodiments of the present application provides a bullet screen display method for a client, and the method includes: Display a target playback interface; the target playback interface includes a playback area for playing target multimedia content and a bullet screen display area; Obtain target bullet screen information of the target multimedia content, where the target bullet screen information is generated or adjusted according to the target multimedia content and / or a target object; According to the target bullet screen information, display the bullet screen content in the target bullet screen information in the bullet screen display area.

[0006] Optionally, the operation of obtaining the target bullet screen information includes: Obtain one or more video plots in the target multimedia content, and each video plot corresponds to a video segment in the target multimedia content; According to the one or more video plots, generate corresponding bullet screen information for each video segment respectively; Wherein, the target bullet screen information is the bullet screen information corresponding to the current video segment among the multiple video segments.

[0007] Optionally, the operation of obtaining the target bullet screen information includes: Obtain the emotion information of the target object; According to the emotion information of the target object, adjust the bullet screen information to be displayed to obtain the target bullet screen information.

[0008] Optionally, the bullet screen information of the bullet screen to be displayed includes style information; adjusting the bullet screen information of the bullet screen to be displayed according to the emotion information of the target object to obtain target bullet screen information includes: Adjusting the style information according to the emotion information of the target object to obtain target bullet screen information with a target style.

[0009] Optionally, the operation of obtaining the target bullet screen information includes: Obtaining the current video plot of the current video segment in the target multimedia content; Generating bullet screen content according to the current video plot; Obtaining the current emotion information of the target object, and determining the style information of the bullet screen content according to the current emotion information; Generating the target bullet screen information according to the bullet screen content and the style information.

[0010] Optionally, the method further includes: Obtaining the current emotion of the target object and the current video plot of the current video segment in the target multimedia content; When multiple bullets to be displayed are associated with the current video segment, matching each of the bullets to be displayed with the current emotion and the current video plot; Adjusting the display order of the multiple bullets to be displayed in the bullet screen display area according to the matching result of each bullet to be displayed.

[0011] Another aspect of the embodiments of the present application provides a bullet screen display method for a server, and the method includes: Obtaining the current video plot of the current video segment in the target multimedia content; Generating bullet screen content according to the current video plot; Obtaining the current emotion information of the target object, and determining the style information of the bullet screen content according to the current emotion information; Generating the target bullet screen information according to the bullet screen content and the style information; Pushing the target bullet screen information to the client of the target object, so that the client displays the bullet screen content according to the style information.

[0012] Another aspect of the embodiments of the present application provides a bullet screen display device for a client, and the device includes: A display module, configured to display a target playback interface; the target playback interface includes a playback area for playing target multimedia content and a bullet screen display area; An acquisition module, configured to acquire target barrage information of the target multimedia content, where the target barrage information is generated or adjusted according to the target multimedia content and / or a target object; The display module is further configured to display the barrage content in the target barrage information in the barrage display area according to the target barrage information.

[0013] Another aspect of the embodiments of the present application provides a barrage display device for a server, and the device includes: An acquisition module, configured to acquire the current video plot of the current video segment in the target multimedia content; A generation module, configured to generate barrage content according to the current video plot; The acquisition module is further configured to acquire the current emotion information of the target object, and determine the style information of the barrage content according to the current emotion information; The generation module is further configured to generate the target barrage information according to the barrage content and the style information; A push module, configured to push the target barrage information to the client of the target object, so that the client displays the barrage content according to the style information.

[0014] Another aspect of the embodiments of the present application provides a computer device, including: At least one processor; and A memory communicatively connected to the at least one processor; Wherein: the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method as described above.

[0015] Another aspect of the embodiments of the present application provides a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium, and when the computer instructions are executed by a processor, the method as described above is implemented.

[0016] Another aspect of the embodiments of the present application provides a computer program product, including a computer program, and when the computer program is executed by a processor, the method as described above is implemented.

[0017] The embodiments of the present application adopting the above technical solutions may include the following advantages: Generating or adjusting target bullet screen information based on target multimedia content and / or target objects, and displaying bullet screen content in a bullet screen display area according to the target bullet screen information can enable the bullet screen content to match the target multimedia content or target objects simultaneously, thereby effectively enhancing the interactivity between the bullet screen and the target multimedia content or target objects. That is, the bullet screen content generated or adjusted according to the target bullet screen information improves the matching degree with the plot of the video content or the target object, which can enhance the viewing immersion and interactive experience, thus improving the viewing experience. Description of the Drawings

[0018] The drawings exemplarily show embodiments and form a part of the specification, and are used together with the written description of the specification to explain the exemplary embodiments of the embodiments. The shown embodiments are only for illustrative purposes and do not limit the scope of the claims. In all the drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0019] Figure 1 Schematically shows the operating environment diagram of the bullet screen display method according to Embodiment 1 of the present application; Figure 2 Schematically shows the flowchart of the bullet screen display method according to Embodiment 1 of the present application; Figure 3 Schematically shows the additional flowchart of the bullet screen display method according to Embodiment 1 of the present application; Figure 4 Schematically shows another additional flowchart of the bullet screen display method according to Embodiment 1 of the present application; Figure 5 Schematically shows yet another additional flowchart of the bullet screen display method according to Embodiment 1 of the present application; Figure 6 Schematically shows another additional flowchart of the bullet screen display method according to Embodiment 1 of the present application; Figure 7 Schematically shows the application example diagram of the bullet screen display method according to Embodiment 1 of the present application; Figure 8 Schematically shows the flowchart of the bullet screen display method according to Embodiment 2 of the present application; Figure 9 Schematically shows the block diagram of the bullet screen display device according to Embodiment 3 of the present application; Figure 10 Schematically shows the block diagram of the bullet screen display device according to Embodiment 4 of the present application; and Figure 11 Schematically shows the hardware architecture diagram of the computer device according to Embodiment 3 of the present application. Detailed Embodiments

[0020] In order to make the purpose, technical solution and advantages of the present application clearer, the following further details the present application in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts fall within the scope of protection of the present application.

[0021] It should be noted that in the embodiments of the present application, the descriptions involving "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. Additionally, the technical solutions between various embodiments can be combined with each other, but it must be based on the ability of those of ordinary skill in the art to implement. When the combination of technical solutions results in contradictions or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present application.

[0022] In the description of the present application, it should be understood that the numerical labels before the steps do not identify the order of execution of the steps, but are only used to facilitate the description of the present application and distinguish each step, and thus cannot be understood as a limitation to the present application.

[0023] First, the following provides explanations of the terms involved in the present application: Bullet screen: Refers to comments, messages or interactive content that appears in the form of sliding, scrolling or popping up in media such as videos or live broadcasts. The bullet screen can include content such as text, emojis, pictures, animations, etc.

[0024] Speech-to-text: A technology that converts speech signals into text, widely used in scenarios such as voice assistants and real-time subtitles. By analyzing speech through acoustic models and language models, high-accuracy automatic recognition is achieved.

[0025] Natural language processing: A technology that enables a computer to understand, generate and process human language, involving applications such as text analysis, machine translation, and speech recognition, and is widely used in scenarios such as intelligent assistants and search engines.

[0026] Large language model: An artificial intelligence model based on deep learning, trained with large-scale text data, and having the ability to understand, generate and process natural language.

[0027] Secondly, to facilitate the understanding of the technical solutions provided in the embodiments of the present application by those skilled in the art, the following explains the related technologies: Bullet comments have become an important way of interaction between viewers and video content. The inventor of the present application has found that the bullet comment system relies on real-time text input by users, and its presentation method is static and lacks personalization. Users can freely send text bullet comments, but these bullet comments are often irrelevant to the context of the video content and the emotions of the viewers, resulting in chaotic bullet comment content and affecting the viewing experience. At the same time, the funny, touching or tense scenes in the video and the emotional fluctuations of the viewers cannot be responded to in real time, resulting in poor interactivity of the bullet comments and unable to make full use of the bullet comments to enhance the viewers' sense of participation and immersion.

[0028] Therefore, the embodiments of the present application provide a technical solution for bullet comment display. In this technical solution, target bullet comment information is generated or adjusted based on the target multimedia content and / or the target object, and the bullet comment content is displayed in the bullet comment display area according to the target bullet comment information, so that the bullet comment content can be matched with the target multimedia content or the target object at the same time, thereby effectively improving the interactivity between the bullet comments and the target multimedia content or the target object and enhancing the user experience. See the following for details.

[0029] Finally, for the convenience of understanding, an exemplary operating environment is provided below.

[0030] As Figure 1 shown, the operating environment diagram includes: a server 2 and a client.

[0031] The server 2 can be connected to the client (4A, 4B,..., 4N) through a network.

[0032] The server 2 can provide various content and bullet comment services for the client. For example, send bullet comments to the client via the network. The network includes various network devices, such as routers, switches, multiplexers, hubs, bridges, repeaters, firewalls, proxy devices, and / or similar devices. The network can include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, and their combinations, etc. The network can include wireless links, such as cellular links, satellite links, Wi-Fi links, etc.

[0033] Among them, the server 2 can be a single server, a server cluster or a cloud computing service center for providing various services. For example: The server 2 can provide content services. Among them, the content service can be configured to provide content such as videos, audios, text data, and their combinations. The content can include content streams (such as video streams, audio streams, information streams), content files (such as video files, audio files, text files), and / or other data.

[0034] The server 2 can be configured to manage messages for various contents. Users can browse and access different contents to view comments on specific contents, such as comments posted by other users on that specific content. Comments from users associated with a specific content can be output to other users who view that specific content. For example, all users accessing a content (such as a video) can view the comments associated with that content. The input comment content can be output in real-time or near real-time.

[0035] The server 2 can be configured to receive multiple messages. The multiple messages can include multiple bullet comments associated with the content.

[0036] The server 2 can be configured to process multiple messages. For example, various processing operations such as message storage, message filtering, message pushing, etc. Among them, message storage is used to store multiple messages in a data storage system such as a database. Message filtering can include rejecting or marking messages that match the filtering criteria. Among them, the filtering criteria can specify terms and / or phrases, such as profanity, hate speech, indecent language, etc. The filtering criteria can specify characters, such as symbols, fonts, etc. The filtering criteria can specify languages, computer-readable codes, etc.

[0037] The server 2 can perform natural language processing, topic recognition, pattern recognition, artificial intelligence, etc. to automatically determine the characteristics of the messages and / or group the messages. As an example, frequently occurring phrases or patterns can be recognized as topics. As another example, a database of topics associated with the content can be maintained. Topics can include genres (such as: action, drama, comedy), personalities (such as: actors, actresses, directors), languages, etc. The messages can be further grouped based on the characteristics of the client device and / or the user sending the message. Demographics, interests, history, and / or the like can be stored for multiple users to determine potential groupings of the messages. For example, the bullet comments uploaded by individual users can be screened, filtered, sorted, and personalized pushed, etc.

[0038] The server 2 can provide a bullet comment service, which can be configured to allow users to comment on and / or share comments (i.e., bullet comments) associated with the content. The bullet comments are presented on the same screen as the content. The bullet comments can be displayed in an overlay above the content and can have animation effects. For example, the bullet comments can scroll (such as: from right to left, from left to right, from top to bottom,...), and this animation effect can be implemented based on the transition property of CSS3.

[0039] Clients (4A, 4B, …… 4N) can be configured to access the content and services of Server 2. The clients (4A, 4B, …… 4N) can include electronic devices with built-in or external display panels, such as mobile devices, tablet devices, laptop computers, workstations, virtual reality devices, gaming devices, digital streaming devices, vehicle clients, smart TVs, set-top boxes, etc., and can also include virtualized computing examples. The virtualized computing examples can include virtual machines, such as emulations of computer systems, operating systems, servers, etc.

[0040] Clients (4A, 4B, …, 4N) can be associated with one or more users. A single user can also use one or more of the clients (4A, 4B, …, 4N) to access Server 2. The clients (4A, 4B, …, 4N) can travel to various locations and use different networks to access Server 2.

[0041] Clients (4A, 4B, …… 4N) can include multiple client programs, such as video APPs, live broadcast APPs, or mini-programs with built-in bullet screen systems. In the embodiments of the present application, through the client program, content such as videos provided by Server 2 can be presented, and the bullet screen content can be presented in a specific manner through the bullet screen system.

[0042] Clients (4A, 4B, …… 4N) can include interfaces, which can include touch pads, touch screens, mice, keyboards, or other sensing elements. For example, the input elements can be configured to accept user instructions, and the user instructions can cause the clients (4A, 4B, …… 4N) to perform various operations, such as inputting bullet screens.

[0043] It should be noted that the above devices are exemplary, and in different scenarios or according to different requirements, the quantity and types of devices are adjustable.

[0044] Next, taking the client (such as 4A) as the execution entity, the technical solutions of the present application will be introduced through multiple embodiments. It should be noted that these embodiments can be implemented in various different forms and should not be construed as being limited only to the embodiments described herein.

[0045] Embodiment 1 Figure 2 A flowchart of a bullet screen display method according to Embodiment 1 of the present application is schematically shown.

[0046] As Figure 2 shown, the bullet screen display method can include steps S200~S204, where: Step S200, display a target playback interface; the target playback interface includes a playback area for playing target multimedia content and a bullet screen display area.

[0047] Step S202, obtain the target bullet screen information of the target multimedia content, where the target bullet screen information is generated or adjusted according to the target multimedia content and / or the target object.

[0048] Step S204, according to the target bullet screen information, display the bullet screen content in the target bullet screen information in the bullet screen display area.

[0049] The bullet screen display method provided in this embodiment generates or adjusts the target bullet screen information through the target multimedia content and / or the target object, and displays the bullet screen content in the bullet screen display area according to the target bullet screen information, which can make the bullet screen content match the target multimedia content or the target object at the same time, thereby effectively improving the interactivity between the bullet screen and the target multimedia content or the target object. That is, the bullet screen content generated or adjusted according to the target bullet screen information improves the matching degree with the plot of the video content or the target object, which can enhance the viewing immersion and interactive experience, thereby improving the viewing experience.

[0050] The following combines Figure 2 , and elaborates on each step in steps S200 to S204 and other optional steps in detail.

[0051] Step S200 , display the target playback interface; the target playback interface includes a playback area for playing the target multimedia content and a bullet screen display area.

[0052] The target playback interface can be an area on the device screen for displaying content (such as text, pictures, videos, etc.). The target playback interface can be used to play various types of multimedia content, including but not limited to videos, animations, live streams, recorded broadcast content, etc. The target playback interface can be applicable to various playback applications, such as online video platforms, live broadcast platforms, short video applications, etc.

[0053] The target playback interface includes at least a playback area and a bullet screen display area. The playback area is used to play the target multimedia content, that is, the video, animation or other multimedia resources watched by the user. The playback area can be in full-screen mode, window mode, or embedded in other application interfaces for display. The playback area can be adaptively adjusted according to the screen size, resolution, and type of playback device (such as smartphones, tablets, TVs, computers). The bullet screen display area can overlap with the playback area (that is, the bullet screen covers the video content), or can be set separately outside the playback area, such as in the upper and lower or side areas of the playback area. The style of the bullet screen display area can be adjusted according to user preferences or platform settings, such as adjusting transparency, font size, color, scrolling method, etc.

[0054] Step S202 , obtain the target bullet screen information of the target multimedia content, where the target bullet screen information is generated or adjusted according to the target multimedia content and / or the target object.

[0055] The target multimedia content may be associated with a bullet screen pool, which can be continuously updated. In this embodiment, the bullet screen pool may store the bullet screens posted by users when watching the target multimedia content, the bullet screens automatically generated by the system according to the target multimedia content, or the bullet screens generated by the target object (user). The target bullet screen information may be stored in a structure or other form. The target bullet screen information may include the bullet screen content (such as text), bullet screen speed, pop-up time, etc. of the target bullet screen. The target bullet screen may be selected from the bullet screen pool. Among them, the screening criteria may include user level, bullet screen type, blocked words, release time, etc. More specifically, the target bullet screen information may include information such as the timestamp, type, text size, color, creation time, user identification, bullet screen identification, bullet screen content, duration, border information, line style, etc. of the bullet screen.

[0056] The target bullet screen information may be generated or adjusted based on the picture information, audio information, subtitle information, etc. of the target multimedia content. Exemplarily, the target bullet screen information may be automatically generated or adjusted based on a scene with specific features in the picture information of the target multimedia content (such as a scene of intense battle, a horror or funny scene, etc.), so that the target bullet screen information is more in line with the target multimedia content. In addition, the target bullet screen information may also be generated or adjusted according to specific characters, scenes, items, etc. in the target multimedia content. For example, when a specific character appears, the target bullet screen information related to the character may be automatically generated, or specific bullet screens may be pushed in a specific scene.

[0057] The target object may be a user who is watching the target multimedia content. The target object may also be used to generate or adjust the target bullet screen information. Exemplarily, when the target object is a user who is watching the target multimedia content, with the user's authorization, the push or display style of the target bullet screen information may be adjusted based on the user's mood, historical viewing records, interaction behaviors (such as liking, commenting), etc. when watching the target multimedia content. For example, when the user shows an excited mood, more humorous target bullet screen information may be pushed, and when the user is immersed in a tense or intense scene, the target bullet screen information may be more concise or adjusted to an emphasized text style (such as bold, enlarged font, etc.) to ensure the synchronization of the target bullet screen information with the user's mood, thereby improving the interactivity and viewing experience.

[0058] Step S204 According to the target bullet screen information, display the bullet screen content in the bullet screen display area.

[0059] The information such as the bullet screen content, timestamp, and display style included in the target bullet screen information can be used to guide the specific presentation method of the bullet screen in the bullet screen display area. Specifically, according to the target bullet screen information, specific bullet screen content can be rendered and displayed in the bullet screen display area according to a predetermined rule. The bullet screen content can be text, picture, control, or other visual elements. According to the setting of the target bullet screen information, the display method of the bullet screen content can be adjusted. For example, based on the timestamp of the target bullet screen information, the bullet screen content is adjusted so that the bullet screen content can enter the bullet screen display area at a specified time point and disappear after being displayed for a set duration. The display form of the bullet screen content can also be optimized based on the display style in the target bullet screen information. For example, the font size, color, transparency, border style, etc. of the bullet screen content can be adjusted according to the target bullet screen information to adapt to different playback scenarios or user emotions. In this embodiment, using the target bullet screen information generated or adjusted based on the target multimedia content and / or the target object as the basis for displaying the bullet screen content can make the display of the bullet screen content coordinated with the target multimedia content or user emotions, enhance interaction, and thus improve the user's viewing experience.

[0060] The operations for obtaining the target bullet screen information will be further introduced by way of more embodiments below.

[0061] In an alternative embodiment, as Figure 3 shown, the operations for obtaining the target bullet screen information include: Step S300, obtain one or more video plots in the target multimedia content, and each video plot corresponds to a video segment in the target multimedia content.

[0062] A video plot can be a specific video segment in the target multimedia content, and the video segment can be divided according to various factors such as the content characteristics, story development, and scene switching of the target multimedia content. In some embodiments, the division method of the video plot can be based on the subtitle information of the target multimedia content, the speech-to-text (ASR) result, combined with natural language processing (NLP) to analyze the keywords in the segment, extract the core content and perform scene division. It can also be based on computer vision technology, by identifying features such as scene changes, appearance and disappearance of specific characters or objects, and color changes in the picture, to automatically detect and divide video plots. In this embodiment, by obtaining the video plots in the target multimedia content and determining the video segments corresponding to each video plot, the generation of the bullet screen information can be optimized for specific plots, improving the relevance and adaptability of the bullet screen content to the target multimedia content.

[0063] Step S302, generate corresponding bullet screen information for each of the video segments according to the one or more video plots. Among them, the target bullet screen information is the bullet screen information corresponding to the current video segment among the multiple video segments.

[0064] In some embodiments, high-quality barrage content can be extracted from video segments with similar plots based on the historical barrage library as the barrage information recommendation source for the current video segment. For example, in a suspense drama, if a certain plot twist is similar to the plot of another classic detective drama, high-quality barrage information such as "The foreshadowing recovery is so wonderful!" and "The screenwriter is so good at laying clues!" can be extracted from the historical barrage library and recommended to the current video segment to enhance the user discussion atmosphere. In addition, barrage information related to the plot can be automatically generated based on large language models (LLMs) or artificial intelligence natural language processing technologies, thereby enhancing the user's immersion and engagement. For example, if the current video plot is identified as a horror atmosphere, barrage content such as "So scary, please take me in" and "The screen is too dark, I'm too scared to watch" can be automatically generated to enhance the sense of tension and resonance. In a comedy atmosphere, barrages indicating the humor of the plot such as "This part is killing me, the screenwriter understands the punchlines!" and "This facial expression management has been completely abandoned, hahaha" can be generated to make the viewing experience more vivid and interesting.

[0065] In this embodiment, generating corresponding barrage information based on the video plot can improve the matching degree between the video plot and the barrage information, enabling the barrage content to more accurately reflect the core content of the video. The barrage display for each video segment is more targeted, avoiding the chaos of barrage information, thereby enhancing the user's viewing experience.

[0066] In an alternative embodiment, as Figure 4 shown, the operation of obtaining the target barrage information may further include: Step S400, obtaining the emotional information of the target object.

[0067] The emotional information of the target object can characterize the emotional state of the user when watching the target multimedia content, such as excitement, pleasure, sadness, tension, or surprise. By obtaining the emotional information of the target object, the target barrage information can be dynamically adjusted to make the barrage content more in line with the user's psychological expectations and viewing experience. In some embodiments, the emotional information can be judged by obtaining the user's facial expression information or the user's audio information. Specifically, the user's facial expression can be obtained through the camera of the device currently used by the user, and then the user's current emotional state can be analyzed through facial expression recognition technology in combination with a computer vision model. The voice data of the user when watching the target multimedia content, such as laughter, exclamation, sigh, scream, etc., can be collected through the microphone of the device currently used by the user, and the user's emotional state can be judged in combination with voice emotion analysis technology. For example, when it is detected that the user frequently emits laughter or has a high-pitched tone, it can be judged that the user is in a pleasant or excited state. When it is detected that the user sighs or has a slow speech rhythm, it can be judged that the user may be in a low or tired state.

[0068] It should be noted that the acquisition of the user's facial expression information or the user's audio information both originate from the collection methods explicitly authorized by the user, and strictly comply with the privacy protection regulations and the compliance requirements of the platform. For example, the expression information can be collected through the camera authorized by the user, and the audio information can be recorded through the microphone permitted by the user. In addition, security measures such as de-identification, data encryption, and access control can be adopted to ensure the privacy security of user information during storage, transmission, and use, so as to prevent unauthorized access and abuse.

[0069] Step S402: Adjust the barrage information to be displayed according to the emotion information of the target object to obtain target barrage information.

[0070] After obtaining the emotion information of the target object, the barrage information to be displayed can be adjusted according to the emotion information, so that the target barrage information is adapted to the user's current emotional state. The adjustment methods of the barrage information can include adjusting the display timestamp of the barrage content, adjusting the barrage style, optimizing the display mode of the barrage, etc. Exemplarily, the barrage content that matches the user's current emotion can be preferentially displayed. For example, when the user is in a happy state, the barrages with humor, teasing, or positive evaluations are preferentially displayed, while when the user is in a sad state, the barrages with a sense of resonance or comfort can be preferentially displayed. The style of the barrage, such as its color, size, and transparency, can also be dynamically adjusted according to the user's emotion. In addition, the display density and scrolling speed of the barrage can be adjusted according to the emotion information. For example, when the user's emotion is relatively excited, the density of the barrage can be increased and the scrolling speed can be accelerated to enhance the interactivity, while when the user's emotion is relatively low or focused, the number of barrages can be reduced and the scrolling speed can be decreased to make the viewing experience more comfortable.

[0071] In this embodiment, the barrage information is adjusted through the emotion information of the target object, so that the target barrage information better meets the user's current viewing needs and emotional state. In this way, not only the personalized experience of the barrage is improved, but also the emotional resonance between the user and the target multimedia content is enhanced, thereby improving the immersion and interactivity of the viewing.

[0072] In an alternative embodiment, the barrage information to be displayed includes style information, and step S402 includes: Adjust the style information according to the emotion information of the target object to obtain target barrage information with a target style.

[0073] The style information may include the visual, animation, and layout styles of the barrage content during display, specifically including the font, color, size, transparency, movement trajectory, special effects (such as fade, blink, rotate), layout method (such as centered, randomly distributed, ballistic limit), etc. of the barrage. Adjusting the style information according to the emotional information of the target object can make the barrage content more in line with the user's emotional state, thereby improving the user's immersion and interactive experience.

[0074] Exemplarily, when the emotional information of the target object indicates that the user is in an excited state, the barrage color can be adjusted to brighter colors with higher saturation (such as red, yellow), the font size can be increased, and the dynamic effects of the barrage can be increased (such as jumping, fluctuating). When the emotional information of the target object indicates that the user is in a low or calm state, a softer color scheme (such as blue, purple) can be adopted, and the dynamic special effects can be reduced to make the barrage style more in line with the user's viewing atmosphere.

[0075] In this embodiment, adjusting the barrage style according to the emotional information of the target object can enhance the personalization degree of the barrage display, and further improve the viewing experience and interactive interest.

[0076] In an alternative embodiment, as Figure 5 shown, the operation of obtaining the target barrage information also combines the content and the user's emotion, specifically as follows: Step S500, obtain the current video plot of the current video segment in the target multimedia content.

[0077] Step S502, generate barrage content according to the current video plot.

[0078] Step S504, obtain the current emotional information of the target object, and determine the style information of the barrage content according to the current emotional information.

[0079] Step S506, generate the target barrage information according to the barrage content and the style information.

[0080] In specific implementation, the current video plot can be determined by analyzing the target multimedia content. Specifically, computer vision technology can be used to identify the scene, character, or key event in the current video segment. For example, in a movie or TV drama segment, it can be identified whether the current plot is an action scene, an emotional dialogue scene, or a funny segment, so as to generate barrage content that conforms to the plot. When obtaining the current emotional information of the target object, it can be judged based on the user's facial expression recognition, speech emotion analysis, or viewing behavior data (such as barrage interaction, like, pause watching, etc.). For example, if the user shows a surprised expression during viewing, it can be judged that the user's emotion tends to be excited, and the style information of the barrage can be adjusted accordingly to generate the target barrage information.

[0081] In this embodiment, the target barrage information is generated and adjusted by integrating the current video plot and the user's emotional information, so that the display effect of the barrage matches the video content and the user's emotions, further enhancing the interactivity and interestingness of the barrage, thereby improving the user's viewing experience. In addition, when there are a large number of barrages to be displayed, they can also be adjusted in a certain order, such as in the following embodiments.

[0082] In an alternative embodiment, as Figure 6 shown, the method further includes: Step S600, obtaining the current emotion of the target object and the current video plot of the current video segment in the target multimedia content.

[0083] Step S602, when multiple barrages to be displayed are associated with the current video segment, matching each of the barrages to be displayed with the current emotion and the current video plot.

[0084] Step S604, adjusting the display order of the multiple barrages to be displayed in the barrage display area according to the matching result of each barrage to be displayed.

[0085] In specific implementation, all the barrage contents to be displayed can be extracted from the current video segment, and the barrage contents to be displayed are matched with the current emotion of the target object and the current video plot of the current video segment in the target multimedia content. The matching result can be calculated based on multiple algorithm models, such as sentiment analysis models, natural language processing, image sentiment analysis models, etc. After calculating the matching result, the display order of the barrages in the barrage display area is adjusted according to the matching result of each barrage. Specifically, the barrages with a high matching degree with the current emotion and video plot can be preferentially displayed. For example, if a certain barrage highly matches the emotion of a tense chase scene, this barrage can be arranged in a relatively front position to ensure that the audience can obtain a more fitting interactive experience when watching.

[0086] In this embodiment, by adjusting the barrage display order by combining the current emotion and the current video plot, the immersion of the user when watching multimedia content can be further enhanced, making the display of the barrage more closely connected to the video content and the emotional state of the target object, and enhancing the interactivity and resonance between the user and the content.

[0087] To make the present application easier to understand, the following Figure 7 provides an exemplary application.

[0088] S11, analyzing the video emotion according to the video data.

[0089] S12, generating barrage content based on the video emotion.

[0090] S13. Obtain the current facial data or voice data of the user who is watching the video data.

[0091] S14. Analyze the current emotional information of the user based on the facial data or voice data.

[0092] S15. Adjust the bullet screen display style according to the current emotional information of the user.

[0093] S16. Display the adjusted bullet screen information based on the bullet screen style adjustment information.

[0094] In this exemplary application, generating and adjusting the bullet screen information through video emotions and / or user emotions, and displaying the bullet screen content in the bullet screen display area according to the bullet screen information can make the bullet screen content match the target multimedia content or target object at the same time. The matching degree between the generated or adjusted bullet screen content and the plot of the video content or the user's emotions is improved, which can enhance the user's immersion and interactive experience, thereby improving the user's viewing experience.

[0095] Embodiment 2 This method embodiment can be executed in the server 2. Here, the server 2 is taken as the single execution subject of this process. It should be noted that the technical details and effects in Embodiment 2 can be referred to, introduced, and combined with the content in Embodiment 1.

[0096] Figure 8 Schematically shows a flowchart of the bullet screen display method according to Embodiment 2 of the present application.

[0097] As Figure 8 shown, the live broadcast reservation mounting method may include steps S800 to S808, where: Step S800. Obtain the current video plot of the current video segment in the target multimedia content; Step S802. Generate bullet screen content according to the current video plot; Step S804. Obtain the current emotional information of the target object, and determine the style information of the bullet screen content according to the current emotional information; Step S806. Generate the target bullet screen information according to the bullet screen content and the style information; Step S808. Push the target bullet screen information to the client of the target object, so that the client displays the bullet screen content according to the style information.

[0098] In specific implementation, the server 2 can first extract the currently playing video segment from the target multimedia content and analyze the plot information of each video segment through video analysis technology. According to the type and development of the plot, etc., the server 2 can label the video segment as a specific plot, such as an intense fight scene, a relaxed conversation scene, or a touching farewell scene, etc. Further, the display style of the barrage is adjusted by collecting the real-time emotion information of the target object. For example, by analyzing the facial expression, voice data or interaction behavior of the target object, the current emotion state of the target object (such as excitement, tension, sadness, etc.) can be inferred, and then according to the current emotion of the target object, the style information of the barrage is determined. For example, the text color, font of the barrage, the appearance timing of the barrage, etc. After determining the display style information of the current barrage, the server 2 combines the barrage content and the style information to generate the final target barrage information.

[0099] In this embodiment, matching barrage content is generated according to the plot characteristics of the current video segment, and the style information of the barrage is adjusted in combination with the real-time emotion of the user, so that the barrage not only fits the video content, but also reflects the user's viewing experience. The matching degree between the barrage content generated or adjusted according to the target barrage information and the plot of the video content or the user's emotion is improved, which can enhance the user's immersion and interactive experience, thereby improving the user's viewing experience.

[0100] Embodiment III Figure 9 The block diagram of the barrage display device according to Embodiment III of the present application is schematically shown. The device can be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiments of the present application. The program modules referred to in the embodiments of the present application refer to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. As Figure 9 shown, the device 1000 may include: a display module 1010, an acquisition module 1020, where: The display module 1010 is used to display a target playback interface; the target playback interface includes a playback area for playing target multimedia content and a barrage display area; The acquisition module 1020 is used to acquire the target barrage information of the target multimedia content, and the target barrage information is generated or adjusted according to the target multimedia content and / or the target object; The display module 1010 is further used to display the barrage content in the target barrage information in the barrage display area according to the target barrage information.

[0101] In an alternative embodiment, the operation of obtaining the target barrage information includes: Obtain one or more video episodes in the target multimedia content, where each video episode corresponds to a video segment in the target multimedia content; Generate corresponding bullet screen information for each of the video segments according to the one or more video episodes; Wherein, the target bullet screen information is the bullet screen information corresponding to the current video segment among the multiple video segments.

[0102] In an alternative embodiment, the operation of obtaining the target bullet screen information includes: Obtain the emotion information of the target object; Adjust the bullet screen information of the bullet screen to be displayed according to the emotion information of the target object to obtain the target bullet screen information.

[0103] In an alternative embodiment, the bullet screen information of the bullet screen to be displayed includes style information; adjusting the bullet screen information of the bullet screen to be displayed according to the emotion information of the target object to obtain the target bullet screen information includes: Adjust the style information according to the emotion information of the target object to obtain the target bullet screen information with the target style.

[0104] In an alternative embodiment, the operation of obtaining the target bullet screen information includes: Obtain the current video episode of the current video segment in the target multimedia content; Generate bullet screen content according to the current video episode; Obtain the current emotion information of the target object, and determine the style information of the bullet screen content according to the current emotion information; Generate the target bullet screen information according to the bullet screen content and the style information.

[0105] In an alternative embodiment, the apparatus 1000 is further configured to: Obtain the current emotion of the target object and the current video episode of the current video segment in the target multimedia content; In the case where multiple bullet screens to be displayed are associated with the current video segment, match each of the bullet screens to be displayed with the current emotion and the current video episode; Adjust the display order of the multiple bullet screens to be displayed in the bullet screen display area according to the matching result of each bullet screen to be displayed.

[0106] Embodiment Four Figure 10A block diagram of a bullet screen display device according to Embodiment 4 of the present application is schematically shown. The device can be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiments of the present application. The program modules referred to in the embodiments of the present application refer to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. As Figure 10 shown, the device 2000 may include: an acquisition module 2010, a generation module 2020, and a push module 2030, where: The acquisition module 2010 is configured to acquire the current video plot of the current video segment in the target multimedia content; The generation module 2020 is configured to generate bullet screen content according to the current video plot; The acquisition module 2010 is further configured to acquire the current emotion information of the target object and determine the style information of the bullet screen content according to the current emotion information; The generation module 2020 is further configured to generate the target bullet screen information according to the bullet screen content and the style information; The push module 2030 is configured to push the target bullet screen information to the client of the target object, so that the client displays the bullet screen content according to the style information.

[0107] Embodiment 5 Figure 11 A hardware architecture diagram of a computer device 10000 suitable for implementing the bullet screen display method according to Embodiment 5 of the present application is schematically shown. In some embodiments, the computer device 10000 may be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle-mounted terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server or a server cluster composed of multiple servers). As Figure 11 shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other through a system bus. Where: The memory 10010 includes at least one type of computer-readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disc, etc. In some embodiments, the memory 10010 may be an internal storage module of the computer device 10000, such as the hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 may also be an external storage device of the computer device 10000, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, Flash Card, etc. equipped on the computer device 10000. Of course, the memory 10010 may also include both the internal storage module and the external storage device of the computer device 10000. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed on the computer device 10000, such as the program code of the bullet screen display method. In addition, the memory 10010 may also be used to temporarily store various types of data that have been output or will be output.

[0108] In some embodiments, the processor 10020 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other chip. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data.

[0109] The network interface 10030 may include a wireless network interface or a wired network interface, which is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an enterprise intranet (Intranet), the Internet, the Global System of Mobile communication (GSM for short), Wideband Code Division Multiple Access (WCDMA for short), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0110] It should be noted that Figure 11 Only the computer device with components 10010 - 10030 is shown, but it should be understood that it is not required to implement all the shown components, and more or fewer components may be implemented alternatively.

[0111] In this embodiment, the bullet screen display method stored in the memory 10010 may also be divided into one or more program modules and executed by one or more processors (such as the processor 10020) to complete the embodiments of the present application.

[0112] Embodiment Six The embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the bullet screen display method in the embodiments are implemented.

[0113] In this embodiment, the computer-readable storage medium includes flash memory, hard disks, multimedia cards, card-type memories (e.g., SD or DX memories, etc.), random access memories (RAM), static random access memories (SRAM), read-only memories (ROM), electrically erasable programmable read-only memories (EEPROM), programmable read-only memories (PROM), magnetic memories, magnetic disks, optical discs, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc., equipped on the computer device. Of course, the computer-readable storage medium may also include both the internal storage unit and the external storage device of the computer device. In this embodiment, the computer-readable storage medium is generally used to store the operating system installed on the computer device and various application software, such as the program code of the bullet screen display method in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various data that have been output or are to be output.

[0114] Embodiment VII The embodiment of the present application further provides a computer program product, including a computer program, which when executed by a processor implements the method in the above embodiment.

[0115] Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the embodiments of the present application can be implemented by a general computer device. They can be concentrated on a single computer device or distributed on a network composed of multiple computer devices. Optionally, they can be implemented by program codes executable by the computer device. Thus, they can be stored in a storage device and executed by the computer device. And in some cases, the steps shown or described can be executed in a different order from here, or they can be separately fabricated into individual integrated circuit modules, or multiple modules or steps among them can be fabricated into a single integrated circuit module to implement. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0116] It should be noted that the above are only the preferred embodiments of the present application, and do not limit the patent protection scope of the present application. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present application.

Claims

1. A bullet screen display method, characterized in that, For a client, the method includes: Displaying a target playback interface; the target playback interface includes a playback area for playing target multimedia content and a bullet screen display area; Obtaining target bullet screen information of the target multimedia content, where the target bullet screen information is generated or adjusted according to the target multimedia content and / or a target object; According to the target bullet screen information, displaying bullet screen content in the bullet screen display area.

2. The method according to claim 1, wherein The operation of obtaining the target bullet screen information includes: Obtaining one or more video plots in the target multimedia content, and each video plot corresponds to a video segment in the target multimedia content; According to the one or more video plots, respectively generating corresponding bullet screen information for each video segment; Wherein, the target bullet screen information is the bullet screen information corresponding to the current video segment among multiple video segments.

3. The method according to claim 1, wherein The operation of obtaining the target bullet screen information includes: Obtaining the emotion information of the target object; According to the emotion information of the target object, adjusting the bullet screen information of the bullet screen to be displayed to obtain the target bullet screen information.

4. The method according to claim 3, wherein The bullet screen information of the bullet screen to be displayed includes style information; according to the emotion information of the target object, adjusting the bullet screen information of the bullet screen to be displayed to obtain the target bullet screen information includes: According to the emotion information of the target object, adjusting the style information to obtain the target bullet screen information with a target style.

5. The method according to claim 1, characterized in that The operation of obtaining the target bullet screen information includes: Obtaining the current video plot of the current video segment in the target multimedia content; Generating bullet screen content according to the current video plot; Obtaining the current emotion information of the target object, and determining the style information of the bullet screen content according to the current emotion information; Generating the target bullet screen information according to the bullet screen content and the style information.

6. The method according to any one of claims 1 to 4, characterized in that, The method further includes: Obtaining the current emotion of the target object and the current video plot of the current video segment in the target multimedia content; In the case where multiple bullets screens to be displayed are associated with the current video segment, matching each bullet screen to be displayed with the current emotion and the current video plot; According to the matching result of each bullet screen to be displayed, adjusting the display order of the multiple bullets screens to be displayed in the bullet screen display area.

7. A bullet screen display method, characterized in that For a server, the method includes: Obtaining the current video plot of the current video segment in the target multimedia content; Generating bullet screen content according to the current video plot; Obtaining the current emotion information of the target object, and determining the style information of the bullet screen content according to the current emotion information; Generating the target bullet screen information according to the bullet screen content and the style information; Pushing the target bullet screen information to the client of the target object, so that the client displays the bullet screen content according to the style information.

8. A bullet screen display device, characterized in that, For a client, the device includes: A display module for displaying a target playback interface; the target playback interface includes a playback area for playing target multimedia content and a bullet screen display area; An acquisition module, configured to acquire target barrage information of the target multimedia content, where the target barrage information is generated or adjusted according to the target multimedia content and / or a target object; The display module is further configured to display the barrage content in the target barrage information in the barrage display area according to the target barrage information.

9. A bullet screen display device, characterized in that, For a server, the apparatus includes: An acquisition module, configured to acquire a current video plot of a current video segment in the target multimedia content; A generation module, configured to generate barrage content according to the current video plot; The acquisition module is further configured to acquire current emotion information of the target object, and determine style information of the barrage content according to the current emotion information; The generation module is further configured to generate the target barrage information according to the barrage content and the style information; A push module, configured to push the target barrage information to a client of the target object, so that the client displays the barrage content according to the style information.

10. A computer device, characterized in that, Includes: At least one processor; And A memory communicatively connected to the at least one processor; wherein: The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method according to any one of claims 1 to 7.

11. A computer-readable storage medium, characterized in that, Computer instructions are stored in the computer-readable storage medium, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

12. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, the steps of the method according to claims 1 to 7 are implemented.