Popup window display method and device

Abstract

The embodiment of the invention provides a pop-up window display method, and the method comprises the steps: playing a target video, and enabling the target video to be associated with a target keyword in a preset playing time period; obtaining a target bullet screen of the target video, wherein the launching time of the target bullet screen is within the preset playing time period; and under the condition that a preset condition is met between the target bullet screen and the target keyword, displaying a target popup window corresponding to the target keyword. According to the technical scheme, when the bullet screen is related to the keyword of the video in the preset time period, the pop-up window corresponding to the keyword can be displayed. Therefore, the interactivity between the video and the bullet screen can be improved, so that the interactive experience of the user and the enthusiasm of sending the bullet screen are improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a pop-up display method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the rapid development of video technology, more and more users can watch various video programs through the Internet. In the process of watching video programs, users can interact with anchors or other users by sending bullet comments. Bullet comments allow users to comment or think, but unlike ordinary video sharing websites that only display comments in the dedicated comment area under the player, they will appear in real time on the video screen in the form of sliding subtitles to ensure that all viewers can notice them.

[0003] The existing barrage exists only as a kind of commentary information flow, lacks deep integration with user interaction and has poor interactivity.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the invention

[0005] The embodiments of the present application provide a pop-up display method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.

[0006] One aspect of an embodiment of the present application provides a pop-up window display method for a user terminal, the method comprising: Playing a target video, wherein the target video is associated with a target keyword during a preset playback time period; Obtain a target bullet screen of the target video, where the emission time of the target bullet screen is within the preset playback time period; When a preset condition is satisfied between the target bullet screen and the target keyword, a target pop-up window corresponding to the target keyword is displayed.

[0007] Optionally, the preset play time period and the target keyword are associated through the following operations: Acquire multiple text contents of the target video, each of which corresponds to a different playback time period; Filtering target text content including the target keyword from multiple text contents; The playing time period of the target text content is determined as the preset playing time period associated with the target keyword.

[0008] Optionally, the preset play time period and the target keyword are associated through the following operations: Acquire multiple key elements of the target video, wherein the key elements include visual elements and auditory elements, and each of the key elements corresponds to a different playback time period; Determine the target keyword according to a target element, wherein the target element is any one of the multiple key elements; The play time period of the target element is determined to be the preset play time period associated with the target keyword.

[0009] Optionally, the preset condition includes a target keyword matching degree; When the target bullet screen and the target keyword meet a preset condition, displaying a target pop-up window corresponding to the target keyword includes: Matching the target bullet screen with the target keyword to obtain a target matching degree; When the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is displayed.

[0010] Optionally, there are multiple target bullet comments; Matching the target bullet screen with the target keyword to obtain a target matching degree includes: Acquire a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens; Matching the bullet screen keyword with the target keyword to obtain the target matching degree; Among them, when the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is triggered and displayed.

[0011] Optionally, there are multiple barrage keywords; Matching the bullet screen keyword with the target keyword to obtain the target matching degree includes: Obtain the number of occurrences of each of the bullet screen keywords; Determining a target barrage keyword from the plurality of barrage keywords according to the number of occurrences of each barrage keyword; The target bullet screen keyword is matched with the target keyword to obtain the target matching degree.

[0012] Optionally, the target keywords include character keywords, plot keywords and / or music keywords, and the target pop-up window includes a character pop-up window, a plot pop-up window and / or a music pop-up window.

[0013] Another aspect of an embodiment of the present application provides a pop-up window display method for a server, the method comprising: Obtain a target bullet screen of a target video, wherein the target video is associated with a target keyword in a preset playback time period, and the emission time of the target bullet screen is within the preset playback time period; When the target bullet screen and the target keyword meet a preset condition, a target pop-up window file corresponding to the target keyword is generated; The target pop-up window file is sent to the user terminal so that the user terminal displays the target pop-up window corresponding to the target keyword according to the target pop-up window file.

[0014] Optionally, the preset condition includes a target keyword matching degree; When the target bullet screen and the target keyword meet a preset condition, generating a target pop-up window file corresponding to the target keyword includes: Matching the target bullet screen with the target keyword to obtain a target matching degree; When the target matching degree reaches a preset threshold, a target pop-up window file corresponding to the target keyword is generated.

[0015] Optionally, there are multiple target bullet comments; Matching the target bullet screen with the target keyword to obtain a target matching degree includes: Acquire a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens; Matching the bullet screen keyword with the target keyword to obtain the target matching degree; Among them, when the target matching degree reaches a preset threshold, the target pop-up file corresponding to the target keyword is triggered to be generated.

[0016] Another aspect of an embodiment of the present application provides a pop-up window display device, the device comprising: A playback module, used to play a target video, wherein the target video is associated with a target keyword during a preset playback time period; An acquisition module, used to acquire a target bullet screen of the target video, wherein the emission time of the target bullet screen is within the preset playback time period; A display module is used to display a target pop-up window corresponding to the target keyword when a preset condition is met between the target bullet screen and the target keyword.

[0017] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0018] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0019] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the method described above when executed by a processor.

[0020] The embodiment of the present application adopts the above technical solution to have the following advantages: when the bullet screen is related to the keyword in the preset time period of the video, the pop-up window corresponding to the keyword is displayed. In this way, the interactivity between the video and the bullet screen can be improved, thereby improving the interactive experience of the user and the enthusiasm for sending bullet screens. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0021] Figure 1 The following schematically shows an operating environment diagram of the pop-up window display method according to the first embodiment of the present application; Figure 2 The flowchart of the pop-up window display method according to the first embodiment of the present application is schematically shown; Figure 3 The following schematically shows a newly added flow chart of the pop-up window display method according to the first embodiment of the present application; Figure 4 Another newly added flow chart of the pop-up window display method according to the first embodiment of the present application is schematically shown; Figure 5 Schematically shows Figure 2 Flow chart of sub-steps of step S204; Figure 6 Schematically shows Figure 5 Flow chart of sub-steps of step S500; Figure 7 Schematically shows Figure 6 Flow chart of sub-steps of step S602; Figure 8 The following schematically shows the effect of implementing a target pop-up window according to the pop-up window display method of the first embodiment of the present application; Fig. 9 The flowchart of the pop-up window display method according to the second embodiment of the present application is schematically shown; Fig.10 Schematically shows Fig. 9 Flow chart of sub-steps of step S902; Fig.11 Schematically shows Fig.10 Flow chart of sub-steps of step S1000; Fig.12 The following schematically shows an exemplary application flow chart of the pop-up window display method according to an embodiment of the present application; Fig.13 A block diagram of a pop-up window display device according to Embodiment 3 of the present application is schematically shown; Fig.14 A block diagram schematically shows a pop-up window display device according to Embodiment 4 of the present application; and Fig.15 The hardware architecture diagram of the computer device according to the fifth embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0023] It should be noted that the descriptions involving "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0024] In the description of the present application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed, but are only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as a limitation on the present application.

[0025] First, the following terms are explained: Danmu: refers to the subtitles, pictures, etc. that pop up and move in a predetermined direction when watching a video on the Internet. It is a form of communication information. There is no fixed word for Danmu in English. It is usually called: comment, danmaku, barrage, bullet screen, bullet-screen comment, etc.

[0026] Pop-up: A user interface element that appears on the user's screen in the form of a small window to provide information, prompts, advertisements, or interactions.

[0027] Visual elements: They are the basic components of video content, acting on the audience's visual perception to convey information, emotions and stories, such as images and pictures, texts and graphics, characters and objects, etc.

[0028] Auditory elements: refers to the components that convey information and emotions through sound in addition to visual images, such as dialogue, narration, sound effects or music.

[0029] Clustering: It is an unsupervised learning algorithm that aims to divide the samples in the data set into several groups or "clusters" so that the samples within the same cluster are more similar, while the samples between different clusters are less similar.

[0030] TF-IDF: Term Frequency-Inverse Document Frequency, is a weighted technique used in information retrieval and text mining, which reflects the importance of a word to a document set or one of the documents in a corpus.

[0031] BERT: Bidirectional Encoder Representations from Transformers, is a method for pre-training language representation. It is based on the Transformer architecture and learns deep bidirectional text representation by pre-training with a large amount of text data.

[0032] DeepSpeech: is an open source embedded speech recognition engine developed by Mozilla that enables offline, real-time speech-to-text conversion.

[0033] Convolutional Neural Networks: Convolutional Neural Networks, referred to as CNN, is a deep learning model used to process data with grid-like topological structures, such as images.

[0034] Faster R-CNN: It is an object detection algorithm in deep learning, proposed by Shaoqing Ren et al. of Microsoft Research in 2015. It is an improved version of the R-CNN series of algorithms, which solves some performance bottleneck problems in R-CNN and its subsequent version (Fast R-CNN).

[0035] Speech emotion recognition model: It is an artificial intelligence technology that understands the emotional information contained in human speech signals by analyzing them.

[0036] LLM: Large Language Model is an artificial intelligence model based on deep learning, which is specially designed to understand and generate human language. LLM learns the structure, grammar and semantics of language by training on a large amount of text data, so that it can perform a wide range of natural language processing (NLP) tasks, including text summarization, translation, sentiment analysis, etc.

[0037] NLP: Natural Language Processing, a branch of artificial intelligence and linguistics, is dedicated to studying how to enable computers to understand, interpret and generate content in human language.

[0038] Secondly, in order to facilitate those skilled in the art to understand the technical solutions provided in the embodiments of the present application, the relevant technologies are described below: The inventors found that barrage only exists as a comment chat and cannot be dynamically associated with video content, resulting in its lack of intelligence and personalization, and failing to provide users with rich real-time information or interactive content. At the same time, users can only see static, single barrage information, and cannot obtain detailed information about video characters, plots, background music, etc. from the barrage. Traditional video players are also unable to adjust the barrage display according to the user's viewing behavior, barrage content, and video plot, and provide a personalized experience that meets the user's interests and needs. It is even more impossible to dynamically generate targeted interactive pop-ups based on real-time barrage or video plots, affecting the user's immersive experience and the interactive effect of the video.

[0039] To this end, the embodiment of the present application provides a pop-up window display technology solution. In this technical solution, (1) by combining video content and real-time bullet screen information, pop-ups can be intelligently generated to provide more interactive options and enhance user participation; (2) users can not only obtain real-time plot information, but also gain in-depth understanding of character background, music and other detailed information by clicking on the pop-up window, greatly enhancing the user's immersive experience; (3) the pop-up window content can be dynamically adjusted according to the keywords that frequently appear in the bullet screen, providing users with a more personalized interactive experience; (4) the pop-up window display can be dynamically adjusted according to the user's interactive behavior to form a smooth user experience. See below for details.

[0040] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0041] like Figure 1 As shown, the operating environment diagram includes: server 2 and user end.

[0042] The server 2 can be connected to the client terminals ( 4A, 4B, ..., 4N) via a network.

[0043] The server 2 can provide various content and bullet screen services for the user terminal. For example, the video and bullet screen are sent to the user terminal via the network. The network includes various network devices, such as routers, switches, multiplexers, hubs, bridges, repeaters, firewalls, proxy devices and / or similar devices. The network may include physical links, such as coaxial cable links, twisted pair cable links, optical fiber links and combinations thereof. The network may include wireless links, such as cellular links, satellite links, Wi-Fi links, etc.

[0044] The server 2 may be a single server, a server cluster or a cloud computing service center, which is used to provide various services. For example: The server 2 may provide content services. The content services may be configured to provide content such as video, audio, text data, and combinations thereof. The content may include content streams (e.g., video streams, audio streams, information streams), content files (e.g., video files, audio files, text files), and / or other data.

[0045] The server 2 may be configured to receive a plurality of messages. The plurality of messages may include a plurality of bullet comments associated with the content.

[0046] Server 2 may provide a bullet screen service, which may be configured to allow users to comment and / or share comments (i.e. bullet screens) associated with the content. The bullet screens are presented on the same screen together with the content. The bullet screens may be displayed in an overlay above the content and may have animation effects. For example, the bullet screens may scroll (e.g., from right to left, from left to right, from top to bottom, ...), and the animation effect may be implemented based on the transition property of CSS3.

[0047] The server 2 may also provide a pop-up window service, which may be configured to generate and send a pop-up window file to the user terminal (4A, 4B, ... 4N) so that the user terminal (4A, 4B, ... 4N) can display a corresponding pop-up window. The pop-up window may be used to display information and provide interactive functions.

[0048] The client (4A, 4B, ... 4N) may be configured to access the content and services of the server 2. The client (4A, 4B, ... 4N) may include an electronic device carrying or connected to a display panel, such as a mobile device, a tablet device, a laptop computer, a workstation, a virtual reality device, a gaming device, a digital streaming device, a vehicle client, a smart TV, a set-top box, etc., and may also include a virtualized computing instance. The virtualized computing instance may include a virtual machine, such as an emulation of a computer system, an operating system, a server, etc.

[0049] The user terminals (4A, 4B, ... 4N) may include multiple user terminal programs, such as a video APP with a built-in bullet screen system, a live broadcast APP or a mini program, etc. In the embodiment of the present application, the video, bullet screen, pop-up window and other contents provided by the server 2 may be presented through the user terminal program.

[0050] The user terminal (4A, 4B, ... 4N) may include an interface, which may include a touch pad, a touch screen, a mouse, a keyboard or other sensing elements. For example, the input element may be configured to receive user instructions, and the user instructions may enable the user terminal (4A, 4B, ... 4N) to perform various operations, such as inputting bullet screens, and various triggering actions for bullet windows.

[0051] It should be noted that the above devices are exemplary, and the number and type of devices are adjustable in different scenarios or according to different needs.

[0052] The following describes the technical solution of the present application through multiple embodiments, taking the user terminal 4A or the server 2 as the execution subject. It should be noted that these embodiments can be implemented in a variety of different forms and should not be interpreted as being limited to the embodiments described here.

[0053] Embodiment 1 This method embodiment can be executed in the user terminal 4A.

[0054] Figure 2 The flowchart of the pop-up window display method according to the first embodiment of the present application is schematically shown.

[0055] like Figure 2 As shown, the pop-up window display method may include steps S200 to S206, wherein: Step S200, playing a target video, wherein the target video is associated with a target keyword in a preset playing time period.

[0056] Step S202, obtaining a target bullet screen of the target video, wherein the emission time of the target bullet screen is within the preset playback time period.

[0057] Step S204, when the target bullet screen and the target keyword meet a preset condition, display a target pop-up window corresponding to the target keyword.

[0058] The pop-up window display method provided in this embodiment displays a pop-up window corresponding to a keyword when the bullet screen is related to a keyword in a preset time period of the video. Thus, the interactivity between the video and the bullet screen can be improved, thereby improving the user's interactive experience and the enthusiasm for sending bullet screens.

[0059] The following combination Figure 2 , each step in steps S200~S204 and other optional steps are described in detail.

[0060] Step S200 , play a target video, wherein the target video is associated with a target keyword during a preset play time period.

[0061] In a specific implementation, the target video may be a video of various types, such as a documentary, cartoon, movie, news report, etc. The target video is associated with a bullet screen, and there may be various types of bullet screens, such as ordinary text bullet screens or picture bullet screens.

[0062] It should be noted that, according to actual conditions, the same preset playback time period may be associated with one target keyword or multiple different target keywords, which is not limited here.

[0063] In this embodiment, by adding corresponding keywords to specific time periods of the video, the characteristics of the video in each time period can be accurately described. The audience is stimulated to actively participate in the barrage communication through specific keywords or plots in the video, which enhances the audience's interactive enthusiasm and sense of participation. This interactive experience not only makes the audience feel more fun, but also may make them more willing to share these videos on social media, thereby expanding the influence and appeal of the video.

[0064] In an optional embodiment, if Figure 3 As shown, the preset play time period and the target keyword are associated through the following operations: S300, obtaining multiple text contents of the target video, each of which corresponds to a different playback time period.

[0065] S302: Filter out target text content including the target keyword from multiple text contents.

[0066] S304: Determine the playback time period of the target text content as the preset playback time period associated with the target keyword.

[0067] In specific implementation, the text content can be the subtitles of the target video. It can also be obtained by converting the target video speech into text using models such as DeepSpeech and Wav2Vec 2.0. Depending on the actual situation, the text content can also be obtained by other methods.

[0068] In some embodiments, the target keyword is one of the preset multiple keywords. In other embodiments, important information can be extracted from the text content by using TF-IDF or BERT to obtain a new keyword that is not in the preset multiple keywords, and the new keyword is used as the target keyword.

[0069] In this embodiment, associating the preset playback time period with the text content containing specific keywords can enhance the relevance of the video content with these keywords, thereby achieving more accurate pop-up display and improving the user's viewing experience.

[0070] In an optional embodiment, if Figure 4 As shown, the preset play time period and the target keyword are associated through the following operations: S400, obtaining multiple key elements of the target video, wherein the key elements include visual elements and auditory elements, and each of the key elements corresponds to a different playback time period.

[0071] S402: Determine the target keyword according to a target element, where the target element is any one of the multiple key elements.

[0072] S404: Determine the play time period of the target element as the preset play time period associated with the target keyword.

[0073] In some embodiments, the visual elements may be scenes, characters, plots, etc. in the video, and the auditory elements may be lines, voices, background music, etc. in the video. In other embodiments, the visual elements and auditory elements may also be other content in the video.

[0074] In specific implementation, convolutional neural networks (CNNs) such as ResNet and EfficientNet can be used to classify video frames. Objects and people in the picture can also be detected through deep learning models (such as YOLO and Faster R-CNN), and faces can be recognized through models such as FaceNet and DeepFace, and matched with known databases to determine specific people or roles. At the same time, the speaker's identity can also be identified through models such as X-Vector and ECAPA-TDNN, and the emotions in the voice can be analyzed based on speech emotion recognition models (such as HCRNN). Depending on the actual situation, the key elements can also be determined from the video in other ways.

[0075] In this embodiment, the associated target keywords are determined based on key elements such as the current video scene, characters, and plot information. Thus, a pop-up window can be intelligently generated by combining the video content, providing more interactive options and enhancing the user's sense of participation.

[0076] Step S202 , obtain the target barrage of the target video, and the emission time of the target barrage is within the preset playback time period.

[0077] In this embodiment, the bullet comments launched within the preset playback time period are used as the target bullet comments that may trigger the pop-up window, which can ensure the relevance of the target bullet comments to the real-time video content. At the same time, as the video playback progresses, the corresponding bullet comments are analyzed in real time, so that users can not only obtain real-time plot information, but also deeply understand the detailed information such as the character background and music by clicking on the pop-up window, which greatly enhances the user's immersive experience.

[0078] Step S204 When the preset conditions are met between the target bullet screen and the target keyword, a target pop-up window corresponding to the target keyword is displayed.

[0079] In some embodiments, the target pop-up window can be configured to display information related to the target keyword. In other embodiments, the target pop-up window can also be configured to have interactive functions, such as buttons.

[0080] It should be noted that one or more target pop-up windows can be displayed at the same time, and the number of target pop-up windows is not limited here.

[0081] In this embodiment, the corresponding target pop-up window is determined according to the content of the target bullet screen. Thus, by combining the video content and real-time bullet screen information, a pop-up window can be intelligently generated to provide more interactive options and enhance the user's sense of participation. At the same time, the pop-up window content can be dynamically adjusted according to the keywords that frequently appear in the bullet screen, providing users with a more personalized interactive experience.

[0082] In an optional embodiment, if Figure 5 As shown, the preset condition includes the target keyword matching degree; step S204 includes: S500, matching the target bullet screen with the target keyword to obtain a target matching degree.

[0083] S502: When the target matching degree reaches a preset threshold, display the target pop-up window corresponding to the target keyword.

[0084] In some embodiments, the matching degree between the candidate bullet comments and the target keywords can be evaluated by training a specific model (such as LLM, NLP, etc.). In other embodiments, a third-party dedicated or general large language model can also be called to obtain the matching degree. According to actual needs, other feasible methods can also be used to obtain the matching degree.

[0085] In this embodiment, whether to display the pop-up window corresponding to the target keyword is determined according to the matching degree between the target bullet screen and the target keyword. When the user sends or sees the target bullet screen that meets the matching degree threshold with the target keyword, the target pop-up window can be displayed accordingly. In this way, the relevance between the information contained in the pop-up window and the bullet screen sent by the user can be improved, thereby improving the user interaction experience and the transmission efficiency of the pop-up window information.

[0086] In an optional embodiment, if Figure 6 As shown, there are multiple target bullet comments, and step S500 includes: S600, obtaining a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens.

[0087] S602, matching the bullet screen keyword with the target keyword to obtain the target matching degree; wherein, when the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is triggered for display.

[0088] In specific implementation, tools such as K-Means, DBSCAN or BERT-based Sentence Embedding can be used to perform semantic clustering on the target bullet comments to obtain bullet comment keywords. Other methods can also be used to obtain bullet comment keywords according to actual needs.

[0089] It should be noted that, if the target matching degree does not reach the preset threshold, a pop-up window can be generated and displayed based on the bullet-screen keywords to deal with more unknown questions or keywords. At this time, if the multiple keywords preset in the database do not include the bullet-screen keywords, information related to the bullet-screen keywords can be queried through various search interfaces, and a pop-up window can be generated and displayed based on the queried relevant information.

[0090] In this embodiment, keywords with high correlation are clustered based on multiple target bullet comments. Thus, the pop-up window content can be dynamically adjusted based on the keywords that frequently appear in the bullet comments, thereby ensuring that the content displayed in the pop-up window is what the user who sent the bullet comment needs, providing users with a more personalized interactive experience.

[0091] In an optional embodiment, if Figure 7 As shown, there are multiple bullet screen keywords, and step S602 includes: S700, obtaining the number of occurrences of each of the bullet screen keywords.

[0092] S702, determining a target barrage keyword from the multiple barrage keywords according to the number of occurrences of each barrage keyword.

[0093] S704, matching the target bullet screen keyword with the target keyword to obtain the target matching degree.

[0094] According to actual needs, in addition to determining the target bullet-screen keyword from multiple bullet-screen keywords according to the number of occurrences of the bullet-screen keyword, the target bullet-screen keyword can also be determined according to the preset priority of the bullet-screen keyword. Other feasible methods besides these can also be used to determine the target bullet-screen keyword.

[0095] It should be noted that, according to the actual situation, it can also be set to display multiple target pop-up windows at the same time in the same playback time period. At this time, the corresponding pop-up windows can be displayed separately according to multiple barrage keywords.

[0096] In this embodiment, a pop-up window is generated based on the most frequently appearing bullet-screen keywords. Thus, the relevance between the pop-up window content and the target bullet-screen can be improved, ensuring that the content displayed in the pop-up window can meet the needs of most users, improving the interactivity of the video and bullet-screen, and the user experience.

[0097] In an optional embodiment, the target keywords include character keywords, plot keywords and / or music keywords, and the target pop-up window includes a character pop-up window, a plot pop-up window and / or a music pop-up window.

[0098] In specific implementation, the character pop-up window corresponds to the character keyword and can be configured to display relevant information of a certain character, such as background introduction, avatar icon, etc. The plot pop-up window corresponds to the plot keyword and can be configured to display detailed information or background information of a certain plot, etc. The music pop-up window corresponds to the music keyword and can be configured to display relevant information such as the background music of the video, etc.

[0099] According to actual needs, the target keywords may include other keywords besides the above keywords, such as object keywords, terminology keywords, etc. The corresponding target pop-up window may also include other pop-up windows.

[0100] In some embodiments, after determining the type of the target keyword, the template file for generating the pop-up window can be determined by the corresponding pop-up window type, and the target pop-up window can be finally generated and displayed according to the relevant information of the queried target keyword. In other embodiments, other methods can also be used to generate or display the target pop-up window.

[0101] It should be noted that in addition to displaying information, the target pop-up window can also be configured with interactive functions, and the pop-up window display can be dynamically adjusted according to the user's interactive behavior to form a smooth user experience. For example, a button for opening or closing the pop-up window, a button or link for viewing more detailed information, etc., is configured, so that the user can click on the pop-up window to view detailed information, jump to a related page, or control video playback (such as jumping to a specific time point). The implementation effect of the target pop-up window of this embodiment is as follows: Figure 8 shown.

[0102] Embodiment 2 This method embodiment may be executed in the server 2. The specific execution details of the pop-up window display method in this embodiment may refer to, be introduced into, or be combined with the first embodiment.

[0103] Fig. 9 The flowchart of the pop-up window display method according to the second embodiment of the present application is schematically shown. Fig. 9 As shown, the pop-up window display method may include steps S900 to S904, wherein: S900, obtaining a target barrage of a target video, wherein the target video is associated with a target keyword in a preset playback time period, and the emission time of the target barrage is within the preset playback time period.

[0104] S902, when the target bullet screen and the target keyword meet a preset condition, generate a target pop-up window file corresponding to the target keyword.

[0105] S904: Send the target pop-up window file to the user terminal, so that the user terminal displays the target pop-up window corresponding to the target keyword according to the target pop-up window file.

[0106] The pop-up window display method provided in this embodiment generates a pop-up window file corresponding to the keyword and sends it to the user end when the bullet screen is related to the keyword in the preset time period of the video, so that the user end can display the corresponding pop-up window. In this way, the interactivity between the video and the bullet screen can be improved, thereby improving the interactive experience of the user and the enthusiasm for sending bullet screens.

[0107] In an optional embodiment, the preset condition includes a target keyword matching degree, such as Fig.10 As shown, step S902 includes: S1000, matching the target bullet screen with the target keyword to obtain a target matching degree.

[0108] S1002, when the target matching degree reaches a preset threshold, generating a target pop-up file corresponding to the target keyword.

[0109] In some embodiments, the matching degree between the candidate bullet comments and the target keywords can be evaluated by training a specific model (such as LLM, NLP, etc.). In other embodiments, a third-party dedicated or general large language model can also be called to obtain the matching degree. According to actual needs, other feasible methods can also be used to obtain the matching degree.

[0110] In this embodiment, whether to generate a pop-up window file corresponding to the target keyword is determined according to the matching degree between the target bullet screen and the target keyword. Thus, the relevance between the information contained in the pop-up window and the bullet screen sent by the user can be improved, thereby improving the user interaction experience and the transmission efficiency of the pop-up window information.

[0111] In an optional embodiment, the target bullet screen has multiple items, such as Fig.11 As shown, step S1000 includes: S1100, acquiring a bullet comment keyword according to the contents of the plurality of target bullet comments, wherein the bullet comment keyword is a clustered keyword based on the plurality of target bullet comments; S1102, matching the bullet screen keyword with the target keyword to obtain the target matching degree; wherein, when the target matching degree reaches a preset threshold, the target pop-up window file corresponding to the target keyword is triggered to be generated.

[0112] In specific implementation, tools such as K-Means, DBSCAN or BERT-based Sentence Embedding can be used to perform semantic clustering on the target bullet comments to obtain bullet comment keywords. Other methods can also be used to obtain bullet comment keywords according to actual needs.

[0113] It should be noted that, if the target matching degree does not reach the preset threshold, a pop-up window file can also be generated based on the bullet-screen keywords to deal with more unknown questions or keywords. At this time, if the multiple keywords preset in the database do not include the bullet-screen keywords, various search interfaces and other methods can be used to query information related to the bullet-screen keywords, and a pop-up window file can be generated based on the relevant information queried.

[0114] In this embodiment, keywords with high correlation are clustered based on multiple target bullet comments. Thus, the pop-up window content can be dynamically adjusted based on the keywords that frequently appear in the bullet comments, thereby ensuring that the content displayed in the pop-up window is what the user who sent the bullet comment needs, providing users with a more personalized interactive experience.

[0115] In order to make this application easier to understand, the following Fig.12 An exemplary application is provided. S11, playing animation video A (ie, target video).

[0116] S12, play to 1 minute, and obtain 30 bullet comments (i.e., target bullet comments) between 1 minute and 1 minute 30 seconds.

[0117] S13, cluster and extract the target keyword "background music" from these 30 comments.

[0118] S14, a music pop-up window is displayed, wherein the content is the relevant information of the background music of the animation video A between 1 minute and 1 minute 30 seconds, and there is a "Learn More" button in the pop-up window, and the audience can jump to the web page introducing the background music after clicking the button.

[0119] S15, played to 11 minutes, and obtained 14 bullet comments between 11 minutes and 11 minutes 45 seconds.

[0120] S16, clustering and extracting the keywords "character C" and "object M" from these 14 bullet comments, among which "character C" is mentioned 14 times and "object M" is mentioned 10 times.

[0121] S17, displaying a character pop-up window, wherein the content is the relevant information of "character C", including the avatar, identity information and background story of "character C".

[0122] Embodiment 3 Fig.13 The block diagram of the pop-up display device according to the third embodiment of the present application is schematically shown. The device can be divided into one or more program modules for the user end. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig.13 As shown, the device 1000 may include: a playing module 1100, an acquisition module 1200, and a display module 1300, wherein: A playback module 1100 is used to play a target video, wherein the target video is associated with a target keyword in a preset playback time period; An acquisition module 1200 is used to acquire a target bullet screen of the target video, where the emission time of the target bullet screen is within the preset playback time period; The display module 1300 is used to display a target pop-up window corresponding to the target keyword when a preset condition is satisfied between the target bullet screen and the target keyword.

[0123] In an optional embodiment, the apparatus 1000 further includes an association module, configured to: Keywords are associated through the following operations: Acquire multiple text contents of the target video, each of which corresponds to a different playback time period; Filtering target text content including the target keyword from multiple text contents; The playing time period of the target text content is determined as the preset playing time period associated with the target keyword.

[0124] In an optional embodiment, the association module is further used for: Acquire multiple key elements of the target video, wherein the key elements include visual elements and auditory elements, and each of the key elements corresponds to a different playback time period; Determine the target keyword according to a target element, wherein the target element is any one of the multiple key elements; The play time period of the target element is determined to be the preset play time period associated with the target keyword.

[0125] In an optional embodiment, the preset condition includes a target keyword matching degree, and the display module 1300 is used to: Matching the target bullet screen with the target keyword to obtain a target matching degree; When the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is displayed.

[0126] In an optional embodiment, there are multiple target bullet comments, and the display module 1300 is used to: Acquire a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens; Matching the bullet screen keyword with the target keyword to obtain the target matching degree; Among them, when the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is triggered and displayed.

[0127] In an optional embodiment, there are multiple bullet screen keywords, and the display module 1300 is used to Obtain the number of occurrences of each of the bullet screen keywords; Determining a target barrage keyword from the plurality of barrage keywords according to the number of occurrences of each barrage keyword; The target bullet screen keyword is matched with the target keyword to obtain the target matching degree.

[0128] In an optional embodiment, the target keywords include character keywords, plot keywords and / or music keywords, and the target pop-up window includes a character pop-up window, a plot pop-up window and / or a music pop-up window.

[0129] Embodiment 4 Fig.14 The block diagram of the pop-up display device according to the fourth embodiment of the present application is schematically shown, which is used for a server. The device can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig.14 As shown, the device 2000 may include: an acquisition module 2100, a generation module 2200, and a sending module 2300, wherein: An acquisition module 2100 is used to acquire a target bullet screen of a target video, wherein the target video is associated with a target keyword in a preset playback time period, and the emission time of the target bullet screen is within the preset playback time period; A generating module 2200 is used to generate a target pop-up window file corresponding to the target keyword when the target bullet screen and the target keyword meet a preset condition; The sending module 2300 is used to send the target pop-up window file to the user terminal, so that the user terminal displays the target pop-up window corresponding to the target keyword according to the target pop-up window file.

[0130] As an optional embodiment, the preset condition includes a target keyword matching degree, and the generating module 2200 is further used for: Matching the target bullet screen with the target keyword to obtain a target matching degree; When the target matching degree reaches a preset threshold, a target pop-up window file corresponding to the target keyword is generated.

[0131] As an optional embodiment, there are multiple target bullet comments, and the generating module 2200 is further used to: Acquire a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens; Matching the bullet screen keyword with the target keyword to obtain the target matching degree; Among them, when the target matching degree reaches a preset threshold, the target pop-up file corresponding to the target keyword is triggered to be generated.

[0132] Embodiment 5 Fig.15The hardware architecture diagram of a computer device 10000 suitable for implementing a pop-up window display method according to the fifth embodiment of the present application is schematically shown. In some embodiments, the computer device 10000 may be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle-mounted terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Fig.15 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other through a system bus. Among them: The memory 10010 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 10010 can be an internal storage module of the computer device 10000, such as a hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 can also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 10010 can also include both the internal storage module of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed in the computer device 10000, such as the program code of the pop-up window display method, etc. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0133] In some embodiments, the processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data.

[0134] The network interface 10030 may include a wireless network interface or a wired network interface, and the network interface 10030 is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0135] It should be pointed out that Fig.15 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.

[0136] In this embodiment, the pop-up display method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0137] Embodiment 6 An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the pop-up display method in the embodiment are implemented.

[0138] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of a computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device. Of course, the computer-readable storage medium may also include both an internal storage unit of a computer device and an external storage device thereof. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on a computer device, such as the program code of the pop-up window display method in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.

[0139] Embodiment 7 An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0140] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented by general-purpose computer devices, they can be concentrated on a single computer device, or distributed on a network composed of multiple computer devices, optionally, they can be implemented by executable program codes of computer devices, so that they can be stored in a storage device and executed by the computer device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0141] It should be noted that the above are only preferred embodiments of the present application, and the patent protection scope of the present application is not limited thereto. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A pop-up window display method, characterized in that: For a user terminal, the method includes: Playing a target video, wherein the target video is associated with a target keyword during a preset playback time period; Obtain a target bullet screen of the target video, where the emission time of the target bullet screen is within the preset playback time period; When a preset condition is satisfied between the target bullet screen and the target keyword, a target pop-up window corresponding to the target keyword is displayed.

2. The method according to claim 1, characterized in that The preset play time period and the target keyword are associated through the following operations: Acquire multiple text contents of the target video, each of which corresponds to a different playback time period; Filtering target text content including the target keyword from multiple text contents; The playing time period of the target text content is determined as the preset playing time period associated with the target keyword.

3. The method according to claim 1, characterized in that The preset play time period and the target keyword are associated through the following operations: Acquire multiple key elements of the target video, wherein the key elements include visual elements and auditory elements, and each of the key elements corresponds to a different playback time period; Determine the target keyword according to a target element, wherein the target element is any one of the multiple key elements; The play time period of the target element is determined to be the preset play time period associated with the target keyword.

4. The method according to any one of claims 1 to 3, characterized in that: The preset conditions include target keyword matching degree; When the target bullet screen and the target keyword meet a preset condition, displaying a target pop-up window corresponding to the target keyword includes: Matching the target bullet screen with the target keyword to obtain a target matching degree; When the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is displayed.

5. The method according to claim 4, characterized in that There are multiple target bullet comments; Matching the target bullet screen with the target keyword to obtain a target matching degree includes: Acquire a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens; Matching the bullet screen keyword with the target keyword to obtain the target matching degree; Among them, when the target matching degree reaches a preset threshold, the target pop-up window corresponding to the target keyword is triggered and displayed.

6. The method according to claim 5, characterized in that There are multiple barrage keywords; Matching the bullet screen keyword with the target keyword to obtain the target matching degree includes: Obtain the number of occurrences of each of the bullet screen keywords; Determining a target barrage keyword from the plurality of barrage keywords according to the number of occurrences of each barrage keyword; The target bullet screen keyword is matched with the target keyword to obtain the target matching degree.

7. The method according to any one of claims 1 to 6, characterized in that: The target keywords include character keywords, plot keywords and / or music keywords, and the target pop-up window includes a character pop-up window, a plot pop-up window and / or a music pop-up window.

8. A pop-up window display method, characterized in that: For a server, the method comprises: Obtain a target bullet screen of a target video, wherein the target video is associated with a target keyword in a preset playback time period, and the emission time of the target bullet screen is within the preset playback time period; When the target bullet screen and the target keyword meet a preset condition, a target pop-up window file corresponding to the target keyword is generated; The target pop-up window file is sent to the user terminal so that the user terminal displays the target pop-up window corresponding to the target keyword according to the target pop-up window file.

9. The method according to claim 8, characterized in that The preset conditions include target keyword matching degree; When the target bullet screen and the target keyword meet a preset condition, generating a target pop-up window file corresponding to the target keyword includes: Matching the target bullet screen with the target keyword to obtain a target matching degree; When the target matching degree reaches a preset threshold, a target pop-up window file corresponding to the target keyword is generated.

10. The method according to claim 9, characterized in that There are multiple target bullet comments; Matching the target bullet screen with the target keyword to obtain a target matching degree includes: Acquire a bullet screen keyword according to the contents of the plurality of target bullet screens, wherein the bullet screen keyword is a clustered keyword based on the plurality of target bullet screens; Matching the bullet screen keyword with the target keyword to obtain the target matching degree; Among them, when the target matching degree reaches a preset threshold, the target pop-up file corresponding to the target keyword is triggered to be generated.

11. A pop-up window display device, characterized in that: For a user terminal, the device comprises: A playback module, used to play a target video, wherein the target video is associated with a target keyword during a preset playback time period; An acquisition module, used to acquire a target bullet screen of the target video, wherein the emission time of the target bullet screen is within the preset playback time period; A display module is used to display a target pop-up window corresponding to the target keyword when a preset condition is met between the target bullet screen and the target keyword.

12. A pop-up window display device, characterized in that: For a server, the device comprises: An acquisition module is used to acquire a target bullet screen of a target video, wherein the target video is associated with a target keyword in a preset playback time period, and the emission time of the target bullet screen is within the preset playback time period; A generating module, configured to generate a target pop-up window file corresponding to the target keyword when a preset condition is satisfied between the target bullet screen and the target keyword; The sending module is used to send the target pop-up window file to the user end, so that the user end displays the target pop-up window corresponding to the target keyword according to the target pop-up window file.

13. A computer device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 10 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 10 are implemented.

Images