Bullet screen generation method and video playing method

Abstract

The embodiment of the invention provides a bullet screen generation method and a video playing method, and belongs to the technical field of bullet screen processing and video playing. The bullet screen generation method comprises the following steps: acquiring a target video file; obtaining a target event in the target video file; and generating a target bullet screen according to the target event, wherein the target bullet screen is displayed in a bullet screen form when the target video file is played. According to the technical scheme of the embodiment of the invention, the bullet screen can be automatically generated, so that the intelligent level of video interaction is improved, the interactivity of the video is improved, and the user experience is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a bullet screen generation method, a video playback method, a bullet screen generation device, a video playback device, a computer device, a computer-readable storage medium, and a computer program product. Background Art

[0002] With the rapid development of video technology, more and more users can watch various video programs through the Internet. In the process of watching video programs, users can interact with anchors or other users by sending barrages. The barrage refers to the subtitles that pop up and move in a predetermined direction when watching videos through the Internet. It is a kind of communication information. There is no fixed word for barrage in English. It is usually called: comment, danmaku, barrage, bullet screen, bullet-screen comment, etc. Barrage allows users to post comments or thoughts, but unlike ordinary video sharing websites that only display them in a dedicated comment area under the player, it will appear in real time on the video screen in the form of sliding subtitles to ensure that all viewers can notice it.

[0003] However, the existing bullet screen generation and display solutions lack interactivity and intelligence, resulting in a poor user experience.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the invention

[0005] The embodiments of the present application provide a barrage generation method, a video playback method, a barrage generation device, a video playback device, a computer device, a computer-readable storage medium, and a computer program product to solve or alleviate one or more of the technical problems raised above.

[0006] One aspect of an embodiment of the present application provides a method for generating a bullet screen, the method comprising: Optionally, obtaining a target video file; Acquire a target event in the target video file; A target bullet screen is generated according to the target event, and the target bullet screen is displayed in the form of a bullet screen when the target video file is played.

[0007] Optionally, obtaining a target event in the target video file includes: Identify the target video file to obtain target video information; identifying the target event according to the target video information; The target event is marked on the time axis of the target video file and corresponds to the target event data.

[0008] Optionally, the target video information includes image information, sound information and / or text information; identifying the target video file to obtain the target video information includes: Acquiring the image information according to the video frame of the target video file; and / or Acquiring the audio information according to the audio spectrum of the target video file; and / or The text information is acquired according to the language data of the target video file.

[0009] Optionally, identifying the target event according to the video information includes: The target event is identified and multi-verified through the image information, the audio information and the text information.

[0010] Optionally, the target bullet screen is configured with a pop-up time and a jump link; wherein: The pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to the target time point associated with the target event; There is a time interval between the occurrence time point and the target time point.

[0011] Optionally, the target event corresponds to an event type and an event description; Generating a target bullet screen according to the target event includes: Determine a predefined bullet comment template according to the event type of the target event; The target barrage is generated according to the event description of the target event and the predefined barrage template.

[0012] Optionally, the target event corresponds to a target time point and an event description; Generating a target bullet screen according to the target event includes: Acquiring contextual content within a preset range of the target time point and / or the emotional tendency of the target video file within the preset range; The target barrage is generated based on the contextual content and / or emotional tendency, and the event description.

[0013] One aspect of an embodiment of the present application provides a video playback method for a viewer, the method comprising: Display a video playing area for playing a target video file; Obtain candidate bullet comments corresponding to the target video file, wherein the candidate bullet comments include a target bullet comment configured with a jump link; Displaying the target bullet screen in the video playback area; In response to a triggering operation on the target bullet screen, the playback progress of the target video file is adjusted according to the jump link.

[0014] Optionally, the target bullet screen is configured with a pop-up time and a jump link; wherein: The pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to a target time point associated with a target event; wherein the target event is associated with a target scene or a target segment of the target video file.

[0015] There is a time interval between the occurrence time point and the target time point.

[0016] Another aspect of an embodiment of the present application provides a bullet screen generation device, the device comprising: A first acquisition module acquires a target video file; A second acquisition module is used to acquire a target event in the target video file; A generation module generates a target bullet screen according to the target event, and the target bullet screen is displayed in the form of a bullet screen when playing the target video file.

[0017] Another aspect of an embodiment of the present application provides a video display device, the device comprising: A first display module, used for displaying a video playing area for playing a target video file; An acquisition module, used for acquiring candidate bullet comments corresponding to the target video file, wherein the candidate bullet comments include a target bullet comment configured with a jump link; A second display module, used for displaying the target bullet screen in the video playback area; The jump module is used to respond to the trigger operation of the target barrage and adjust the playback progress of the target video file according to the jump link.

[0018] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0019] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0020] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the method described above when executed by a processor.

[0021] The embodiments of the present application using the above-mentioned technical solution may include the following advantages: by obtaining the target event in the target video file and generating the target barrage according to the target event, the automatic generation of the barrage is realized, thereby improving the intelligence level of video interaction and increasing the interactivity of the video, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0023] Figure 1 The following schematically shows an operating environment diagram of the bullet screen generation method according to the first embodiment of the present application; Figure 2 The flowchart of the method for generating a bullet screen according to the first embodiment of the present application is schematically shown; Figure 3 Schematically shows Figure 2 Flow chart of sub-steps of step S202; Figure 4 Schematically shows Figure 2 Flow chart of sub-steps of step S204; Figure 5 Schematically shows Figure 2 Flow chart of sub-steps of step S204; Figure 6 A flowchart of a video playback method according to Embodiment 2 of the present application is schematically shown; Figure 7 A block diagram of a bullet screen generating device according to Embodiment 3 of the present application is schematically shown; Figure 8 A block diagram schematically shows a video playback device according to a fourth embodiment of the present application; and Fig. 9 The hardware architecture diagram of the computer device according to the fifth embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0025] It should be noted that the descriptions involving "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0026] In the description of the present application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed, but are only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as a limitation on the present application.

[0027] First, the following terms are explained: Danmu: subtitles that pop up and move in a predetermined direction when watching a video on the Internet. There is no fixed word for Danmu in English, and it is usually called: comment, danmaku, barrage, bullet screen, bullet-screen comment, etc. Danmu allows viewers to comment or feel something, but unlike ordinary video sharing websites that only display comments in the dedicated comment area under the player, it will appear in real time on the video screen in the form of sliding subtitles to ensure that all viewers can notice it. Danmu can be managed by the Danmu system. Some Danmu systems can use CSS (Cascading StyleSheets) or JavaScript language to provide specific Danmu forms, such as the appearance or disappearance of Danmu in a specific position, control the speed of Danmu pop-up, Danmu position, etc. In addition, the Danmu that appears fixed at the bottom or top of the screen will also be used as subtitles for videos without subtitles.

[0028] Convolutional Neural Network (CNN): is a deep learning model that is particularly good at processing image and video data.

[0029] Natural Language Processing (NLP): is a branch of artificial intelligence that focuses on enabling computers to understand, generate, and analyze human language. NLP combines fields such as linguistics, computer science, and data science, and is widely used in machine translation, text analysis, sentiment analysis, speech recognition, etc.

[0030] Secondly, in order to facilitate those skilled in the art to understand the technical solutions provided by the embodiments of the present application, the relevant technologies are described below.

[0031] The applicant understands that when users watch videos, they need to manually search for key information, which results in a poor viewing experience. In addition, existing bullet screens lack intelligence and cannot automatically generate functional bullet screens related to the video content, which affects the interactivity of the video.

[0032] To this end, the embodiments of the present application provide a technical solution for barrage generation and a technical solution for video playback based on barrage control. In this technical solution, (1) through the automatically generated functional barrage, users can participate in video interaction more conveniently; (2) users can easily jump to key clips or events in the video, avoiding tedious manual search and improving viewing efficiency; (3) the automatic generation and intelligent jump functions of barrage make the viewing process more intelligent and smooth, meeting the needs of modern users for convenience and practicality. See below for details.

[0033] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0034] like Figure 1 As shown, the operating environment diagram includes: a service platform 2 and a client.

[0035] The service platform 2 can be connected to the client terminals ( 4A, 4B, ..., 4N) via the network.

[0036] The service platform 2 can provide various content and bullet screen services for the client. For example, the bullet screen is sent to the client via the network. The network includes various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices and / or the like. The network may include physical links, such as coaxial cable links, twisted pair cable links, optical fiber links, combinations thereof, etc. The network may include wireless links, such as cellular links, satellite links, Wi-Fi links, etc.

[0037] The service platform 2 may be a single server, a server cluster or a cloud computing service center, which is used to provide various services. For example: The service platform 2 may provide content services. The content services may be configured to provide content such as video, audio, text data, or a combination thereof. The content may include content streams (e.g., video streams, audio streams, information streams), content files (e.g., video files, audio files, text files), and / or other data.

[0038] The service platform 2 can be configured to manage messages for various content items. Users can browse content and access different content items to view comments for specific content, such as comments posted by other users for the specific content. Comments from users associated with a specific content item can be output to other users who view the specific content item. For example, all users who access a content item (e.g., a video) can view comments associated with the content item. The input comment content can be output in real time or near real time.

[0039] The service platform 2 may be configured to receive a plurality of messages. The plurality of messages may include a plurality of bullet comments associated with the content.

[0040] The service platform 2 may be configured to process multiple messages, for example, various processing operations such as message storage, message filtering, and message push. Among them, message storage is used to store multiple messages in a data storage such as a database. Message filtering may include rejecting or marking messages that match the filtering criteria. Among them, the filtering criteria may specify terms and / or phrases, such as profanity, hate speech, indecent language, etc. The filtering criteria may specify characters, such as symbols, fonts, etc. The filtering criteria may specify languages, computer-readable code patterns, etc.

[0041] The service platform 2 can perform natural language processing, topic recognition, pattern recognition, artificial intelligence, etc. to automatically determine the characteristics of the message and / or group the message. As an example, frequently occurring phrases or patterns can be identified as topics. As another example, a database of topics associated with the content can be maintained. Topics can include genres (e.g., action, drama, comedy), personalities (e.g., actors, actresses, directors), languages, etc. Messages can be grouped based on the characteristics of the client device and / or the user sending the message. Demographics, interests, history, and / or the like can be stored for multiple users to determine potential groupings of messages. For example, the bullet screens uploaded by each user can be screened, filtered, sorted, and personalized push, etc.

[0042] The service platform 2 may provide a bullet screen service, which is configured to allow users to comment and / or share comments (i.e. bullet screens) associated with the content. The bullet screens are presented on the same screen together with the content. The bullet screens may be displayed in an overlay above the content and may have animation effects. For example, the bullet screens may scroll (e.g., from right to left, from left to right, from top to bottom, ...), and the animation effect may be implemented based on the transition property of CSS3.

[0043] The client (4A, 4B, ..., 4N) may be configured to access the content and services of the service platform 2. The client (4A, 4B, ..., 4N) may include an electronic device carrying or connected to a display panel, such as a mobile device, a tablet device, a laptop computer, a workstation, a virtual reality device, a gaming device, a digital streaming device, a vehicle client, a smart TV, a set-top box, etc., and may also include a virtualized computing instance. The virtualized computing instance may include a virtual machine, such as a simulation of a computer system, an operating system, a server, etc.

[0044] The client (4A, 4B, ..., 4N) may be associated with one or more users. A single user may also use one or more of the clients (4A, 4B, ..., 4N) to access the service platform 2. The client (4A, 4B, ..., 4N) may travel to various locations and use different networks to access the service platform 2.

[0045] The client (4A, 4B, ..., 4N) may include multiple client programs, such as a video APP, a live broadcast APP or a mini program with a built-in bullet screen system. In this embodiment, the video and other contents provided by the service platform 2 may be presented through the client program, and the bullet screen system may present the bullet screen contents in a specific manner.

[0046] The client (4A, 4B, ..., 4N) may include an interface, which may include a touch pad, a touch screen, a mouse, a keyboard or other sensing elements. For example, the input element may be configured to receive user instructions, and the user instructions may enable the client (4A, 4B, ..., 4N) to perform various operations, such as inputting bullet comments, etc.

[0047] It should be noted that the above devices are exemplary, and the number and type of devices are adjustable in different scenarios or according to different needs.

[0048] The technical solutions of the present application are described below through multiple embodiments. It should be noted that these embodiments can be implemented in a variety of different forms and should not be construed as being limited to the embodiments described here.

[0049] Embodiment 1 Figure 2 The flowchart of the bullet screen generation method according to the first embodiment of the present application is schematically shown.

[0050] like Figure 2 As shown, the bullet screen generation method may include steps S200 to S204, wherein: Step S200, obtaining a target video file.

[0051] Step S202: Acquire a target event in the target video file.

[0052] Step S204, generating a target bullet screen according to the target event, and the target bullet screen is displayed in the form of a bullet screen when playing the target video file.

[0053] By obtaining the target event in the target video file and generating the target barrage according to the target event, the automatic generation of the barrage is realized, thereby improving the intelligence level of video interaction and increasing the interactivity of the video, thereby improving the user experience.

[0054] The following combination Figure 2 , each step in steps S200~S204 and other optional steps are described in detail.

[0055] Step S200 , get the target video file.

[0056] This embodiment does not limit the target video file, which can be considered as a video file used to automatically generate barrage, and the video file can be a video uploaded by the user or a video file selected by the user to be watched.

[0057] Step S202 , obtain the target event in the target video file.

[0058] Through in-depth analysis of the target video file, the corresponding target event can be detected to facilitate the subsequent generation of target bullet comments. The target event can be a specific scene in the target video file, the appearance of a specific character, key dialogue or emotional changes, such as key game events, goal / score update events, character appearance events, plot turning events and emotional scene events.

[0059] The target event will be further exemplified below through more embodiments.

[0060] In an optional embodiment, if Figure 3 As shown, step S202 may include: Step S302: Identify the target video file to obtain target video information.

[0061] Step S304, identifying the target event according to the target video information; The target event is marked on the time axis of the target video file and corresponds to the target event data.

[0062] In some embodiments, target video information that meets predetermined rules or patterns can be automatically discovered through image recognition, audio recognition, natural language processing and other technologies, thereby identifying target events. The target video information can be specific people, objects, scene changes, specific sound patterns, high-frequency words and keywords, etc. The identified target event will be marked on the timeline of the target video file, that is, the time point when the event occurred is recorded. At the same time, the corresponding target event data will be generated, and the target event data may include timestamps, event descriptions, event types, etc.

[0063] In this embodiment, the target event is identified through the target video information, and the target event is marked on the timeline of the target video file, thereby realizing the automatic generation and precise positioning of the target event, thereby improving the accuracy of the barrage association information.

[0064] In an optional embodiment, the target video information includes image information, sound information and / or text information. Step S202 may include: The image information is obtained according to the video frame of the target video file; and / or the audio information is obtained according to the audio spectrum of the target video file; and / or the text information is obtained according to the language data of the target video file.

[0065] In some embodiments, a convolutional neural network (CNN) can be used to analyze video frames to identify image information such as characters and objects in the scene. For example, image information such as specific characters, objects or scene changes can be detected to identify the corresponding target event, such as "character A appears" → character appearance event, "scene switches from the living room to the outdoors" → scene transition event. In some embodiments, audio spectrum analysis can be used to identify key sound clips in the video, such as audio information such as dialogue, music, and environmental sound effects. For example, by detecting specific sound patterns (such as music climaxes, screams, important dialogues, etc.), key clips (target events) in the target video can be identified and located, such as "audience cheers detected" → exciting moments, "the high-pitched tone of the game commentator detected" → key goals. In some embodiments, high-frequency words or keywords and other text information can be extracted from subtitles or dialogues based on natural language processing technology to identify target events, such as "subtitles appear 'awards start'" → award ceremony event, "anchor says 'this is the last big gift'" → event countdown event.

[0066] In this embodiment, by analyzing the video frames, audio spectra and language data to obtain image information, audio information and text information, a more comprehensive and accurate analysis of the target video file is achieved, so that the generated barrage is more comprehensive and accurately matched.

[0067] In an optional embodiment, step S202 may include: identifying and multi-verifying the target event through the image information, the audio information and the text information.

[0068] When a specific scene or person is detected in the image information, the scene can be identified and verified in combination with the audio information. For example, the image recognizes the audience cheering, and the audio detects applause → "Victory Celebration" event. When a high emotional tone is detected in the audio information, the subtitles in the text information can be further analyzed to see if there are relevant keywords. For example, the audio detects "applause" and the subtitles appear "Welcome XX" → "Important person appears" event. If it is necessary to explain, multiple verification can be cross-verification of various information or comprehensive verification of all information, which is not limited here.

[0069] In this embodiment, the accuracy and reliability of the target event are improved by multiple verifications of the target event, thereby generating a highly matching bullet comment.

[0070] Step S204 , a target barrage is generated according to the target event, and the target barrage is displayed in the form of barrage when playing the target video file.

[0071] In some embodiments, the target bullet screen can be generated by the timestamp, event type and event description corresponding to the target event. The timestamp is the specific time when the target event occurs (such as 00:12:15). The event type can be the appearance of a character, a goal, a product introduction, a climax paragraph, etc. The event description can be a brief description of the event (such as "Zhang San appears", "The game is over"). During the video playback process, the target bullet screen will move continuously on the video screen in a predetermined direction until it moves out of the video screen, so that the viewer can see the target bullet screen at the specified time.

[0072] The designated time may be the time point when the target event occurs, or a certain time in advance, or a certain time in delay.

[0073] The following will provide a further exemplary introduction to generating target bullet comments through more embodiments.

[0074] In an optional embodiment, the target event corresponds to an event type and an event description; Figure 4 As shown, step S204 may include: Step S400, determining a predefined bullet comment template according to the event type of the target event.

[0075] Step S402: Generate the target bullet comment according to the event description of the target event and the predefined bullet comment template.

[0076] In some embodiments, in the target event about the appearance of a character, the event type may be a character appearance event, the determined barrage template may be "{character name} appears!", the event description may be "Zhang San appears", and the target barrage "Zhang San appears! Click to see his performance." may be generated. In the target event about a sports game, the event type may be a goal event, the determined barrage template may be "Goal! Score {score}", the event description may be "Score 2:1", and the target barrage "Goal! Score 2:1" may be generated. In the target event about product recommendation, the event type may be a product recommendation event, the determined barrage template may be "{product name} is surprisingly online! Click to see details", and the event description may be "Smart watch recommendation", and the target barrage "Smart watch is surprisingly online! Click to see details." may be generated. In the target event about a climax paragraph, the event type may be a climax paragraph event, the confirmed barrage template may be "Wonderful moment! Come and see!", and the target barrage "Wonderful moment! Come and see!" may be generated.

[0077] In this embodiment, a predefined bullet screen template is determined by the event type, and then a target video bullet screen is generated according to the event description, thereby realizing automatic generation of bullet screens, thereby improving the intelligence level of video interaction and increasing the interactivity of the video, thereby improving the user experience.

[0078] In an optional embodiment, the target event corresponds to a target time point and an event description; Figure 5 As shown, step S204 may include: Step S500: acquiring contextual content within a preset range of the target time point and / or the emotional tendency of the target video file within the preset range.

[0079] Step S502, generating the target barrage based on the context content and / or emotional tendency, and the event description.

[0080] In some embodiments, the context content can be further analyzed by natural language processing technology to generate a target barrage. The tone of the target barrage can be adjusted according to the emotional vocabulary to enhance the emotional expression. For example, if "exciting" is detected, a target barrage "This is a really exciting moment!" can be generated. If there are associated events in the context content (such as consecutive goals), a target barrage "Continuous goals! The opponent has no power to fight back." is generated.

[0081] In this embodiment, target bullet comments are generated through contextual content and / or emotional tendencies and event descriptions, thereby achieving automatic supplementation and personalized processing of the bullet comments, thereby increasing the interactivity of the video and improving the user experience.

[0082] In an optional embodiment, the target bullet screen is configured with a pop-up time and a jump link; wherein: The pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to the target time point associated with the target event; wherein there is a time interval between the occurrence time point and the target time point.

[0083] A jump link can be generated based on the target time point. The jump link can be the information carried by the target bullet comment, and the jump link allows the user to jump to the target time point associated with the target event by clicking the target bullet comment. The time interval between the appearance time point of the target bullet comment and the target time point can be flexibly set according to the actual situation, such as a period of time in advance.

[0084] In this embodiment, through the jump link, the user can easily jump to the time point associated with the relevant event at the current playback time of the target video file, thereby avoiding the user's frequent manual search for related events and improving the user's viewing experience and efficiency.

[0085] Embodiment 2 Figure 6 The flowchart of the video playback method according to the second embodiment of the present application is schematically shown.

[0086] like Figure 6 As shown, the video playing method may include steps S600 to S606, wherein: Step S600: displaying a video playing area for playing a target video file.

[0087] Step S602, obtaining candidate bullet comments corresponding to the target video file, wherein the candidate bullet comments include a target bullet comment configured with a jump link.

[0088] Step S604: display the target bullet screen in the video playback area.

[0089] Step S606, in response to the triggering operation on the target bullet screen, adjusting the playback progress of the target video file according to the jump link.

[0090] The playback area can be the area on the device screen used to display content (such as text, pictures, videos, etc.). The playback area can be used to play various types of videos (live or on-demand), that is, target videos, such as movies, TV shows, user-uploaded videos, animations, etc. Candidate bullet comments can be various types of bullet comments that are bound to the target video in the bullet comment database. Among these candidate bullet comments, some bullet comments with jump links (such as the target bullet comment) may be included. Each bullet comment with a jump link can point to the time point when the corresponding event occurs for an event.

[0091] These bullet comments with jump links can be displayed at the stage when the target video file starts playing, and the display order can be sorted according to the time point when the event occurs. When the user clicks on the bullet comment configured with a jump link, the playback progress bar of the target video file can be adjusted to the time point when the corresponding event occurs.

[0092] In this embodiment, by displaying a bullet screen with a jump link, the user can directly fast forward or rewind to a specific segment by clicking the jump link, thereby avoiding the user's frequent manual search for related content and improving the viewing experience and efficiency.

[0093] In an optional embodiment, the target bullet screen is configured with a pop-up time and a jump link; wherein: the pop-up time is used to indicate the appearance time point of the target bullet screen; the jump link is used to jump the current playback time point of the target video file to the target time point associated with the target event; wherein the target event is associated with the target scene or target segment of the target video file. wherein the appearance time point and the target time point have a time interval.

[0094] In some embodiments, after the user clicks on the jump link of the target barrage, it is further checked whether the target barrage has timeliness (including time information). If so, the player's jump timestamp API is called to pass the time information to the video playback controller, thereby adjusting the playback progress of the target video file to the target time point.

[0095] In this embodiment, when a user clicks on a target bullet screen, the user can directly jump to the time point when a related event occurs, thereby helping the user to quickly locate a specific content segment or key content, thereby improving the flexibility and convenience of video viewing.

[0096] In order to make the present application easier to understand, an exemplary application is provided below. S1: The service platform obtains the target video file uploaded by the user.

[0097] S2: The service platform identifies and analyzes the target video file to obtain the target event in the video file.

[0098] S3: The service platform automatically creates a target bullet comment with a jump link based on the target event data corresponding to the target event.

[0099] S4: The service platform binds the target bullet comment and the target video and stores them in the bullet comment database.

[0100] S5: When the user watches the target video file on the client, the target barrage is obtained from the barrage database and displayed when the target video file starts to play.

[0101] S6: When the user clicks on the bullet screen, the client checks whether the bullet screen is a functional bullet screen with a jump link (target bullet screen). If it is, the playback progress of the target video file is adjusted to the time point specified by the bullet screen through the jump link.

[0102] In this exemplary application, the automatic generation of barrage and the fast forward or rewind of video playback based on barrage are realized, which plays a role in navigation of specific clips, improves the intelligence level of video interaction and increases the interactivity of the video, thereby improving the user experience.

[0103] Embodiment 3 Figure 7 The block diagram of the bullet screen generation device according to the third embodiment of the present application is schematically shown. The device can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 7 As shown, the device 1600 may include: a first acquisition module 1610, a second acquisition module 1620 and a generation module 1630, wherein: A first acquisition module 1610 is used to acquire a target video file; The second acquisition module 1620 is used to acquire the target event in the target video file; The generating module 1630 is used to generate a target bullet screen according to the target event, and the target bullet screen is displayed in the form of a bullet screen when playing the target video file.

[0104] As an optional embodiment, obtaining a target event in the target video file includes: Identify the target video file to obtain target video information; identifying the target event according to the target video information; The target event is marked on the time axis of the target video file and corresponds to the target event data.

[0105] As an optional embodiment, the target video information includes image information, sound information and / or text information; identifying the target video file to obtain the target video information includes: Acquiring the image information according to the video frame of the target video file; and / or Acquiring the audio information according to the audio spectrum of the target video file; and / or The text information is acquired according to the language data of the target video file.

[0106] As an optional embodiment, identifying the target event according to the video information includes: The target event is identified and multi-verified through the image information, the audio information and the text information.

[0107] As an optional embodiment, the target bullet screen is configured with a pop-up time and a jump link; wherein: The pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to the target time point associated with the target event; There is a time interval between the occurrence time point and the target time point.

[0108] As an optional embodiment, the target event corresponds to an event type and an event description; Generating a target bullet screen according to the target event includes: Determine a predefined bullet comment template according to the event type of the target event; The target barrage is generated according to the event description of the target event and the predefined barrage template.

[0109] As an optional embodiment, the target event corresponds to a target time point and an event description; Generating a target bullet screen according to the target event includes: Acquiring contextual content within a preset range of the target time point and / or the emotional tendency of the target video file within the preset range; The target barrage is generated based on the contextual content and / or emotional tendency, and the event description.

[0110] Embodiment 4 Figure 8The block diagram of the video playback device according to the fourth embodiment of the present application is schematically shown. The device can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 8 As shown, the device 1700 may include: a first display module 1710, an acquisition module 1720, a second display module 1730 and a jump module 1740, wherein: The first display module 1710 is used to display a video playing area for playing a target video file; An acquisition module 1720 is used to acquire candidate bullet comments corresponding to the target video file, wherein the candidate bullet comments include a target bullet comment configured with a jump link; The second display module 1730 is used to display the target bullet screen in the video playback area; The jump module 1740 is used to respond to the trigger operation on the target barrage and adjust the playback progress of the target video file according to the jump link.

[0111] As an optional embodiment, the pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to a target time point associated with a target event; wherein the target event is associated with a target scene or a target segment of the target video file.

[0112] There is a time interval between the occurrence time point and the target time point.

[0113] Embodiment 5 Fig. 9 The schematic diagram of the hardware architecture of a computer device 10000 suitable for implementing the bullet screen generation method according to the fifth embodiment of the present application is shown. In some embodiments, the computer device 10000 may be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Fig. 9 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other through a system bus. Among them: The memory 10010 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 10010 can be an internal storage module of the computer device 10000, such as a hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 can also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 10010 can also include both the internal storage module of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed in the computer device 10000, such as the program code of the bullet screen generation method, etc. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0114] In some embodiments, the processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data.

[0115] The network interface 10030 may include a wireless network interface or a wired network interface, and the network interface 10030 is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0116] It should be pointed out that Fig. 9 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.

[0117] In this embodiment, the barrage generation method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0118] Embodiment 6 An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the barrage generation method in the embodiment are implemented.

[0119] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of a computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device. Of course, the computer-readable storage medium may also include both an internal storage unit of a computer device and an external storage device thereof. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on a computer device, such as the program code of the bullet screen generation method in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.

[0120] Embodiment 7 An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0121] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented by general-purpose computer devices, they can be concentrated on a single computer device, or distributed on a network composed of multiple computer devices, optionally, they can be implemented by executable program codes of computer devices, so that they can be stored in a storage device and executed by the computer device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0122] It should be noted that the above are only preferred embodiments of the present application, and the patent protection scope of the present application is not limited thereto. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for generating a bullet comment, characterized in that: The method comprises: Get the target video file; Acquire a target event in the target video file; A target bullet screen is generated according to the target event, and the target bullet screen is displayed in the form of a bullet screen when the target video file is played.

2. The method according to claim 1, characterized in that Obtaining the target event in the target video file includes: Identify the target video file to obtain target video information; identifying the target event according to the target video information; The target event is marked on the time axis of the target video file and corresponds to the target event data.

3. The method according to claim 2, characterized in that The target video information includes image information, sound information and / or text information; identifying the target video file to obtain the target video information includes: Acquiring the image information according to the video frame of the target video file; and / or Acquiring the audio information according to the audio spectrum of the target video file; and / or The text information is acquired according to the language data of the target video file.

4. The method according to claim 3, characterized in that According to the video information, identifying the target event, including The target event is identified and multi-verified through the image information, the audio information and the text information.

5. The method according to claim 1, characterized in that The target bullet screen is configured with a pop-up time and a jump link; wherein: The pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to the target time point associated with the target event; There is a time interval between the occurrence time point and the target time point.

6. The method according to claim 5, characterized in that The target event corresponds to an event type and an event description; Generating a target bullet screen according to the target event includes: Determine a predefined bullet comment template according to the event type of the target event; The target barrage is generated according to the event description of the target event and the predefined barrage template.

7. The method according to claim 5, characterized in that The target event corresponds to a target time point and an event description; Generating a target bullet screen according to the target event includes: Acquiring contextual content within a preset range of the target time point and / or the emotional tendency of the target video file within the preset range; The target barrage is generated based on the contextual content and / or emotional tendency, and the event description.

8. A video playback method, characterized in that: For the audience, the method includes: Display a video playing area for playing a target video file; Obtain candidate bullet comments corresponding to the target video file, wherein the candidate bullet comments include a target bullet comment configured with a jump link; Displaying the target bullet screen in the video playback area; In response to a triggering operation on the target bullet screen, the playback progress of the target video file is adjusted according to the jump link.

9. The method according to claim 8, characterized in that The target bullet screen is configured with a pop-up time and a jump link; wherein: The pop-up time is used to indicate the time point when the target bullet screen appears; The jump link is used to jump the current playback time point of the target video file to a target time point associated with a target event; wherein the target event is associated with a target scene or a target segment of the target video file. There is a time interval between the occurrence time point and the target time point.

10. A barrage generation device, characterized in that: The device comprises: A first acquisition module acquires a target video file; A second acquisition module is used to acquire a target event in the target video file; A generation module generates a target bullet screen according to the target event, and the target bullet screen is displayed in the form of a bullet screen when the target video file is played.

11. A video playback device, characterized in that: The device comprises: A first display module, used for displaying a video playing area for playing a target video file; An acquisition module, used for acquiring candidate bullet comments corresponding to the target video file, wherein the candidate bullet comments include a target bullet comment configured with a jump link; A second display module, used for displaying the target bullet screen in the video playback area; The jump module is used to respond to the trigger operation of the target barrage and adjust the playback progress of the target video file according to the jump link.

12. A computer device, characterized in that: include: at least one processor; and a memory communicatively coupled to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 9 is implemented.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 9 are implemented.

Images