Method and device for correcting bullet screen display time, storage medium and electronic equipment

Abstract

The invention discloses a bullet screen display time correction method and device, a storage medium and electronic equipment. The method comprises the steps that a first Sprite map is created for a first media resource, the first Sprite map is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet screen which is synchronously displayed; establishing a first mapping relationship between the at least one bullet screen and the first Sprite map according to the first media time associated with the at least one bullet screen and the second media time associated with the at least one key frame; creating a second Sprite map for a second media resource, the second media resource being a media resource obtained by performing media resource correction on the first media resource; and establishing a second mapping relationship between the at least one bullet screen and the second Sprite map according to difference information between the second Sprite map and the first Sprite map. The technical problem that the bullet screen display time correction efficiency is low is solved.

Description

Technical Field

[0001] The present application relates to the field of computers, and more specifically, to a method and device for correcting the display time of a bullet screen, a storage medium, and an electronic device. Background Art

[0002] As the content of online video platforms continues to grow, the need for resource correction operations (such as replacement operations) after video media assets are launched is increasing. While this operation brings about content adjustment, it also causes a significant problem: the misalignment of the bullet screen display time.

[0003] At present, the common solution is to manually record and adjust the display time of each bullet comment. This method is not only time-consuming and laborious, but also prone to errors in the manual adjustment process due to the complexity and changeability of video content, affecting the user's viewing experience.

[0004] Therefore, there is a technical problem in the related art that the correction efficiency of the barrage display time is low. Summary of the invention

[0005] The embodiments of the present application provide a method and device for correcting the display time of a bullet screen, a storage medium, and an electronic device, so as to at least solve the technical problem of low correction efficiency of the display time of the bullet screen in the related art.

[0006] According to one aspect of an embodiment of the present application, a method for correcting the display time of a barrage is provided, including: creating a first Sprite image for a first media resource, wherein the first Sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one barrage displayed synchronously; establishing a first mapping relationship between at least one barrage and the first Sprite image based on a first media time associated with at least one barrage and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate the display time information of at least one barrage in the first media resource; creating a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained after media resource correction of the first media resource; establishing a second mapping relationship between at least one barrage and the second Sprite image based on the difference information between the second Sprite image and the first Sprite image, wherein the second mapping relationship is used to indicate the display time information of at least one barrage in the second media resource.

[0007] According to another aspect of an embodiment of the present application, a device for correcting the display time of a barrage is also provided, including: a first creation unit, used to create a first Sprite image for a first media resource, wherein the first Sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one barrage displayed synchronously; a first establishment unit, used to establish a first mapping relationship between at least one barrage and the first Sprite image based on a first media time associated with at least one barrage and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate the display time information of at least one barrage in the first media resource; a second creation unit, used to create a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained after media resource correction of the first media resource; a second establishment unit, used to establish a second mapping relationship between at least one barrage and the second Sprite image based on the difference information between the second Sprite image and the first Sprite image, wherein the second mapping relationship is used to indicate the display time information of at least one barrage in the second media resource.

[0008] According to another aspect of the embodiments of the present application, a computer program product is provided, the computer program product including a computer program / instruction, the computer instruction being stored in a computer-readable storage medium. A processor of a computer device reads the computer program / instruction from the computer-readable storage medium, and the processor executes the computer program / instruction, so that the computer device executes the above method for correcting the bullet screen display time.

[0009] According to another aspect of an embodiment of the present application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the method for correcting the barrage display time through the computer program.

[0010] In this embodiment, a first Sprite is first created for the first media resource before the media resource is modified, and then a mapping relationship between at least one bullet screen and the first Sprite is established based on the media playback time corresponding to at least one key frame included in the first Sprite and the media playback time when the at least one bullet screen user associated with the first media resource sends the bullet screen to obtain the display time information of at least one bullet screen in the first media resource. Furthermore, when a second media resource is obtained after the media resource is modified, a second Sprite is created for the second media resource, and based on the difference information between the second Sprite and the first Sprite, a mapping relationship between at least one bullet screen and the second Sprite is determined and established to obtain the display time information of at least one bullet screen in the second media resource, thereby efficiently achieving the purpose of automatically adjusting the display time of the bullet screen after the media resource is modified, which not only greatly reduces the complexity of manual operation, but also effectively prevents errors that may be caused by manual adjustment, thereby achieving the technical effect of improving the correction efficiency of the bullet screen display time. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0012] Figure 1 It is a schematic diagram of a process of an optional method for correcting the barrage display time according to an embodiment of the present application;

[0013] Figure 2 is a schematic diagram of an optional method for correcting the display time of a bullet screen according to an embodiment of the present application;

[0014] Figure 3 is a schematic diagram of an optional method for correcting the display time of a bullet screen according to an embodiment of the present application;

[0015] Figure 4 is a schematic diagram of an optional method for correcting the display time of a bullet screen according to an embodiment of the present application;

[0016] Figure 5 is a schematic diagram of an optional method for correcting the display time of a bullet screen according to an embodiment of the present application;

[0017] Figure 6 is a schematic diagram of an optional method for correcting the display time of a bullet screen according to an embodiment of the present application;

[0018] Figure 7 is a schematic diagram of an optional device for correcting the display time of a bullet screen according to an embodiment of the present application;

[0019] Figure 8 A schematic structural diagram of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0021] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0022] Optionally, as an optional implementation, as Figure 1 As shown, the method for correcting the bullet screen display time includes the following specific steps:

[0023] S102, creating a first sprite image for a first media resource, wherein the first sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet comment to be displayed synchronously;

[0024] S104, establishing a first mapping relationship between at least one bullet comment and a first sprite image according to a first media time associated with at least one bullet comment and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate display time information of at least one bullet comment in the first media resource;

[0025] S106, creating a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained by modifying the first media resource;

[0026] S108, establishing a second mapping relationship between at least one bullet comment and the second sprite image based on the difference information between the second sprite image and the first sprite image, wherein the second mapping relationship is used to indicate display time information of at least one bullet comment in the second media resource.

[0027] Optionally, in this embodiment, the method for correcting the display time of the bullet screen can be, but is not limited to, applied to the automatic correction scenario of the bullet screen of the media asset replacement. In this scenario, with the continuous enrichment of the content of the online video platform, the demand for replacement operations after the video media asset goes online is increasing. The replacement operation is usually caused by program production adjustments, advertising insertions, or video review. While the replacement operation brings about content adjustments, it also causes a significant problem: the misalignment of the bullet screen display time.

[0028] In the related art, the display time of each bullet comment is corrected by manual recording and manual adjustment. This method is not only time-consuming and laborious, but also prone to errors in the manual adjustment process due to the complexity and changeability of video content, affecting the user's viewing experience.

[0029] In order to solve the above defects, the method for correcting the display time of the bullet screen provided in this embodiment is used to first create a first sprite for the first media resource before the media resource is corrected, and then establish a mapping relationship between at least one bullet screen and the first sprite based on the media playback time corresponding to at least one key frame included in the first sprite and the media playback time when the at least one bullet screen user associated with the first media resource sends the synchronously displayed media resource, so as to obtain the display time information of at least one bullet screen in the first media resource. Furthermore, in the case where a second media resource is obtained after the media resource is corrected, a second sprite is created for the second media resource, and based on the difference information between the second sprite and the first sprite, a mapping relationship between at least one bullet screen and the second sprite is determined and established to obtain the display time information of at least one bullet screen in the second media resource, thereby efficiently achieving the purpose of automatically adjusting the display time of the bullet screen after the media resource is corrected, which not only greatly reduces the complexity of manual operation, but also effectively prevents errors that may be caused by manual adjustment, thereby improving the correction efficiency of the bullet screen display time.

[0030] Optionally, in this embodiment, the Sprite image is an image formed by splicing key frame images of the media resource in chronological order, each key frame represents a static picture of the media resource at a certain time point and is marked with a timestamp and displacement information.

[0031] It is understandable that before creating the first Sprite image for the first media resource, the first media resource to be processed is obtained, and content analysis is performed on the first media resource, and at least one key frame is automatically extracted from the first media resource at a set time interval, wherein at least one key frame is a key frame representing a change in the content of the first media resource, the first media resource may be but is not limited to a video resource, and the set time interval may be but is not limited to a frames per second or b frames per minute, where a and b are positive integers.

[0032] Optionally, in this embodiment, the first media resource is associated with at least one barrage that is displayed synchronously, wherein the at least one barrage is a barrage sent when the user views the first media resource.

[0033] Optionally, in this embodiment, the first media time associated with each barrage in at least one barrage may be, but is not limited to, the playback time node of the first media resource when the user sends the barrage on the first media resource. The second media time associated with each key frame in at least one key frame may be, but is not limited to, the playback time node or playback time segment of the first media resource represented by each key frame.

[0034] It should be noted that, when the second media time is the above-mentioned playback time node, establishing a first mapping relationship between at least one barrage and the first Sprite image may include but is not limited to: matching the playback time node of the first media resource when at least one barrage indicated by the first media time is sent with the playback time node of the second media resource, and for the same time node, establishing a mapping relationship between the corresponding barrage and the corresponding key frame.

[0035] It should be noted that, when the second media time is the above-mentioned playback time segment, the playback time segment indicated by each second media time is a time segment with the playback time node indicated by the key frame as the midpoint, and the length of the time segment is the set time interval. Establishing a first mapping relationship between at least one bullet screen and the first sprite image may include, but is not limited to: matching the playback time node of the first media resource when at least one bullet screen indicated by the first media time is sent with the playback time segment of the second media resource, and for the time node in the playback time segment, establishing a mapping relationship between the corresponding bullet screen and the corresponding key frame.

[0036] Optionally, in this embodiment, the second media resource is a media resource obtained by modifying the first media resource, wherein the media resource modification may include but is not limited to at least one of the following: media resource filling and media resource deletion.

[0037] It is understandable that media resources may be inserted or supplemented based on the first media resource but not limited thereto, media resources may be deleted based on the first media resource but not limited thereto, and media resources may be inserted or supplemented and deleted based on the first media resource but not limited thereto at the same time.

[0038] It should be noted that, since the first Sprite image corresponding to the first media resource is composed of at least one key frame of the first media resource, and the at least one key frame represents the content of the first media resource, after the first media resource is modified to obtain the second media resource, the difference between the second Sprite image created for the second media resource according to the same parameters and the first Sprite image is that: there are fewer key frames of the deleted media resources and more key frames of the filled media resources.

[0039] It can be understood that according to the difference information between the second Sprite image and the first Sprite image, adjustments are made on the basis of the first mapping relationship to obtain a second mapping relationship between at least one barrage and the second Sprite image, wherein the second mapping relationship is used to indicate the display time information of at least one barrage in the second media resource.

[0040] It should be noted that after the content of the media resource is modified, the timeline changes of the media resource content can be automatically calculated by comparing the differences between the key frames in the original first Sprite and the new second Sprite, and then the time display of the barrage can be accurately corrected, avoiding the time-consuming and labor-intensive traditional manual adjustment and potential errors, and achieving seamless synchronization of the barrage and media resource content, thereby greatly improving the user experience and enhancing the operational efficiency of media resources.

[0041] Through the embodiment provided by the present application, a first Sprite is first created for the first media resource before the media resource is corrected, and then a mapping relationship between at least one bullet screen and the first Sprite is established based on the media playback time corresponding to at least one key frame included in the first Sprite and the media playback time when the at least one bullet screen user associated with the first media resource sends the bullet screen to obtain the display time information of at least one bullet screen in the first media resource. Furthermore, when a second media resource is obtained after the media resource is corrected, a second Sprite is created for the second media resource, and based on the difference information between the second Sprite and the first Sprite, a mapping relationship between at least one bullet screen and the second Sprite is determined and established to obtain the display time information of at least one bullet screen in the second media resource, thereby efficiently achieving the purpose of automatically adjusting the display time of the bullet screen after the media resource is corrected, which not only greatly reduces the complexity of manual operation, but also effectively prevents errors that may be caused by manual adjustment, thereby achieving the technical effect of improving the correction efficiency of the bullet screen display time.

[0042] As an optional solution, according to the difference information between the second Sprite image and the first Sprite image, a second mapping relationship between at least one bullet comment and the second Sprite image is established, including:

[0043] In a case where the first Sprite image includes a first key frame and the second Sprite image includes a second key frame corresponding to the first key frame, a first mapping sub-relationship between a bullet comment associated with the first key frame and the first Sprite image is obtained, wherein the first key frame and the second key frame are associated with the same bullet comment, at least one bullet comment includes a bullet comment associated with the first key frame, and the first mapping relationship includes a first mapping sub-relationship;

[0044] According to the time displacement information of the second key frame relative to the first key frame, the first mapping sub-relationship is adjusted to obtain a second mapping sub-relationship between the bullet commentary associated with the first key frame and the second Sprite image, wherein the second mapping relationship includes the second mapping sub-relationship.

[0045] Optionally, in this embodiment, the content of the first media resource corresponding to the first key frame is the same as the content of the second media resource corresponding to the second key frame. It is understandable that after the media resource is modified, the play time nodes of the same content in different media resources change.

[0046] Optionally, in this embodiment, the time displacement information of the second key frame relative to the first key frame is used to indicate the change of the above-mentioned playback time node. To further illustrate, if a certain media resource content is moved forward by 2 minutes due to the media resource modification operation, the time node of the corresponding key frame in the new sprite image is also moved forward by two minutes, and the corresponding bullet screen display time is also moved forward by 2 minutes.

[0047] It can be understood that, according to the time displacement information of the second key frame relative to the first key frame, the first mapping sub-relationship is adjusted to obtain the second mapping sub-relationship between the associated at least one bullet comment and the second sprite image.

[0048] Through the embodiments provided by the present application, the first mapping relationship between at least one barrage and the first Sprite is adjusted according to the time displacement information system of the key frame before and after the media resource is corrected, and the second mapping relationship between at least one barrage and the second Sprite is obtained, thereby efficiently achieving the purpose of automatic display time adjustment of the barrage after the media resource is corrected, greatly reducing the complexity of manual operation, and achieving the technical effect of improving the correction efficiency of the barrage display time.

[0049] As an optional solution, the first mapping sub-relationship is adjusted according to the time displacement information of the second key frame relative to the first key frame to obtain a second mapping sub-relationship between the bullet comment associated with the first key frame and the second sprite image, including:

[0050] In a case where the time displacement information indicates that the second key frame moves a target time period relative to the first key frame, a display time correction is performed on the basis of the first display time of the barrage associated with the first key frame indicated by the first mapping sub-relationship in the first media resource to obtain a second display time, wherein the second mapping sub-relationship is used to indicate the second display time of the barrage associated with the first key frame in the second media resource, and the second display time is related to the moving direction of the second key frame relative to the first key frame, and differs from the first display time by a target time period.

[0051] Optionally, in this embodiment, the time displacement information can be but is not limited to being used to indicate the time change of the playback time node of the second key frame in the second media resource relative to the playback time node of the first key frame in the first media resource, wherein the playback time node of the second key frame in the second media resource and the playback time node of the first key frame in the first media resource share a same timeline.

[0052] Optionally, in this embodiment, when the time displacement information indicates that the second key frame is moved forward by the first time period relative to the playback time node of the first key frame, the display time of the bullet commentary corresponding to the second key frame is also moved forward by the first time period. When the time displacement information indicates that the second key frame is moved backward by the second time period relative to the playback time node of the first key frame, the display time of the bullet commentary corresponding to the second key frame is also moved backward by the second time period.

[0053] Through the embodiments provided by the present application, the first mapping relationship between at least one barrage and the first Sprite is adjusted according to the time displacement information system of the key frame before and after the media resource is corrected, and the second mapping relationship between at least one barrage and the second Sprite is obtained, thereby efficiently achieving the purpose of automatic display time adjustment of the barrage after the media resource is corrected, greatly reducing the complexity of manual operation, and achieving the technical effect of improving the correction efficiency of the barrage display time.

[0054] As an optional solution, before creating the second Sprite image for the second media resource, the method further includes at least one of the following:

[0055] In response to a media resource filling request triggered by the first media resource, filling a first media sub-resource at a first media position in the first media resource to obtain a second media resource; and / or,

[0056] In response to a media resource deletion request triggered on a first media resource, a second media sub-resource is deleted at a first media position in the first media resource to obtain a second media resource.

[0057] Optionally, in this embodiment, the media resource modification of the first media resource to obtain the second media resource may include, but is not limited to, filling in the media resource and / or deleting the media resource on the basis of the first media resource to obtain the second media resource.

[0058] It should be noted that filling media resources based on the first media resource may include but is not limited to filling at least one media sub-resource in at least one media position in the first media resource. Deleting media resources based on the first media resource may include but is not limited to deleting at least one media sub-resource in at least one media position in the first media resource.

[0059] It can be understood that, in the case of performing a resource replacement operation on the first media resource, it can be understood that the media sub-resource at the target position of the first media resource is first deleted, and then the new media sub-resource is filled at the target position.

[0060] Through the embodiments provided in the present application, by triggering a media resource filling request and a media resource deletion request on a first media resource, the purpose of modifying the media resource on the first media resource to obtain a second media resource is achieved, thereby adjusting the media resource quickly, efficiently and flexibly.

[0061] As an optional solution, after the first media sub-resource is filled in the first media position in the first media resource to obtain the second media resource, the method further includes:

[0062] Obtain at least one key frame included in the first Sprite image, and obtain a key frame corresponding to the first media sub-resource;

[0063] According to the first media position, fill the key frame corresponding to the first media sub-resource on the basis of at least one key frame, and obtain a second sprite image created for the second media resource based on the filled key frames;

[0064] After deleting the second media sub-resource at the first media position in the first media resource to obtain the second media resource, the method further includes:

[0065] Acquire at least one key frame, and acquire a key frame corresponding to the second media sub-resource, wherein the at least one key frame includes a key frame corresponding to the second media sub-resource;

[0066] According to the second media position, the key frames corresponding to the second media sub-resource are deleted based on at least one key frame, and a second Sprite image created for the second media resource is obtained based on the deleted key frames.

[0067] Optionally, in this embodiment, the key frame corresponding to the first media sub-resource is determined in the same manner as the at least one key frame included in the first Sprite image, and may include but is not limited to the same preset time interval.

[0068] Optionally, in this embodiment, according to the order in which the first media sub-resources are distributed in the first media resource, key frames corresponding to the first media sub-resources are sequentially filled / inserted into at least one key frame to obtain multiple key frames to form a second sprite.

[0069] Optionally, in this embodiment, according to the distribution order of the second media sub-resources in the first media resource, key frames corresponding to the second media sub-resources are deleted from at least one key frame in order to obtain at least one key frame to form a second Sprite image.

[0070] Through the embodiments provided by the present application, based on the filling / deletion of media resources, the key frames of the media resources after filling / deletion are corrected, and then a new second Sprite image is obtained, so as to quickly and efficiently establish a mapping relationship between the new barrage and the second Sprite image based on the difference information between the second Sprite image and the first Sprite image, and obtain the display time information of the barrage in the media resources after filling / deletion.

[0071] As an optional solution, create a first Sprite image for the first media resource, including:

[0072] Extracting at least one key frame from the first media resource at a preset time interval;

[0073] At least one key frame is spliced ​​in chronological order to generate a first Sprite image of a first media resource.

[0074] Optionally, in this embodiment, a first media resource to be processed is obtained, and content analysis is performed on the first media resource, and at least one key frame is automatically extracted from the first media resource at a set time interval, wherein the at least one key frame is a key frame representing a content change of the first media resource, the first media resource may be but is not limited to a video resource, and the set time interval may be but is not limited to a frames per second or b frames per minute, where a and b are positive integers.

[0075] As an optional solution, after establishing a second mapping relationship between at least one bullet comment and the second sprite image, the method further includes:

[0076] In the case where there is a deviation barrage whose display time exceeds the expected playback time of the second media resource in at least one barrage, the deviation barrage is marked, wherein the mark is used to indicate that the deviation barrage is hidden when the second media resource is played.

[0077] Optionally, in this embodiment, if the media resource modification operation causes the time points of certain barrages to exceed the expected playback time of the media resources, the system will automatically mark these barrages as invalid and notify the operator for further processing to avoid users encountering unreasonable barrage display problems during the viewing process.

[0078] As an optional solution, the above-mentioned method for correcting the display time of barrage is applied to a scenario of automatic correction of barrage in a media asset replacement film. In this scenario, with the continuous enrichment of the content of online video platforms, the demand for replacement operations after the video media assets are online is increasing. This replacement operation is usually caused by program production adjustments, advertising insertion or review. While the replacement operation brings about content adjustment, it also causes a significant problem: the misalignment of barrage time.

[0079] At present, the common solution is to manually record the time nodes of the replacement film, and then have the barrage operator manually adjust the time of each barrage. This method is not only time-consuming and laborious, but also due to the complexity and changeability of the replacement film content, it is easy to make mistakes during the manual adjustment process, which in turn affects the user's viewing experience. In particular, when the video content is replaced multiple times, the problem of time misalignment of the barrage is more prominent.

[0080] It is understandable that the above commonly used solutions have a low degree of automation and rely on manual operation. They cannot achieve real-time, automated adjustment of the bullet screen time and are difficult to cope with frequent film replacement needs. They lack accuracy and are prone to time deviations. Especially in complex film replacement scenarios, it is difficult to ensure the accuracy of the bullet screen time adjustment, which may cause the bullet screen content to be out of sync with the video content. They lack scalability and are difficult to maintain efficient and stable operation in the face of large-scale film replacement operations. They lack the ability to cope with diverse video content, resulting in a decline in user experience.

[0081] In order to solve the above defects, this embodiment uses the above method for correcting the display time of bullet comments to generate a corresponding segment timeline sprite according to the media asset segments during the process of video content production and processing. The sprite is composed of key frame images of the video in chronological order.

[0082] Optionally, key frames are extracted from the video according to set time intervals (for example, 1 frame per second or 1 frame per minute), and these key frames can represent the main changes in the video content. Each key frame will be marked with a precise timestamp, and the marked time point is the time position of the frame in the original video. In addition to saving the key frame image, the Sprite also contains the displacement information of each key frame on the video timeline, which will be used for the automatic adjustment of the subsequent barrage time. Contains: video start time, end time, video playback time of each key frame, key frame image width, height, number of rows, number of columns, and number of key frame images.

[0083] When a user sends a bullet comment while watching a video, the following operations are performed to record the bullet comment information: Record the video playback time point when the user sends the bullet comment, which corresponds to the actual playback time of the video content. Map the sending time of the bullet comment to the specific position in the media asset timeline sprite chart, that is, find the key frame image corresponding to the time point. Associate the video playback time point of the bullet comment with the position of the sprite chart and store them, forming a corresponding relationship between bullet comment-time-sprite chart position. This record provides a data basis for the correction of the bullet comment time after the subsequent replacement operation.

[0084] When performing a video replacement operation, perform the following steps to ensure the consistency of the content before and after the replacement: Before the replacement operation begins, generate a list of video sprites before the replacement as a timeline reference for the content before the replacement. Compare the sprites before and after the replacement frame by frame, and form a time mapping relationship by calculating the time difference of each key frame before and after the replacement. This mapping relationship will reflect the time displacement before and after the replacement and determine the new timeline.

[0085] The time axis position of the barrage is automatically corrected by using the time mapping relationship of the sprite images before and after the replacement. The specific steps are as follows: Extract the original sending time point of each barrage and its position in the sprite image from the record. According to the time mapping relationship obtained by key frame comparison, the original time point of the barrage is converted to a new time point. For example, if the time axis of a certain video content moves forward by 2 minutes after the replacement, the corresponding barrage time should also move forward by 2 minutes accordingly. The converted new time point is stored in the barrage system to replace the old time point, thereby completing the automatic correction of the barrage time.

[0086] For video content that needs to be replaced, it is processed in the following way: after each replacement operation, a new sprite is generated and key frame comparison is performed to establish a time mapping relationship. The history of each replacement operation is retained so that it can be traced back or further adjusted when necessary.

[0087] In order to improve the user experience, the following optimization measures are also implemented after the film replacement operation is completed: After the film replacement operation is completed, the system immediately triggers the automatic correction operation of the barrage time to ensure that the barrage display is synchronized with the video content when the user watches the content after the film replacement.

[0088] It should be noted that the automatic correction method of barrage provided in this embodiment has good scalability and integration capabilities, including: it can be seamlessly integrated into the existing video content management system (CMS) to achieve rapid data exchange and processing through standardized interfaces. It is not only suitable for traditional on-demand video content, but also can be expanded to support barrage time correction for various media scenarios such as live broadcast to on-demand, advertising replacement, and international subtitles. It provides an open API interface for third-party developers or other business systems to facilitate the integration of the barrage correction function into a wider range of application scenarios, thereby improving the versatility of the system.

[0089] Optionally, in the above-mentioned bullet screen automatic correction method, a schematic diagram of a media resource timeline sprite image generation process is as follows: Figure 2 As shown, specifically including:

[0090] S202, video import and analysis: import the video file to be processed, start analyzing the video content, and extract key frames.

[0091] S204, key frame extraction: automatically extract key frame images that can represent changes in the main content of the video from the video according to a set time interval (eg, 1 frame per second or 1 frame per minute).

[0092] S206, sprite image stitching: stitching the extracted key frame images in chronological order to generate a media asset timeline sprite image. An optional sprite image schematic diagram is as follows Figure 3 shown.

[0093] S208, Sprite image storage: the generated Sprite image is stored in the database of the system for use in subsequent steps.

[0094] Optionally, in the above-mentioned automatic correction method of bullet screen, a schematic diagram of a process of recording bullet screen time points and sprite image positions is as follows: Figure 4 As shown, specifically including:

[0095] S402, sending bullet comments: when the user is watching a video, the time point of each bullet comment sent by the user is recorded in real time.

[0096] S404, recording the playback time of the bullet comment video: mapping the sending time of each bullet comment to a specific position in the sprite chart, and determining the video key frame position corresponding to the bullet comment.

[0097] S406, record the displacement information (row, column) and time difference (bullet time - sprite time) of the bullet screen near the sprite image: store the bullet screen time point and its corresponding sprite image position in association to form a corresponding relationship between bullet screen - time - sprite image position. These data will be used to correct the bullet screen time after the replacement.

[0098] Optionally, in the above-mentioned bullet screen automatic correction method, a schematic diagram of a replacement operation and time mapping process is as follows: Figure 5 As shown, specifically including:

[0099] S502, read the elements of the sprite image after the replacement.

[0100] S504, contrast and match the elements of the sprite image before the replacement.

[0101] S506, establishing a mapping relationship between the displacement information of the elements of the Sprite image before and after the replacement: in the case of a successful match, the Sprite images before and after the replacement are compared frame by frame, the time displacement difference of each key frame is calculated, and a mapping relationship between the new and old time axes is established.

[0102] It should be noted that, if the matching fails, the process ends.

[0103] Optionally, in the above-mentioned automatic correction method of bullet screen, a schematic diagram of the automatic correction process of bullet screen time is as follows: Figure 6 As shown, specifically including:

[0104] S602, traverse the bullet comment data according to the associated sprite element.

[0105] S604, obtaining the mapping relationship between the sprite image elements before and after the replacement.

[0106] S606, determine whether the mapping is included.

[0107] S608, in the case of including mapping, modify the time of the bullet comment video, use the time mapping relationship obtained by comparing the key frames before and after the replacement, automatically correct the time axis position of the bullet comment, and convert the old time point to the new time point. The corrected new time point will be updated to the bullet comment system, replacing the original time record, to ensure that the bullet comment is displayed synchronously with the video content after the replacement.

[0108] S610, when no mapping is included, determining that the barrage mark is invalid.

[0109] S612, notify the operator.

[0110] Optionally, in the above-mentioned automatic correction method of barrage, key frames are automatically extracted from the video during the production process of video content. The extraction frequency of key frames can be adjusted according to the specific situation of the video, for example, one segment every 10 seconds, and 1 frame is extracted from each segment per second to ensure that the key frames can represent the main changes in the video content. The extracted key frames are spliced ​​in chronological order to generate a media asset timeline sprite. Each key frame image occupies a fixed position in the sprite and is accompanied by corresponding timestamp information. This timestamp marks the specific time position of the key frame in the original video. Each barrage sent by the user while watching the video will automatically record its sending time point, and map the time point to the specific position in the sprite. This mapping relationship will be stored in the database for subsequent barrage time correction after the replacement of the film.

[0111] Optionally, in the above-mentioned automatic correction method of barrage, before performing the video replacement operation, first generate a video sprite before the replacement and save it as a reference image. The sprite contains all key frames and their corresponding time displacement information. According to the specific operation type of the replacement (such as adding, deleting or replacing the content), generate a new video sprite after the replacement. This sprite is compared frame by frame with the sprite before the replacement. By comparing the key frames before and after the replacement, the time displacement difference of each key frame is calculated, and the mapping relationship between the video time axis before and after the replacement is established. The time mapping relationship will record the correspondence between the new and old time axes for the subsequent automatic adjustment of the barrage time.

[0112] Optionally, in the above-mentioned automatic correction method of barrage, the original time point of each barrage and its corresponding sprite image position are extracted from the database. The barrage time point recorded before the film replacement is converted into a new time point after the film replacement using the time mapping relationship obtained by key frame comparison. For example, if a certain video content is moved forward by 2 minutes due to the film replacement operation, the corresponding barrage time should also be moved forward by 2 minutes. The new time point after mapping adjustment is updated to the barrage system to replace the original barrage time record. In this way, when the user watches the video content after the film replacement, the barrage can still be displayed synchronously with the video content.

[0113] Optionally, in the above-mentioned automatic correction method of barrage, in the case where the video content is replaced multiple times, a new time mapping relationship will be generated after each replacement operation according to the above process, and applied to all recorded barrages one by one to ensure that the time of the barrage after each replacement can be correctly adjusted. If the replacement operation causes the time points of some barrages to exceed the new duration range of the video, these barrages will be automatically marked as invalid, and the operator will be notified for further processing to avoid users encountering unreasonable barrage display problems during the viewing process. This method can be seamlessly integrated with the existing video content management system (CMS) and supports barrage time correction for multiple media types. In addition, the system provides an open API interface, allowing third-party developers to call the automatic barrage correction function and expand it to more application scenarios, such as replacement of live to on-demand content, barrage correction after advertising insertion, etc.

[0114] The following is a summary of the beneficial effects of the automatic correction method of the barrage in this embodiment.

[0115] Innovative application of media asset timeline sprite: By splicing the video into a sprite in chronological order according to the key frames in the segment, the bullet comments at each time point can be mapped to a specific sprite position. This innovative design provides a precise positioning basis for the bullet comment time correction after the replacement of the video, avoiding the errors in traditional manual adjustment.

[0116] The association record of the time point of the bullet comment and the position of the sprite image: The traditional bullet comment system only records the time point of the bullet comment, and this embodiment further associates each bullet comment with the position of the sprite image on the time axis of the corresponding media asset on this basis. This improvement enables the system to quickly find the correct time position of the bullet comment through the sprite image comparison after the replacement occurs, greatly improving the efficiency and accuracy of time correction.

[0117] Automatic comparison of key frames before and after the replacement: This embodiment automatically compares the key frames of the sprite image before and after the replacement to establish a time mapping relationship before and after the replacement. This improvement enables the system to automatically calculate the displacement difference of each time period after the replacement operation is completed, so as to quickly adjust the position of the relevant bullet comments. Compared with traditional manual calculation and manual adjustment, this process is more efficient and accurate.

[0118] Automatic bullet time correction mechanism: After the replacement operation is completed, this embodiment designs an automatic bullet time correction mechanism, which can automatically update the time position of each bullet according to the time mapping relationship before and after the replacement. This improvement not only greatly reduces the complexity of manual operation, but also effectively prevents errors that may be caused by manual adjustment, providing users with a seamless viewing experience.

[0119] Enhanced system expansion and integration capabilities: The technical solution of this embodiment has good scalability and can be seamlessly integrated with the existing video content management system (CMS) and bullet screen system. Through the open API interface, it supports third-party systems to call the bullet screen automatic correction function to meet the application requirements of various media asset replacement scenarios. This improvement provides the platform with higher flexibility and compatibility, and adapts to the diverse needs of content management.

[0120] It is understandable that in the specific implementation of this application, related data such as user information is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0121] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0122] According to another aspect of the embodiment of the present application, a device for correcting the display time of a bullet screen is provided for implementing the method for correcting the display time of a bullet screen. Figure 7 As shown, the device comprises:

[0123] A first creation unit 702 is configured to create a first sprite image for a first media resource, wherein the first sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet comment to be displayed synchronously;

[0124] A first establishing unit 704 is used to establish a first mapping relationship between at least one bullet comment and a first sprite image according to a first media time associated with at least one bullet comment and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate display time information of at least one bullet comment in the first media resource;

[0125] A second creation unit 706 is configured to create a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained by modifying the first media resource;

[0126] The second establishing unit 708 is used to establish a second mapping relationship between at least one bullet comment and the second Sprite image according to the difference information between the second Sprite image and the first Sprite image, wherein the second mapping relationship is used to indicate the display time information of at least one bullet comment in the second media resource.

[0127] As an optional solution, the second establishing unit 708 includes:

[0128] A first acquisition module is used to acquire a first mapping sub-relationship between a bullet comment associated with the first key frame and the first Sprite image when the first Sprite image includes a first key frame and the second Sprite image includes a second key frame corresponding to the first key frame, wherein the first key frame and the second key frame are associated with the same bullet comment, at least one bullet comment includes a bullet comment associated with the first key frame, and the first mapping relationship includes a first mapping sub-relationship;

[0129] The adjustment module is used to adjust the first mapping sub-relationship according to the time displacement information of the second key frame relative to the first key frame to obtain the second mapping sub-relationship between the bullet comment associated with the first key frame and the second sprite image, wherein the second mapping relationship includes the second mapping sub-relationship.

[0130] As an optional solution, adjust the module, including:

[0131] A correction submodule is used to correct the display time based on the first display time of the barrage associated with the first key frame indicated by the first mapping subrelationship in the first media resource, so as to obtain a second display time when the time displacement information indicates that the second key frame moves a target time period relative to the first key frame, wherein the second mapping subrelationship is used to indicate the second display time of the barrage associated with the first key frame in the second media resource, and the second display time is related to the moving direction of the second key frame relative to the first key frame, and differs from the first display time by a target time period.

[0132] As an optional solution, the device further includes at least one of the following:

[0133] A first filling module is applied before creating a second Sprite image for a second media resource, in response to a media resource filling request triggered by the first media resource, to fill the first media sub-resource in the first media position of the first media resource to obtain the second media resource; and / or,

[0134] The first deletion module is applied before creating the second Sprite image for the second media resource, and in response to a media resource deletion request triggered on the first media resource, deletes the second media sub-resource at the first media position in the first media resource to obtain the second media resource.

[0135] As an optional solution, the device also includes:

[0136] A second acquisition module is used to fill the first media sub-resource in the first media position in the first media resource, and after obtaining the second media resource, obtain at least one key frame included in the first Sprite image, and obtain the key frame corresponding to the first media sub-resource;

[0137] A second filling module is used to fill the first media sub-resource in the first media position in the first media resource, and after obtaining the second media resource, fill the key frame corresponding to the first media sub-resource based on at least one key frame according to the first media position, and obtain a second sprite image created for the second media resource based on the filled multiple key frames;

[0138] The device also includes:

[0139] A third acquisition module is used to delete the second media sub-resource at the first media position in the first media resource, and after obtaining the second media resource, obtain at least one key frame and obtain the key frame corresponding to the second media sub-resource, wherein the at least one key frame includes the key frame corresponding to the second media sub-resource;

[0140] The second deletion module is applied to delete the second media sub-resource at the first media position in the first media resource. After obtaining the second media resource, the key frame corresponding to the second media sub-resource is deleted based on at least one key frame according to the second media position, and a second sprite image created for the second media resource is obtained based on the deleted multiple key frames.

[0141] As an optional solution, the first creating unit 702 includes:

[0142] An extraction module, configured to extract at least one key frame from the first media resource at a preset time interval;

[0143] The splicing module is used to splice at least one key frame in time sequence to generate a first Sprite image of the first media resource.

[0144] As an optional solution, the device also includes:

[0145] A marking module is used to mark the deviation barrage after establishing a second mapping relationship between at least one barrage and a second Sprite image, if there is a deviation barrage in at least one barrage whose display time exceeds the expected playback time of the second media resource, wherein the mark is used to indicate that the deviation barrage is hidden when playing the second media resource.

[0146] According to another aspect of the embodiment of the present application, an electronic device for implementing the above-mentioned method for correcting the bullet screen display time is also provided, further as follows Figure 8 As shown, the electronic device includes a memory 802 and a processor 804. The memory 802 stores a computer program, and the processor 804 is configured to execute the steps in any of the above method embodiments through the computer program.

[0147] Optionally, in this embodiment, the electronic device may be located in at least one network device among a plurality of network devices of a computer network.

[0148] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0149] S1, creating a first sprite image for a first media resource, wherein the first sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet comment to be displayed synchronously;

[0150] S2, establishing a first mapping relationship between at least one bullet comment and a first sprite image according to a first media time associated with at least one bullet comment and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate display time information of at least one bullet comment in the first media resource;

[0151] S3, creating a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained by modifying the first media resource;

[0152] S4. Establish a second mapping relationship between at least one bullet comment and the second sprite image based on the difference information between the second sprite image and the first sprite image, wherein the second mapping relationship is used to indicate display time information of at least one bullet comment in the second media resource.

[0153] Alternatively, a person skilled in the art may understand that: Figure 8 The structure shown is for illustration only. Figure 8 The structure of the electronic device is not limited. Figure 8 More or fewer components (such as network interfaces, etc.) as shown in, or with Figure 8 Different configurations are shown.

[0154] Among them, the memory 802 can be used to store software programs and modules, such as the program instructions / modules corresponding to the method and device for correcting the barrage display time in the embodiment of the present application. The processor 804 executes various functional applications and data processing by running the software programs and modules stored in the memory 802, that is, to implement the above-mentioned method for correcting the barrage display time. The memory 802 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 802 may further include a memory remotely arranged relative to the processor 804, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned networks include but are not limited to the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Among them, the memory 802 can be specifically but not limited to being used to store information such as the first mapping relationship, the second mapping relationship, etc. As an example, such as Figure 8 As shown, the memory 802 may include, but is not limited to, the first creation unit 702, the first establishment unit 704, the second creation unit 706, and the second establishment unit 708 in the device for correcting the display time of the bullet screen. In addition, other module units in the device for correcting the display time of the bullet screen may also be included but are not limited to, which will not be repeated in this example.

[0155] Optionally, the transmission device 806 is used to receive or send data via a network. Specific examples of the network may include wired networks and wireless networks. In one example, the transmission device 806 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers via a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 806 is a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0156] In addition, the electronic device further includes: a display 808 for displaying information such as the first mapping relationship and the second mapping relationship; and a connection bus 810 for connecting various module components in the electronic device.

[0157] In other embodiments, the client or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the multiple nodes in the form of network communication. A peer-to-peer network may be formed between the nodes, and any form of computing device, such as a server, a client, or other electronic device, may become a node in the blockchain system by joining the peer-to-peer network.

[0158] According to one aspect of the present application, a computer program product is provided, the computer program product comprising a computer program / instruction, the computer program / instruction comprising a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part, and / or installed from a removable medium. When the computer program is executed by a central processing unit, various functions provided by the embodiments of the present application are executed.

[0159] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0160] It should be noted that the computer system of the electronic device is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0161] The computer system includes a central processing unit (CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) or the program loaded from the storage part to the random access memory (RAM). In the random access memory, various programs and data required for system operation are also stored. The central processing unit, the read-only memory and the random access memory are connected to each other through a bus. The input / output interface (I / O interface) is also connected to the bus.

[0162] The following components are connected to the input / output interface: an input part including a keyboard, a mouse, etc.; an output part including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part including a hard disk, etc.; and a communication part including a network interface card such as a local area network card, a modem, etc. The communication part performs communication processing via a network such as the Internet. A drive is also connected to the input / output interface as needed. Removable media, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., are installed on the drive as needed so that the computer program read therefrom is installed into the storage part as needed.

[0163] In particular, according to an embodiment of the present application, the process described in each method flow chart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part, and / or installed from a removable medium. When the computer program is executed by a central processing unit, various functions defined in the system of the present application are executed.

[0164] According to one aspect of the present application, a computer-readable storage medium is provided, and a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above-mentioned various optional implementations.

[0165] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0166] S1, creating a first sprite image for a first media resource, wherein the first sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet comment to be displayed synchronously;

[0167] S2, establishing a first mapping relationship between at least one bullet comment and a first sprite image according to a first media time associated with at least one bullet comment and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate display time information of at least one bullet comment in the first media resource;

[0168] S3, creating a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained by modifying the first media resource;

[0169] S4. Establish a second mapping relationship between at least one bullet comment and the second sprite image based on the difference information between the second sprite image and the first sprite image, wherein the second mapping relationship is used to indicate display time information of at least one bullet comment in the second media resource.

[0170] Optionally, in this embodiment, a person of ordinary skill in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing hardware related to the electronic device through a program, and the program may be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0171] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0172] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling one or more computer devices (which can be personal computers, servers or network devices, etc.) to execute all or part of the steps of the methods of each embodiment of the present application.

[0173] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0174] In the several embodiments provided in the present application, it should be understood that the recorded client can be implemented in other ways. Among them, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0175] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0176] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0177] The above are only preferred implementations of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A method for correcting the display time of a bullet screen, characterized in that: include: Creating a first Sprite image for a first media resource, wherein the first Sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet comment displayed synchronously; Establishing a first mapping relationship between the at least one bullet comment and the first sprite image according to a first media time associated with the at least one bullet comment and a second media time associated with the at least one key frame, wherein the first mapping relationship is used to indicate display time information of the at least one bullet comment in the first media resource; Creating a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained by performing media resource modification on the first media resource; Based on the difference information between the second Sprite image and the first Sprite image, a second mapping relationship between the at least one barrage and the second Sprite image is established, wherein the second mapping relationship is used to indicate the display time information of the at least one barrage in the second media resource.

2. The method according to claim 1, characterized in that The establishing a second mapping relationship between the at least one bullet comment and the second Sprite image according to the difference information between the second Sprite image and the first Sprite image comprises: In a case where the first Sprite image includes a first key frame and the second Sprite image includes a second key frame corresponding to the first key frame, obtaining a first mapping sub-relationship between a bullet comment associated with the first key frame and the first Sprite image, wherein the first key frame and the second key frame are associated with the same bullet comment, the at least one bullet comment includes a bullet comment associated with the first key frame, and the first mapping relationship includes the first mapping sub-relationship; According to the time displacement information of the second key frame relative to the first key frame, the first mapping sub-relationship is adjusted to obtain a second mapping sub-relationship between the barrage associated with the first key frame and the second Sprite image, wherein the second mapping relationship includes the second mapping sub-relationship.

3. The method according to claim 1, characterized in that The first mapping sub-relationship is adjusted according to the time displacement information of the second key frame relative to the first key frame to obtain a second mapping sub-relationship between the bullet comment associated with the first key frame and the second sprite image, including: In a case where the time displacement information indicates that the second key frame moves a target time period relative to the first key frame, a display time correction is performed based on the first display time of the barrage associated with the first key frame in the first media resource indicated by the first mapping sub-relationship to obtain a second display time, wherein the second mapping sub-relationship is used to indicate the second display time of the barrage associated with the first key frame in the second media resource, and the second display time is related to the moving direction of the second key frame relative to the first key frame and differs from the first display time by the target time period.

4. The method according to claim 1, characterized in that Before creating the second Sprite image for the second media resource, the method further includes at least one of the following: In response to a media resource filling request triggered by the first media resource, a first media sub-resource is filled in a first media position in the first media resource to obtain the second media resource; and / or, in response to a media resource deletion request triggered by the first media resource, a second media sub-resource is deleted in a first media position in the first media resource to obtain the second media resource.

5. The method according to claim 4, characterized in that After filling the first media sub-resource in the first media position in the first media resource to obtain the second media resource, the method further includes: Acquire the at least one key frame included in the first Sprite image, and acquire the key frame corresponding to the first media sub-resource; According to the first media position, filling the key frame corresponding to the first media sub-resource on the basis of the at least one key frame, and obtaining the second Sprite image created for the second media resource based on the filled key frames; After deleting the second media sub-resource at the first media position in the first media resource to obtain the second media resource, the method further includes: Acquire the at least one key frame, and acquire the key frame corresponding to the second media sub-resource, wherein the at least one key frame includes the key frame corresponding to the second media sub-resource; According to the second media position, the key frames corresponding to the second media sub-resource are deleted based on the at least one key frame, and the second Sprite image created for the second media resource is obtained based on the deleted key frames.

6. The method according to any one of claims 1 to 5, characterized in that: The step of creating a first Sprite image for the first media resource includes: Extracting the at least one key frame from the first media resource at a preset time interval; The at least one key frame is spliced ​​in chronological order to generate the first Sprite image of the first media resource.

7. The method according to any one of claims 1 to 5, characterized in that: After establishing the second mapping relationship between the at least one bullet comment and the second Sprite image, the method further includes: In the case where there is a deviation barrage in the at least one barrage whose display time exceeds the expected playback time of the second media resource, the deviation barrage is marked, wherein the mark is used to indicate that the deviation barrage is hidden when the second media resource is played.

8. A device for correcting the display time of a bullet screen, characterized in that: include: A first creation unit is used to create a first sprite image for a first media resource, wherein the first sprite image is composed of at least one key frame of the first media resource, and the first media resource is associated with at least one bullet comment to be displayed synchronously; A first establishing unit is used to establish a first mapping relationship between at least one bullet comment and a first sprite image according to a first media time associated with at least one bullet comment and a second media time associated with at least one key frame, wherein the first mapping relationship is used to indicate display time information of at least one bullet comment in the first media resource; A second creation unit is used to create a second Sprite image for a second media resource, wherein the second media resource is a media resource obtained by modifying the first media resource; The second establishing unit is used to establish a second mapping relationship between at least one bullet comment and the second Sprite image according to the difference information between the second Sprite image and the first Sprite image, wherein the second mapping relationship is used to indicate the display time information of at least one bullet comment in the second media resource.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program executes the method described in any one of claims 1 to 7 when executed by an electronic device.

10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 7 through the computer program.

Images