Video episode switching transition method

Through the transition video and multiplayer technology generated by AIGC multimodal big model, the problem of unsmooth switching of series on the online video platform is solved, seamless connection and smooth switching of video series are achieved, and user experience is improved.

CN119071593APending Publication Date: 2024-12-03HANGZHOU ARCVIDEO TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411227895.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The screen performance of the online video platform is not smooth enough when switching episodes, resulting in the customer's viewing thoughts being interrupted, and it is difficult for the existing technology to achieve seamless connection between episode switching.

Method used

Using artificial intelligence content generation (AIGC) multi-modal big model to generate transition videos related to the content and tones before and after the episode, it realizes seamless switching of episodes through multiplayer technology, and uses transition videos to cover the time-consuming switching of episodes. , achieve a smooth and unconscious effect.

Benefits of technology

The transition video generated through AIGC technology achieves seamless connection of video series, improving the viewing experience in continuous viewing scenes of multiple episodes, ensuring the smooth and unconscious episode switching process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071593A_ABST
    Figure CN119071593A_ABST
Patent Text Reader

Abstract

The invention discloses a video episode switching and transition method, which comprises the following steps of: setting the same video playing window, performing video playing by associating with the video playing window when a previous episode is played, and continuing to associate with the video playing window to play a transition video when the transition video is played, after the playing of the next episode is prepared, the video playing window is associated to play the next episode, and only the current video playing is associated with the video playing window at the same time; the transition video is generated by using an AIGC multi-mode large model; a first player is created to play episodes, a second player is created to play transition videos, and seamless switching of the episodes is realized by controlling dynamic switching of the first player and the second player and circulation of a video playing window between the first player and the second player.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of video playback, and in particular relates to a method for switching scenes of a video series. Background Art

[0002] Internet video has become the mainstream scenario for video playback, which is called online video playback. The mainstream online video platforms are in fierce competition. In addition to providing high-quality video content, they are also constantly optimizing the video playback experience to provide customers with the best viewing experience. There are two main screen display performances for VIP members when switching episodes on online video platforms: the first is that when the episodes are switched, the screen goes black and then a buffering screen that keeps spinning appears until the buffering ends and the video screen appears to enter the next episode playback; the second is that when the episodes are switched, the screen stays on a static screen and a buffering screen that keeps spinning appears until the buffering ends and the screen switches to the new episode for playback. The above two screen display performances when switching episodes have the disadvantages that the episode switching is not smooth enough, the picture connection is unnatural, and the customer's viewing thoughts are easily interrupted.

[0003] AIGC stands for Artificial Intelligence Generated Content. After the emergence of the revolutionary Chat-GPT, AIGC multimodal large model research has become popular all over the world, and AI technology has made rapid progress in the fields of text generation, image generation, video generation, and audio generation. In particular, the launch of the artificial intelligence text video large model (Sora) released by the artificial intelligence research company OpenAI has made it possible to automatically generate videos based on plot scripts. Therefore, the shortcomings of the episode switching experience can be optimized using AIGC technology. Summary of the invention

[0004] In view of the above problems, the present invention provides a method for switching scenes of video series, which is used to generate a transition video associated with the content and color tone before and after the series through AIGC video content generation technology, and use the generated transition video to achieve seamless connection of series switching, so as to achieve smooth and imperceptible switching of series, and achieve the purpose of optimizing the viewing experience of series switching.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0006] A video episode switching method comprises the following steps:

[0007] The same video playback window is set, and when the previous episode is played, the video playback window is associated with the video playback window for video playback. When the transition video is played, the video playback window is continued to be associated with the transition video. When the next episode is ready to play, the video playback window is also associated with the next episode. At the same time, only the current video playback is associated with the video playback window; the transition video is generated using the AIGC multimodal large model;

[0008] Create a first player to play the episodes, and a second player to play the transition videos. Seamless switching of episodes is achieved by controlling the dynamic switching of the first and second players and the flow of video playback windows between the first and second players. The playback switching logic is as follows:

[0009] Use the first player to create a second player in advance before the previous episode ends, and use the transition video to initialize the player to the waiting screen state and then pause;

[0010] When the previous episode is finished playing, close the first player, associate the play window W0 with the second player, call the start play interface of the second player to start playing the transition video, and use the play address of the next episode to reinitialize the first player to the waiting screen state and then pause;

[0011] When the transition video is finished playing, close the second player, associate the video playing window with the first player, and call the start playing interface of the first player to start playing the next episode;

[0012] Through the above process, seamless switching of video series can be achieved.

[0013] In a possible implementation manner, the generation of the transition video using the AIGC multimodal large model specifically includes:

[0014] When obtaining the basic information of the previous episode, obtain the ending shot script and the main color tone of the ending shot of the current episode from the basic information;

[0015] Continuously collect network download rate statistics during the playback of the previous episode;

[0016] A certain time before the end of the previous episode, the basic information of the next episode is obtained in advance, and the starting shot script and the main color tone of the starting shot of the next episode are obtained from the basic information;

[0017] Calculate the duration of the transition video based on the network download rate, the bit rate of the next episode video, the duration of the player's start-up cache data, and the weight coefficient k;

[0018] The AIGC video generation service is called to generate a transition video based on the duration of the transition video, the ending shot script of the previous episode, the main color tone of the ending shot of the previous episode, the starting shot script of the next episode, the main color tone of the starting shot of the next episode, and auxiliary information.

[0019] In one possible implementation, the script of the ending shot of the previous episode uses text to describe the content of the ending shot of the episode, which is sent to the AIGC big model to understand the content of the ending shot of the episode.

[0020] In a possible implementation, the main color tone of the ending shot of the previous episode is to use words to describe the overall tendency of the color of the ending shot.

[0021] In one possible implementation, the script for the next episode's opening shot uses text to describe the content of the episode's opening shot, which is then sent to the AIGC big model for understanding the content of the episode's beginning.

[0022] In a possible implementation, the main color tone of the beginning shot of the next episode is to use words to describe the overall tendency of the color of the beginning shot.

[0023] In one possible implementation, the transition video duration TransVdieo_Duration matches the episode switching time Change_Time, so that the transition video covers the episode switching time. The episode switching time Change_Time depends on parameters including the network download rate Net_Speed, the next episode video bitrate Next_Bitrate and the player start-up cache data duration Start_CacheDuration. The episode switching time Change_Time = Start_CacheDuration*Next_Bitrate / Net_Speed ​​is calculated based on the above parameters, and the transition video duration TransVdieo_Duration = k*Change_Time is calculated using the episode switching time Change_Time and the weight coefficient k, where the weight coefficient k>1.

[0024] The present invention has the following beneficial effects:

[0025] (1) Introducing the video generation capabilities of the AIGC multimodal large model, combined with information such as the episode video shot script, the main color tone of the shot, and the duration of the transition video, to generate a transition video that is related to the content of the episodes before and after the video, achieving seamless connection in content;

[0026] (2) By using multi-player technology to initialize the specified video in advance and reuse the same playback window among multiple players, different videos can be seamlessly connected on the timeline, thereby ultimately achieving smooth and imperceptible switching of video series, greatly improving the viewing experience in the scenario of continuous viewing of multiple series. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 The present invention is a flowchart of the steps of a method for switching scenes in a video series according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] join Figure 1 , a video episode switching method, comprising the following steps:

[0030] S10, setting the same video playback window, when the previous episode is played, the video playback window is associated to play the video, when the transition video is played, the video playback window is continued to be associated to play the transition video, and when the next episode is ready to play, the video playback window is also associated to play the next episode, and only the current video playback is associated with the video playback window at the same time; wherein the transition video is generated using the AIGC multimodal large model;

[0031] S20, creating a first player responsible for playing the episode, and a second player responsible for playing the transition video. By controlling the dynamic switching between the first player and the second player and the flow of the video playing window between the first player and the second player, the episodes are seamlessly switched. The play switching logic is as follows:

[0032] Use the first player to create a second player in advance before the previous episode ends, and use the transition video to initialize the player to the waiting screen state and then pause;

[0033] When the previous episode is finished playing, close the first player, associate the play window W0 with the second player, call the start play interface of the second player to start playing the transition video, and use the play address of the next episode to reinitialize the first player to the waiting screen state and then pause;

[0034] When the transition video is finished playing, close the second player, associate the video playing window with the first player, and call the start playing interface of the first player to start playing the next episode;

[0035] Through the above process, seamless switching of video series can be achieved.

[0036] Furthermore, in a video episode switching method according to another embodiment of the present invention, the generation of the transition video using the AIGC multimodal large model specifically includes:

[0037] When obtaining the basic information of the previous episode, obtain the ending shot script and the main color tone of the ending shot of the current episode from the basic information;

[0038] Continuously collect network download rate statistics during the playback of the previous episode;

[0039] A certain time before the end of the previous episode, the basic information of the next episode is obtained in advance, and the starting shot script and the main color tone of the starting shot of the next episode are obtained from the basic information; the advance amount of obtaining the basic information of the next episode in advance is configured and adjusted according to the actual situation;

[0040] Calculate the duration of the transition video based on the network download rate, the bit rate of the next episode video, the duration of the player's start-up cache data, and the weight coefficient k;

[0041] The AIGC video generation service is called to generate a transition video based on the duration of the transition video, the ending shot script of the previous episode, the main color tone of the ending shot of the previous episode, the starting shot script of the next episode, the main color tone of the starting shot of the next episode, and auxiliary information.

[0042] Specifically, the purpose of setting the duration of the transition video is to enable the transition video to cover the time consumed by the episode switching. The script of the ending shot of the previous episode uses text to describe the content of the ending shot of the episode, and the description content will be sent to the AIGC model to understand the content of the ending shot of the episode. The duration of the ending shot can be defined as needed, and in a specific application example, it can be the last 15 seconds of the video. The main color tone of the ending shot of the previous episode uses text to describe the overall tendency of the color of the ending shot. The script of the beginning shot of the next episode uses text to describe the content of the beginning shot of the episode, and the description content will be sent to the AIGC model to understand the beginning content of the episode; the duration of the beginning shot can be defined as needed, and in a specific application example, it can be the first 15 seconds of the video. The main color tone of the beginning shot of the next episode uses text to describe the overall tendency of the color of the beginning shot. Other auxiliary information is information that can only help the AIGC model better understand the content requirements of the transition video. In actual applications, relevant definitions can be made according to the characteristics of the AIGC model.

[0043] Generally speaking, the content of a series video will not be changed after it is produced. The shot scripts and main color parameters mentioned above can be prepared in advance and uploaded to the media server as the basic information of the series, and directly obtained from the media server when the series video is played.

[0044] In a specific application example, to achieve seamless and smooth episode switching, the transition video duration TransVdieo_Duration needs to match the episode switching time Change_Time, so that the transition video can cover the episode switching time. The episode switching time Change_Time depends on parameters including the network download rate Net_Speed, the next episode video bitrate Next_Bitrate and the player start-up cache data duration Start_CacheDuration; based on the above parameters, the episode switching time Change_Time = Start_CacheDuration*Next_Bitrate / Net_Speed ​​is calculated. Considering the volatility of the network download rate, in order to ensure that the transition video duration TransVdieo_Duration can cover the actual episode switching time, the episode switching time Change_Time and the weight coefficient k are used to calculate the transition video duration TransVdieo_Duration = k*Change_Time, and the weight coefficient k>1.

[0045] A video episode switching method of a specific application example, the specific implementation steps are as follows:

[0046] First, the basic information of the episode Section1 to be played is obtained from the media server, including but not limited to the playback address Url1, the video bitrate Bitrate1, the video duration Duration1, the video ending shot script End_Script1 and the video ending shot main color End_Tone1;

[0047] Section1 episode video bitrate1 = 2M, video duration1 = 40 minutes, video ending shot script End_Script1 = "Zhang San lay quietly on the bed, looking at the bright moonlight outside the window, spreading all over the earth and shining in front of the window. An inexplicable feeling of loneliness surged in his heart, and he couldn't calm down for a long time", the main color of the video ending shot End_Tone1 = "hazy grayish white";

[0048] Create player A to start playing episode Section1. Player A configures the start cache data duration Start_CacheDuration = 3 seconds, associates the play window W0 with player A, and continuously performs statistics on the network download rate Net_Speed ​​during the play process. The statistical frequency is to record and update the network download rate value every 5 minutes.

[0049] When the video is played to 35 minutes, it starts to obtain the basic information of the next episode Section2 from the media server, including but not limited to the playback address Url2, video bitrate Bitrate2, video duration Duration2, video start shot script Start_Script2 and video start shot main color Start_Tone2; at this time, the latest network download rate statistics value is Net_Speed ​​= 3M;

[0050] Section2 episode video bitrate Bitrate2 = 4M, video duration Duration2 = 40 minutes, video start shot script Start_Script2 = "The chirping of birds comes one after another, Zhang San opens his hazy eyes, a ray of soft sunlight spreads in front of the bed, a group of birds chase and play happily in the tree outside the window, a day's plan begins in the morning, come on, Zhang San cheered himself up", video start shot main color Start_Tone2 = "bright sunshine yellow";

[0051] The total duration of the transition video is calculated based on the video bitrate Bitrate2 of the next episode Section2, the start cache data duration Start_CacheDuration of player A, and the network download rate statistics Net_Speed. The weight coefficient is k=1.5. Substituting these parameters into the episode switching time calculation formula, the episode switching time Change_Time=Start_CacheDuration*Bitrate2 / Net_Speed=3*4 / 3=4 seconds can be calculated, and then the transition video duration TransVdieo_Duration=k*Change_Time=1.5*4=6 seconds can be calculated;

[0052] Input the video ending shot script End_Script1, the video ending shot main color End_Tone1, the next episode video starting shot script Start_Script2, the next episode video starting shot main color Start_Tone2 and the transition video total duration TransVdieo_Duration and other information to the AIGC video generation service to generate the transition video without adding other auxiliary information;

[0053] After the transition video is generated, create player B to initialize the transition video and wait for the screen to be drawn before entering the pause state to wait for the end of the playback of episode Section 1;

[0054] When the play of episode Section1 is finished, first close player A, then associate the play window W0 with player B and call the start play interface of player B to start the play of the transition video; at the same time, use the play address Url2 of the next episode Section2 to reinitialize player A and enter the pause state after reaching the waiting screen state to wait for the transition video to finish playing;

[0055] When the transition video ends, close player B first, then associate the play window W0 with player A and call the start play interface of player A to start the play of the next episode Section2;

[0056] After the above steps, the entire process of switching scenes of video episodes is realized.

[0057] Through the video series switching transition method set up above, using the AIGC multimodal large model capabilities, we can generate transition videos that are strongly related to the content of the previous and next series to achieve seamless connection of the series content. By reusing the same playback window with multiple players, we can achieve seamless connection of different video playbacks on the timeline, thereby ultimately achieving smooth and imperceptible switching of video series, greatly improving the viewing experience in the scenario of continuous viewing of multiple series.

[0058] It should be understood that the exemplary embodiments described herein are illustrative rather than restrictive. Although one or more embodiments of the present invention have been described in conjunction with the accompanying drawings, it should be understood by those skilled in the art that various changes in form and detail may be made without departing from the spirit and scope of the present invention as defined by the appended claims.

Claims

1. A method for switching scenes of a video series. It is characterized in that The following steps are involved: The same video playback window is set, and when the previous episode is played, the video playback window is associated with the video playback window for video playback. When the transition video is played, the video playback window is continued to be associated with the transition video. When the next episode is ready to play, the video playback window is also associated with the next episode. At the same time, only the current video playback is associated with the video playback window; the transition video is generated using the AIGC multimodal large model; Create a first player to play the episodes, and a second player to play the transition videos. Seamless switching of episodes is achieved by controlling the dynamic switching of the first and second players and the flow of video playback windows between the first and second players. The playback switching logic is as follows: Use the first player to create a second player in advance before the previous episode ends, and use the transition video to initialize the player to the waiting screen state and then pause; When the previous episode is finished playing, close the first player, associate the play window W0 with the second player, call the start play interface of the second player to start playing the transition video, and use the play address of the next episode to reinitialize the first player to the waiting screen state and then pause; When the transition video is finished playing, close the second player, associate the video playing window with the first player, and call the start playing interface of the first player to start playing the next episode; Through the above process, seamless switching of video series can be achieved.

2. The video episode switching method according to claim 1, It is characterized in that The generation of the transition video using the AIGC multimodal large model specifically includes: When obtaining the basic information of the previous episode, obtain the ending shot script and the main color tone of the ending shot of the current episode from the basic information; Continuously collect network download rate statistics during the playback of the previous episode; A certain time before the end of the previous episode, the basic information of the next episode is obtained in advance, and the starting shot script and the main color tone of the starting shot of the next episode are obtained from the basic information; Calculate the duration of the transition video based on the network download rate, the bit rate of the next episode video, the duration of the player's start-up cache data, and the weight coefficient k; The AIGC video generation service is called to generate a transition video based on the duration of the transition video, the ending shot script of the previous episode, the main color tone of the ending shot of the previous episode, the starting shot script of the next episode, the main color tone of the starting shot of the next episode, and auxiliary information.

3. The method for switching between episodes according to claim 2, It is characterized in that The script of the ending shot of the previous episode uses text to describe the content of the ending shot of the episode, which is sent to the AIGC big model to understand the content of the ending shot of the episode.

4. The method for switching between episodes according to claim 2, It is characterized in that The main color tone of the ending shot of the previous episode uses words to describe the overall color tendency of the ending shot.

5. The method for switching between episodes according to claim 2, It is characterized in that The script for the start of the next episode uses text to describe the content of the start of the episode, which is sent to the AIGC big model to understand the content of the beginning of the episode.

6. The method for switching between episodes according to claim 2, It is characterized in that The main color tone of the opening shot of the next episode uses words to describe the overall color tendency of the opening shot.

7. The method for switching between episodes according to any one of claims 2 to 6, It is characterized in that The transition video duration TransVdieo_Duration matches the episode switching time Change_Time, so that the transition video covers the episode switching time. The episode switching time Change_Time depends on parameters including the network download rate Net_Speed, the next episode video bitrate Next_Bitrate and the player start-up cache data duration Start_CacheDuration. According to the above parameters, the episode switching time Change_Time = Start_CacheDuration*Next_Bitrate / Net_Speed ​​is calculated, and the episode switching time Change_Time and the weight coefficient k are used to calculate the transition video duration TransVdieo_Duration = k*Change_Time, where the weight coefficient k>1.