Method for quickly positioning video playing position through AI shorthand

Abstract

The invention relates to a method for quickly positioning a video playing position through AI shorthand, which comprises the following steps: constructing a target video acquisition module, a shorthand generation and editing center, a shorthand quick positioning video position module and an export module, and wherein the shorthand generation and editing center comprises a shorthand generation module, a shorthand editing module and a shorthand extraction module; the subtitle generating module is used for generating subtitle recording data based on video content and generating a shorthand subtitle file based on shorthand subtitle data; the shorthand quick positioning video module realizes quick positioning of a video playing position through a shorthand text and comprises a video playing function and a shorthand display function, the video playing function comprises configuration of a video server, linkage of a playing mechanism and playing of subsequent content, and the shorthand display function comprises analysis of a shorthand file, quick positioning and interaction and extension of function support. The problem that an existing video playing and skipping scheme cannot meet the requirement for quick positioning according to keywords is solved, and the video playing time point is quickly positioned by combining the shorthand text generated by the video content.

Description

Technical Field

[0001] This invention relates to audio and video, artificial intelligence technology, and in particular to a method for quickly locating the video playback position through AI shorthand. Background Technology

[0002] With the widespread adoption of mobile internet technology, online video has become a very common media resource. However, the lack of quick navigation methods such as directories and keywords in video playback makes it difficult to quickly and clearly find the desired content, often resulting in wasted time due to irrelevant content being played.

[0003] Currently, there are several ways to play videos:

[0004] 1. Playing at normal speed to retrieve content: Advantages: complete content retrieval; Disadvantages: wasted time.

[0005] 2. Playing at double speed to get content: Advantages: Shortens the time to get content; Disadvantages: There may be situations where the content cannot be heard clearly.

[0006] 3. Jump to playback progress to get content. Advantages: None at present. Disadvantages: Requires multiple jumps, frequent operation.

[0007] Existing video playback and navigation solutions cannot meet the needs of quickly locating content based on keywords. Users need to watch the entire video to obtain the content they need, which is a waste of time. On the other hand, it is also a waste of manpower to find the content they need by jumping through the video progress. Summary of the Invention

[0008] To address the issue that existing video playback and navigation solutions cannot quickly locate content based on keywords, this invention aims to rapidly locate video positions using shorthand text to obtain content. It leverages methods such as keyword search and rapid text browsing to save time and effort in content retrieval. This invention proposes a method for quickly locating video playback positions using AI shorthand. A new interactive method combines shorthand text generated from video content to quickly pinpoint the video playback time point. Shorthand: recording the text of the speaker's speech in the video.

[0009] The technical solution of this invention is as follows:

[0010] A method for quickly locating video playback position using AI stenography is proposed, comprising a target video acquisition module, a stenography generation and editing center, a stenography-based rapid video position location module, and an export module. The stenography generation and editing center includes stenography generation, stenography editing, and stenography extraction modules, used to generate subtitle data based on video content and generate stenography subtitle files from the stenography subtitle data. The stenography-based rapid video position location module achieves rapid location of the video playback position through stenography text, including video playback and stenography display functions. The video playback function includes configuring the video server, a linked playback mechanism, and playing subsequent content. The stenography display function includes parsing the stenography file, rapid location and interaction, and support for extended functions.

[0011] Furthermore, the stenotype generation and editing center is implemented as follows:

[0012] Generate subtitle data based on video content:

[0013] The stenography generation module has the function of generating stenographic subtitle data from video content. Install ffmpeg and configure the environment variables; use the Python audio processing library pydub to convert the video into audio format wav segments; install the pocketsphinx library and the SpeechRecognition library to recognize audio;

[0014] Generate shorthand subtitle files from shorthand subtitle data:

[0015] After generating shorthand subtitle data from the video content, each subtitle segment is accompanied by start and end timestamps. This process utilizes an external AI subtitle recognition system to analyze the video's timestamps, word segmentation timestamps, and natural language processing to merge the subtitle data into a video shorthand subtitle file with timestamped long sentences. The shorthand editing module has the function of further processing the generated video shorthand subtitle file and saving it again.

[0016] Furthermore, the subtitle segmentation rules of the external AI subtitle recognition system are as follows: based on natural semantic analysis, a single subtitle can form a sentence with complete meaning; the duration of a single subtitle is no more than 24 seconds.

[0017] Furthermore, the specific implementation of the stenography rapid location video module is as follows:

[0018] Video playback function: The video playback function supports multiple common video formats and has the ability to play them accurately. The specific implementation process is as follows:

[0019] Configure a video server: Configure a video streaming server that supports playback time display and positioning functions; the server processes video files through tools, extracts timestamp information, and ultimately achieves synchronization with the video playback progress;

[0020] Linked playback mechanism: After loading the video and shorthand subtitle files on the front-end page, users can quickly locate the video by clicking on any position in the subtitles; the specific implementation is as follows: when the user clicks on a subtitle, the front-end system obtains the timestamp corresponding to the subtitle and jumps the video to that time point through the API of the video playback component; this process requires close linkage between the video playback component and the subtitle data to ensure that the system can respond quickly and locate the corresponding video position after clicking on the subtitle;

[0021] Play subsequent content: The video starts playing from the position corresponding to the subtitle timestamp and continues playing subsequent content; this function requires the video playback component to have good buffering and playback capabilities;

[0022] Shorthand display function:

[0023] Parsing shorthand files: The shorthand display module can parse shorthand subtitle files with timestamps, extract keywords and corresponding time information; through natural language processing technology, the system can identify key entities in the subtitles and associate them with timestamps, providing data support for subsequent rapid location;

[0024] Quick location and interaction: Users can quickly locate the corresponding playback position of the video by clicking on any position or keyword in the shorthand text; the system transmits the user's operation command to the video playback component through timestamp information to realize the linkage and interaction between the video and the shorthand text; in addition, the shorthand display interface also supports keyword highlighting and search functions.

[0025] Extended functionality support: The shorthand display module not only supports basic location functions, but can also combine AI technology for semantic analysis and tagging.

[0026] A system for quickly locating video playback position using AI shorthand is characterized by a method for achieving the aforementioned method, comprising a target video acquisition module, a shorthand generation and editing center, a shorthand fast video position location module, and an export module. The shorthand generation and editing center includes shorthand generation, shorthand editing, and shorthand extraction modules, used to generate shorthand subtitle data based on video content and to generate shorthand subtitle files from the shorthand subtitle data. The shorthand fast video position location module achieves rapid location of the video playback position through shorthand text, including video playback and shorthand display functions. The video playback function includes configuring a video server, a linked playback mechanism, and playing subsequent content. The shorthand display function includes parsing the shorthand file, rapid location and interaction, and support for extended functions.

[0027] The beneficial effects of this invention are as follows:

[0028] 1. Quickly generate AI shorthand based on video content; 2. Quickly locate the position of video playback content based on the shorthand.

[0029] Specifically as follows:

[0030] 1. Shorthand Positioning and Linked Playback: The shorthand data contains time information. During video file playback, the shorthand data automatically locates the current video position.

[0031] 2. The stenography interface is interactive: Clicking on any stenography position will automatically jump the video to the corresponding playback position.

[0032] 3. Expandable shorthand content: Based on AI semantic analysis, the shorthand text content is materialized, key entities are extracted, and further operations such as video tagging and keyword matching to jump to specific pages are performed. Attached Figure Description

[0033] Figure 1 This is a flowchart illustrating the process of the method for quickly locating video playback position using AI shorthand, as described in this invention.

[0034] Figure 2 This is a partial illustration of the conversion code and results for the speech caption generation of this invention;

[0035] Figure 3 The image shows the conversion code and results of the keyword editing in this invention. Detailed Implementation

[0036] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments. These embodiments are based on the technical solution of the present invention and provide detailed implementation methods and specific operating procedures. However, the scope of protection of the present invention is not limited to the following embodiments.

[0037] The purpose of this invention is to provide a solution for quickly locating video positions based on keywords. It has the ability to generate shorthand notes based on video content, and the ability to quickly locate video positions based on the shorthand notes.

[0038] This invention includes a target video acquisition module, a shorthand generation and editing center, a shorthand rapid video location positioning module, and an export module.

[0039] Work process as follows Figure 1 As shown:

[0040] This invention comprises two main parts: a shorthand generation and editing center and a shorthand rapid positioning video module.

[0041] 1. The shorthand generation and editing center includes modules for shorthand generation, shorthand editing, and shorthand extraction.

[0042] a) Generating subtitle data based on video content

[0043] The stenography generation module has the function of generating stenographic subtitle data from video content. The conversion code and results are as follows: Figure 2 As shown:

[0044] ① Install ffmpeg and configure the environment variables;

[0045] ② Use the Python audio processing library pydub to convert the video into audio clips in WAV format;

[0046] ③ Install the pocketsphinx library and the SpeechRecognition library to recognize audio;

[0047] b) Generating shorthand subtitle files from shorthand subtitle data

[0048] After generating shorthand subtitle data from the video content in step a, each subtitle segment includes start and end timestamps. This process utilizes an external system—an AI subtitle recognition system—to analyze the video's timestamps, word segmentation timestamps, and natural language processing, merging the subtitle data into a long, timestamped video shorthand subtitle file. The shorthand editing module can further process the generated video shorthand subtitle file and save it again. The conversion result is as follows: Figure 3 As shown:

[0049] The subtitle segmentation rules of the external AI subtitle recognition system are as follows: 1. Based on natural language processing, a single subtitle can form a sentence with complete meaning. 2. The duration of a single subtitle is no more than 24 seconds.

[0050] 2. Shorthand and rapid location video module

[0051] The shorthand video location module is the core component of this invention. It aims to quickly locate the video playback position using shorthand text, thereby improving the efficiency of users finding and retrieving video content. This module mainly includes video playback and shorthand display functions. The following is a detailed description of its functions and implementation process:

[0052] a) Video playback function

[0053] The video playback function supports multiple common video formats (such as mp4, m3u8, etc.) and has precise playback capabilities to ensure that users can quickly locate the content they need. The specific implementation process is as follows:

[0054] 1) Configure the video server

[0055] To achieve accurate playback, a video streaming server that supports playback time display and positioning is required. The server processes the video file using tools, extracts timestamp information, and ultimately synchronizes it with the video playback progress.

[0056] 2) Linked playback mechanism

[0057] After loading the video and shorthand subtitle files on the front-end page, users can quickly locate the video content by clicking anywhere in the subtitles. Specifically, when a user clicks a subtitle, the front-end system retrieves the timestamp corresponding to that subtitle and uses the video playback component's API to jump to that time point in the video. This process requires close coordination between the video playback component and the subtitle data to ensure a rapid response and accurate location of the corresponding video content after clicking a subtitle.

[0058] 3) Play subsequent content

[0059] The video starts playing from the position corresponding to the subtitle timestamp and continues playing subsequent content. This feature requires the video playback component to have good buffering and playback capabilities to ensure that the video can seamlessly and smoothly continue playing from the positioned point, avoiding impact on user experience due to buffering delays.

[0060] b) Shorthand display function

[0061] The shorthand display function is a key component of this invention for achieving rapid location, and it has the following functional characteristics:

[0062] 1) Parsing shorthand documents

[0063] The shorthand display module can parse shorthand subtitle files with timestamps and extract keywords and corresponding time information. Through natural language processing technologies (such as word segmentation and semantic analysis), the system can identify key entities in the subtitles and associate them with timestamps, providing data support for subsequent rapid location.

[0064] 2) Quick location and interaction

[0065] Users can quickly locate the corresponding playback position in the video by clicking anywhere in the shorthand text or on keywords. The system uses timestamp information to transmit the user's operation command to the video playback component, enabling interactive linkage between the video and the shorthand text. Furthermore, the shorthand display interface also supports keyword highlighting and search functions, further enhancing the user experience.

[0066] 3) Extended functionality support

[0067] The shorthand display module not only supports basic location functions, but can also combine AI technology for semantic analysis and tagging. For example, by extracting key entities and semantic information, the system can generate tags for videos, helping users find relevant content more quickly, and even enabling intelligent navigation based on keywords.

[0068] Through the design and implementation of the above functions, this invention can effectively solve the problem of time-consuming search for specific content in traditional video playback, and provide users with an efficient and convenient way to retrieve video content.

[0069] The above-described embodiments are merely one implementation of the present invention, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of the invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this invention should be determined by the appended claims.

Claims

1. A method for quickly locating the video playback position using AI shorthand, characterized in that, The system comprises a target video acquisition module, a shorthand generation and editing center, a shorthand rapid video location positioning module, and an export module. The shorthand generation and editing center includes shorthand generation, shorthand editing, and shorthand extraction modules, used to generate shorthand subtitle data based on video content and to generate shorthand subtitle files from the shorthand subtitle data. The shorthand rapid video location module enables rapid positioning of the video playback position through shorthand text, including video playback and shorthand display functions. The video playback function includes configuring the video server, a linked playback mechanism, and playing subsequent content. The shorthand display function includes parsing shorthand files, rapid positioning and interaction, and support for extended functions.

2. The method for quickly locating the video playback position using AI shorthand as described in claim 1, characterized in that, The shorthand generation and editing center is implemented as follows: Generate subtitle data based on video content: The stenography generation module has the function of generating stenographic subtitle data from video content. Install ffmpeg and configure the environment variables; use the Python audio processing library pydub to convert the video into audio format wav segments; install the pocketsphinx library and the SpeechRecognition library to recognize audio; Generate shorthand subtitle files from shorthand subtitle data: After generating shorthand subtitle data from the video content, each short subtitle data segment is accompanied by start and end timestamp data. In this process, an external system - AI subtitle recognition system - will be used to analyze the video timestamps, word segmentation timestamps, and natural semantics to merge the subtitle data into a video shorthand subtitle file with timestamped long sentences. The shorthand editing module has the function of further processing the generated video shorthand subtitle file and saving the video shorthand subtitle file again.

3. The method for quickly locating the video playback position using AI shorthand as described in claim 2, characterized in that, The subtitle segmentation rules of the external AI subtitle recognition system are as follows: based on natural semantic analysis, a single subtitle can form a sentence with complete meaning; the duration of a single subtitle is no more than 24 seconds.

4. The method for quickly locating the video playback position using AI shorthand as described in claim 1, characterized in that, The specific implementation of the shorthand rapid location video module is as follows: Video playback function: The video playback function supports multiple common video formats and has the ability to play them accurately. The specific implementation process is as follows: Configure a video server: Configure a video streaming server that supports playback time display and positioning functions; the server processes video files through tools, extracts timestamp information, and ultimately achieves synchronization with the video playback progress; Linked playback mechanism: After loading the video and shorthand subtitle files on the front-end page, users can quickly locate the video by clicking on any position in the subtitles; the specific implementation is as follows: when the user clicks on a subtitle, the front-end system obtains the timestamp corresponding to the subtitle and jumps the video to that time point through the API of the video playback component; this process requires close linkage between the video playback component and the subtitle data to ensure that the system can respond quickly and locate the corresponding video position after clicking on the subtitle; Play subsequent content: The video starts playing from the position corresponding to the subtitle timestamp and continues playing subsequent content; this function requires the video playback component to have good buffering and playback capabilities; Shorthand display function: Parsing shorthand files: The shorthand display module can parse shorthand subtitle files with timestamps, extract keywords and corresponding time information; through natural language processing technology, the system can identify key entities in the subtitles and associate them with timestamps, providing data support for subsequent rapid location; Quick location and interaction: Users can quickly locate the corresponding playback position of the video by clicking on any position or keyword in the shorthand text; The system uses timestamp information to transmit user commands to the video playback component, enabling interactive linkage between video and stenographic text. In addition, the stenographic display interface also supports keyword highlighting and search functions. Extended functionality support: The shorthand display module not only supports basic location functions, but can also combine AI technology for semantic analysis and tagging.

5. A system for quickly locating the video playback position using AI shorthand, characterized in that, The method for quickly locating video playback position using AI shorthand as described in any of claims 1-4 includes a target video acquisition module, a shorthand generation and editing center, a shorthand quick video position location module, and an export module. The shorthand generation and editing center includes shorthand generation, shorthand editing, and shorthand extraction modules, used to generate shorthand subtitle data based on video content and generate shorthand subtitle files from the shorthand subtitle data. The shorthand quick video position location module achieves rapid location of the video playback position through shorthand text, including video playback and shorthand display functions. The video playback function includes configuring a video server, a linked playback mechanism, and playing subsequent content. The shorthand display function includes parsing shorthand files, quick location and interaction, and support for extended functions.

Images