Method for rapidly splicing transcoding fragmented file

A fast splicing and file technology, applied in the computer field, can solve the problems of consuming transcoding node system resources, high construction and maintenance costs, and information islands, saving network bandwidth resources, facilitating resource management, and reducing maintenance costs.

Inactive Publication Date: 2017-10-24
北京达沃时代科技股份有限公司
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional transcoding scheme is to append and write the fragmented transcoding files to the final transcoding file one by one. The appending writing scheme has a read operation for each fragmented transcoding file and a write operation for the final transcoding file at the same time. The solution not only consumes network resources, but also consumes transcoding node system resources; the traditional transcoding solution can only achieve 1.5 to 2 times the speed, which is far from meeting the transcoding requirements brought about by the expansion of video data
[0003] As the video sources become clearer and the types of TV programs are more and more, the data volume of the resource system of the radio and television industry reaches the PB level, resulting in a sharp increase in storage demand; at the same time, there are many types of TV station business systems, and the business systems have different storage requirements , have to use multiple sets of storage systems, but information islands are likely to be formed between multiple sets of storage systems, and the construction and maintenance costs are high at the same time, and it is not conducive to unified management

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for rapidly splicing transcoding fragmented file
  • Method for rapidly splicing transcoding fragmented file
  • Method for rapidly splicing transcoding fragmented file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] Embodiment 1: as figure 1 As shown, a method for quickly splicing and transcoding fragmented files includes:

[0051] Call the create aggregated file interface of the distributed storage system to create the aggregated file;

[0052] Obtain fragmented transcoding files from the distributed storage system;

[0053] Call the distributed storage system interface to lock the fragmented transcoding file;

[0054] When the lock of the transcoded file of the fragment fails, the aggregation operation fails;

[0055] Judging whether the split-transferred file meets the transcoding conditions;

[0056] When the fragmented transcoding file does not meet the conditions, the aggregation operation fails;

[0057] When the fragmented transcoded file satisfies the conditions, add one to the aggregation information index item of the aggregated file, and the index information corresponding to the newly added aggregated index item is the length of the fragmented transcoded file, the u...

Embodiment 2

[0062] Embodiment 2: as figure 1 As shown, a method for quickly splicing and transcoding fragmented files includes:

[0063] Step 11, write the video file generated by the video source into the distributed storage system, the distributed storage provides a unified name space for the video source file, and multiple transcoding nodes can concurrently read the data of the video source;

[0064] In step 12, the transcoding scheduler assigns the segmented video source data segment index to the transcoding node, and the transcoding node reads the time slice data corresponding to the index from the storage system.

[0065] Wherein, step 12 includes:

[0066] Step 121, using the transcoding scheduler to averagely segment the video source according to time, and sequentially assign index numbers to the segmented transcoding files;

[0067] Step 122, the transcoding scheduler sends the fragment index to be transcoded to the idle transcoding node;

[0068] Step 13: According to the rec...

Embodiment 3

[0081] Embodiment 3: as figure 2 As shown, the method for reading the data content of the aggregated file, wherein the fragmented transcoded files in the aggregated file are uniformly described as small files in the storage client system, and the reading process includes:

[0082] Step 22, query the aggregation length of the aggregation file storing client records, where the aggregation length is the sum of the lengths of all small files.

[0083] Wherein, step 22 includes:

[0084] Step 221, if the length of the aggregated file is less than the sum of the read offset and the read size of the file, send a message to the metadata to obtain the aggregated information of the aggregated file, the aggregated information includes the length of all small files, the number of the small file, the number of the small file in the aggregation file offset;

[0085] Step 222, recording the aggregation information into the client aggregation file information cache, so that subsequent read...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for rapidly splicing transcoding fragmented files, and belongs to the technical field of computers. The method comprises: writing a video source file into a distributed storage, a distributed storage system providing an unified name space for transcoding service, a plurality of transcoding servers reading the video source file from the distributed storage in a parallel manner, according to time period intervals of fragments, obtaining data corresponding to the time period of the video source file; distributing index numbers of fragmented data segments for transcoding nodes through a transcoding scheduler, to transcode the fragmented data. Through recording length of the fragmented transcoding file, file number, and offset information in an aggregation file in an index entry of aggregation information attribution of the aggregation file, a conventional additional writing-in method is completely abandoned, and time-consuming data reading-writing operation is changed to increasing of attribute information, efficiency for merging transcoding fragmented files is improved, and valuable network bandwidth resources are saved.

Description

technical field [0001] The invention relates to a method for quickly splicing and transcoding fragmented files, which belongs to the technical field of computers. Background technique [0002] As the traditional broadcasting industry has higher and higher requirements for video clarity, from the earliest standard definition era 25Mbps bit stream to the current high definition era 100Mbps bit stream, and then to the future 4K era, the one-hour video rate in the future 4K era The program material file length will reach 180GB. The traditional transcoding scheme is to append and write the fragmented transcoding files to the final transcoding file one by one. The appending writing scheme has a read operation for each fragmented transcoding file and a write operation for the final transcoding file at the same time. The solution consumes both network resources and transcoding node system resources; the traditional transcoding solution can only achieve 1.5 to 2 times the speed, whi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/845H04N21/2343
CPCH04N21/234309H04N21/845H04N21/8455
Inventor 肖文文王栩
Owner 北京达沃时代科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products