Video file index method and system

A video file and indexing system technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve problems such as waste, and achieve the effect of improving reading efficiency, saving storage resources, and saving memory resources

Inactive Publication Date: 2013-09-04
SHENZHEN KONKA TELECOMM TECH
View PDF2 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide an efficient video file indexing method and system for video service platforms and mobile terminals in view of the above-mentioned defects of the prior art, and to construct

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video file index method and system
  • Video file index method and system
  • Video file index method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the object, technical solution and advantages of the present invention more clear and definite, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0033] See figure 2 , figure 2 It is a flowchart of a preferred embodiment of the video file indexing method of the present invention.

[0034] The video file indexing method provided by the embodiment of the present invention provides an indexing mechanism for efficient management of small files in HDFS, adopts the method of fusing multiple small files into one large file, and then indexes the merged files and stores them in HDFS; from When HDFS reads a file, the name node obtains the corresponding storage location through file mapping, and then the HDFS service client directly comm...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video file index method and system. The method includes the steps of file merging and file extraction. According to the step of file extraction, data nodes of an HDFS extract corresponding file data from corresponding HDFS blocks according to offset and length information saved in an index table of a generated merged file. More specifically, the method includes the steps of merging small files into the large file, establishing an index for the merged file, storing the merged file onto the HDFS, acquiring a corresponding storage position at namenodes with the method of file mapping in the process of reading the merged file from the HDFS, and improving read efficiency by direct communication between an HDFS service client-side and the data nodes and by file prefetching at the HDFS service client-side. The video file index method and system can manage the small files in the HDFS efficiently, save internal storage resources of the namenodes of the HDFS, improve the efficiency in reading the small files, and save storage resources of the data nodes of the HDFS.

Description

technical field [0001] The invention relates to the field of video file processing, in particular to an efficient video file indexing method and system for a video service platform and a mobile terminal. Background technique [0002] HDFS (Hadoop Distributed File System) is a core basic component of Hadoop (a distributed system infrastructure). Hadoop is a distributed system infrastructure supported by the Apache Foundation. HDFS is a file system designed to store large files (each file block is usually above 64Mb), and has a streaming data access mode, which can usually run on more common hardware. HDFS system architecture such as figure 1 As shown, the common master-slave architecture of HDFS clusters is mainly composed of a name node (NameNode) and several data nodes (DataNodes). The data nodes are arranged in an array, such as figure 1 The array 1 and array 2 shown; the HDFS system architecture usually also provides a secondary name node (Secondary NameNode) for backu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 杨卫国何震宇薛鸿杰
Owner SHENZHEN KONKA TELECOMM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap