Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

mass video storage method based on an HDFS

A video storage, mass technology, applied in image communication, selective content distribution, electrical components, etc., can solve the problem of computing time difference, can not meet the requirements of video big data processing and so on

Inactive Publication Date: 2019-05-14
CHINA CHANGFENG SCI TECH IND GROUPCORP
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the same algorithm, videos of the same size will have great differences in computing time due to different content, which makes the mechanism of task allocation based on file size unable to meet the processing requirements of video big data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • mass video storage method based on an HDFS
  • mass video storage method based on an HDFS
  • mass video storage method based on an HDFS

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0012] In order to improve the execution efficiency of the system, the simplest way to achieve the purpose of computing load balancing is to redistribute the video data according to the degree of heat and complexity. The redistribution strategy is to store files with high popularity and files with low popularity together, and to store videos with high computational complexity and low computational complexity together. In order to make the problem clearer, we analyze the case where the number of copies is 1, and the theory obtained is theoretically applicable to the case where the number of copies is multiple. Suppose a group of video files are stored in the following way on HDFS. In each Datanode node, the small rectangles stored represent the complexity of the file. The sum of the complexity of the two video files in Datanode1 is 14, Datanode2 is 12, Datanode3 is 4, and Datanode4 is 6. Obviously when the 8 video files that need to be video intelligently analyzed are stored a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a mass video storage method based on an HDFS, which comprises the following steps: after a user processes a specific video file by adopting a corresponding algorithm each time,adding some information statistical methods into an algorithm executed by the user, and storing the collected information into an Hbase; firstly, using an interface provided by an HDFS for obtaining name information of all video files wherein for file names which are not stored in an Hbase, namely data names which are newly stored on the HDFS, the file names serve as Key values to be stored in theHbase, and assigning the heat value and the complexity to be zero; after a HDFS is executed, starting to execute a calculation task, after the file is executed, updating the file execution time in the Hbase, adding 1 to the hot degree, and after all tasks are executed, ending the whole process, and obtaining the video load information in the HDFS.

Description

Technical field [0001] The invention belongs to the technical field of computer network information processing, and relates to network video storage technology, in particular to a mass video storage method based on HDFS. Background technique [0002] Cloud computing is another new computing model following peer-to-peer computing, grid computing, utility computing, and distributed computing. As soon as it appeared, it became the focus of attention in academia and industry. The core concept of cloud computing is resource leasing, application hosting and service outsourcing. It uses virtualization technology to form a shared virtualized pool of distributed computing nodes to provide users with services. Through cloud computing technology, users and enterprises do not need to spend The excessively high price is used for the purchase and maintenance of early hardware. Among them, Hadoop under the Apache Fund has been the hottest in recent years and has attracted widespread attention i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/218H04N21/231H04N21/234H04N21/24
Inventor 张超赵凯
Owner CHINA CHANGFENG SCI TECH IND GROUPCORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com