Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A general network community trusted distributed collection and storage system

A technology of storage system and network community, which is applied in the field of general network community trusted distributed collection and storage system, can solve the problems of lack of complex structure data collection and storage scheme, lack of framework credibility demonstration, etc., to achieve effective management and guarantee Sustainability, authenticity guaranteed

Active Publication Date: 2020-11-03
BEIJING UNIV OF POSTS & TELECOMM
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Lack of effective collection and storage solutions for complex structured data; lack of credibility demonstration of the entire framework, including the sustainability, real-time, integrity and authenticity of data collection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A general network community trusted distributed collection and storage system
  • A general network community trusted distributed collection and storage system
  • A general network community trusted distributed collection and storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

[0029] like figure 1 As shown, it is a schematic diagram of the framework structure of the open source web crawler WebMagic. The web crawler is a program for automatically extracting web page information, which downloads web page information from the Internet for a search engine and is an important part of the search engine. Web crawler generally consists of four parts including: information downloading component, url sche...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A general trusted distributed collection and storage system for network community includes a distributed data collection framework, a rapid development framework, a trusted framework and a data storage framework. The distributed data collection framework adopts multiple heterogeneous forms and is used for distributed and parallel data collection. The rapid development framework comprises a plurality of rapid development modules, which are used for realizing the rapid development of the system. The trusted framework comprises a plurality of property verification modules, which are used for realizing the assurance of the plurality of performance in the data acquisition process and the verification of the plurality of performance of the stored data. The data storage framework comprises a plurality of data storage modules, which are used for storing data of a plurality of complex structures. The system of the invention not only solves the problem of lacking data credibility verification inthe prior crawler frame, but also designs a plurality of storage modules for the complicated data to realize effective storage. Through the rapid development framework, the development process is more convenient and faster.

Description

technical field [0001] The invention relates to the field of network information collection and storage, in particular to a general network community trusted distributed collection and storage system, which is used for trusted data acquisition and effective data storage. Background technique [0002] With the rapid development of the Internet, the Internet, a highly open platform, has brought subversive changes to traditional media. More and more people use the Internet to express their attitudes, opinions and opinions, and to obtain and study the opinions expressed by the public. Opinions have an increasingly important practical significance for timely discovery of hot topics and tracking of event trends. If you want to obtain this information, you need professional information collection means. [0003] A web crawler is a program that automatically extracts web pages. It downloads web pages from the World Wide Web for search engines and is an important component of search...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/955G06F16/951
Inventor 吴旭吴海涛段思澍许晋颉夏青
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com