Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data collection method and device

A data and database technology, applied in the field of Internet information, can solve problems such as low collection efficiency and waste of human resources, so as to reduce labor costs, improve efficiency, and avoid inaccessibility.

Active Publication Date: 2020-02-14
连连银通电子支付有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] This application provides a data collection method and device, with the purpose of solving the existing problems of consuming a lot of human resources and low collection efficiency in collecting public opinion data in the dark network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data collection method and device
  • Data collection method and device
  • Data collection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0048]When collecting data on dark web sites, it is necessary to pre-configure overseas servers and connect to the Onion Network to search for corresponding dark web sites. In the embodiment of this application, overseas virtual private servers are constructed in advance, onion tor software and python3 development environment are deployed on overseas virtual private servers, and Django-based Agent and server are built respectively, and the Agent is used to realize the implementation ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data collection method and device, and the scheme comprises the steps: obtaining a dark website point domain name, transmitting an access request to a dark website point through the domain name, obtaining a meta label of a dark website point webpage through a preset first style sheet css path, and determining the latest domain name of the dark website point based on the meta label. And under the condition that the login state is login, obtaining webpage data meeting a preset collection condition in the dark website points based on a preset second style sheet css path.Converting the webpage data into data conforming to a preset format, and storing the data into a database. Based on the present application, an access request is sent to a dark website point through adomain name, so that automatic access of the dark website point can be realized; the latest domain name of the dark website point is obtained through the preset first style sheet css path, the situation that the dark website point cannot be accessed is avoided, automatic search and extraction of data are achieved based on the preset second style sheet css path, the labor cost is reduced, and theefficiency of public opinion data collection in a dark network is improved.

Description

technical field [0001] The present application relates to the field of Internet information technology, and in particular to a data collection method and device. Background technique [0002] The entire Internet can be divided into Mingnet and Deepnet. The difference between Mingnet and Deepnet lies in whether it can be retrieved by ordinary search engines. In the deep web, there is also a small part called the dark web. Dark web sites require specific browsers, special authorization, or special settings to access. Real-time collection of relevant public opinion data on the dark web can improve the company's overall control over network public opinion and emergency response capabilities. [0003] At present, most of the public opinion data collection methods in the existing darknet sites are manually collected, pre-configured overseas servers, and manually connected to the onion network to search for the corresponding darknet sites, manually register and log in to the accou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/9532
CPCG06F16/9532
Inventor 姚轶麒林颜双童将廖位明
Owner 连连银通电子支付有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com