Data mining method for anonymous network

Through the data mining method for anonymous network, the Recon-ng and metasploit framework combined with the Tor proxy gateway to obtain and process anonymous network data is solved, and the problem that traditional technology cannot effectively process anonymous network data is achieved, and efficient data support for anonymous network crimes is achieved , improving the crackdown capabilities of the public security organs.

CN118939855APending Publication Date: 2024-11-12ZHEJIANG POLICE COLLEGE
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411008259.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Traditional data mining technology is difficult to effectively process information in anonymous networks and cannot effectively collect and analyze relevant data, which leads to difficulties for public security organs in combating anonymous cyber crimes.

Method used

Using a data mining method for anonymous network, the Recon-ng open source framework and metasploit framework are used to conduct data detection, and anonymous website data is obtained through the Tor proxy gateway, and big data processing includes data cleaning, translation, word segmentation, automatic digest and recognition. The processed data will be rendered, displayed and stored, and provided to the public security organs.

Benefits of technology

Effectively collect and analyze gray and black industry data in anonymous networks to improve the efficiency and accuracy of public security organs in combating anonymous cyber crimes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939855A_ABST
    Figure CN118939855A_ABST
Patent Text Reader

Abstract

The invention discloses a data mining method for an anonymous network. The data mining method comprises the four steps of dark network grey production target website basic network information collection, grey production big data acquisition based on a Tor proxy gateway, big data processing and data rendering display and evidence storage. The method comprises the following steps: firstly, carrying out active and passive information acquisition through a Reccon-ng open source framework based on Web; then, a plurality of Tor proxy gateways are selected as data acquisition interfaces, and data interception is carried out through an API; then, cleaning, translating, segmenting words, automatically abstracting and classifying the acquired data, and identifying and analyzing the voice, the image and the video of the dark web; and finally, carrying out visual display on the processed data, and storing the data for subsequent investigation evidence obtaining and scientific research analysis. The method can effectively collect and analyze gray black product data in the dark web, and provides powerful data support for fighting against dark web crimes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical fields of network security and data mining, and in particular to a data mining method for anonymous networks. Background Art

[0002] With the continuous development of the Internet, anonymous networks have become a hotbed for illegal transactions, information trafficking and other gray and black market activities. Especially in the Tor anonymous network, criminals can use its anonymity to conduct illegal activities without being easily tracked. Traditional data mining technology is difficult to effectively process information in anonymous networks, mainly because anonymous networks are highly concealed and complex. In addition, when processing anonymous network data, existing technologies are often unable to effectively collect and analyze relevant data, which brings many difficulties to public security organs in combating anonymous network crimes. Summary of the invention

[0003] The purpose of the present invention is to provide a data mining method for anonymous networks, which can effectively collect, process and analyze gray and black industry data in anonymous networks, thereby providing powerful data support for combating anonymous network crimes.

[0004] To achieve the above object, the present invention provides a data mining method for anonymous networks, comprising the following steps: S1. Anonymous network data and basic network information collection of websites: Utilize the web-based Recon-ng open source framework for development and information collection, and use independent modules, database exchange functions, interactive help prompts and command completion features, combined with the Metasploit framework and social engineering toolkit to conduct active and passive data reconnaissance to obtain basic network information of anonymous websites; S2. Big data acquisition of gray and black industries based on Tor proxy gateway: Select several Tor proxy gateways as the data acquisition interface layer, and intercept data from anonymous websites through API; S3, data processing and recognition: performing big data processing on the data obtained in step S2, including data cleaning, translation, word segmentation, automatic summarization and classification, and recognizing and analyzing the voice, image and video after big data processing; S4. Data display: Render and display the processed data, and store the data for subsequent investigation, evidence collection, and scientific research analysis, to assist public security organs in mastering anonymous network gray and black industry data resources and provide data support for combating anonymous network crimes.

[0005] Preferably, in step S1, collecting basic network information includes utilizing Recon-ng's modules and database functions to perform web reconnaissance and information collection.

[0006] Preferably, the step S2 includes collecting and processing information matching the keywords on the anonymous network market based on a custom data interception algorithm and crawling strategy.

[0007] Preferably, in step S4, the rendering, display and evidence storage step includes generating an index table and sorting the output results according to a relevance evaluation index between the query and the document.

[0008] Preferably, in step S2, the selected Tor proxy gateways include Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams, and each proxy gateway has a data secondary output API.

[0009] Through the above steps, the present invention can effectively collect and analyze gray and black industry data in anonymous networks, and improve the work efficiency and accuracy of public security organs in combating anonymous network crimes. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 is a flow chart of an anonymous network data collection method of the present invention; Figure 2 It is a structural schematic diagram of an anonymous network data collection system of the present invention. DETAILED DESCRIPTION

[0011] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0012] Example: Figure 2 As shown, the anonymous network data collection system based on the present invention includes a Tor dark web proxy gateway 1, a search layer 2, a user interface layer 3, an output layer 4 and a client 5. The Tor dark web proxy gateway includes six types: Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams. The search layer includes a retriever 21, a classifier 22 and an indexer 23. The search layer is connected to the dark web (anonymous network) 6 through the Tor dark web proxy gateway. The client is connected to the search layer through the user interface layer. The user interface layer stores data in the classification directory 41, MD5 library 42 and MongoDB43 of the output layer.

[0013] It includes information collection module, data processing module and data storage module. The information collection module uses the Recon-ng framework and Tor proxy gateway to actively and passively collect anonymous network data. The data processing module cleans, translates, and segment the collected data, and classifies and automatically summarizes the data through big data analysis technology. The data storage module stores and visualizes the processed data for use by public security organs and scientific researchers.

[0014] A data mining method for anonymous networks in this embodiment, such as Figure 1 As shown, the following steps are included: S1. Anonymous network data and basic network information collection of websites: Utilize the web-based Recon-ng open source framework for development and information collection, and use independent modules, database exchange functions, interactive help prompts and command completion features, combined with the Metasploit framework and social engineering toolkit to conduct active and passive data reconnaissance to obtain basic network information of anonymous websites; S2. Big data acquisition of gray and black industries based on Tor proxy gateway: Select several Tor proxy gateways as the data acquisition interface layer, and intercept data from anonymous websites through API; S3, data processing and recognition: performing big data processing on the data obtained in step S2, including data cleaning, translation, word segmentation, automatic summarization and classification, and recognizing and analyzing the voice, image and video after big data processing; S4. Data display: Render and display the processed data, and store the data for subsequent investigation, evidence collection, and scientific research analysis, to assist public security organs in mastering anonymous network gray and black industry data resources and provide data support for combating anonymous network crimes.

[0015] In step S1, collecting basic network information includes using Recon-ng's modules and database functions to perform web reconnaissance and information collection.

[0016] Step S2 includes collecting and processing information matching the keywords on the anonymous network market based on a custom data interception algorithm and crawling strategy.

[0017] In step S4, the rendering, display and evidence storage step includes generating an index table and sorting the output results according to the relevance evaluation index between the query and the document.

[0018] In step S2, the selected Tor proxy gateways include Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams, each of which has a secondary data output API.

[0019] The present invention has demonstrated its application in anonymous network data collection and processing through the above-mentioned embodiments, and has proved its effectiveness and practicality in enhancing the public security organs' combating of anonymous network crimes.

[0020] The specific embodiments described herein are merely examples of the spirit of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in similar ways, but they will not deviate from the spirit of the present invention or exceed the scope defined by the appended claims.

Claims

1. A data mining method for anonymous networks, It is characterized in that The following steps are involved: S1. Anonymous network data and basic network information collection of websites: Utilize the web-based Recon-ng open source framework for development and information collection, and use independent modules, database exchange functions, interactive help prompts and command completion features, combined with the Metasploit framework and social engineering toolkit to conduct active and passive data reconnaissance to obtain basic network information of anonymous websites; S2. Big data acquisition of gray and black industries based on Tor proxy gateway: Select several Tor proxy gateways as the data acquisition interface layer, and intercept data from anonymous websites through API; S3, data processing and recognition: performing big data processing on the data obtained in step S2, including data cleaning, translation, word segmentation, automatic summarization and classification, and recognizing and analyzing the voice, image and video after big data processing; S4. Data display: Render and display the processed data and store them as evidence to assist public security organs in mastering anonymous network gray and black industry data resources and provide data support for combating anonymous network crimes.

2. A data mining method for anonymous networks according to claim 1, It is characterized in that In the step S1, collecting basic network information includes using the modules and database functions of Recon-ng to perform web reconnaissance and information collection.

3. A data mining method for anonymous networks according to claim 1, It is characterized in that The step S2 includes collecting and processing information matching the keywords on the anonymous network market based on a custom data interception algorithm and crawling strategy.

4. A data mining method for anonymous networks according to claim 1, It is characterized in that In step S4, the rendering, display and evidence storage step includes generating an index table and sorting the output results according to the relevance evaluation index between the query and the document.

5. A data mining method for anonymous networks according to claim 1 or 3, It is characterized in that In step S2, the selected Tor proxy gateways include Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams, and each proxy gateway has a data secondary output API.