Data mining method for anonymous network
Through the data mining method for anonymous network, the Recon-ng and metasploit framework combined with the Tor proxy gateway to obtain and process anonymous network data is solved, and the problem that traditional technology cannot effectively process anonymous network data is achieved, and efficient data support for anonymous network crimes is achieved , improving the crackdown capabilities of the public security organs.
Patent Information
- Application Number
- CN202411008259.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2024-11-12
AI Technical Summary
Traditional data mining technology is difficult to effectively process information in anonymous networks and cannot effectively collect and analyze relevant data, which leads to difficulties for public security organs in combating anonymous cyber crimes.
Using a data mining method for anonymous network, the Recon-ng open source framework and metasploit framework are used to conduct data detection, and anonymous website data is obtained through the Tor proxy gateway, and big data processing includes data cleaning, translation, word segmentation, automatic digest and recognition. The processed data will be rendered, displayed and stored, and provided to the public security organs.
Effectively collect and analyze gray and black industry data in anonymous networks to improve the efficiency and accuracy of public security organs in combating anonymous cyber crimes.
Smart Images

Figure CN118939855A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical fields of network security and data mining, and in particular to a data mining method for anonymous networks. Background Art
[0002] With the continuous development of the Internet, anonymous networks have become a hotbed for illegal transactions, information trafficking and other gray and black market activities. Especially in the Tor anonymous network, criminals can use its anonymity to conduct illegal activities without being easily tracked. Traditional data mining technology is difficult to effectively process information in anonymous networks, mainly because anonymous networks are highly concealed and complex. In addition, when processing anonymous network data, existing technologies are often unable to effectively collect and analyze relevant data, which brings many difficulties to public security organs in combating anonymous network crimes. Summary of the invention
[0003] The purpose of the present invention is to provide a data mining method for anonymous networks, which can effectively collect, process and analyze gray and black industry data in anonymous networks, thereby providing powerful data support for combating anonymous network crimes.
[0004] To achieve the above object, the present invention provides a data mining method for anonymous networks, comprising the following steps: S1. Anonymous network data and basic network information collection of websites: Utilize the web-based Recon-ng open source framework for development and information collection, and use independent modules, database exchange functions, interactive help prompts and command completion features, combined with the Metasploit framework and social engineering toolkit to conduct active and passive data reconnaissance to obtain basic network information of anonymous websites; S2. Big data acquisition of gray and black industries based on Tor proxy gateway: Select several Tor proxy gateways as the data acquisition interface layer, and intercept data from anonymous websites through API; S3, data processing and recognition: performing big data processing on the data obtained in step S2, including data cleaning, translation, word segmentation, automatic summarization and classification, and recognizing and analyzing the voice, image and video after big data processing; S4. Data display: Render and display the processed data, and store the data for subsequent investigation, evidence collection, and scientific research analysis, to assist public security organs in mastering anonymous network gray and black industry data resources and provide data support for combating anonymous network crimes.
[0005] Preferably, in step S1, collecting basic network information includes utilizing Recon-ng's modules and database functions to perform web reconnaissance and information collection.
[0006] Preferably, the step S2 includes collecting and processing information matching the keywords on the anonymous network market based on a custom data interception algorithm and crawling strategy.
[0007] Preferably, in step S4, the rendering, display and evidence storage step includes generating an index table and sorting the output results according to a relevance evaluation index between the query and the document.
[0008] Preferably, in step S2, the selected Tor proxy gateways include Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams, and each proxy gateway has a data secondary output API.
[0009] Through the above steps, the present invention can effectively collect and analyze gray and black industry data in anonymous networks, and improve the work efficiency and accuracy of public security organs in combating anonymous network crimes. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Figure 1 is a flow chart of an anonymous network data collection method of the present invention; Figure 2 It is a structural schematic diagram of an anonymous network data collection system of the present invention. DETAILED DESCRIPTION
[0011] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0012] Example: Figure 2 As shown, the anonymous network data collection system based on the present invention includes a Tor dark web proxy gateway 1, a search layer 2, a user interface layer 3, an output layer 4 and a client 5. The Tor dark web proxy gateway includes six types: Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams. The search layer includes a retriever 21, a classifier 22 and an indexer 23. The search layer is connected to the dark web (anonymous network) 6 through the Tor dark web proxy gateway. The client is connected to the search layer through the user interface layer. The user interface layer stores data in the classification directory 41, MD5 library 42 and MongoDB43 of the output layer.
[0013] It includes information collection module, data processing module and data storage module. The information collection module uses the Recon-ng framework and Tor proxy gateway to actively and passively collect anonymous network data. The data processing module cleans, translates, and segment the collected data, and classifies and automatically summarizes the data through big data analysis technology. The data storage module stores and visualizes the processed data for use by public security organs and scientific researchers.
[0014] A data mining method for anonymous networks in this embodiment, such as Figure 1 As shown, the following steps are included: S1. Anonymous network data and basic network information collection of websites: Utilize the web-based Recon-ng open source framework for development and information collection, and use independent modules, database exchange functions, interactive help prompts and command completion features, combined with the Metasploit framework and social engineering toolkit to conduct active and passive data reconnaissance to obtain basic network information of anonymous websites; S2. Big data acquisition of gray and black industries based on Tor proxy gateway: Select several Tor proxy gateways as the data acquisition interface layer, and intercept data from anonymous websites through API; S3, data processing and recognition: performing big data processing on the data obtained in step S2, including data cleaning, translation, word segmentation, automatic summarization and classification, and recognizing and analyzing the voice, image and video after big data processing; S4. Data display: Render and display the processed data, and store the data for subsequent investigation, evidence collection, and scientific research analysis, to assist public security organs in mastering anonymous network gray and black industry data resources and provide data support for combating anonymous network crimes.
[0015] In step S1, collecting basic network information includes using Recon-ng's modules and database functions to perform web reconnaissance and information collection.
[0016] Step S2 includes collecting and processing information matching the keywords on the anonymous network market based on a custom data interception algorithm and crawling strategy.
[0017] In step S4, the rendering, display and evidence storage step includes generating an index table and sorting the output results according to the relevance evaluation index between the query and the document.
[0018] In step S2, the selected Tor proxy gateways include Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams, each of which has a secondary data output API.
[0019] The present invention has demonstrated its application in anonymous network data collection and processing through the above-mentioned embodiments, and has proved its effectiveness and practicality in enhancing the public security organs' combating of anonymous network crimes.
[0020] The specific embodiments described herein are merely examples of the spirit of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in similar ways, but they will not deviate from the spirit of the present invention or exceed the scope defined by the appended claims.
Claims
1. A data mining method for anonymous networks, It is characterized in that The following steps are involved: S1. Anonymous network data and basic network information collection of websites: Utilize the web-based Recon-ng open source framework for development and information collection, and use independent modules, database exchange functions, interactive help prompts and command completion features, combined with the Metasploit framework and social engineering toolkit to conduct active and passive data reconnaissance to obtain basic network information of anonymous websites; S2. Big data acquisition of gray and black industries based on Tor proxy gateway: Select several Tor proxy gateways as the data acquisition interface layer, and intercept data from anonymous websites through API; S3, data processing and recognition: performing big data processing on the data obtained in step S2, including data cleaning, translation, word segmentation, automatic summarization and classification, and recognizing and analyzing the voice, image and video after big data processing; S4. Data display: Render and display the processed data and store them as evidence to assist public security organs in mastering anonymous network gray and black industry data resources and provide data support for combating anonymous network crimes.
2. A data mining method for anonymous networks according to claim 1, It is characterized in that In the step S1, collecting basic network information includes using the modules and database functions of Recon-ng to perform web reconnaissance and information collection.
3. A data mining method for anonymous networks according to claim 1, It is characterized in that The step S2 includes collecting and processing information matching the keywords on the anonymous network market based on a custom data interception algorithm and crawling strategy.
4. A data mining method for anonymous networks according to claim 1, It is characterized in that In step S4, the rendering, display and evidence storage step includes generating an index table and sorting the output results according to the relevance evaluation index between the query and the document.
5. A data mining method for anonymous networks according to claim 1 or 3, It is characterized in that In step S2, the selected Tor proxy gateways include Ahmia, Torch, OnionLink, Onioncab, NotEvil and Grams, and each proxy gateway has a data secondary output API.
