Terminal-based big data analysis processing method and system
A technology of analysis processing and data preprocessing, applied in the field of data processing, it can solve the problems of data information security cannot be guaranteed, lack of reasonable management of private information access, user assets and privacy leakage, etc. Analyse the effect of error in results, reducing workload and error rate
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0093] The terminal-based big data analysis and processing method provided by the embodiment of the present invention is as follows: figure 1 As shown, as a preferred embodiment, such as image 3 As shown, the method provided by the embodiment of the present invention to extract and collect locally stored data or data received by a network through a data collection module using a terminal device according to preset instructions includes:
[0094] S201, read the type information of the information to be collected included in the control instruction, and collect it in local storage and network storage according to the type information;
[0095] S202, storing the collected data in the data cache server, generating original data, classifying the data, storing the classified data in the data cache server again according to different categories, and generating classified data;
[0096] S203, call the classified data, compare the original data with the classified data called by the ...
Embodiment 2
[0102] The terminal-based big data analysis and processing method provided by the embodiment of the present invention is as follows: figure 1 As shown, as a preferred embodiment, such as Figure 4 As shown, the method for preprocessing the data to be processed through the data preprocessing module provided by the embodiment of the present invention includes:
[0103] S301. Obtain data to be processed, and obtain a configuration file matching the data to be processed according to attributes of the data to be processed;
[0104] S302. Determine the current preprocessing method corresponding to the data preprocessing, and after processing the data to be processed according to the current preprocessing method, control each operation node to process the obtained processing result according to the next preprocessing method of the current preprocessing method;
[0105] S303. Obtain the program corresponding to each step according to each step of the preprocessing flow, and process t...
Embodiment 3
[0109] The terminal-based big data analysis and processing method provided by the embodiment of the present invention is as follows: figure 1 As shown, as a preferred embodiment, such as Figure 5 As shown, the method for storing information to be processed or network received information, data preprocessing results, authority levels, remote analysis and processing results, security detection results, and warning messages through the local storage module using the storage hard disk provided by the embodiment of the present invention includes:
[0110] S401. Calculate the size of the data information to be stored, and obtain the data volume of the information to be stored;
[0111] S402. If the data volume of the information to be stored is greater than the maximum data volume of the unit information that can be stored preset by the storage hard disk, split the information to be stored into at least two pieces of information, so that each The data volume of the segmented infor...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com