Extracting statistical method and system aiming at semi-structured big data
A semi-structured and statistical method technology, applied in the direction of semi-structured data retrieval, semi-structured data mapping/conversion, redundant data error detection in operations, etc., can solve the cumbersome process, visual defects, and cannot be automated Handling and other issues to achieve the effect of reducing data redundancy, simple and reliable operation and maintenance, and simple and reliable operation and maintenance
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0041] Such as figure 1 As shown, an extraction statistics method for semi-structured big data includes the following steps:
[0042] S1, the client receives the operation statement input by the user for extracting and counting semi-structured big data, and synchronizes the operation statement to the parsing and conversion module for processing;
[0043] S2. The parsing and conversion module receives the operation statement, parses the operation statement, and converts the parsing result into a configuration rule;
[0044] S3, the client calls the application engine module to generate job tasks according to the configuration rules, and submits the job tasks to the underlying framework for processing;
[0045]S4, the underlying framework splits the job task into multiple subtasks and assigns them to the cluster for execution, and returns the result data obtained after execution to the client for display.
[0046] Specifically, the client is responsible for user interaction. T...
Embodiment 2
[0063] Such as figure 2 As shown, an extractive statistics system for semi-structured big data, including:
[0064] The client module is used to receive the operation statement input by the user for extracting and counting semi-structured big data, and synchronize the operation statement to the parsing and conversion module, and call the application after the parsing and conversion module completes the parsing and conversion of the operation statement The engine module acquires the result data, and displays the acquired result data after the application engine module acquires the result data;
[0065] A parsing and conversion module, configured to receive the operation statement, analyze the operation statement and convert the analysis result into a configuration rule;
[0066] The application engine module is used to generate job tasks according to the configuration rules generated by the parsing and conversion module after receiving the call from the client module, submit ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com