Production domain data quality quasi-real-time monitoring system and method for based on big data technology
A big data technology and data quality technology, applied in the field of computer software design, can solve problems such as heavy data processing and analysis workload, affecting real-time data problems, and difficulty in obtaining high-quality data, so as to reduce incremental problem data and improve Data quality level, effect of shortening verification time
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Examples
Embodiment Construction
[0022] The present invention will be further described in detail below in conjunction with specific embodiments.
[0023] A quasi real-time monitoring system for data quality in the production domain based on big data technology, including: data access layer, data storage processing layer and data reference layer. Among them, the data access layer is used to access various types of source data, such as 4A systems, human resources systems, financial systems, material systems, marketing systems, and production systems. The data storage processing layer performs distributed storage of streaming data and automatically runs offline batch processing tasks for workflow in real time. The data storage processing layer is set up with a Kafka message queue that provides real-time streaming data, which can decouple data writing and data reading, real-time high availability and high concurrency; it also includes a stream processing engine that performs real-time calculation of streaming data;...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com