Data platform system based on real-time streaming computing
A real-time data and data platform technology, applied in computing, digital data processing, special data processing applications, etc., can solve problems such as difficulty in meeting the timeliness and accuracy of data processing and analysis, and the inability of traditional data processing models to analyze massive data. , to achieve the effect of low latency, high throughput, and high security
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment
[0104] In the present embodiment, the data of 260M (as shown in table 2, is the sales data of a certain company) is arranged in a table in the setting Oracle database,
[0105] Table 2
[0106]
[0107]
[0108] In Table 2, the first column ORDERNO indicates the order number, the second column MEMBERNO indicates the member number, the third column TOTALPRICE indicates the total price, the fourth column ORDERSTATUS indicates the order status, the fifth column ORGID indicates the organization number, and the sixth column OPERATORID indicates operator number;
[0109] Configure the oracle database connection information through the data source module, including user name, password, oracle driver, etc. Due to the large amount of data, which has reached 120W rows, it is necessary to perform the data initialization process first, and then perform the data synchronization process;
[0110] The data initialization process is to use spark sql micro-batch to extract all the data ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com