Memory map-based mass data preprocessing method
A massive data, memory mapping technology, applied in the direction of electrical digital data processing, special data processing applications, semi-structured data retrieval, etc., can solve problems such as design examples of spacecraft gigabit-level massive data preprocessing methods, and reduce the proportion , Improve the efficiency of interpretation, improve the effect of reading and writing speed
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0050] The present invention is described in detail below in conjunction with accompanying drawing and specific embodiment:
[0051] Such as figure 1 As shown, a massive data preprocessing method based on memory mapping, which includes a data table generation module, a massive data fast import module, a massive data fast preprocessing module and a massive data fast retrieval module. Among them, the mass data fast import module includes a memory mapping submodule.
[0052] The data table generation module copies the new data storage table according to the designed data table format, and automatically generates the current data index information in the database index table according to the test information. The index information is used as the basis and basis for the rapid retrieval of massive data.
[0053] After the data import starts, the mass data fast import module reads the original data address, reads the original TXT files sequentially according to the original file con...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com