Integrated System for Consistency Validation and Autonomous Correction in Standardized Mapping of Unstructured Data

Abstract

The present invention relates to the field of data processing technology for converting and linking unstructured data into standard data suitable for Enterprise Resource Planning (ERP) systems. More specifically, it relates to an integrated system for unstructured data standardization mapping consistency verification and autonomous correction that ensures stable linkage with ERP systems by converting unstructured data, such as documents, messages, and transaction records collected from various sources, into a standard column set suitable for each ERP module through preprocessing, intent classification, and context-based mapping processes, and by performing consistency verification and error correction procedures on the results. The technical gist of the present invention is that the unstructured data standardization mapping consistency verification and autonomous correction integrated system, which performs mapping from unstructured data to ERP standard data to achieve the above-mentioned purpose, comprises: a preprocessing module in which unstructured data is collected and normalized; an intent classification module in which the preprocessed data is classified according to business intents such as purchasing, sales, and production; a mapping module in which the classified data is mapped to a set of standard columns for each ERP module, and a ranking of candidate items is calculated based on context-based weights to determine the optimal item code; a consistency verification module in which the consistency of the results of the mapping module is verified and the data is excluded from ERP input if an error is detected; an autonomous correction module in which user correction or automatic remapping is performed by providing a recommended correction value when an error is detected; and an ERP linkage module in which only data that has passed the consistency verification module and the autonomous correction module is input into the ERP system, and traceability is ensured by applying idempotent keys and duplicate blocking logic during the input process and recording all processing logs.