Customized structure data processing method and system, electronic equipment and storage medium
By introducing a customized data reader plug-in to the Seatunnel data processing platform, the platform's non-supported data format for customized structures packaged into ZIP files is solved, and the reading and parsing of this data format is realized, which improves the adaptability and practicality of the platform.
Patent Information
- Application Number
- CN202411705580.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-26
- Publication Date
- 2025-03-14
AI Technical Summary
The Seatunnel data processing platform does not support reading customized structure data formats packaged into ZIP files, resulting in the inability to effectively process such data in some business scenarios.
Provide a customized structure data processing method. By introducing a customized data reader plug-in in the Seatunnel data processing platform, including data reading interface, dynamic loading components, data pattern recognition components and data analysis components, it realizes the reading and parsing of customized structure data in ZIP files.
It extends the support of the Seatunnel data processing platform for customized structure data formats, especially the data format packaged into ZIP files, improving the adaptability and practicality of the platform.
Smart Images

Figure CN119621179A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer software technology, and in particular to a customized structure data processing method, system, electronic device and storage medium. Background Art
[0002] As the demand for big data processing grows, data processing platforms need to support multiple data sources and formats. Seatunnel data processing platform is an open source framework for data integration and conversion that supports access to multiple data sources. However, in actual applications, there are some data formats with special structures, and these formats are supported by Seatunnel data processing platform to a limited extent. For example, in some business scenarios, data may be packaged into a ZIP file, which contains a data.txt file and a meta.json file, where the meta.json file is used to describe the column header information of the data.txt file. For this kind of data format with special structure, Seatunnel data processing platform currently does not support data reading. Summary of the invention
[0003] The purpose of this application is to provide a customized structure data processing method, system, electronic device and storage medium to alleviate the above-mentioned technical problems existing in the prior art.
[0004] In a first aspect, the present invention provides a customized structure data processing method, which is applied to a customized data reader plug-in based on a Seatunnel data processing platform, wherein the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component, and a data parsing component, wherein the data reading interface is type matched with the dynamic loading component; the method comprises:
[0005] The data reading interface of the corresponding type is recorded through the dynamic loading component, the customized structure data of the corresponding type is accessed through the loaded data reading interface, and the data format of the customized structure data is extracted through the data pattern recognition component. After the target data format of the customized structure data is determined, the customized structure data is parsed and processed through the data parsing component.
[0006] In an optional embodiment, the customized data reader plug-in is configured with a user registration mechanism; the method further comprises:
[0007] In response to a user-initiated configuration file or a registration request to register a new data reader plug-in through an API, a new customized data reader plug-in is generated.
[0008] In an optional embodiment, the method further comprises:
[0009] Create a custom ClassLoader class and generate a dynamic loading component, which is used to load various types of customized data reader plug-ins.
[0010] In an optional embodiment, the method further comprises:
[0011] When starting the dynamic loading component, the plug-in class in the preset directory is scanned and the dynamic loading component is loaded into the memory.
[0012] In an optional implementation, after extracting the data format of the customized structure data by the data pattern recognition component, the method further includes:
[0013] Create a target mapping table, and map the customized structure data to the internal data model corresponding to the Seatunnel data processing platform according to the fields of the target data format based on the target mapping table.
[0014] In an optional embodiment, the method further comprises:
[0015] The customized data reader plug-in is consistent with the interface specification of the Seatunnel data processing platform.
[0016] In an optional embodiment, the method further comprises:
[0017] Monitor the reading status of the customized data reader plug-in in real time during the data reading process, and start the exception handling mechanism when a reading error is detected.
[0018] In a second aspect, the present invention provides a customized structure data processing system, including the customized data reader plug-in applied to the Seatunnel data processing platform according to the aforementioned embodiment, wherein the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface is type matched with the dynamic loading component; the system is used for:
[0019] The data reading interface of the corresponding type is recorded through the dynamic loading component, the customized structure data of the corresponding type is accessed through the loaded data reading interface, and the data format of the customized structure data is extracted through the data pattern recognition component. After the target data format of the customized structure data is determined, the customized structure data is parsed and processed through the data parsing component.
[0020] In a third aspect, the present invention provides an electronic device including a processor and a memory, wherein the memory stores computer executable instructions that can be executed by the processor, and the processor executes the computer executable instructions to implement the customized structure data processing method of any one of the aforementioned implementations.
[0021] In a fourth aspect, the present invention provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the customized structure data processing method of any one of the aforementioned implementation modes.
[0022] The customized structure data processing method, system, electronic device and storage medium provided by the present application have the following beneficial effects:
[0023] By providing a customized data reader plug-in on the Seatunnel data processing platform, the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface and the dynamic loading component are type matched. The Seatunnel data processing platform can be provided with an extended customized structure data format reading function, so that the Seatunnel data processing platform supports the reading of data in a customized structure data format packaged into a ZIP file, thereby greatly improving the adaptability and practicality of the Seatunnel data processing platform. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0025] Figure 1 A flowchart of a customized structure data processing method provided in an embodiment of the present application;
[0026] Figure 2 A structural diagram of a customized structure data processing system provided in an embodiment of the present application;
[0027] Figure 3 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.
[0029] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0030] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0031] The embodiment of the present application provides a customized structure data processing method, which is applied to a customized data reader plug-in based on the Seatunnel data processing platform. The customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface and the dynamic loading component are type matched; see Figure 1 As shown, the method is mainly implemented by the following steps:
[0032] Step S110, recording a data reading interface of a corresponding type by dynamically loading a component.
[0033] In one embodiment, the data reading interface is a pluggable data reader architecture that can be integrated into the Seatunnel framework to support reading the corresponding type of custom structured data. For example, the custom structured data can be data packaged into a ZIP file, and the ZIP file includes a data.txt file and a meta.json file, the latter of which is used to describe the column header information of the data.txt file.
[0034] The above data reading interface can be implemented by pre-defining a unified data reader interface (DataFetcherInterface), which contains necessary methods such as read(), close() and initialize().
[0035] Step S120 , accessing the corresponding type of customized structure data through the loaded data reading interface, and extracting the data format of the customized structure data through the data pattern recognition component.
[0036] In one implementation, the corresponding relationship between the loaded data reading interface accessing the corresponding type of customized structure data can be one-to-one, that is, one data reading interface corresponds to one type of customized structure data; the corresponding relationship between the loaded data reading interface accessing the corresponding type of customized structure data can also be one-to-many, that is, one data reading interface corresponds to several types of customized structure data. In actual applications, adaptive adjustments can be made according to the application scenario.
[0037] The above-mentioned data pattern recognition component is used to extract key information from different data formats and identify the structural pattern of the data format, so as to facilitate subsequent data processing and analysis.
[0038] Step S130: after determining the target data format of the customized structure data, the customized structure data is parsed by a data parsing component.
[0039] In one embodiment, the data parsing component is used to parse the customized structure data of the corresponding target data format. In practical applications, an efficient data parsing algorithm can be selected to accelerate the reading and parsing process of the target data format and improve the overall data processing performance.
[0040] In specific implementation, the specific optimization measures of the above efficient data parsing algorithm include:
[0041] Cache mechanism: For recurring data structures, use a cache mechanism to reduce the number of parsing times.
[0042] Parallel processing: Use multi-threading or multi-process technology to achieve parallel reading and parsing of data.
[0043] The customized structure data processing method provided in the embodiment of the present application provides a customized data reader plug-in on the Seatunnel data processing platform, and the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface and the dynamic loading component are type matched. The Seatunnel data processing platform can be provided with an extended customized structure data format reading function, so that the Seatunnel data processing platform supports the reading of data in the customized structure data format packaged into a ZIP file, thereby greatly improving the adaptability and practicality of the Seatunnel data processing platform.
[0044] Furthermore, the customized data reader plug-in is configured with a user registration mechanism; the method further comprises:
[0045] In response to a user-initiated configuration file or a registration request to register a new data reader plug-in through an API, a new customized data reader plug-in is generated. That is, the aforementioned pluggable data reader architecture implements a plug-in registration mechanism, allowing users to register new data reader plug-ins through configuration files or APIs.
[0046] In a specific implementation, the data reader plug-in is registered through a configuration file, and the specific implementation process is as follows:
[0047] 1. Configuration file example
[0048] In the configuration file seatunnel-config.yml, users can register a new data reader plug-in through this configuration file. The following is an example configuration file:
[0049] job:
[0050] common:
[0051] name:"ReadZIPWithMetaAndData"
[0052] environment:
[0053] flink:
[0054] runner:LOCAL
[0055] source:
[0056] type:customZipFetcher
[0057] filePath: / path / example / zipfile.zip
[0058] pluginClass:com.example.seatunnel.ZipTextJsonDataFetcherImpl
[0059] sink:
[0060] type:console
[0061] format:
[0062] type:json
[0063] 2. Configuration file parsing
[0064] 2.1. Parsing the configuration file
[0065] 1. Read the configuration file:
[0066] Use a tool or library such as SnakeYAML to read the seatunnel-config.yml file.
[0067] Parse the file content into a Map object for subsequent processing.
[0068] 2. Extract configuration information:
[0069] Extract the configuration information of the source part from the parsed Map object, including pluginClass and filePath.
[0070] pluginClass is the fully qualified class name of the data reader plugin.
[0071] filePath is the path to the ZIP file to read.
[0072] 3. Plugin registration logic
[0073] 3.1. Dynamically loading plugin classes
[0074] 1. Get the plug-in class name:
[0075] Extract the value of pluginClass from the configuration file, which is a string representing the fully qualified class name of the data reader plugin.
[0076] 2. Load the plug-in class:
[0077] Use Java's reflection mechanism to load the plug-in class through the Class.forName(pluginClass) method.
[0078] Get the constructor of the plugin class through the pluginClass.getConstructor() method.
[0079] Create an instance of the plugin class through the constructor.newInstance() method.
[0080] 3.2. Initialize the plugin instance
[0081] 1. Set the file path:
[0082] Extract the value of filePath from the configuration file.
[0083] Call the setFilePath(filePath) method of the plugin instance to set the path of the ZIP file to be read.
[0084] 2. Initialize the plugin:
[0085] Call the initialize() method of the plugin instance to execute the initialization logic of the plugin.
[0086] 3.3. Registering plugins
[0087] 1. Register the plugin:
[0088] Register the plug-in instance to the system and add the plug-in instance to a manager or container so that it can be called during data processing.
[0089] 4. Data Reader Interface and Implementation
[0090] 4.1. Data Reader Interface
[0091] 1. Define the interface:
[0092] Define an interface ZipTextJsonDataFetcher, which contains several methods, such as setFilePath(String filePath), initialize(), readData(), and close().
[0093] 4.2. Data Reader Implementation
[0094] 1. Implement the interface:
[0095] Create a class ZipTextJsonDataFetcherImpl to implement the ZipTextJsonDataFetcher interface.
[0096] In the setFilePath(String filePath) method, set the path of the ZIP file to be read.
[0097] In the initialize() method, execute initialization logic, such as opening files, reading metadata, etc.
[0098] In the readData() method, read the data.txt file and meta.json file in the ZIP file and parse the data.
[0099] In the close() method, close resources, such as closing a file stream.
[0100] 5. Main program
[0101] 1. Parse the configuration file:
[0102] Call the configuration file parsing method to read and parse the seatunnel-config.yml file to obtain the configuration information.
[0103] 2. Register the plugin:
[0104] Use the configuration information to dynamically load the plug-in class and create a plug-in instance.
[0105] Set the file path and initialize the plugin.
[0106] Register the plugin to the system.
[0107] Through the above configuration file seatunnel-config.yml, users can specify the class name and file path of the data reader plug-in. When the system starts, it will read the configuration file, parse the configuration information, dynamically load the plug-in class, create a plug-in instance, and set the necessary parameters. Then, the plug-in instance will be registered with the system so that it can be called during data processing. This mechanism allows users to flexibly add and manage new data reader plug-ins without modifying the code, which improves the ease and flexibility of operation.
[0108] In an optional embodiment, the above-mentioned dynamic loading component can be implemented by creating a custom ClassLoader class. The dynamic loading component is used to load various types of customized data reader plug-ins. Through dynamic class loading technology, the system can load different data reader plug-ins as needed at runtime without restarting the entire application.
[0109] In addition, in actual applications, in order to realize the smooth use of the dynamically loaded component, when the dynamically loaded component is started, the plug-in class under the preset directory can be scanned and the dynamically loaded component can be loaded into the memory.
[0110] Considering that there may be a variety of different data formats in actual use, in one embodiment, after the data format of the custom structure data is extracted by the data pattern recognition component, a general metadata extraction method can be pre-configured to extract key information from different data formats to facilitate subsequent data processing and analysis. In specific implementation, the structural pattern of the data format is identified, a target mapping table is created, and based on the target mapping table, the custom structure data is mapped to the internal data model corresponding to the Seatunnel data processing platform according to the fields of the target data format.
[0111] Furthermore, in order to ensure that the newly added data reader is compatible with other components of Seatunnel and to ensure a smooth transition of the data processing flow, in one embodiment, the interface specification of the customized data reader plug-in can be made consistent with that of the Seatunnel data processing platform.
[0112] In addition, in order to ensure that problems encountered during the data reading process can be handled promptly and effectively, in an optional implementation, the reading status of the customized data reader plug-in during the data reading process can be monitored in real time, and when a reading error is detected, an exception handling mechanism is initiated.
[0113] In summary, the embodiments of the present application provide a flexible and extensible data reader architecture, so that Seatunnel can easily support customized structured data formats packaged into ZIP files, greatly improving the adaptability and practicality of the system.
[0114] Based on the above method embodiment, the present application embodiment also provides a customized structure data processing system, including the customized data reader plug-in applied to the Seatunnel data processing platform in the above embodiment, the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface and the dynamic loading component are type matched. The system also includes a data source, a data processing engine and a data receiving end. The system structure is shown in Figure 2 As shown. Among them:
[0115] Data source: indicates the ZIP file to be processed, including data.txt and meta.json files.
[0116] Data reader plug-in: represents the new data reader plug-in proposed by the present invention.
[0117] Data processing engine: represents the core processing component of Seatunnel.
[0118] Data receiving end: represents the target of data output, such as database, file system, etc.
[0119] The above system is used to:
[0120] The data reading interface of the corresponding type is recorded through the dynamic loading component, the customized structure data of the corresponding type is accessed through the loaded data reading interface, and the data format of the customized structure data is extracted through the data pattern recognition component. After the target data format of the customized structure data is determined, the customized structure data is parsed and processed through the data parsing component.
[0121] In a feasible implementation manner, the customized data reader plug-in is configured with a user registration mechanism; the above system is also used for:
[0122] In response to a user-initiated configuration file or a registration request to register a new data reader plug-in through an API, a new customized data reader plug-in is generated.
[0123] In a feasible implementation manner, the above system is also used to: create a custom ClassLoader class, generate a dynamic loading component, and the dynamic loading component is used to load various types of customized data reader plug-ins.
[0124] In a feasible implementation manner, the above system is further used to: when starting the dynamic loading component, scan the plug-in class under the preset directory and load the dynamic loading component into the memory.
[0125] In a feasible implementation, after extracting the data format of the customized structure data through the data pattern recognition component, the above system is also used to: create a target mapping table, and map the customized structure data according to the fields of the target data format to the internal data model corresponding to the Seatunnel data processing platform based on the target mapping table.
[0126] In a feasible implementation manner, the above system is also used to: customize the data reader plug-in to maintain consistency with the interface specification of the Seatunnel data processing platform.
[0127] In a feasible implementation manner, the above system is also used to: monitor the reading status of the customized data reader plug-in in real time during the data reading process, and when a reading error is detected, start an exception handling mechanism.
[0128] The implementation principle and technical effects of the customized structure data processing system provided in the embodiment of the present application are the same as those of the aforementioned method embodiment. For the sake of brief description, for parts not mentioned in the embodiment of the customized structure data processing system, reference may be made to the corresponding contents in the aforementioned customized structure data processing method embodiment.
[0129] The present application also provides an electronic device, such as Figure 3 As shown, it is a schematic diagram of the structure of the electronic device, wherein the electronic device 100 includes a processor 31 and a memory 30, the memory 30 stores computer executable instructions that can be executed by the processor 31, and the processor 31 executes the computer executable instructions to implement any of the above-mentioned customized structure data processing methods.
[0130] exist Figure 3 In the illustrated embodiment, the electronic device further includes a bus 32 and a communication interface 33 , wherein the processor 31 , the communication interface 33 and the memory 30 are connected via the bus 32 .
[0131] Among them, the memory 30 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 33 (which can be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. can be used. The bus 32 can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus 32 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0132] The processor 31 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 31. The above processor 31 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor can be combined and performed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor 31 reads the information in the memory and completes the steps of the customized structure data processing method of the above embodiment in combination with its hardware.
[0133] An embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the above-mentioned customized structure data processing method. The specific implementation can be found in the aforementioned method embodiment, which will not be repeated here.
[0134] The computer program products of the customized structure data processing method, system, electronic device and storage medium provided in the embodiments of the present application include a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods in the previous method embodiments. The specific implementation can be found in the method embodiments, which will not be repeated here.
[0135] Unless otherwise specifically stated, the relative steps, numerical expressions and values of the components and steps set forth in these embodiments do not limit the scope of the present application.
[0136] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program codes.
[0137] In the description of this application, it should also be noted that, unless otherwise clearly specified and limited, the terms "set", "install", "connect", and "connect" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for processing customized structure data, characterized in that: A customized data reader plug-in is applied to a Seatunnel data processing platform, wherein the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface is type matched with the dynamic loading component; the method comprises: The data reading interface of the corresponding type is recorded through the dynamic loading component, the customized structure data of the corresponding type is accessed through the loaded data reading interface, and the data format of the customized structure data is extracted through the data pattern recognition component. After the target data format of the customized structure data is determined, the customized structure data is parsed and processed through the data parsing component.
2. The method for processing customized structure data according to claim 1, characterized in that: The customized data reader plug-in is configured with a user registration mechanism; the method further comprises: In response to a user-initiated configuration file or a registration request to register a new data reader plug-in through an API, a new customized data reader plug-in is generated.
3. The method for processing customized structure data according to claim 1, characterized in that: The method further comprises: A custom ClassLoader class is created to generate the dynamic loading component, which is used to load various types of customized data reader plug-ins.
4. The method for processing customized structure data according to claim 3, characterized in that: The method further comprises: When the dynamic loading component is started, the plug-in class in the preset directory is scanned, and the dynamic loading component is loaded into the memory.
5. The method for processing customized structure data according to claim 1, characterized in that: After extracting the data format of the customized structure data by the data pattern recognition component, the method further includes: A target mapping table is created, and based on the target mapping table, the customized structure data is mapped to an internal data model corresponding to the Seatunnel data processing platform according to the fields of the target data format.
6. The method for processing customized structure data according to claim 1, characterized in that: The method further comprises: The customized data reader plug-in maintains consistency with the interface specification of the Seatunnel data processing platform.
7. The method for processing customized structure data according to claim 1, characterized in that: The method further comprises: The reading status of the customized data reader plug-in during the data reading process is monitored in real time, and when a reading error is detected, an exception handling mechanism is started.
8. A customized structure data processing system, characterized in that: The system comprises the customized data reader plug-in applied to the Seatunnel data processing platform according to claim 1, wherein the customized data reader plug-in is provided with a data reading interface, a dynamic loading component, a data pattern recognition component and a data parsing component, wherein the data reading interface is type matched with the dynamic loading component; and the system is used for: The data reading interface of the corresponding type is recorded through the dynamic loading component, the customized structure data of the corresponding type is accessed through the loaded data reading interface, and the data format of the customized structure data is extracted through the data pattern recognition component. After the target data format of the customized structure data is determined, the customized structure data is parsed and processed through the data parsing component.
9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer executable instructions that can be executed by the processor, and the processor executes the computer executable instructions to implement the customized structure data processing method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the customized structure data processing method according to any one of claims 1 to 7.