Data extraction method and device, computer equipment and storage medium
By extracting and converting ESG information and checking its correctness by using regular mapping relationships, the problems of low efficiency and error-prone ESG data extraction in the prior art are solved, and more efficient and accurate data extraction is achieved.
Patent Information
- Application Number
- CN202411745568.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-28
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2044-11-28
AI Technical Summary
In the prior art, the extraction efficiency of ESG data is low and prone to errors, mainly due to errors, missed and incorrect raising problems caused by manual extraction.
By obtaining ESG information in the target file, extracting ESG description information and numerical information, and converting it into a standard format, the correctness of the extracted information is checked using regular mapping relationships to ensure the accuracy and completeness of the data.
It improves the accuracy and completeness of ESG data extraction, reduces the problems of errors, missed and misreported, improves the efficiency of data extraction, and is more automated and efficient than manual extraction methods.
Smart Images

Figure CN119720953A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the fields of data processing and financial technology, and in particular to a data extraction method, device, computer equipment and storage medium. Background Art
[0002] File data extraction refers to the process of extracting useful data from files of various formats (such as txt / PDF / Word and other file types). This process is crucial for fields such as data analysis, machine learning and artificial intelligence. With the popularization of the concept of sustainable development, the ESG performance of enterprises has received more and more attention. ESG reports contain a large amount of quantitative data, which can be used to help companies identify internal and external factors that have a substantial impact on sustainable development strategies, identify corporate management risks, climate change environmental risks, etc.
[0003] Currently, ESG data is mostly extracted manually, but manual data extraction is inefficient and prone to errors. Summary of the invention
[0004] The present invention provides a data extraction method, device, computer equipment and storage medium to solve the technical problems of low efficiency and easy error of manual extraction.
[0005] In a first aspect, a data extraction method is provided, comprising: obtaining a target file, wherein the target file includes ESG information;
[0006] Extracting ESG description information and / or ESG value information included in the ESG information in the target file;
[0007] Convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units;
[0008] Based on the regular mapping relationship and the target file, check whether the ESG description information and / or ESG data information extracted from each ESG information is correct. The regular mapping relationship includes the regular expression between different description information of the same ESG information and the standard description information, and the conversion ratio between different data units of the same ESG information and the standard unit.
[0009] In a second aspect, a data extraction device is provided, comprising: an acquisition module, configured to acquire a target file, wherein the target file includes ESG information;
[0010] An extraction module, used to extract ESG description information and / or ESG value information included in the ESG information in the target file;
[0011] A conversion module, used to convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units;
[0012] A checking module is used to check whether the ESG description information and / or ESG data information extracted from each ESG information is correct based on a regular mapping relationship and the target file. The regular mapping relationship includes a regular expression between different description information of the same ESG information and the standard description information, and a conversion ratio between different data units of the same ESG information and the standard unit.
[0013] In a third aspect, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned data extraction method when executing the computer program.
[0014] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned data extraction method are implemented.
[0015] In the scheme implemented by the above-mentioned data extraction method, device, computer equipment and storage medium, by extracting the ESG description information and / or ESG numerical information included in the ESG information in the target file, different description information of the same ESG information is converted into standard description information, different numerical units of the same ESG information are converted into standard units, and the ESG description information and / or ESG data information extracted from each ESG information is checked to see if they are correct. Since there may be multiple description methods for the same ESG information in the target file, the ESG information is converted into standard information to facilitate data analysis and use, and the correctness of the extracted ESG information is detected through a regular mapping relationship, which solves the problems of data extraction errors, omissions, and erroneous extractions, and improves the accuracy of data extraction and the completeness of extracted data. And compared with the manual extraction method, the present invention uses an automated method to extract and check data, which improves the efficiency of data extraction. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.
[0017] Figure 1 is a schematic diagram of an application environment of a data extraction method in one embodiment of the present invention;
[0018] Figure 2is a flow chart of a data extraction method in one embodiment of the present invention;
[0019] Figure 3 is a structural schematic diagram of a data extraction device in one embodiment of the present invention;
[0020] Figure 4 is a schematic diagram of a structure of a computer device in one embodiment of the present invention;
[0021] Figure 5 It is another structural schematic diagram of a computer device in one embodiment of the present invention. DETAILED DESCRIPTION
[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0023] The data extraction method provided by the embodiment of the present invention can be applied to Figure 1 In an application environment, the client communicates with the server through a network. The server can receive the target file sent by the user through the client, extract the ESG description information and ESG numerical information included in the ESG information in the target file; convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units; based on the regular mapping relationship and the target file, check whether the ESG description information and ESG data information extracted from each ESG information are correct. In the present invention, the ESG information is converted into standard information to facilitate data analysis and use, and the correctness of the extracted ESG information is detected by the regular mapping relationship, which solves the problems of data extraction errors, omissions, and erroneous extractions, and improves the accuracy of data extraction and the integrity of extracted data. Compared with the manual extraction method, the present invention uses an automated method to extract data and check data, which improves the efficiency of data extraction. Among them, the client can be but is not limited to various personal computers, laptops, smart phones, tablet computers and portable wearable devices. The server can be implemented with an independent server or a server cluster consisting of multiple servers. The present invention is described in detail below through specific embodiments.
[0024] See also Figure 2 As shown, Figure 2 A flow chart of a data extraction method provided by an embodiment of the present invention includes the following steps:
[0025] S10: Acquire a target file, which includes ESG information.
[0026] The data extraction method provided by the present invention can be applied to file extraction in various application scenarios. File extraction is usually implemented through a server, and the server can receive the target file in real time.
[0027] Among them, ESG information covers the company's information in three aspects: environment (Environmental), society (Social) and governance (Governance). Specifically, in terms of environment, ESG information includes greenhouse gas emissions, energy use and efficiency, water resource management, waste management, pollution control, natural resource protection, environmental policies and management systems, environmental risks and opportunities; in terms of society, ESG information includes labor standards, employee relations, community participation and development, supply chain responsibility, consumer protection, health and social impacts, social responsibility policies and practices; in terms of governance, ESG information includes corporate governance structure, business ethics and compliance, transparency and disclosure, shareholder and stakeholder rights, risk management, diversity of executives and boards of directors, political participation and lobbying, tax strategies, etc. Among them, taking greenhouse gas emissions as an example, ESG information can be the carbon dioxide and other greenhouse gas emissions produced by the company.
[0028] S20: Extract ESG description information and / or ESG value information included in the ESG information in the target file.
[0029] The ESG description information is used to describe the ESG numerical information of the ESG information, including the numerical unit of the ESG information. For example, when the ESG information is greenhouse gas emissions, the ESG description information may be the total greenhouse gas emissions, greenhouse gas emission intensity, etc., and the ESG numerical information may be kilograms, tons, kilograms, degrees, etc.
[0030] In some embodiments, the ESG description information and / or ESG value information included in the ESG information in the target file is extracted based on the big model. The big model is pre-trained with a training set so that the trained big model can extract the ESG description information and / or ESG value information included in the ESG information in the target file. The present invention does not limit the type of big model, as long as it can implement the data extraction method proposed in the present invention.
[0031] In some embodiments, the ESG description information and / or ESG numerical information included in the ESG information in the target file is extracted based on a regular mapping relationship. The regular mapping relationship includes a regular expression between different description information of the same ESG information and the standard description information, and a conversion ratio between different data units of the same ESG information and the standard unit. Specifically, different description information corresponding to the standard description information is determined based on the regular mapping relationship, and different description information for the same standard information in the target file is extracted.
[0032] In some embodiments, ESG information in the target file is extracted based on the large model, and then based on the regular mapping relationship, ESG description information and / or ESG value information is extracted from the ESG information.
[0033] In some embodiments, before extracting the ESG description information and / or ESG value information included in the ESG information in the target file, the target file is parsed to convert the information in different formats in the target file into text descriptions. For example, the text information in the tables and pictures in the target file is extracted through a pre-trained model or OCR recognition, so as to extract the ESG description information and / or ESG value information included in the ESG information in the target file based on a large model or a regular mapping relationship.
[0034] In the embodiment of the present invention, ESG information is extracted in an automated manner, which improves the efficiency of data extraction compared to a method with frequent manual intervention.
[0035] S30: Convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units.
[0036] In some embodiments, different description information of the same ESG information is converted into standard description information based on a regular mapping relationship, and different numerical units of the same ESG information are converted into standard units.
[0037] For example, for the ESG description information of greenhouse gas emissions, the standard description information is total greenhouse gas emissions-category 1, but the description information used in the document may be total greenhouse gas emissions-scope 1 or total greenhouse gas emissions-category 1, etc., so the regular mapping relationship is shown in Table 1:
[0038] Table 1
[0039] Standard description information Regular expression Total greenhouse gas emissions - Scope 1 (Scope|Range)(1|one).*(?!.*degree) Greenhouse gas emission intensity - Scope 1 (Scope|Range)(1|one).*(degree)
[0040] Through the regular mapping relationship shown in Table 1, different description information for the total amount of greenhouse gas emissions can be converted into "total amount of greenhouse gas emissions-category 1", and different description information for greenhouse gas emission intensity can be converted into "greenhouse gas emission intensity-category 1". In this way, by establishing a regular mapping relationship between standard description information corresponding to different description information, different description information of the same ESG information in the target file can be converted into standard description information.
[0041] For example, for ESG numerical information on total greenhouse gas emissions, the standard numerical unit is tons, but the numerical unit used in the file may be kilograms, tons of standard coal, etc., so the regular mapping relationship is shown in Table 2:
[0042] Table 2
[0043]
[0044] The canonical mapping relationship shown in Table 2 specifies the conversion ratio between different numerical units and standard numerical units. For example, the conversion ratio between the non-standard unit "ton of standard coal" and the standard unit "ton" is 2.64. Therefore, by establishing a canonical mapping relationship between different non-standard units and standard units, different numerical units of the same ESG information in the target file can be converted into standard units.
[0045] S40: Based on the regular mapping relationship and the target file, check whether the ESG description information and / or ESG data information extracted from each ESG information is correct.
[0046] When extracting ESG descriptive information and / or ESG numerical information included in the ESG information in the target file, extraction errors may occur. For example, the ESG information in the target file is that the total amount of C02 emissions is 34KG. When step S20 extracts the ESG information, the extracted ESG descriptive information is the total amount of C03 emissions, and the extracted ESG numerical information is 34KG. At this time, the ESG descriptive information extracted in step S20 is wrong, so it is necessary to check whether the extracted ESG information and / or ESG data information is correct through step S40.
[0047] In some embodiments, based on the canonical mapping relationship and the target file, it is checked whether the ESG description information and / or ESG value information extracted from the same ESG information is located in the target file. Specifically, the extracted ESG description information and ESG value information are converted into original ESG description information and original ESG value information through the canonical mapping relationship, and the original ESG description information and original ESG value information are compared with the target file to determine whether the target file includes the original ESG description information and original ESG value information.
[0048] In other embodiments, based on the regular mapping relationship and the target file, it is checked whether the ESG description information and the ESG value information extracted from the same ESG information are located in the same sentence. Specifically, the extracted ESG description information and the ESG value information are converted into the original ESG description information and the original ESG value information through the regular mapping relationship. If the original ESG description information and the original ESG value information are located in a table, it is determined whether they are located in the same sentence by judging whether the original ESG description information and the original ESG value information are located in the same table; if the original ESG description information and the original ESG value information are located in the text, it is determined whether the original ESG description information and the original ESG value information are located in the same sentence by punctuation or line breaks. For example, if there is a "." in the sentence where the original ESG description information and the original ESG value information are located, it can be determined that the original ESG description information and the original ESG value information are not located in the same sentence. For another example, if there is a line break in the sentence where the original ESG description information and the original ESG value information are located, it can be determined that the original ESG description information and the original ESG value information are not located in the same sentence.
[0049] In another embodiment, based on the regular mapping relationship and the target file, it is checked whether the ESG description information and the ESG value information extracted from the same ESG information are located in the target file and whether they are located in the same sentence. Specifically, the original ESG description information and the original ESG value information corresponding to the ESG description information and the ESG value information extracted from the same ESG information in the target file are determined by the regular mapping relationship, and the target file is scanned and the original ESG description information and the original ESG value information are compared with the target file to determine whether the original ESG description information and the original ESG value information are located in the target file. Further, it is determined whether the original ESG description information and the original ESG value information are located in the same sentence by line breaks or punctuation marks.
[0050] In some embodiments of the present invention, after step S40, if the ESG description information and ESG value information extracted from the same ESG information are located in the target file and in the same statement, the ESG description information and the ESG value information are stored in the first data table for subsequent use of the ESG information.
[0051] If the ESG description information and ESG value information extracted from the same ESG information are not located in the target file and / or are not located in the same statement, the number of extraction times of the ESG information is determined, and a method for processing the ESG information is determined based on the number of extraction times of the ESG information.
[0052] Specifically, if the number of times the ESG information is extracted is greater than a preset number, the ESG information is stored in the second data table. In order to save time and improve extraction efficiency, the ESG information is no longer extracted, and the ESG information is subsequently extracted by manually checking the second data table. If the number of times the ESG information is extracted is less than or equal to the preset number, the ESG information is re-extracted, and it is subsequently determined whether the extracted ESG description information and ESG value information are located in the target file and / or in the same statement.
[0053] Furthermore, if it is determined that the ESG description information and the ESG numerical information are not located in the target file and / or are not located in the same statement, the ESG description information or the ESG numerical information that is not located in the target file and / or the ESG description information or the ESG numerical information that is not located in the same statement will be deleted.
[0054] In this embodiment, by checking whether the extracted ESG description information and ESG value information are located in the target file and / or in the same statement, extraction errors and forged data can be eliminated, thereby improving the accuracy of data extraction.
[0055] It can be seen that in the above scheme, by extracting the ESG description information and / or ESG numerical information included in the ESG information in the target file, different description information of the same ESG information is converted into standard description information, different numerical units of the same ESG information are converted into standard units, and the ESG description information and / or ESG data information extracted from each ESG information is checked to see if they are correct. Since there may be multiple description methods for the same ESG information in the target file, the ESG information is converted into standard information to facilitate data analysis and use, and the correctness of the extracted ESG information is detected through a regular mapping relationship, which solves the problems of data extraction errors, omissions, and erroneous extractions, and improves the accuracy of data extraction and the completeness of extracted data. And compared with the manual extraction method, the present invention uses an automated method to extract and check data, which improves the efficiency of data extraction.
[0056] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.
[0057] In one embodiment, a data extraction device is provided, which corresponds one-to-one to the data extraction method in the above embodiment. Figure 3 As shown, the data extraction device includes an acquisition module 101, an extraction module 102, a conversion module 103, a check module 104 and a processing module 105. The functional modules are described in detail as follows:
[0058] An acquisition module 101 is used to acquire a target file, wherein the target file includes ESG information;
[0059] An extraction module 102, configured to extract ESG description information and / or ESG value information included in the ESG information in the target file;
[0060] A conversion module 103, used to convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units;
[0061] The checking module 104 is used to check whether the ESG description information and / or ESG data information extracted from each ESG information is correct based on the regular mapping relationship and the target file. The regular mapping relationship includes the regular expression between different description information of the same ESG information and the standard description information and the conversion ratio between different data units of the same ESG information and the standard unit.
[0062] In one embodiment, the extraction module 102 is specifically used to extract the ESG description information and / or ESG value information included in the ESG information in the target file based on the large model; or to extract the ESG description information and / or ESG value information included in the ESG information in the target file based on a regular mapping relationship.
[0063] In one embodiment, the conversion module 103 is specifically configured to convert data in the table into text information if it is detected that the target text includes a table.
[0064] In one embodiment, the checking module 104 is specifically used to check whether the ESG description information and / or ESG numerical information extracted from the same ESG information is located in the target file based on the regular mapping relationship and the target file; and / or based on the regular mapping relationship and the target file, check whether the ESG description information and ESG numerical information extracted from the same ESG information are located in the same statement.
[0065] In one embodiment, the processing module 105 is configured to store the ESG description information and the ESG value information extracted from the same ESG information in the first data table if the ESG description information and the ESG value information are located in the target file and in the same statement;
[0066] If the ESG description information and the ESG value information are not located in the target file and / or are not located in the same statement, the number of extraction times of the ESG information is determined, and a method for processing the ESG information is determined based on the number of extraction times of the ESG information.
[0067] In one embodiment, the processing module 105 is used to store the ESG information in the second data table if the number of extraction times of the ESG information is greater than a preset number; or to re-extract the ESG information if the number of extraction times of the ESG information is less than or equal to the preset number.
[0068] In one embodiment, the processing module 105 is used to determine ESG description information or ESG value information that is not located in the same statement; and delete the ESG description information or ESG value information that is not located in the target file, and / or the ESG description information or ESG value information that is not located in the same statement.
[0069] The present invention provides a data extraction device, which extracts ESG description information and / or ESG numerical information included in the ESG information in the target file, converts different description information of the same ESG information into standard description information, converts different numerical units of the same ESG information into standard units, and checks whether the ESG description information and / or ESG data information extracted from each ESG information is correct. Since there may be multiple description methods for the same ESG information in the target file, the ESG information is converted into standard information to facilitate data analysis and use, and the correctness of the extracted ESG information is detected through a regular mapping relationship, which solves the problems of data extraction errors, omissions, and erroneous extractions, and improves the accuracy of data extraction and the completeness of extracted data. Compared with the manual extraction method, the present invention uses an automated method to extract and check data, which improves the efficiency of data extraction.
[0070] The specific definition of the data extraction device can be found in the definition of the data extraction method above, which will not be repeated here. Each module in the above data extraction device can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0071] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 4As shown. The computer device includes a processor, a memory, a network interface and a database connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile and / or volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external client via a network connection. When the computer program is executed by the processor, it implements a function or step on the server side of a data extraction method.
[0072] In one embodiment, a computer device is provided. The computer device may be a client, and its internal structure diagram may be as follows: Figure 5 As shown. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external server through a network connection. When the computer program is executed by the processor, it realizes the functions or steps of the client side of a data extraction method
[0073] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:
[0074] Acquire a target file, wherein the target file includes ESG information;
[0075] Extracting ESG description information and / or ESG value information included in the ESG information in the target file;
[0076] Convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units;
[0077] Based on the regular mapping relationship and the target file, check whether the ESG description information and / or ESG data information extracted from each ESG information is correct. The regular mapping relationship includes the regular expression between different description information of the same ESG information and the standard description information, and the conversion ratio between different data units of the same ESG information and the standard unit.
[0078] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0079] Acquire a target file, wherein the target file includes ESG information;
[0080] Extracting ESG description information and / or ESG value information included in the ESG information in the target file;
[0081] Convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units;
[0082] Based on the regular mapping relationship and the target file, check whether the ESG description information and / or ESG data information extracted from each ESG information is correct. The regular mapping relationship includes the regular expression between different description information of the same ESG information and the standard description information, and the conversion ratio between different data units of the same ESG information and the standard unit.
[0083] It should be noted that the above functions or steps that can be implemented by the computer-readable storage medium or computer device can refer to the relevant descriptions on the server side and the client side in the aforementioned method embodiment. To avoid repetition, they will not be described one by one here.
[0084] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0085] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.
[0086] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.
Claims
1. A data extraction method, characterized in that: include: Acquire a target file, wherein the target file includes ESG information; Extracting ESG description information and / or ESG value information included in the ESG information in the target file; Convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units; Based on the regular mapping relationship and the target file, check whether the ESG description information and / or ESG data information extracted from each ESG information is correct. The regular mapping relationship includes the regular expression between different description information of the same ESG information and the standard description information, and the conversion ratio between different data units of the same ESG information and the standard unit.
2. The method according to claim 1, characterized in that The extracting the ESG description information and / or ESG value information included in the ESG information in the target file includes: Extracting ESG description information and / or ESG value information included in the ESG information in the target file based on the large model; or The ESG description information and / or ESG value information included in the ESG information in the target file is extracted based on the regular mapping relationship.
3. The method according to claim 1 or 2, characterized in that: Before extracting the ESG description information and / or ESG value information included in the ESG information in the target file, the method further includes: If it is detected that the target text includes a table, the data in the table is converted into text information.
4. The method according to claim 1, characterized in that The step of checking whether the ESG description information and / or ESG data information extracted from each piece of ESG information is correct based on the regular mapping relationship and the target file includes: Based on the canonical mapping relationship and the target file, checking whether the ESG description information and / or the ESG value information extracted from the same ESG information is located in the target file; and / or Based on the regular mapping relationship and the target file, it is checked whether the ESG description information and the ESG value information extracted from the same ESG information are located in the same statement.
5. The method according to claim 4, characterized in that The method further comprises: If the ESG description information and the ESG value information extracted from the same ESG information are located in the target file and in the same statement, storing the ESG description information and the ESG value information in the first data table; If the ESG description information and the ESG value information are not located in the target file and / or are not located in the same statement, the number of extraction times of the ESG information is determined, and a method for processing the ESG information is determined based on the number of extraction times of the ESG information.
6. The method according to claim 5, characterized in that The method of determining a processing method for the ESG information based on the number of extraction times of the ESG information includes: If the number of extractions of the ESG information is greater than a preset number, storing the ESG information in a second data table; or If the number of times the ESG information is extracted is less than or equal to a preset number, the ESG information is extracted again.
7. The method according to any one of claims 4 to 6, characterized in that If the ESG description information and the ESG value information are not located in the target file and / or are not located in the same statement, the method further includes: Determine ESG description information or ESG value information that is not in the same statement; The ESG description information or ESG value information that is not located in the target file, and / or the ESG description information or ESG value information that is not located in the same statement, is deleted.
8. A data extraction device, characterized in that: include: An acquisition module, used for acquiring a target file, wherein the target file includes ESG information; An extraction module, used to extract ESG description information and / or ESG value information included in the ESG information in the target file; A conversion module, used to convert different description information of the same ESG information into standard description information, and convert different numerical units of the same ESG information into standard units; A checking module is used to check whether the ESG description information and / or ESG data information extracted from each ESG information is correct based on a regular mapping relationship and the target file. The regular mapping relationship includes a regular expression between different description information of the same ESG information and the standard description information, and a conversion ratio between different data units of the same ESG information and the standard unit.
9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the data extraction method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the data extraction method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Data processing method and device and electronic equipment
CN112380214A
Data processing method and device, computer equipment and storage medium
CN115098642A
Data format verification method and device, equipment and storage medium
CN116644121A
Information display method and device, electronic equipment and storage medium
CN117591583A
System and method for verifying a regex group
US20210350000A1