A securities supervision and reporting data verification method, device, system and storage medium
By performing formal and cross-validation checks on the data submitted by the China Securities Regulatory Commission (CSRC), the problem of complex file formats and data cross-validation relationships in the CSRC's data submission process was solved, achieving automated verification and rapid error location, thus ensuring the accuracy and timeliness of the submission.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-26
- Publication Date
- 2026-04-17
AI Technical Summary
The existing data submission process of the China Securities Regulatory Commission (CSRC) has several problems, including: repeated repairs after document submission failures consume manpower; complex data consistency relationships are time-consuming and labor-intensive; individual data exceeding the scope can lead to complete failure; and the inability to obtain new data can cause submission failures.
A method for verifying data submitted by the China Securities Regulatory Commission (CSRC) is provided, including formal verification and cross-validation. By acquiring the data submitted by the CSRC, file format and field format verification are performed, and a trained field recognition model is used to perform cross-validation between the internal and external parts of the file, thereby generating a submission file that meets the requirements of the CSRC.
It has achieved automated data verification, which has improved verification accuracy, quickly located and repaired errors, ensured the timeliness and accuracy of reporting, and reduced manual intervention and repetitive work.
Smart Images

Figure CN115577703B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data verification technology for data submitted by the China Securities Regulatory Commission (CSRC), and more specifically, to a method, apparatus, system, and storage medium for verifying data submitted by the CSRC. Background Technology
[0002] The China Securities Regulatory Commission (CSRC) requires all custodian institutions and fund companies to submit documents on time in accordance with the prescribed documents.
[0003] The documents submitted to the China Securities Regulatory Commission (CSRC) must be generated in strict accordance with the regulations. This includes not only correct data content, strictly regulated data types, data ranges, data character sets (including delimiters, line breaks, etc.), the character set of the submitted documents, data dates, file dates, and serial numbers, but also, crucially, the implicit cross-referencing relationships between 37 submitted documents. Any deviation from these regulations or any submitted document will result in the failure of all submissions for that period. After a submission failure, the erroneous documents must be processed promptly, and the documents for the current period must be resubmitted. If the resubmission exceeds the current submission period, a resubmission application must be submitted. The CSRC will issue a notice to any institution or company that fails to submit on time. If submission is still not completed by the deadline, on-site inspections will be conducted, and legal action will be taken. Therefore, it is essential to verify data according to the CSRC's submission regulations beforehand to promptly identify problems and avoid resubmissions.
[0004] In summary, the existing reporting process has the following defects and shortcomings:
[0005] 1. When submitting documents fails, correcting the errors and resubmitting sometimes results in further failures. Repeatedly fixing and resubmitting is very manpower-intensive.
[0006] 2. The data relationships between the submitted documents are complex, and manual verification after errors occur is time-consuming and labor-intensive, and repairing and resubmitting may miss the submission window.
[0007] 3. Submissions often fail because individual data points exceed the acceptable range, and these individual data points need to be verified by each department before they can be confirmed, thus delaying the submission process.
[0008] 4. Sometimes, due to the inability to retrieve certain fields of new data (such as newly added products), the submission may fail. Summary of the Invention
[0009] In view of the above-mentioned technical problems, this invention provides a method for verifying data submitted to the China Securities Regulatory Commission (CSRC) that can be used in financial technology or other related fields, comprising:
[0010] Obtain data submitted by the China Securities Regulatory Commission (CSRC);
[0011] The data submitted by the China Securities Regulatory Commission (CSRC) is subject to formal verification.
[0012] If the data submitted by the China Securities Regulatory Commission (CSRC) passes the verification in the above manner, then the data submitted by the CSRC will be subject to cross-checking.
[0013] If the data submitted by the China Securities Regulatory Commission (CSRC) passes the cross-check, a submission file corresponding to the CSRC is generated based on the data submitted by the CSRC, and the submission file is input into the CSRC submission interface so as to submit the submission file to the CSRC.
[0014] Preferably, the formal verification includes file format verification and field format verification;
[0015] The formal verification of the data submitted by the China Securities Regulatory Commission includes:
[0016] The file format of the data submitted by the China Securities Regulatory Commission (CSRC) is validated.
[0017] If the file format verification passes, then the field format verification is performed on the data submitted by the China Securities Regulatory Commission.
[0018] If the file format verification fails, an error message corresponding to the file format verification is generated, the error message is pushed to the client of the party submitting the data to the China Securities Regulatory Commission (CSRC), and the process of obtaining the data submitted by the CSRC is returned. The error message includes the file format field that failed the file format verification in the data submitted by the CSRC, the area corresponding to the file format field, and the file name.
[0019] Preferably, the step of performing file format verification on the data submitted by the China Securities Regulatory Commission includes:
[0020] Obtain the format information of the data submitted by the China Securities Regulatory Commission (CSRC); wherein, the format information includes the file name, file character set, space character, newline character, non-standard file type, and non-standard file character set of the data submitted by the CSRC.
[0021] The format information of the data submitted by the China Securities Regulatory Commission is compared with the preset standard format information;
[0022] If the data submitted by the China Securities Regulatory Commission (CSRC) simultaneously meets all the preset standard format information, then the data submitted by the CSRC is determined to have passed the file format verification.
[0023] If the data submitted by the China Securities Regulatory Commission (CSRC) does not meet the preset standard format information, then the data submitted by the CSRC is determined to have failed the file format verification.
[0024] Preferably, the step of performing field format validation on the data submitted by the China Securities Regulatory Commission includes:
[0025] Obtain the field length value, market value range value, and field content code value of the data submitted by the China Securities Regulatory Commission;
[0026] The field length value is compared with a preset length value range; the market value range is compared with a preset market value range; and the field content code value is compared with the specification appendix code value range.
[0027] If the field length value conforms to the preset length value range, the market value range conforms to the preset market value range, and the field content conforms to the specification appendix code value range, then the data submitted by the China Securities Regulatory Commission is determined to have passed the field format verification.
[0028] If the field length value does not conform to the preset length value range and / or the market value range does not conform to the preset market value range and / or the field content code value does not conform to the specification appendix code value range, then the data submitted by the China Securities Regulatory Commission (CSRC) is determined to have failed the field format verification.
[0029] Preferably, the verification of the data submitted by the China Securities Regulatory Commission includes:
[0030] The data submitted by the China Securities Regulatory Commission (CSRC) is subjected to internal verification within the file.
[0031] If the data submitted by the China Securities Regulatory Commission (CSRC) passes the intra-file cross-check, then the inter-file cross-check will be performed on the data submitted by the CSRC.
[0032] Preferably, the document internal verification includes:
[0033] The data submitted by the China Securities Regulatory Commission (CSRC) is converted into a binary information document in binary format;
[0034] The trained field recognition model is used to identify the binary information document and split the binary information document into multiple ordered field sequences.
[0035] Based on the predefined field specifications, extract the associated subject field, subject modifier field, object field, object predicate field, and independent predicate field from the ordered field sequence, and construct a split field table;
[0036] Based on the split field table, determine the associated data region corresponding to the ordered field sequence; and determine the associated value in the associated data region corresponding to the ordered field sequence.
[0037] Determine whether the field results obtained from each group of associated subject field, subject modifier field, object field, object predicate field and independent predicate field in the split field table are consistent with the associated values;
[0038] If so, then the associated subject field, subject modifier field, object field, object predicate field, and independent predicate field corresponding to the ordered field sequence in the split field table are determined to pass the file internal verification.
[0039] If all fields corresponding to the ordered field sequence in the split field table pass the file internal verification, then the data submitted by the China Securities Regulatory Commission is determined to have passed the file internal verification.
[0040] Preferably, the step of performing inter-document cross-checking on the data submitted by the China Securities Regulatory Commission includes:
[0041] The data submitted by the China Securities Regulatory Commission (CSRC) is converted into a binary information document in binary format;
[0042] The trained field recognition model is used to identify the binary information document and extract the associated file string groups from the binary information document.
[0043] Based on the associated file string group, the feature association information is determined, and a simulated file containing the feature association information is generated;
[0044] The associated file string group is used to determine the CSRC-submitted data in the same batch corresponding to the associated file string group, which is then used as a comparison document.
[0045] Compare the simulated file with the comparison document to determine whether the feature association information in the simulated file matches and / or is consistent with the comparison document;
[0046] If so, then the associated file string group is determined to have passed the inter-file cross-verification.
[0047] If all the associated file string groups in the data submitted by the CSRC pass the inter-file cross-verification check, then the submitted data is determined to have passed the inter-file cross-verification check.
[0048] In addition, to solve the above problems, the present invention also provides a data verification device for securities regulatory reporting, comprising:
[0049] The acquisition module is used to acquire data submitted by the China Securities Regulatory Commission (CSRC).
[0050] The formal verification module is used to perform formal verification on the data submitted by the China Securities Regulatory Commission.
[0051] The cross-validation module is used to perform cross-validation on the data submitted by the China Securities Regulatory Commission (CSRC) if the data passes the form verification.
[0052] The reporting module is used to generate a reporting file corresponding to the China Securities Regulatory Commission (CSRC) when the data reported by the CSRC passes the cross-checking, and to input the reporting file into the CSRC reporting interface so as to submit the reporting file to the CSRC.
[0053] In addition, to solve the above problems, the present invention also provides a CSRC data verification system, including a memory and a processor. The memory stores a CSRC data verification program, and the processor runs the CSRC data verification program to enable the CSRC data verification system to perform the CSRC data verification method as described above.
[0054] In addition, to solve the above problems, the present invention also provides a computer-readable storage medium storing a verification program for data submitted by the China Securities Regulatory Commission (CSRC), which, when executed by a processor, implements the verification method for data submitted by the CSRC as described above.
[0055] This invention provides a method, apparatus, system, and storage medium for verifying data submitted by the China Securities Regulatory Commission (CSRC), wherein the method includes:
[0056] Obtain data submitted by the China Securities Regulatory Commission (CSRC);
[0057] The data submitted by the China Securities Regulatory Commission (CSRC) is subject to formal verification.
[0058] If the data submitted by the China Securities Regulatory Commission (CSRC) passes the verification in the above manner, then the data submitted by the CSRC will be subject to cross-checking.
[0059] If the data submitted by the China Securities Regulatory Commission (CSRC) passes the cross-check, a submission file corresponding to the CSRC is generated based on the data submitted by the CSRC, and the submission file is input into the CSRC submission interface so as to submit the submission file to the CSRC.
[0060] This invention acquires the CSRC (China Securities Regulatory Commission) data submitted by the reporting end, and sequentially performs formal verification and cross-validation on the submitted data. After the cross-validation is completed, it generates a reporting document corresponding to the CSRC, thereby facilitating the submission of the reporting document to the CSRC's reporting interface. This invention enables automatic checking of CSRC-submitted data. The two-step verification improves the accuracy of the verification. Formal verification identifies formatting issues in the CSRC-submitted data, while cross-validation determines the cross-validation relationships within or between files in the CSRC-submitted data, identifying cross-validation problems. This allows for intuitive viewing of error information during autonomous verification of erroneous data, enabling rapid location and reprocessing, ensuring the timeliness and accuracy of reporting, and facilitating the verification of reporting documents. Attached Figure Description
[0061] Figure 1 This is a schematic diagram of the hardware operating environment involved in an embodiment of the data verification method submitted to the China Securities Regulatory Commission (CSRC) of the present invention.
[0062] Figure 2 This is a flowchart illustrating the first embodiment of the data verification method submitted to the China Securities Regulatory Commission (CSRC) according to the present invention.
[0063] Figure 3 This is a detailed flowchart of step S200 in the second embodiment of the data verification method submitted by the China Securities Regulatory Commission (CSRC) of the present invention.
[0064] Figure 4 This is a detailed flowchart of step S300 in the third embodiment of the data verification method submitted by the China Securities Regulatory Commission (CSRC) of the present invention.
[0065] Figure 5 This is a schematic diagram of the module connections of the data verification device for CSRC reporting of the present invention;
[0066] Figure 6 This is a schematic diagram of the overall workflow of the data verification method submitted by the China Securities Regulatory Commission (CSRC) according to the present invention.
[0067] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0068] The embodiments of the present invention are described in detail below, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout.
[0069] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.
[0070] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.
[0071] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
[0072] like Figure 1 The diagram shown is a structural schematic of the hardware operating environment of the terminal involved in an embodiment of the present invention.
[0073] The securities regulatory data verification system of this invention can be a PC, or a mobile terminal device such as a smartphone, tablet, or laptop. This system may include: a processor 1001 (e.g., a CPU), a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to establish communication between these components. The user interface 1003 may include a display screen, an input unit such as a keyboard, or a remote control; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM or a stable memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the processor 1001. Optionally, the securities regulatory data verification system may also include RF (Radio Frequency) circuitry, audio circuitry, a Wi-Fi module, etc. In addition, the data verification system submitted by the China Securities Regulatory Commission can also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, which will not be elaborated here.
[0074] Those skilled in the art will understand that Figure 1 The data verification system shown in the diagram does not constitute a limitation on it and may include more or fewer components than illustrated, or combine certain components, or have different component arrangements. Figure 1 As shown, the memory 1005, which is a computer-readable storage medium, may include an operating system, a data interface control program, a network connection program, and a data verification program for reporting to the China Securities Regulatory Commission.
[0075] In summary, this invention provides a method, apparatus, system, and storage medium for verifying data submitted by the China Securities Regulatory Commission (CSRC). The method enables automatic checking of CSRC-submitted data, improves verification accuracy through a two-step verification process, identifies format issues in the submitted data through formal verification, and determines the internal or inter-file consistency relationships and consistency problems through cross-checking. This allows for intuitive viewing of error information during autonomous verification of erroneous data, enabling rapid location and reprocessing, ensuring the timeliness and accuracy of submissions, and facilitating the verification of submitted documents.
[0076] Example 1:
[0077] Reference Figure 2 The first embodiment of the present invention provides a method for verifying data submitted by the China Securities Regulatory Commission (CSRC), comprising:
[0078] Step S100: Obtain data submitted by the China Securities Regulatory Commission (CSRC);
[0079] The aforementioned data submitted by the China Securities Regulatory Commission (CSRC) refers to the documents that the submitting personnel are required to submit. The data submitted by the CSRC may be a single document, or the documents to be submitted may include multiple independent data submitted by the CSRC.
[0080] It should be noted that the China Securities Regulatory Commission (CSRC) requires all custodian institutions and fund companies to standardize their documentation and submit documents on time.
[0081] Furthermore, the documents submitted by the China Securities Regulatory Commission (CSRC) must be generated in strict accordance with the specifications. These specifications include not only correct data content, strictly regulated data types, data ranges, data character sets (including delimiters, line breaks, etc.), character sets of the submitted documents, data dates, file dates, and serial numbers, but also, crucially, the implicit interrelationships between the 37 submitted documents. If any specification or submitted document is not in compliance, all submitted documents for that period will fail to be submitted.
[0082] It should be noted that if a submission fails, the erroneous document must be processed promptly and the document for the current period must be resubmitted. If the resubmission exceeds the current submission period, a resubmission application form must be submitted. The China Securities Regulatory Commission (CSRC) will issue a notice to any institution or company that fails to submit on time. If the submission is still not completed by the deadline, on-site inspections will be conducted and the matter will be handled according to law. Therefore, it is essential to verify the data in accordance with the CSRC's submission guidelines beforehand and to promptly identify problems to avoid resubmission.
[0083] This embodiment provides a verification platform based on a data verification method for reporting. Through this verification platform, reporting personnel submit documents to the China Securities Regulatory Commission (CSRC). The platform verifies the documents to ensure that they meet the CSRC's reporting requirements in terms of format and consistency, thereby improving verification efficiency.
[0084] Step S200: Perform a formal verification on the data submitted by the China Securities Regulatory Commission (CSRC).
[0085] The above-mentioned formal verification refers to the verification of format and specifications, which may include, but is not limited to, verification categories formulated according to the reporting requirements of the China Securities Regulatory Commission, such as requirements for file name naming, paragraph requirements, font requirements, character requirements, word count requirements, etc.
[0086] First, we perform a formal verification of the data submitted by the China Securities Regulatory Commission (CSRC), and then conduct further verification. This allows us to identify format and formal issues, thereby filtering out problems and finding erroneous areas.
[0087] As mentioned above, only if the formal verification passes can the next step of verification be carried out.
[0088] If the formal verification fails, the problematic area can be identified, the reason for the failure can be determined, and the document can be returned until the submitter corrects the criminal issues and resubmits it on the verification platform.
[0089] Step S300: If the data submitted by the China Securities Regulatory Commission (CSRC) passes the formal verification, then the data submitted by the CSRC is subjected to cross-verification.
[0090] As mentioned above, there may be certain correlations between different fields in each submitted file. For example, if a field is "the total market value in year A is B", then all the original data used to calculate the market value in year A (which points to B), and the value B derived from the original data, are in a correlation relationship with this field. All three should be completely identical, or the conclusions drawn should be the same. If one set of fields is different, it is determined that there is a problem with the correlation relationship, that there is a calculation error or mistake, and that the correlation verification cannot be passed.
[0091] Step S400: If the data submitted by the China Securities Regulatory Commission (CSRC) passes the cross-check, a submission file corresponding to the CSRC is generated based on the data submitted by the CSRC, and the submission file is input into the CSRC submission interface so as to submit the submission file to the CSRC.
[0092] Once the cross-checking is passed and it is confirmed that there are no errors in the cross-checking relationships, the application process can proceed.
[0093] The data submitted by the China Securities Regulatory Commission (CSRC) is used to generate the corresponding submission documents for the CSRC. If the submission documents are complete, they are entered into the CSRC's submission interface. Alternatively, a buffer can be set up at the CSRC's submission interface to store the CSRC's submitted data that has passed the verification. If all documents meet the submission requirements, they are combined into a single submission package and submitted to the CSRC.
[0094] In summary, this embodiment provides a method, apparatus, system, and storage medium for verifying data submitted by the China Securities Regulatory Commission (CSRC). The method enables automatic checking of CSRC-submitted data, improves verification accuracy through a two-step verification process, identifies format issues in the submitted data through formal verification, and determines the internal or inter-file consistency relationships and consistency problems through cross-referencing verification. This allows for intuitive viewing of error information, rapid location and reprocessing of errors, and ensures the timeliness and accuracy of submissions, facilitating the verification of submitted documents.
[0095] Example 2:
[0096] Reference Figure 3 The second embodiment of the present invention provides a method for verifying data submitted by the China Securities Regulatory Commission (CSRC), based on the above embodiment 1. The formal verification includes file format verification and field format verification;
[0097] Step S200 involves performing a formal verification on the data submitted by the China Securities Regulatory Commission (CSRC), including:
[0098] Step S210: Perform file format verification on the data submitted by the China Securities Regulatory Commission (CSRC).
[0099] Step S220: If the file format verification passes, then the field format verification is performed on the data submitted by the China Securities Regulatory Commission.
[0100] Step S230: If the file format verification fails, generate error information corresponding to the file format verification, push the error information to the client of the CSRC data submitter, and return to the step of obtaining CSRC data; wherein, the error information includes the file format field that failed the file format verification in the CSRC data, the area and file name corresponding to the file format field.
[0101] The above first involves file format verification. File format refers to the verification of the format of the submitted file. In the process, the file format is verified. If it passes, the next step, field format verification, is performed. If it fails, an error message is generated and pushed to the submitter's client, indicating the region, location, and specific file involved in the error.
[0102] The error message mentioned above may include the failed file format field, the area corresponding to the field, and the file name, etc.
[0103] Step S210, which verifies the file format of the data submitted by the China Securities Regulatory Commission, includes:
[0104] Step S211: Obtain the format information of the data submitted by the China Securities Regulatory Commission (CSRC); wherein, the format information includes the file name, file character set, space character, newline character, non-standard file type, and non-standard file character set of the data submitted by the CSRC.
[0105] Step S212: Compare the format information of the data submitted by the China Securities Regulatory Commission with the preset standard format information;
[0106] The aforementioned preset standard format information refers to the format rules set in advance according to the requirements of the China Securities Regulatory Commission (CSRC), which may include field length, range, content code value, etc.
[0107] Step S213: If the data submitted by the China Securities Regulatory Commission (CSRC) simultaneously meets all the preset standard format information, then it is determined that the data submitted by the CSRC has passed the file format verification.
[0108] Step S214: If the data submitted by the China Securities Regulatory Commission (CSRC) does not meet the preset standard format information, then the data submitted by the CSRC is determined to have failed the file format verification.
[0109] In this embodiment, the platform compares the data submitted by the China Securities Regulatory Commission (CSRC) according to a pre-set standard format, and the comparison results are as follows:
[0110] 1. Simultaneously satisfy all preset standard format information;
[0111] 2. There are data or fields that do not meet all the preset standard format information;
[0112] If both conditions are met, the file format verification is considered successful.
[0113] If any conditions or data do not meet the requirements, it indicates a formatting issue in the file, and the file format verification fails.
[0114] The above-mentioned field format validation may include, but is not limited to: the system will check whether the submitted file name is correct, whether the file character set is correct, whether spaces, newlines, etc. are correct, and whether the non-standard file (such as compressed file) type and character set are correct, etc. If they do not meet the requirements, they must be regenerated.
[0115] Furthermore, for those that do not meet the criteria, error messages can be generated and notified to the reporting client via email. This allows the reporting client to promptly know the location of the error, which file the problem occurred in, and the specific circumstances.
[0116] Step S220 involves validating the field format of the data submitted by the China Securities Regulatory Commission (CSRC), including:
[0117] Step S221: Obtain the field length value, market value range value, and field content code value of the data submitted by the China Securities Regulatory Commission (CSRC). In the field format verification process, the platform system will check the field format of the data submitted by the CSRC, including but not limited to: the system will check whether the field length exceeds the limit, whether the market value range exceeds the limit, and whether the field content is within the code value range of the appendix of the specification.
[0118] Step S222: Compare the field length value with a preset length value range; compare the market value range with a preset market value range; and compare the field content code value with the specification appendix code value range.
[0119] The field length values, market capitalization range values, and field content code values mentioned above are compared with the corresponding standard values. Specifically, the field length value is compared with the preset length range, the market capitalization range value is compared with the preset market capitalization range, and the field content code value is compared with the range of code values in the standard appendix.
[0120] Step S223: If the field length value conforms to the preset length value range, the market value range conforms to the preset market value range, and the field content conforms to the specification appendix code value range, then the data submitted by the China Securities Regulatory Commission is determined to have passed the field format verification.
[0121] Step S224: If the field length value does not conform to the preset length value range and / or the market value range does not conform to the preset market value range and / or the field content code value does not conform to the specification appendix code value range, then it is determined that the data submitted by the China Securities Regulatory Commission has failed the field format verification.
[0122] In this embodiment, the field length value, market capitalization range value, and field content code value are compared with the corresponding standard values. Specifically, the field length value is compared with a preset length range, the market capitalization range value is compared with a preset market capitalization range, and the field content code value is compared with the standard appendix code value range. The comparison results are then obtained. If all three conditions are met simultaneously, the field format validation is deemed successful. If one or more conditions are not met, the field format validation is deemed unsuccessful.
[0123] Example 3:
[0124] Reference Figure 4 The third embodiment of the present invention provides a method for verifying data submitted by the China Securities Regulatory Commission (CSRC). Based on the above embodiment 1, step S300, which involves verifying the data submitted by the CSRC, includes:
[0125] Step S310: Perform internal verification of the data submitted by the China Securities Regulatory Commission (CSRC).
[0126] The documents submitted by the China Securities Regulatory Commission (CSRC) contain some inconsistencies in data and text content. To ensure that these inconsistencies, after undergoing formal verification, can mitigate the risk of non-compliance in terms of content, this embodiment performs further in-document inconsistency verification on the data submitted by the CSRC.
[0127] Step S320: If the data submitted by the China Securities Regulatory Commission (CSRC) passes the intra-document cross-check, then the inter-document cross-check is performed on the data submitted by the CSRC.
[0128] As described above, after performing intra-file cross-checking, if the intra-file cross-checking passes, further inter-file cross-checking can be performed. If the intra-file cross-checking fails, corresponding error messages are generated and sent back to the reporting platform, including the areas of failed fields and a prompt message.
[0129] Different data submitted by the China Securities Regulatory Commission (CSRC) correspond to different CSRC-submitted documents. If the documents are from the same batch of documents, there may be interrelationships between them, such as referencing data, content, or information from other documents. Therefore, after passing the intra-document interrelation verification, the inter-document interrelation verification is used to check the interrelationships between documents in order to find out the problem.
[0130] Step S310, the internal document verification includes:
[0131] Step S311: Convert the data submitted by the China Securities Regulatory Commission into a binary information document in binary format;
[0132] Step S312: Use the trained field recognition model to recognize the binary information document and split the binary information document into multiple ordered field sequences;
[0133] The above first describes how the data submitted by the China Securities Regulatory Commission (CSRC) is converted into binary information documents, which allows the field recognition model to directly obtain the data.
[0134] The field recognition model is trained using field recognition methods to capture relevant paragraph data, thereby splitting the overall file fields into multiple ordered field sequences arranged in sequence.
[0135] An ordered sequence of fields refers to the field statements that appear sequentially in a document. The field statements in a document are broken down into independent ordered sequences for individual identification.
[0136] The above-mentioned splitting method can be to identify paragraphs according to character rules, firstly by identifying statement fields based on periods, and secondly by identifying semicolons.
[0137] Furthermore, during the recognition process, the content in the document is first identified as images, tables, and text paragraphs, and then the text paragraphs are further broken down into independent ordered field sequences.
[0138] When recognizing paragraphs, each line is marked according to the arrangement of Chinese characters within the document. If the line begins with two spaces, it is marked as "S"; the entire following line is part of the paragraph's content, and is marked as "L". When recognizing the end of a paragraph, if the most recent line is marked with two spaces at the beginning, the line above it is marked as "E", indicating the end of the paragraph. Therefore, the following is determined:
[0139] 1×S+n×L+1×E represents the content of a natural paragraph. A paragraph tag D1 is assigned to this natural paragraph content, and further, based on the natural paragraph content, it is identified and split into an ordered sequence of fields within that natural paragraph.
[0140] For example, in the current page, there are natural paragraphs D1, D2, D3, and D4; where D1 is determined by 1×S+n×L+1×E. D1 is further divided into ordered field sequences Q1, Q2, Q3, Q4, and Q5, which are five ordered field sequences.
[0141] Step S313: According to the pre-defined field specifications, extract the associated subject field, subject modifier field, object field, object predicate field, and independent predicate field from the ordered field sequence, and construct a split field table;
[0142] Based on predefined field rules that conform to grammatical rules, extract the subject field, the subject's modifier field, the object field, the object's predicate field, and the independent predicate field that conform to Chinese grammar, and construct a split field table.
[0143] Pre-defined field rules, regardless of their quantity, should ensure that, as a group of things, they share certain commonalities—that is, rules of rules. Only rule-based things can achieve significant compression and repeatability. Syntactically, validation rules are mostly simple "predicate + subject + verb + predicate + object" structures. For example, in the rule: "The total transaction value of the A1 market capitalization calculation table equals the total transaction value of the A2 company asset status table equals (error 0.1)," the subject is "the total transaction value of the A1 market capitalization calculation table," the object is "the total transaction value of the A2 company asset status table," and the verb is "equals (error 0.1)." Thus, this validation rule is broken down into the following rule table.
[0144]
[0145] Replace "predicate" with "verification relationship" and "error", replace "subject modifier" and "object modifier" with "upper verification table" and "lower verification table" respectively, and replace "subject" and "object" with "upper verification table field" and "lower verification table field" respectively. This will give you the following validation rule configuration table.
[0146]
[0147] The next step is to write a program that reads the verification rule configuration table in a loop, constructs the verification rules into executable verification statements, executes them one by one, and outputs the verification results to the user.
[0148] Step S314: Based on the split field table, determine the associated data region corresponding to the ordered field sequence; and determine the associated value in the associated data region corresponding to the ordered field sequence.
[0149] The above process identifies the associated data regions and their associated values by analyzing the subject field, subject modifier field, object field, object predicate field, and independent predicate field of each group in the split field table. For example, by identifying "The total transaction value in the A1 Market Value Calculation Table equals the total transaction value in the A2 Company Asset Status Table equals (error 0.1)," the system locates the Company Asset Status Table and the Market Value Calculation Table in the data submitted by the China Securities Regulatory Commission (CSRC). The system then identifies the correspondence between the data in the two tables, determining the associated data, i.e., the associated values. For example, the sales revenue in month B of year A in the "Company Asset Status Table" and the sales revenue in month B of year A in the "Market Value Calculation Table" are both associated values.
[0150] Step S315: Determine whether the field results obtained from each group of associated subject field, subject modifier field, object field, object predicate field and independent predicate field in the split field table are consistent with the associated values.
[0151] Step S316: If yes, then determine that the associated subject field, subject modifier field, object field, object predicate field and independent predicate field corresponding to the ordered field sequence in the split field table pass the file internal verification.
[0152] Step S317: If all fields corresponding to the ordered field sequence in the split field table pass the file internal verification, then the data submitted by the China Securities Regulatory Commission is determined to have passed the file internal verification.
[0153] In this embodiment, the data submitted by the China Securities Regulatory Commission (CSRC) is tested through intra-document verification. Using a trained recognition model, the text content is first split into paragraphs, then each paragraph is further split into independent ordered field sequences. These ordered field sequences are then identified to determine the associated subject, subject modifier, object, object predicate, and independent predicate fields, constructing a split field table. Next, the associated data regions corresponding to the ordered field sequences are determined, along with the associated values within these regions. If the associated values are consistent, the field passes the intra-document verification; otherwise, it fails. If all fields in the table pass the intra-document verification, the submitted data by the CSRC is deemed to have passed the verification.
[0154] Step S320, which involves performing inter-document verification on the data submitted by the China Securities Regulatory Commission, includes:
[0155] Step S321: Convert the data submitted by the China Securities Regulatory Commission into a binary information document in binary format;
[0156] Step S322: Use the trained field recognition model to recognize the binary information document and extract the associated file string group from the binary information document;
[0157] The above process involves converting the data submitted by the China Securities Regulatory Commission (CSRC) into binary information documents, and then using a recognition model to identify Dangdang, thereby extracting the associated file string groups.
[0158] Step S323: Determine feature association information based on the associated file string group, and generate a simulated file containing the feature association information;
[0159] The above describes the process of generating a simulated file containing the associated information for each group of related file strings through the system platform. This generates multiple simulated file files corresponding to each group of related file strings in the data document submitted by the China Securities Regulatory Commission (CSRC).
[0160] For example, through model recognition, it was determined that the binary information document contained a group of associated file strings as follows:
[0161] 1. The data to be submitted is 122.3. Please refer to the information table in "Application Document 2";
[0162] 2. The total sum of the comprehensive declarations is the sum of the total SUM1 value in Transaction Table 1 of "Declaration Document 3" and the total SUM2 value in Transaction Table 3 of "Declaration Document 4", which is 9903.
[0163] Based on the above-mentioned associated file string groups, the following simulated file files are generated respectively:
[0164] 1. Simulated file 1 - Application file 2, which contains an information table with the value 122.3 in the information table;
[0165] 2. Simulation file 2 - declaration file 3, which contains transaction table 1, and transaction table 1 contains the total SUM1 value;
[0166] 3. Simulation file 3 - declaration file 4, which contains transaction table 3, and transaction table 3 contains the total SUM2 value;
[0167] 4. Furthermore, the total SUM1 value + the total SUM2 value = 9903.
[0168] Step S324: Determine the CSRC-submitted data in the same batch corresponding to the associated file string group through the associated file string group, and use it as a comparison document;
[0169] The data submitted by the China Securities Regulatory Commission in the same batch mentioned above are documents that are different from those currently being verified.
[0170] By searching, one can find the data submitted by the China Securities Regulatory Commission (CSRC) in the same batch. This data contains strings that correspond to the string groups in the associated files.
[0171] Step S325: Compare the simulated file with the comparison document to determine whether the feature association information in the simulated file matches and / or is consistent with the comparison document;
[0172] The above process involves comparing the feature association information in the simulated file with the comparison document to determine whether the two are consistent.
[0173] For example, the comparison is as follows:
[0174]
[0175] Step S326: If yes, then determine that the associated file string group passes the inter-file cross-verification.
[0176] Step S327: If all the associated file string groups in the data submitted by the China Securities Regulatory Commission (CSRC) pass the inter-file cross-verification, then it is determined that the submitted data has passed the inter-file cross-verification.
[0177] By comparison, if the feature association information in the simulated file is consistent with that in the comparison document, it can be determined that the associated string group can pass the inter-file verification. If all associated file string groups in the data submitted by the China Securities Regulatory Commission (CSRC) pass the inter-file verification, it can be determined that the data submitted by the CSRC has passed the inter-file verification.
[0178] In addition, refer to Figure 5 This embodiment also provides a data verification device for data submitted by the China Securities Regulatory Commission (CSRC), comprising:
[0179] Module 10 is used to acquire data submitted by the China Securities Regulatory Commission (CSRC).
[0180] Formal verification module 20 is used to perform formal verification on the data submitted by the China Securities Regulatory Commission.
[0181] The cross-validation module 30 is used to perform cross-validation on the data submitted by the China Securities Regulatory Commission (CSRC) if the data submitted by the CSRC passes the form verification.
[0182] The reporting module 40 is used to generate a reporting file corresponding to the China Securities Regulatory Commission (CSRC) when the CSRC-reported data passes the cross-check, and input the reporting file into the CSRC reporting interface so as to submit the reporting file to the CSRC.
[0183] In addition, this embodiment also provides a CSRC data verification system, including a memory and a processor. The memory stores a CSRC data verification program, and the processor runs the CSRC data verification program to enable the CSRC data verification system to perform the CSRC data verification method as described above.
[0184] In addition, this embodiment also provides a computer-readable storage medium storing a data verification program for securities regulatory submissions. When the data verification program for securities regulatory submissions is executed by a processor, it implements the data verification method for securities regulatory submissions as described above.
[0185] In summary, for reference Figure 6 This embodiment acquires the CSRC-submitted data from the reporting end and performs formal verification and cross-validation on the submitted data sequentially. After the cross-validation is completed, a corresponding reporting document for the CSRC is generated, which is then submitted to the CSRC's reporting interface. This embodiment enables automatic checking of CSRC-submitted data. The two-step verification improves the accuracy of the verification. Formal verification identifies format problems in the CSRC-submitted data, while cross-validation determines the cross-validation relationships within or between files in the CSRC-submitted data, identifying cross-validation issues. This allows for intuitive viewing of error information during self-verification of erroneous data, enabling quick location and reprocessing, ensuring the timeliness and accuracy of reporting, and facilitating the verification of reporting documents.
[0186] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0187] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention. The above are only preferred embodiments of the present invention and do not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.
Claims
1. A method for verifying data submitted by the China Securities Regulatory Commission (CSRC), characterized in that, include: Obtain data submitted by the China Securities Regulatory Commission (CSRC); The data submitted by the China Securities Regulatory Commission (CSRC) is subject to formal verification. If the data submitted by the China Securities Regulatory Commission (CSRC) passes the formal verification, then the data undergoes cross-referencing verification. This cross-referencing verification includes: performing intra-file cross-referencing verification on the submitted data; if the data passes the intra-file cross-referencing verification, then performing inter-file cross-referencing verification on the submitted data. The intra-file cross-referencing verification includes: converting the submitted data into a binary information document in binary format; using a trained field recognition model to identify the binary information document and splitting it into multiple ordered field sequences; extracting the associated subject field, the subject's modifier field, the object field, the object's predicate field, and the independent predicate field from the ordered field sequences according to predefined field specifications, and constructing a split field table; based on... The split field table determines the associated data region corresponding to the ordered field sequence; and determines the associated value in the associated data region corresponding to the ordered field sequence; it judges whether the field results obtained by each group of associated subject field, subject modifier field, object field, object predicate field and independent predicate field in the split field table are consistent with the associated value; if so, it is determined that the associated subject field, subject modifier field, object field, object predicate field and independent predicate field corresponding to the ordered field sequence in the split field table pass the file internal verification; if all fields corresponding to the ordered field sequence in the split field table pass the file internal verification, it is determined that the data submitted by the CSRC passes the file internal verification. If the data submitted by the China Securities Regulatory Commission (CSRC) passes the cross-check, a submission file corresponding to the CSRC is generated based on the data submitted by the CSRC, and the submission file is input into the CSRC submission interface so as to submit the submission file to the CSRC.
2. The data verification method submitted by the China Securities Regulatory Commission as described in claim 1, characterized in that, The formal verification includes file format verification and field format verification; The formal verification of the data submitted by the China Securities Regulatory Commission includes: The file format of the data submitted by the China Securities Regulatory Commission (CSRC) is validated. If the file format verification passes, then the field format verification is performed on the data submitted by the China Securities Regulatory Commission. If the file format verification fails, an error message corresponding to the file format verification is generated, the error message is pushed to the client of the party submitting the data to the China Securities Regulatory Commission (CSRC), and the process of obtaining the data submitted by the CSRC is returned. The error message includes the file format field that failed the file format verification in the data submitted by the CSRC, the area corresponding to the file format field, and the file name.
3. The data verification method submitted by the China Securities Regulatory Commission as described in claim 2, characterized in that, The file format verification of the data submitted by the China Securities Regulatory Commission includes: Obtain the format information of the data submitted by the China Securities Regulatory Commission; The format information of the data submitted by the China Securities Regulatory Commission is compared with the preset standard format information; If the data submitted by the China Securities Regulatory Commission (CSRC) simultaneously meets all the preset standard format information, then the data submitted by the CSRC is determined to have passed the file format verification. If the data submitted by the China Securities Regulatory Commission (CSRC) does not meet the preset standard format information, then the data submitted by the CSRC is determined to have failed the file format verification.
4. The data verification method submitted by the China Securities Regulatory Commission as described in claim 2, characterized in that, The field format validation of the data submitted by the China Securities Regulatory Commission includes: Obtain the field length value, market value range value, and field content code value of the data submitted by the China Securities Regulatory Commission; The field length value is compared with a preset length value range; the market value range is compared with a preset market value range; and the field content code value is compared with the specification appendix code value range. If the field length value conforms to the preset length value range, the market value range conforms to the preset market value range, and the field content code value conforms to the specification appendix code value range, then the data submitted by the China Securities Regulatory Commission is determined to have passed the field format verification. If the field length value does not conform to the preset length value range and / or the market value range does not conform to the preset market value range and / or the field content code value does not conform to the specification appendix code value range, then the data submitted by the China Securities Regulatory Commission (CSRC) is determined to have failed the field format verification.
5. The data verification method submitted by the China Securities Regulatory Commission as described in claim 1, characterized in that, The document cross-verification of the data submitted by the China Securities Regulatory Commission includes: The data submitted by the China Securities Regulatory Commission (CSRC) is converted into a binary information document in binary format; The trained field recognition model is used to identify the binary information document and extract the associated file string groups from the binary information document. Based on the associated file string group, the feature association information is determined, and a simulated file containing the feature association information is generated; The associated file string group is used to determine the CSRC-submitted data in the same batch corresponding to the associated file string group, which is then used as a comparison document. Compare the simulated file with the comparison document to determine whether the feature association information in the simulated file matches and / or is consistent with the comparison document; If so, then the associated file string group is determined to have passed the inter-file cross-verification. If all the associated file string groups in the data submitted by the China Securities Regulatory Commission (CSRC) pass the inter-file cross-verification check, then the data submitted by the CSRC is determined to have passed the inter-file cross-verification check.
6. A data verification device for data submitted to the China Securities Regulatory Commission (CSRC), characterized in that, include: The acquisition module is used to acquire data submitted by the China Securities Regulatory Commission (CSRC). The formal verification module is used to perform formal verification on the data submitted by the China Securities Regulatory Commission. The cross-validation module is used to perform cross-validation on the CSRC-submitted data if the data passes the formal validation. The cross-validation includes: performing intra-file cross-validation on the CSRC-submitted data; and performing inter-file cross-validation on the CSRC-submitted data if the intra-file cross-validation passes the intra-file cross-validation. The intra-file cross-validation includes: converting the CSRC-submitted data into a binary information document in binary format; using a trained field recognition model to identify the binary information document and splitting it into multiple ordered field sequences; and extracting the associated subject field, subject modifier field, object field, object predicate field, and independent predicate field from the ordered field sequences according to predefined field specifications to construct a split character... The data segment table is used to determine the associated data region corresponding to the ordered field sequence based on the segmented field table. The associated values in the associated data region corresponding to the ordered field sequence are also determined. The field results obtained from each group of associated subject fields, subject modifier fields, object fields, object predicate fields, and independent predicate fields in the segmented field table are compared with the associated values. If so, the associated subject fields, subject modifier fields, object fields, object predicate fields, and independent predicate fields corresponding to the ordered field sequence in the segmented field table are determined to pass the file internal verification. If all fields corresponding to the ordered field sequence in the segmented field table pass the file internal verification, the data submitted by the China Securities Regulatory Commission (CSRC) is determined to pass the file internal verification. The reporting module is used to generate a reporting file corresponding to the China Securities Regulatory Commission (CSRC) when the data reported by the CSRC passes the cross-check, and input the reporting file into the CSRC reporting interface so as to submit the reporting file to the CSRC.
7. A data verification system for data submitted by the China Securities Regulatory Commission (CSRC), characterized in that, The system includes a memory and a processor. The memory stores a data verification program for securities regulatory reporting. The processor runs the data verification program to enable the data verification system for securities regulatory reporting to perform the data verification method for securities regulatory reporting as described in any one of claims 1-5.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a data verification program for securities regulatory submissions, which, when executed by a processor, implements the data verification method for securities regulatory submissions as described in any one of claims 1-5.
Citation Information
Patent Citations
Processing method and device for supervision submitted data
CN113297179A