Data element information management method, system and equipment based on json and medium

Abstract

The invention provides a json-based data element information management method, system, equipment and medium, and belongs to the technical field of seismic processing / interpretation system data backup processing, and the method comprises the following steps: S1, starting an application system export function, and obtaining and exporting data element information of an application system through api; s2, writing the data element information into a json file according to a design hierarchical structure; s3, downloading the unstructured data of the application system according to the data element information; s4, initiating a data import function, extracting data meta-information from the json file, and recovering the data meta-information into the application system; and S5, uploading the downloaded unstructured data to an application system according to the data element information in the json file. According to the method, expansion management can be conveniently carried out, and the compatibility of old version data and the stability of a program are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data backup processing in seismic processing / interpretation systems, and specifically relates to a JSON-based method, system, device, and medium for managing data element information. Background Art

[0002] In a seismic data interpretation system, exporting all or part of the data under a project / working area is a very common function, whether for data backup or subsequent data migration to another cluster. Especially data migration can enable processing and interpretation personnel not to manually reload the data one by one, greatly reducing the workload of scientific research personnel. For the export function of the processing and interpretation system, how to store and manage the complex hierarchical metadata information under the exported project / working area is an important topic.

[0003] Generally, many processing and interpretation systems will establish a corresponding file directory structure at the export location according to the hierarchical directory structure of the data model, and manage the storage of metadata in binary format. Specifically, as Figure 1 and Figure 2 shown. This storage management method is a common method, but it also has the disadvantage that the content of the backup data is not intuitive. With the upgrade and improvement of the software system, the content in the backup data binary file needs to be expanded, and the subsequent data import function needs to continuously be compatible with the old backup data format, increasing the complexity of code implementation and making the development and maintenance of the code complex. Summary of the Invention

[0004] The purpose of the present invention is to provide a JSON-based method, system, device, and medium for managing data element information, which manages the data element information of the exported data by introducing the JSON format. In the case of software system upgrade and information expansion, corresponding expansion management can be conveniently carried out. Data import can also conveniently be compatible with the old data format, greatly improving the compatibility with the old version data and the stability of the program.

[0005] The present invention provides a JSON-based method for managing data element information, including the following steps:

[0006] Step S1: Start the export function of the application system, and obtain the data element information of the exported application system through the API;

[0007] Step S2: Write the data element information into a JSON file according to the designed hierarchical structure;

[0008] Step S3: Download the unstructured data of the application system according to the data element information;

[0009] Step S4: Initiate the data import function, extract data element information from the json file, and restore the data element information to the application system;

[0010] Step S5: Upload the downloaded unstructured data to the application system according to the data element information in the json file.

[0011] Preferably, after exporting the data element information of the application system, it further includes: encrypting and converting some sensitive data element information in the data element information through a conversion algorithm.

[0012] Preferably, step S2 specifically includes: writing the data element information into a json file in the form of key-value pairs according to the data model hierarchy relationship of the application system.

[0013] Preferably, the data element information extracted from the json file includes project information, work area information, and seismic information.

[0014] Preferably, in step S4, extracting the data element information from the json file specifically includes: obtaining the corresponding data value according to the data key value of the data element information.

[0015] Preferably, in step S5, upload the downloaded unstructured data through the application system api interface.

[0016] Preferably, between step S4 and step S5, it further includes: searching for the data element information of the next-level exported application system. When the data element information of the next-level exported application system is found, step S1 is performed again. When the data element information of the next-level exported application system is not found, step S5 is entered.

[0017] The present invention also provides a json-based data element information management system, including:

[0018] Data acquisition module: Start the export function of the application system, and obtain the data element information of the exported application system through the api;

[0019] Data encryption module: Encrypt and convert some sensitive data element information in the data element information through a conversion algorithm;

[0020] Data import module: Write the data element information into a json file according to the designed hierarchical structure;

[0021] Data download module: Download the unstructured data of the application system according to the data element information;

[0022] Data Import Module: Initiates the data import function, extracts data element information from the JSON file, and restores the data element information into the application system;

[0023] Data Upload Module: Uploads the downloaded unstructured data into the application system according to the data element information in the JSON file.

[0024] The present invention also provides an electronic device, which is characterized by including:

[0025] A processor;

[0026] A memory for storing instructions executable by the processor;

[0027] Wherein, the processor is configured to call the instructions stored in the memory to execute the JSON-based data element information management method of any one of the above.

[0028] The present invention also provides a storage medium, which is characterized by storing a computer program, and when the computer program is executed by a processor, it implements the JSON-based data element information management method of any one of the above.

[0029] The beneficial effects of the present invention at least include:

[0030] The JSON-based data element information management method and system of the present invention write data element information into a JSON file according to the hierarchical relationship of the application system data model in the form of key-value pairs in JSON format. And in the step of extracting data element information from the JSON file, the corresponding data value is obtained according to the data key value of the data element information. The present invention manages the exported project / section metadata element information by introducing the JSON format, which can be conveniently expanded and managed, and the data import can also conveniently be compatible with the old data format, greatly improving the compatibility with the old version data and the stability of the program.

[0031] The data element information management method and system of the processing and interpretation software of the present invention can be used in the field of the export / import function of seismic processing / interpretation software.

[0032] The method and device of the present invention have other characteristics and advantages, which will be obvious in the accompanying drawings and subsequent specific embodiments incorporated herein, or will be described in detail in the accompanying drawings and subsequent specific embodiments incorporated herein. These drawings and specific embodiments are jointly used to explain the specific principles of the present invention. Brief Description of the Drawings

[0033] The above and other objects, features, and advantages of the present invention will become more apparent by describing the exemplary embodiments of the present invention in more detail with reference to the accompanying drawings.

[0034] Figure 1 It shows a schematic diagram of the process of processing / interpreting software-exported metadata in the prior art;

[0035] Figure 2 It shows a schematic diagram of the process of processing / interpreting software-imported data extraction in the prior art;

[0036] Figure 3 It shows a data export flowchart of the json-based data element information management method of the present invention;

[0037] Figure 4 It shows a data import flowchart of the json-based data element information management method of the present invention. Detailed Embodiments

[0038] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are only a part rather than all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0039] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and do not necessarily need to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order different from those illustrated or described herein.

[0040] It should be understood that in various embodiments of the present invention, the magnitude of the sequence numbers of the processes does not mean the order of execution. The order of execution of each process should be determined by its function and internal logic and should not constitute any limitation to the implementation process of the embodiments of the present invention.

[0041] It should be understood that in the present invention, "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0042] It should be understood that in the present invention, "a plurality of" means two or more. " / or" is merely a relational description of associated objects, indicating that there can be three relationships. For example, A / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. "Including A, B, and C" and "including A, B, C" mean that all of A, B, and C are included. "Including A, B, or C" means that one of A, B, and C is included. "Including A, B, and / or C" means that any one or any two or all three of A, B, and C are included.

[0043] It should be understood that in the present invention, "B corresponding to A", "B corresponding to A relatively", "A corresponding to B relatively", or "B corresponding to A relatively" means that B is associated with A, and B can be determined according to A. Determining B according to A does not mean determining B only according to A. B can also be determined according to A and / or other information. The matching of A and B means that the similarity between A and B is greater than or equal to a preset threshold.

[0044] Depending on the context, as used herein, "if" can be interpreted as "when", "while", "in response to determining", or "in response to detecting".

[0045] The technical solutions of the present invention will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0046] Example 1

[0047] According to an embodiment of the present invention, a method for managing data element information based on json is provided, and the data export flow chart is as Figure 3 shown. The method includes steps S1 to S5:

[0048] Step S1: Initiate an export task, start the export function of the application system, and obtain the data element information of the export application system through the api. Specifically, according to the hierarchical relationship of the application data model, the data element information is obtained sequentially from the processing / interpretation software through the application api data interface;

[0049] Step S2: Write the data element information into a json file according to the designed hierarchical structure. Specifically, after writing the data element information, it is determined whether it is necessary to search for the next-level data element information. If so, return to step S1; otherwise, enter step S3. Since the json file manages data explicitly, some sensitive data element information is converted through a conversion algorithm to ensure data security;

[0050] The full name of JSON is: JavaScript Object Notation. JSON is a lightweight data interchange format. It is based on a subset of ECMAScript (the JavaScript specification developed by the European Computer Manufacturers Association) and uses a text format that is completely independent of programming languages to store and represent data. The JSON format is lighter, faster, and easier to parse than XML. JavaScript natively supports JSON, so the parsing speed is very fast. Moreover, all platform languages support JSON interaction, JSON parsing, and storage. JSON is often used in interface interaction and front-end and back-end interaction, and its parsing speed is fast. JSON stores data in a small volume, unlike formats such as XML and PList that define various Dom nodes. All languages and third-party frameworks support JSON, so the reuse rate of using JSON is higher, and there is no need to convert the format back and forth.

[0051] Step S3: Download the unstructured data of the application system according to the data element information. Specifically, batch download the unstructured data cyclically according to the json file.

[0052] Step S4: Initiate the data import function, extract the data element information from the json file, and restore the data element information to the application system. Specifically, save some of the data in the data element information to the database, and execute Step S5 for the unstructured data in the data element information. During the process of extracting the data from the json file, it is very convenient to obtain the corresponding value according to the data key value. Moreover, for the api data reading interface of the json file, it has natural compatibility with the data of the old version of the application (when the key value does not exist in the old version data, the obtained value is empty).

[0053] Step S5: Upload the downloaded unstructured data to the application system according to the data element information in the json file, that is, upload it to a specific file system.

[0054] The method of the present invention manages the meta-information of the exported data by introducing the JSON format, including writing the data element information into the json file, extracting the data element information from the json file, and uploading the downloaded unstructured data to the application system according to the data element information in the json file. In the case of software system upgrade and information expansion, corresponding expansion management can be carried out very conveniently. Data import can also be very convenient to be compatible with the old data format, greatly improving the compatibility with the old version data and the stability of the program.

[0055] In some embodiments, after exporting the data element information of the application system, it further includes: encrypting and converting some of the sensitive data element information in the data element information through a conversion algorithm.

[0056] In some embodiments, step S2 specifically includes: according to the hierarchical relationship of the application system data model, based on the obtained relevant data meta-information, write the data meta-information into a json file in the form of json format key-value pairs.

[0057] In some embodiments, the data meta-information extracted from the json file includes project information, work area information, and seismic information.

[0058] In some embodiments, in step S4, extracting data meta-information from the json file specifically includes: obtaining the corresponding data value according to the data key value of the data meta-information. During the data transmission process of the json file, encrypt the json data to ensure data security. Data encryption includes two methods: symmetric encryption or asymmetric encryption. Symmetric encryption requires both parties to use the same key for encryption and decryption, while asymmetric encryption uses two keys, the public key and the private key, for encryption and decryption. During the encryption process, it is necessary to encrypt the json data at the sender, and the receiver needs to decrypt the encrypted data to obtain the original json data.

[0059] In some embodiments, in step S5, upload the downloaded unstructured data through the application system api interface. Api refers to the application programming interface, which is a way for different software to interact. The api interface enables software to communicate with each other to execute commands, transfer data, and request services. The api interface enables applications to interact with other applications, and enables applications to more easily share information and functions, and can enhance the capabilities of applications.

[0060] In some embodiments, between step S4 and step S5, it further includes: searching for the data meta-information of the next-level export application system. When the data meta-information of the next-level export application system is found, then perform step S1 again. When the data meta-information of the next-level export application system is not found, then enter step S5.

[0061] Example 2

[0062] According to an embodiment of the present invention, a json-based data meta-information management system is provided, including:

[0063] Data acquisition module: Start the export function of the application system, and obtain the data meta-information of the export application system through the api;

[0064] Data encryption module: Through the conversion algorithm, encrypt and convert some sensitive data meta-information in the data meta-information;

[0065] Data Import Module: Write data element information into a JSON file according to the designed hierarchical structure;

[0066] Data Download Module: Download the unstructured data of the application system according to the data element information;

[0067] Data Import Module: Initiate the data import function, extract data element information from the JSON file, and restore the data element information to the application system;

[0068] Data Upload Module: Upload the downloaded unstructured data to the application system according to the data element information in the JSON file.

[0069] In some embodiments, after exporting the data element information of the application system, it further includes: encrypting and converting some sensitive data element information in the data element information through a conversion algorithm.

[0070] In some embodiments, step S2 specifically includes: according to the hierarchical relationship of the application system data model, according to the obtained relevant data element information, write the data element information into the JSON file in the form of key-value pairs in JSON format.

[0071] In some embodiments, the data element information extracted from the JSON file includes project information, work area information, and seismic information.

[0072] In some embodiments, in step S4, extracting data element information from the JSON file specifically includes: obtaining the corresponding data value according to the data key value of the data element information. During the data transmission process of the JSON file, encrypt the JSON data to ensure data security. Data encryption includes two methods: symmetric encryption and asymmetric encryption. Symmetric encryption requires both parties to use the same key for encryption and decryption, while asymmetric encryption uses two keys, a public key and a private key, for encryption and decryption. During the encryption process, it is necessary to encrypt the JSON data at the sender, and the receiver needs to decrypt the encrypted data to obtain the original JSON data.

[0073] In some embodiments, in step S5, upload the downloaded unstructured data through the application system API interface. API refers to the application programming interface, which is a way for different software to interact. The API interface enables software to communicate with each other to execute commands, transfer data, and request services. The API interface enables applications to interact with other applications, and enables applications to more easily share information and functions, and can enhance the capabilities of applications.

[0074] In some embodiments, between step S4 and step S5, it further includes: searching for the data element information of the next-level export application system. When the data element information of the next-level export application system is found, step S1 is performed again. When the data element information of the next-level export application system is not found, step S5 is entered.

[0075] The JSON-based data element information management system of the present invention manages the exported project / working area metadata through JSON files, and can better cope with software upgrades and compatibility with old export data formats. By using the JSON data format to manage the exported data element information, the content of the backup data can be intuitively understood, and with the upgrade of the application, good compatibility with old export data is achieved.

[0076] Example 3

[0077] According to another aspect of the present invention, an electronic device is also provided. The electronic device includes: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the JSON-based data element information management method of the present invention.

[0078] The method includes the following steps:

[0079] Step S1: Initiate an export task, start the export function of the application system, and obtain the data element information of the export application system through the API. Specifically, according to the hierarchical relationship of the application data model, through the application API data interface, the data element information is sequentially obtained from the processing / interpretation software.

[0080] Step S2: Write the data element information into the JSON file according to the designed hierarchical structure. Specifically, after writing the data element information, it is judged whether it is necessary to search for the next-level data element information. If so, return to step S1; otherwise, enter step S3.

[0081] Step S3: Download the unstructured data of the application system according to the data element information. Specifically, download the unstructured data in batches according to the JSON file in a loop.

[0082] Step S4: Initiate a data import function, extract the data element information from the JSON file, and restore the data element information to the application system. Specifically, part of the data in the data element information is saved to the database, and step S5 is performed for the unstructured data in the data element information.

[0083] Step S5: Upload the downloaded unstructured data to the application system according to the data element information in the JSON file, that is, upload it to a specific file system.

[0084] In some embodiments, after exporting the data element information of the application system, it further includes: encrypting and converting some sensitive data element information in the data element information through a conversion algorithm.

[0085] In some embodiments, step S2 specifically includes: according to the hierarchical relationship of the application system data model, based on the obtained relevant data element information, writing the data element information into a json file in the form of json format key-value pairs.

[0086] In some embodiments, the data element information extracted from the json file includes project information, work area information, and seismic information.

[0087] In some embodiments, in step S4, extracting the data element information from the json file specifically includes: obtaining the corresponding data value according to the data key value of the data element information.

[0088] In some embodiments, in step S5, uploading the downloaded unstructured data through the application system api interface.

[0089] In some embodiments, between step S4 and step S5, it further includes: searching for the data element information of the next-level export application system. When the data element information of the next-level export application system is found, then step S1 is performed again. When the data element information of the next-level export application system is not found, then step S5 is entered.

[0090] Example 4

[0091] According to another aspect of the present invention, there is also provided a storage medium storing a computer program, which when executed by a processor implements the json-based data element information management method according to the present invention.

[0092] The method includes the following steps:

[0093] Step S1: Initiate an export task, start the export function of the application system, and obtain the data element information of the export application system through the api. Specifically, according to the hierarchical relationship of the application data model, through the application api data interface, sequentially obtain the data element information from the processing / interpretation software;

[0094] Step S2: Write the data element information into a json file according to the designed hierarchical structure. Specifically, after writing the data element information, determine whether it is necessary to search for the data element information of the next level. If so, return to step S1; otherwise, enter step S3;

[0095] Step S3: Download the unstructured data of the application system according to the data element information. Specifically, batch-download the unstructured data cyclically according to the json file;

[0096] Step S4: Initiate the data import function, extract data element information from the json file, and restore the data element information to the application system. Specifically, save some of the data in the data element information to the database, and execute Step S5 for the unstructured data in the data element information;

[0097] Step S5: Upload the downloaded unstructured data to the application system according to the data element information in the json file, that is, upload it to a specific file system.

[0098] In some embodiments, after exporting the data element information of the application system, it further includes: encrypting and converting some of the sensitive data element information in the data element information through a conversion algorithm.

[0099] In some embodiments, Step S2 specifically includes: according to the hierarchical relationship of the application system data model, write the data element information into the json file in the form of json format key-value pairs based on the obtained relevant data information.

[0100] In some embodiments, the data element information extracted from the json file includes project information, work area information, and seismic information.

[0101] In some embodiments, in Step S4, extracting the data element information from the json file specifically includes: obtaining the corresponding data value according to the data key value of the data element information.

[0102] In some embodiments, in Step S5, upload the downloaded unstructured data through the application system api interface.

[0103] In some embodiments, between Step S4 and Step S5, it further includes: searching for the data element information of the next-level exported application system. When the data element information of the next-level exported application system is found, then perform Step S1 again. When the data element information of the next-level exported application system is not found, then enter Step S5.

[0104] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. The computer-readable storage medium includes, but is not limited to, electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of the computer-readable storage medium include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disks (DVDs), memory sticks, floppy disks, mechanically encoded devices such as punch cards or raised structures in grooves storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage medium used herein is not construed as an instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through an optical fiber cable), or electrical signals transmitted through wires.

[0105] It can be understood that the above-mentioned embodiments referred to in the present invention, without violating the principle logic, can be combined with each other to form a combined embodiment. Due to space limitations, the present invention will not elaborate further. Those skilled in the art can understand that in the above method of the specific implementation manner, the specific execution order of each step should be determined according to its function and possible internal logic.

[0106] Note that unless otherwise directly stated, all features disclosed in this specification (including any appended claims, abstract, and drawings) can be replaced by alternative features for achieving the same, equivalent, or similar purposes. Therefore, unless otherwise clearly stated, each feature disclosed is only an example of a group of equivalent or similar features. When used, further, preferably, furthermore, and more preferably are simple beginnings for elaborating another embodiment based on the foregoing embodiment. The content following the further, preferably, furthermore, or more preferably in combination with the foregoing embodiment constitutes a complete composition of another embodiment. A further embodiment can be formed by arbitrarily combining several further, preferably, furthermore, or more preferably settings following the same embodiment.

[0107] Those skilled in the art should understand that the embodiments of the present invention described above and shown in the drawings are only examples and do not limit the present invention. The objectives of the present invention have been fully and effectively achieved. The functions and structural principles of the present invention have been demonstrated and explained in the embodiments. Without departing from the said principles, the embodiments of the present invention can have any deformation or modification.

[0108] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for managing data element information based on JSON, characterized in that, it includes the following steps: Step S1: Start the export function of the application system, and obtain the data element information of the exported application system through the API; Step S2: Write the data element information into a JSON file according to the designed hierarchical structure; Step S3: Download the unstructured data of the application system according to the data element information; Step S4: Initiate the data import function, extract the data element information from the JSON file, and restore the data element information to the application system; Step S5: Upload the downloaded unstructured data to the application system according to the data element information in the JSON file.

2. The method for managing data element information based on JSON according to claim 1, characterized in that, after exporting the data element information of the application system, it further includes: encrypting and converting some sensitive data element information in the data element information through a conversion algorithm.

3. The method for managing data element information based on JSON according to claim 1, characterized in that, Step S2 includes: writing the data element information into a JSON file in the form of key-value pairs according to the hierarchical relationship of the application system data model in JSON format.

4. The method for managing data element information based on JSON according to claim 1, characterized in that, the data element information extracted from the JSON file includes project information, work area information, and seismic information.

5. The method for managing data element information based on JSON according to claim 1, characterized in that, in step S4, extracting the data element information from the JSON file includes: obtaining the corresponding data value according to the data key value of the data element information.

6. The method for managing data element information based on JSON according to claim 1, characterized in that, in step S5, uploading the downloaded unstructured data through the application system API interface.

7. The method for managing data element information based on JSON according to claim 1, characterized in that, between step S4 and step S5, it further includes: searching for the data element information of the next-level exported application system. When the data element information of the next-level exported application system is found, step S1 is performed again. When the data element information of the next-level exported application system is not found, step S5 is entered.

8. A system for managing data element information based on JSON, characterized in that, it includes: Data acquisition module: Start the export function of the application system, and obtain the data element information of the exported application system through the API; Data encryption module: Encrypt and convert some sensitive data element information in the data element information through a conversion algorithm; Data import module: Write the data element information into a JSON file according to the designed hierarchical structure; Data download module: Download the unstructured data of the application system according to the data element information; Data import module: Initiate the data import function, extract the data element information from the JSON file, and restore the data element information to the application system; Data upload module: Upload the downloaded unstructured data to the application system according to the data element information in the JSON file.

9. An electronic device, characterized in that, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the method according to any one of claims 1 to 7.

10. A storage medium, characterized in that, stores a computer program, and when the computer program is executed by a processor, it implements the method according to any one of claims 1 to 7.

Images