A data exchange method

Abstract

This invention relates to the field of data exchange technology and discloses a data exchange method. The method involves: a storage end extracting raw data information from an information system; a processing end extracting all raw data information from the same database in the storage end, using one set of raw data as an initial template, comparing the initial template with the remaining raw data in the same database, and integrating the initial template and reference data into standard data information; and a requesting end sending an access request and extracting the corresponding standard data information, wherein the access request includes feature information of the data to be extracted. Compared to traditional methods, this method can integrate several sets of data information of the same type or belonging to the same category from different information systems, extracting the different parts, thereby avoiding the need for staff to search through massive amounts of similar files for the desired content and improving work efficiency.

Description

Technical Field

[0001] The present invention relates to the technical field of data exchange, and in particular to a data exchange method. Background Art

[0002] Data exchange refers to the process of establishing a temporary interconnection path for data communication between multiple data terminal equipment (DTE) for any two terminal equipment. Before sending, the data of the information sender is first encrypted, compressed and encapsulated into data packets according to the rules, and then sent; after receiving the message, the receiver first performs preliminary verification and analysis on the data, and after confirming that the data is OK, it is reorganized according to the rules, and finally saved to the corresponding database to complete a one-way transmission process of data exchange. With the popularization of information technology, especially in the industrial field, it has become the norm to use professional information systems for business processing and information management. Different information systems usually have their own independent databases to store large amounts of data generated by system operation, such as equipment operation information, industrial energy distribution information, etc.

[0003] However, due to the differences in information collection methods, update methods and screening mechanisms, data overlaps within different information systems, and these overlapping data will be inconsistent in content due to the differences in collection methods, update methods and screening mechanisms. If data is collected only from a certain information system, the extracted information may not be the most complete, and if data is collected from all information systems at the same time, a large amount of data needs to be integrated at the same time, which is inefficient. Summary of the invention

[0004] The purpose of the present invention is to provide a data exchange method to solve the problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A data exchange method, characterized in that the method comprises:

[0007] The storage end extracts the original data information in the information system, extracts the characteristic information of the original data information and classifies the original data information according to the different characteristic information. All the original data information with the same characteristic information will be stored in the same database in the processing end. The characteristic information refers to the name information or specified information of the data. The data information can be easily retrieved from the information system through the characteristic information, and the data names of any two different types of data information are different;

[0008] The processing end extracts all the original data information in the same database in the storage end, takes one of the original data as the initial template, compares the initial template with the rest of the original data in the same database, extracts the content that is different from the initial template in different original data, and defines the content as reference data, extracts the initial template and the reference data and integrates them into standard data information;

[0009] The requesting end sends an access request and extracts corresponding standard data information, wherein the access request includes characteristic information of the data to be extracted.

[0010] As a further solution of the present invention, the original data information stored in the storage end is not constant. It will extract new original data information from the information system at a certain time interval under the action of the timer, and the original data information in the database will also be updated accordingly. The specific steps of updating the database are as follows:

[0011] The storage end extracts the original data information in the information system at certain time intervals;

[0012] Extracting characteristic information from the original data information;

[0013] Extracting original data identical to the characteristic information in the database;

[0014] Compare the original data in the database with the newly extracted original data to determine whether there is an item in the database with the same content as the newly extracted original data;

[0015] If the same item as the newly extracted original data does not exist in the database, the original data is stored in the database.

[0016] As a further solution of the present invention, when the original data information in the database in the storage end changes, the standard data information in the processing end cannot cover the content of all the original data in the system, so it needs to be updated, and the specific update steps are as follows:

[0017] Extracting the newly stored raw data information in the database;

[0018] Comparing the original data information with the initial template, and extracting reference data from the original data information;

[0019] Add the reference data mentioned to the standard data information.

[0020] As a further solution of the present invention, if there are items in the database that are identical to the newly extracted original data, the newly extracted original data is determined to be a duplicate item and is directly deleted.

[0021] As a further solution of the present invention, in the processing end, if in the process of extracting reference data of each original data, two or more reference data have the same partial content, a data screening process is performed, and the specific steps of the data screening process are as follows:

[0022] extracting said reference data;

[0023] comparing the reference data;

[0024] Extract two similar reference data, merge the two reference data, and form a new reference data.

[0025] As a further solution of the present invention, the specific comparison process of data screening is:

[0026] One of the reference data is randomly extracted and recorded as a comparison sample, and the comparison sample is compared with the reference data in turn, and the comparison method is pairwise comparison;

[0027] During the comparison process, if the similarity between the reference data and the comparison sample does not exceed the set threshold, the comparison sample is compared with the next reference data.

[0028] As a further solution of the present invention, if during the comparison process, the similarity between the reference data and the comparison sample exceeds a set threshold, the comparison sample and the reference data are merged into the same reference data and stored in a temporary database.

[0029] As a further solution of the present invention, if none of the reference data has a similarity with the comparison sample exceeding a set threshold, the comparison sample is stored in a historical database.

[0030] As a further solution of the present invention, reference data in the temporary database is extracted and the data is screened again until a complete comparison process does not contain any reference information whose similarity with the comparison sample exceeds a certain threshold.

[0031] Compared with the prior art, the beneficial effects of the present invention are: before extracting the object data, a large amount of data information within each information system is extracted, classified, identified and screened, and several pieces of data information of the same type or belonging to the same category from different information systems are integrated, and different parts are extracted and integrated into a complete set of standard data information for the requester to access and view, thereby avoiding the staff from searching for the desired file content in a large number of files of the same type, thereby improving work efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0033] Figure 1 A flowchart of a data exchange method applicable to an embodiment of the present invention is provided for an embodiment of the present invention.

[0034] Figure 2 The present invention is a flowchart of a data processing process before transmission provided in a preferred embodiment of the present invention.

[0035] Figure 3 A schematic flow chart of a data sorting process before reading provided in a preferred embodiment of the present invention.

[0036] Figure 4 The figure is a flow chart of an interrupt emergency process provided in a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] It should be noted that if there are directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention, they are only used to explain the relative position relationship, movement status, etc. between the components in a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.

[0039] In addition, if the descriptions of "first", "second", etc. are involved in the present invention, they are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0040] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments:

[0041] Data exchange refers to the process of establishing a temporary interconnection path for data communication between multiple data terminal equipment (DTE) for any two terminal equipment. Before sending, the data of the information sender is first encrypted, compressed and encapsulated into data packets according to the rules, and then sent; after receiving the message, the receiver first performs preliminary verification and analysis on the data, and after confirming that the data is OK, it is reorganized according to the rules, and finally saved to the corresponding database to complete a one-way transmission process of data exchange. With the popularization of information technology, especially in the industrial field, it has become the norm to use professional information systems for business processing and information management. Different information systems usually have their own independent databases to store large amounts of data generated by system operation, such as equipment operation information, industrial energy distribution information, etc.

[0042] However, due to the differences in information collection methods, update methods and screening mechanisms, data overlaps within different information systems, and these overlapping data will be inconsistent in content due to the differences in collection methods, update methods and screening mechanisms. If data is collected only from a certain information system, the extracted information may not be the most complete, and if data is collected from all information systems at the same time, a large amount of data needs to be integrated at the same time, which is inefficient.

[0043] In this embodiment, the storage end extracts the original data information in the information system, extracts the characteristic information of the original data information and classifies the original data information according to the different characteristic information, and all the original data information with the same characteristic information will be stored in the same database in the processing end; the processing end extracts all the original data information in the same database in the storage end, takes one of the original data as the initial template, compares the initial template with the rest of the original data in the same database, extracts the content that is different from the initial template in different original data, and defines the content as reference data here, extracts the initial template and the reference data and integrates them into standard data information; the request end sends an access request and extracts the corresponding standard data information, and the access request includes the characteristic information of the data to be extracted. Thus, before extracting the object data, the system extracts, classifies, identifies and screens a large amount of data information in each information system, integrates several data information of the same type or belonging to the same category from different information systems, extracts different parts, and integrates them into a complete standard data information for the requester to access and view, thereby avoiding the staff from searching for the desired file content in a large number of files of the same type, and improving work efficiency.

[0044] Example 1

[0045] Figure 1The implementation process of a data exchange method in the present invention is shown. The data exchange method is applied to a device that can connect to the Internet in real time. The device can be a mobile phone, a tablet computer, a computer and other communication devices. No specific limitation is made here. The data exchange method is described in detail as follows:

[0046] Step S100, the storage end extracts the original data information in the information system, extracts the characteristic information of the original data information and classifies the original data information according to the different characteristic information, and all the original data information with the same characteristic information will be stored in the same database in the processing end, the characteristic information refers to the name information or specified information of the data, and the data information can be easily retrieved from the information system through the characteristic information, and the data names of any two different types of data information are different;

[0047] Step S200, the processing end extracts all the original data information in the same database in the storage end, takes one of the original data as the initial template, compares the initial template with the rest of the original data in the same database, extracts the content that is different from the initial template in the different original data, and defines the content as reference data, extracts the initial template and the reference data and integrates them into standard data information;

[0048] Step S300: the requesting end sends an access request and extracts corresponding standard data information, wherein the access request includes characteristic information of the data to be extracted.

[0049] Raw data is data in user databases, or various data stored and used by end users. It is data that has not been processed or simplified. This data may or may not be in machine-readable form. It constitutes physically existing data. Raw data exists in many forms, such as text data, image data, audio data, or a mixture of several types of data.

[0050] The characteristic information is the information that can characterize the information of the original data, i.e., the attributes and functions of the information, including: (i) dependency, (ii) reproducibility (expandability), (iii) transferability, (iv) storability, (v) contractibility, (vi) shareability, (vii) predictability, (viii) validity and invalidity, and (ix) processability.

[0051] In addition, if Figure 2 As shown in , the original data information stored in the storage end is not constant. It will extract new original data information from the information system at a certain time interval under the action of the timer, and the original data information in the database will also be updated accordingly. The specific steps of updating the database are as follows:

[0052] Step S101, the storage end extracts the original data information in the information system at a certain time interval;

[0053] Step S102, extracting characteristic information from the original data information;

[0054] Step S103, extracting original data identical to the characteristic information in the database;

[0055] Step S104, comparing the original data in the database with the newly extracted original data to determine whether there is an item in the database with the same content as the newly extracted original data;

[0056] Step S105: If there is no item identical to the newly extracted original data in the database, the original data is stored in the database.

[0057] In addition, it is worth noting that if there are items in the database that are identical to the newly extracted original data, step S106 is executed. Step S106 determines that the newly extracted original data is a duplicate item and directly deletes it.

[0058] Moreover, it is understandable that when the original data information in the database of the storage end changes, the standard data information in the processing end cannot cover the content of all the original data in the system, so it needs to be updated. The specific update steps are as follows (refer to Figure 3 ):

[0059] Step S201, extracting the original data information newly stored in the database;

[0060] Step S202, comparing the original data information with the initial template, and extracting reference data from the original data information;

[0061] Step S203: adding the reference data to the standard data information.

[0062] like Figure 4 As shown, in another preferred embodiment of the present invention, in the processing end, if in the process of extracting reference data of each original data, two or more reference data have the same partial content, a data screening process is performed, and the specific steps of the data screening process are as follows:

[0063] Step S301, extracting the reference data;

[0064] Step S302, comparing the reference data;

[0065] Step S303: extract two similar reference data, merge the two reference data, and form a new reference data.

[0066] And in Figure 4 In the figure, the specific comparison process in the data screening process is shown:

[0067] One of the reference data is randomly extracted and recorded as a comparison sample, and the comparison sample is compared with the reference data in turn, and the comparison method is pairwise comparison;

[0068] During the comparison process, if the similarity between the reference data and the comparison sample does not exceed the set threshold, the comparison sample is compared with the next reference data.

[0069] In addition, in this embodiment, it is worth noting that if the similarity between the reference data and the comparison sample exceeds a set threshold during the comparison process, the comparison sample and the reference data are merged into the same reference data and stored in a temporary database.

[0070] In another case of this implementation, if none of the reference data has a similarity with the comparison sample exceeding the set threshold, the comparison sample is stored in the history database.

[0071] In another case of this implementation, reference data is extracted from the temporary database and the data is screened again until a complete comparison process does not contain any reference information whose similarity with the comparison sample exceeds a certain threshold.

[0072] The processor takes out instructions from the memory one by one, analyzes the instructions, and then completes the corresponding operations according to the instruction requirements, generating a series of control commands, so that the various parts of the computer can automatically, continuously and coordinately move to become an organic whole, realize the input of programs, the input of data, and the calculation and output of results. The arithmetic operations or logical operations generated in this process are all completed by the operator; the memory includes a read-only memory (ROM), which is used to store computer programs, and a protection device is provided outside the memory.

[0073] Exemplarily, the computer program may be divided into one or more modules, one or more modules are stored in a memory and executed by a processor to implement the present invention. One or more modules may be a series of computer program instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program in a terminal device.

[0074] Those skilled in the art will understand that the description of the above service equipment is merely an example and does not constitute a limitation on the terminal equipment. It may include more or fewer components than described above, or a combination of certain components, or different components, for example, it may include input and output devices, network access devices, buses, etc.

[0075] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the terminal device, and uses various interfaces and lines to connect the various parts of the entire user terminal.

[0076] The memory can be used to store computer programs and / or modules. The processor can realize various functions of the terminal device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as an information collection template display function, a product information release function, etc.); the data storage area can store data created according to the use of the berth status display system (such as product information collection templates corresponding to different product types, product information that different product providers need to release, etc.). In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0077] If the module / unit integrated in the terminal device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the modules / units in the above-mentioned embodiment system, and can also be completed by instructing the relevant hardware through a computer program. The above-mentioned computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can realize the functions of the above-mentioned various system embodiments. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form. Computer-readable media may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0078] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0079] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A data exchange method, characterized in that: The method includes: The storage end extracts the original data information in the information system, extracts the characteristic information of the original data information and classifies the original data information according to the different characteristic information. All the original data information with the same characteristic information will be stored in the same database in the processing end. The characteristic information refers to the name information or specified information of the data. The data information can be easily retrieved from the information system through the characteristic information, and the data names of any two different types of data information are different; The processing end extracts all the original data information in the same database in the storage end, takes one of the original data as the initial template, compares the initial template with the rest of the original data in the same database, extracts the content that is different from the initial template in different original data, and defines the content as reference data, extracts the initial template and the reference data and integrates them into standard data information; The requesting end sends an access request and extracts corresponding standard data information, wherein the access request includes characteristic information of the data to be extracted.

2. A data exchange method according to claim 1, characterized in that: The original data information stored in the storage end is not constant. It will extract new original data information from the information system at a certain time interval under the action of the timer, and the original data information in the database will also be updated accordingly. The specific steps of database update are as follows: The storage end extracts the original data information in the information system at certain time intervals; Extracting characteristic information from the original data information; Extracting original data identical to the characteristic information in the database; Compare the original data in the database with the newly extracted original data to determine whether there is an item in the database with the same content as the newly extracted original data; If the same item as the newly extracted original data does not exist in the database, the original data is stored in the database.

3. A data exchange method according to claim 2, characterized in that: When the original data information in the database on the storage side changes, the standard data information on the processing side cannot cover the content of all the original data in the system, so it needs to be updated. The specific update steps are as follows: Extracting the newly stored raw data information in the database; Comparing the original data information with the initial template, and extracting reference data from the original data information; Add the reference data mentioned to the standard data information.

4. A data exchange method according to claim 2, characterized in that: If there are items in the database that are identical to the newly extracted original data, the newly extracted original data is determined to be a duplicate and is directly deleted.

5. A data exchange method according to claim 3, characterized in that: In the processing end, if two or more reference data have the same content in part during the process of extracting reference data of each original data, a data screening process is performed. The specific steps of the data screening process are as follows: extracting said reference data; comparing the reference data; Extract two similar reference data, merge the two reference data, and form a new reference data.

6. A data exchange method according to claim 5, characterized in that: The specific comparison process of data screening is as follows: One of the reference data is randomly extracted and recorded as a comparison sample, and the comparison sample is compared with the reference data in turn, and the comparison method is pairwise comparison; During the comparison process, if the similarity between the reference data and the comparison sample does not exceed the set threshold, the comparison sample is compared with the next reference data.

7. A data exchange method according to claim 6, characterized in that: If, during the comparison process, the similarity between the reference data and the comparison sample exceeds a set threshold, the comparison sample and the reference data are merged into the same reference data and stored in a temporary database.

8. A data exchange method according to claim 7, characterized in that: If none of the reference data has a similarity with the comparison sample that exceeds the set threshold, the comparison sample is stored in the historical database.

9. A data exchange method according to claim 8, characterized in that: The reference data in the temporary database is extracted and the data is screened again until a complete comparison process does not contain any reference information whose similarity with the comparison sample exceeds a certain threshold.

Images