Big data detection method and system

Abstract

The present invention relates to the technical field of big data tracing, and discloses a big data detection method and system, wherein the method comprises: detecting the location data of a database in a data system by a path detector of the data system; dividing a memory into a plurality of storage areas, wherein the storage areas are configured to generate one or more storage paths according to the location data of the database in the data system, wherein one or more storage paths generated by the same location data are configured to correspond to and match the detection path of the path detector; and each of the one or more storage paths is uniquely mapped to a detection thread in one or more detection paths to form a mapping table; controlling the movement of a pointer on the memory to point to a first storage path in the one or more storage paths by a processor, and for the first storage path, the mapped detection thread extracts the location data including the database.

Description

Technical Field

[0001] The present invention relates to the field of big data integration technology, and in particular to a big data detection method and system. Background Art

[0002] Data traceability is an important information field. Traditional data traceability integrates and traces the data of a publication. However, with the development of the Internet, data is no longer a single publication, but also includes systematic data generated by computers. The systematic data generated by computers has a wide range of applications. Therefore, tracing the source of computer system data is also a very important field. At present, most data integration systems do not trace the source of the data. Summary of the invention

[0003] In view of this, the main purpose of the present invention is to provide a big data detection method and system.

[0004] The technical solution adopted by the invention is as follows:

[0005] The big data detection method includes the following steps:

[0006] Detecting the location data of the database in the data system through a path detector of the data system;

[0007] Dividing a memory into a plurality of storage areas, wherein the storage areas are configured to generate one or more storage paths according to the position data of the database in the data system, wherein the one or more storage paths generated by the same position data are configured to correspond to and match the detection paths of the path detector; and each of the one or more storage paths is uniquely mapped to a detection thread in the one or more detection paths to form a mapping table;

[0008] The processor controls the movement of the pointer on the memory to point to a first storage path among one or more storage paths. For the first storage path, the mapped detection thread extracts the location data including the database.

[0009] Furthermore, when the processor controls the movement of the pointer on the memory, the detection thread configured by the detection path selected by the path detector is dynamically coupled with the pointer, and the pointer is dynamically coupled and switched between different detection threads. The corresponding storage path is derived by the detection thread through the mapping table, and the storage path is marked as the first storage path.

[0010] The present invention also provides a big data detection system, comprising:

[0011] A memory, the memory being configured to have a plurality of storage areas;

[0012] a path detector configured to detect location data of a database in a data system; and

[0013] a processor coupled to the path detector and the memory, and configured to:

[0014] The storage area is configured to generate one or more storage paths according to the position data of the database in the data system; the one or more storage paths generated by the same position data are configured to correspond to and match the detection path of the path detector;

[0015] Uniquely mapping each of the one or more storage paths to a detection thread in the one or more detection paths to form a mapping table; and

[0016] By controlling the movement of the pointer on the memory to point to a first storage path among the one or more storage paths, the mapped detection thread extracts the location data including the database for the first storage path.

[0017] Furthermore, by dynamically coupling the detection thread configured by the detection path selected by the path detector with the pointer, and dynamically coupling and switching the pointer between different detection threads, the corresponding storage path is derived by the detection thread through the mapping table, and the storage path is marked as the first storage path.

[0018] Furthermore, the memory is divided into storage areas according to the configuration type of the database in the data system; and databases of the same type correspond to the same storage area.

[0019] Furthermore, the processor has:

[0020] A first configuration module, coupled to the memory, for generating one or more storage paths according to the location data of the database in the data system, and corresponding the one or more storage paths to the storage area;

[0021] a second configuration module, connected to the path detector, configured to configure one or more storage paths generated by the same position data to correspond to and match the detection path of the path detector; and uniquely map each of the one or more storage paths to a detection thread in the one or more detection paths to form a mapping table;

[0022] A mobile detection module, the mobile detection module has a pointer for display, and the mobile detection module is controlled by an external device to move on any storage area of ​​the memory, so that the movement of the pointer on the memory points to a first storage path among one or more storage paths. For the first storage path, the mapped detection thread extracts the location data including the database.

[0023] Furthermore, the movement detection module is a control component driven by an external device to perform storage path detection on any storage area in the memory during or after data storage.

[0024] Furthermore, when the mobile detection module is driven by an external device to move the pointer to any storage area in the memory, the processor loads the mapping table, and obtains at least one first storage path corresponding to the detection thread by inversely parsing the mapping table. For the first storage path, the mapped detection thread extracts the location data including the database.

[0025] The present invention provides a method for associating a database, a storage path and a storage area according to the establishment of a storage path when storing data. When the storage location and source of the data are detected, it is only necessary to detect the correspondence between the detection thread and the storage path. Not only can the data be traced, but also the storage location of the data can be detected. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The following drawings are only used to illustrate and explain the present invention, and are not used to limit the scope of the present invention, wherein:

[0027] Figure 1 It is a structural schematic diagram of the present invention;

[0028] Figure 2 It is a schematic diagram of the connection structure between the memory and the path detector of the present invention. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution, design method and advantages of the present invention clearer, the present invention is further described in detail by specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0030] Reference Figure 1-2 The present invention provides a big data detection method, comprising the following steps:

[0031] Detecting the location data of the database in the data system through a path detector of the data system;

[0032] Dividing a memory into a plurality of storage areas, wherein the storage areas are configured to generate one or more storage paths according to the position data of the database in the data system, wherein the one or more storage paths generated by the same position data are configured to correspond to and match the detection paths of the path detector; and each of the one or more storage paths is uniquely mapped to a detection thread in the one or more detection paths to form a mapping table;

[0033] The processor controls the movement of the pointer on the memory to point to a first storage path among one or more storage paths. For the first storage path, the mapped detection thread extracts the location data including the database.

[0034] In the above, the path detector detects the location data of the database in the data system, and stores the location data in the address register in the processor; when the processor configures the storage area, one or more storage paths are generated by directly calling the location data in the address register; it should be noted that due to different database types, the amount of data generated corresponding to the database has certain differences. For example, user data in the data system may generate tens of thousands of items in real time, while the maintenance data and system data of the data system are not generated in large amounts. Therefore, when storing, the divided storage area cannot completely store all the data corresponding to a database, and several storage areas may be required for storage. Therefore, a database may correspond to one or more storage paths.

[0035] In the above, when the processor controls the movement of the pointer on the memory, the detection thread configured by the detection path selected by the path detector is dynamically coupled with the pointer, and the pointer is dynamically coupled and switched between different detection threads, and the corresponding storage path is derived by the detection thread through the mapping table, and the storage path is marked as the first storage path.

[0036] In the above, the pointer is a display symbol for the mobile detection module when performing detection. The mobile detection module is controlled by an external device to move on any storage area of ​​the memory, so that the movement of the pointer on the memory points to the first storage path among one or more storage paths. For the first storage path, the mapped detection thread extracts the location data including the database.

[0037] In the above, the movement detection module is a control component driven by an external device to perform storage path detection on any storage area in the memory during or after data storage. When the movement detection module is driven by an external device to move the pointer to any storage area in the memory, the processor loads the mapping table, and obtains at least one first storage path corresponding to the detection thread by inversely solving the mapping table. For the first storage path, the mapped detection thread extracts the location data including the database.

[0038] In the above, the external device can be understood as a device that uses a mouse or a mouse-like device to control the display, which is similar to the mouse control when operating a computer desktop. Of course, it can also be achieved by touching the display screen with a hand or an electronic pen. The specific method is based on the auxiliary device that comes with the computer.

[0039] The main principle of the present invention is as follows: the present invention detects the location data of the database in the data system through the path detector of the data system, and stores the location data in the address register of the processor in sequence. When the processor divides the memory into storage areas, each of the divisions is configured to generate one or more storage paths according to the location data of the database in the data system under the configuration of the processor, so that the database and the storage area can be associated through the storage path. When tracing the data, only the storage path needs to be known to simultaneously understand the storage address and the location of the corresponding database. Therefore, the present invention configures one or more storage paths generated by the same location data to correspond to the detection path of the path detector; and each of the one or more storage paths is uniquely mapped to the detection thread in the one or more detection paths to form a mapping table; the processor controls the movement of the pointer on the memory to point to the first storage path in the one or more storage paths, and for the first storage path, the mapped detection thread extracts the location data including the database.

[0040] Example 2

[0041] The present invention also provides a big data detection system, comprising:

[0042] A memory, the memory being configured to have a plurality of storage areas;

[0043] a path detector configured to detect location data of a database in a data system; and

[0044] a processor coupled to the path detector and the memory, and configured to:

[0045] The storage area is configured to generate one or more storage paths according to the position data of the database in the data system; the one or more storage paths generated by the same position data are configured to correspond to and match the detection path of the path detector;

[0046] Uniquely mapping each of the one or more storage paths to a detection thread in the one or more detection paths to form a mapping table; and

[0047] By controlling the movement of the pointer on the memory to point to a first storage path among the one or more storage paths, the mapped detection thread extracts the location data including the database for the first storage path.

[0048] In the above, the present invention detects the location data of the database in the data system through the path detector of the data system, and stores the location data in the address register of the processor in sequence. When the processor divides the memory into storage areas, each of the divisions is configured to generate one or more storage paths according to the location data of the database in the data system under the configuration of the processor, so that the database and the storage area can be associated through the storage path. When tracing the data, only the storage path needs to be known to simultaneously understand the storage address and the location of the corresponding database. Therefore, the present invention configures one or more storage paths generated by the same location data to correspond to the detection path of the path detector; and each of the one or more storage paths is uniquely mapped to the detection thread in one or more detection paths to form a mapping table; the processor controls the movement of the pointer on the memory to point to the first storage path in the one or more storage paths, and for the first storage path, the mapped detection thread extracts the location data including the database.

[0049] In the above, the detection thread configured by the detection path selected by the path detector is dynamically coupled with the pointer, the pointer is dynamically coupled and switched between different detection threads, and the corresponding storage path is derived by the detection thread through the mapping table, and the storage path is marked as the first storage path.

[0050] In the above, the memory is divided into storage areas according to the configuration type of the database in the data system; and databases of the same type correspond to the same storage area.

[0051] In the above, the processor has:

[0052] A first configuration module, coupled to the memory, for generating one or more storage paths according to the location data of the database in the data system, and corresponding the one or more storage paths to the storage area;

[0053] a second configuration module, connected to the path detector, configured to configure one or more storage paths generated by the same position data to correspond to and match the detection path of the path detector; and uniquely map each of the one or more storage paths to a detection thread in the one or more detection paths to form a mapping table;

[0054] A mobile detection module, the mobile detection module has a pointer for display, and the mobile detection module is controlled by an external device to move on any storage area of ​​the memory, so that the movement of the pointer on the memory points to a first storage path among one or more storage paths. For the first storage path, the mapped detection thread extracts the location data including the database.

[0055] In the above, the movement detection module is a control component driven by an external device to perform storage path detection on any storage area in the memory during or after data storage.

[0056] In the above, when the mobile detection module is driven by an external device to move the pointer to any storage area in the memory, at this time, the processor loads the mapping table, and obtains at least one first storage path corresponding to the detection thread by inversely parsing the mapping table. For the first storage path, the mapped detection thread extracts the location data including the database.

[0057] The present invention provides a method for associating a database, a storage path and a storage area according to the establishment of a storage path when storing data. When detecting the storage location and source of the data, it is only necessary to correspond the detection thread of the path detector to the storage path. Not only can the data be traced, but also the storage location of the data can be detected.

[0058] In this specification, example embodiments have been presented based on a selected set of details. However, one of ordinary skill in the art will appreciate that many other example embodiments including different selected sets of these details may be practiced. It is intended that the appended claims cover all possible example embodiments.

Claims

1. A big data detection method, characterized in that: The steps include: Detecting the location data of the database in the data system through a path detector of the data system; Dividing a memory into a plurality of storage areas, wherein the storage areas are configured to generate one or more storage paths according to the position data of the database in the data system, wherein the one or more storage paths generated by the same position data are configured to correspond to and match the detection paths of the path detector; and each of the one or more storage paths is uniquely mapped to a detection thread in the one or more detection paths to form a mapping table; Controlling, by a processor, movement of a pointer on the memory to point to a first storage path among one or more storage paths, wherein the mapped detection thread extracts location data including the database for the first storage path; When the processor controls the movement of the pointer on the memory, the detection thread configured by the detection path selected by the path detector is dynamically coupled with the pointer, and the pointer is dynamically coupled and switched between different detection threads. The corresponding storage path is derived by the detection thread through the mapping table, and the storage path is marked as the first storage path.

2. A big data detection system, characterized in that: include: A memory, the memory being configured to have a plurality of storage areas; a path detector configured to detect location data of a database in a data system; as well as a processor coupled to the path detector and the memory, and configured to: The storage area is configured to generate one or more storage paths according to the position data of the database in the data system; the one or more storage paths generated by the same position data are configured to correspond to and match the detection path of the path detector; Uniquely mapping each of the one or more storage paths to a detection thread in the one or more detection paths to form a mapping table; as well as By controlling the movement of the pointer on the memory to point to a first storage path among the one or more storage paths, the mapped detection thread extracts the location data including the database for the first storage path; By dynamically coupling the detection thread configured by the detection path selected by the path detector with the pointer, dynamically coupling and switching the pointer between different detection threads, the corresponding storage path is derived by the detection thread through the mapping table, and the storage path is marked as the first storage path.

3. The big data detection system according to claim 2, characterized in that: The memory is divided into storage areas according to the configuration type of the database in the data system; and databases of the same type correspond to the same storage area.

4. The big data detection system according to claim 2, characterized in that: The processor has: A first configuration module, coupled to the memory, for generating one or more storage paths according to the location data of the database in the data system, and corresponding the one or more storage paths to the storage area; A second configuration module, connected to the path detector, configured to configure one or more storage paths generated by the same position data to correspond to and match the detection path of the path detector; and uniquely mapping each of the one or more storage paths to a detection thread in the one or more detection paths to form a mapping table; A mobile detection module, the mobile detection module has a pointer for display, and the mobile detection module is controlled by an external device to move on any storage area of ​​the memory, so that the movement of the pointer on the memory points to a first storage path among one or more storage paths. For the first storage path, the mapped detection thread extracts the location data including the database.

5. The big data detection system according to claim 4, characterized in that: The movement detection module is a control component driven by an external device to perform storage path detection on any storage area in the memory during or after data storage.

6. The big data detection system according to claim 4, characterized in that: When the mobile detection module is driven by an external device to move the pointer to any storage area in the memory, the processor loads the mapping table, and obtains at least one first storage path corresponding to the detection thread by inversely decoding the mapping table. For the first storage path, the mapped detection thread extracts the location data including the database.

Images