Database management system and data management method

Abstract

The invention discloses a database management system and a data management method, the system comprises a data server and a first client, the first client is connected with at least one terminal device, the first client is connected with the data server, and the data server comprises a first database and a second database; wherein the first client is configured to receive to-be-processed data sent by the terminal device, store the to-be-processed data and send the to-be-processed data to the data server; the data server is configured to receive the to-be-processed data, process the to-be-processed data of which the data type belongs to a text type to obtain structured data and store the structured data in the first database, and process the to-be-processed data of which the data type belongs to a non-text type to obtain non-structured data and store the non-structured data in the second database; and storing the data to the second database. The response rate of the access data is improved.

Description

Technical Field

[0001] The present application relates to the field of semiconductor technology, and in particular to a database management system and a data management method. Background Art

[0002] At present, semiconductor FAB (FAB stands for Fabrication, which means manufacturing) mainly uses EES (Equipment Engineering System, abbreviated as EES, which means equipment engineering system) to realize data monitoring, control, analysis and management.

[0003] However, there are a wide variety of measurement data stored on the equipment during the semiconductor manufacturing cycle. If these measurement data need to be scheduled for use, the data management system needs to establish a unified interface to improve the slow response rate for accessing the measurement data. Summary of the invention

[0004] The present application provides a database management system and a data management method, which can improve the response rate and achieve the purpose of rapid access to data.

[0005] The present application provides a database management system, comprising:

[0006] A data server and a first client, wherein the first client is connected to at least one terminal device, the first client is connected to the data server, and the data server includes a first database and a second database; wherein,

[0007] The first client is configured to receive the data to be processed sent by the terminal device, store and send the data to be processed to the data server;

[0008] The data server is configured to receive the data to be processed, process the data to be processed whose data type is a text type to obtain structured data, and store it in the first database, and process the data to be processed whose data type is a non-text type to obtain unstructured data, and store it in the second database.

[0009] In a second aspect, the present application also provides a data management method, comprising the steps of:

[0010] The first client receives the data to be processed sent by at least one terminal device, stores and sends the data to be processed to a data server; the data server includes a first database and a second database;

[0011] The data server receives the data to be processed;

[0012] The data server processes the to-be-processed data of the text type to obtain structured data, and stores the structured data in the first database; and,

[0013] The data server processes the to-be-processed data of a non-text type to obtain unstructured data, and stores the unstructured data in the second database.

[0014] The embodiment of the present application provides a database management system and a data management method; the database management system includes a data server and a first client, the data server includes a first database and a second database, the first client forwards the to-be-processed data sent by the terminal device to the data server, the data server processes the to-be-processed data of the text type to obtain structured data, and stores it in the first database, and processes the to-be-processed data of the non-text type to obtain unstructured data, and stores it in the second database. The data server stores the to-be-processed data in the first database and the second database according to the text type and the non-text type, respectively, by the data server, so that the structured data and the unstructured data can be stored separately, and the response rate of accessing the data can be improved compared with traversing and searching in the same database. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 A schematic diagram of the structure of a database management system provided by an embodiment of the present application is shown;

[0017] Figure 2 Another structural diagram of a database management system provided by an embodiment of the present application is shown;

[0018] Figure 3 A schematic diagram showing a storage method of unstructured data provided by an embodiment of the present application;

[0019] Figure 4 Another structural diagram of a database management system provided by an embodiment of the present application is shown;

[0020] Figure 5 A flowchart of a database management method provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0021] The following will be combined with the accompanying drawings to clearly and completely describe the technical solutions in some embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments provided in this application, all other embodiments obtained by ordinary technicians in this field belong to the scope of protection of this application.

[0022] In the description of the present application, it should be understood that the terms "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0023] Unless the context requires otherwise, throughout the specification and claims, the term "including" is to be interpreted as an open, inclusive meaning, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "exemplarily" or "some examples" and the like are intended to indicate that specific features, structures, materials or characteristics associated with the embodiment or example are included in at least one embodiment or example of the present application. The schematic representation of the above terms does not necessarily refer to the same embodiment or example. In addition, the specific features, structures, materials or characteristics may be included in any one or more embodiments or examples in any appropriate manner.

[0024] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0025] When describing some embodiments, the expressions "coupled" and "connected" and their derivatives may be used. For example, when describing some embodiments, the term "connected" may be used to indicate that two or more components are in direct physical or electrical contact with each other. For another example, when describing some embodiments, the term "coupled" may be used to indicate that two or more components are in direct physical or electrical contact. However, the term "coupled" may also refer to two or more components that are not in direct contact with each other, but still cooperate or interact with each other. The embodiments disclosed herein are not necessarily limited to the contents of this document.

[0026] “At least one of A, B, and C” has the same meaning as “at least one of A, B, or C” and both include the following combinations of A, B, and C: A only, B only, C only, the combination of A and B, the combination of A and C, the combination of B and C, and the combination of A, B, and C.

[0027] “A and / or B” includes the following three combinations: A only, B only, and a combination of A and B.

[0028] The use of "adapted to" or "configured to" herein is meant to be open and inclusive language that does not exclude devices adapted or configured to perform additional tasks or steps.

[0029] Additionally, the use of “based on” is meant to be open and inclusive, as a process, step, calculation, or other action “based on” one or more stated conditions or values ​​may, in practice, be based on additional conditions or values ​​beyond those stated.

[0030] As used herein, "about," "substantially," or "approximately" includes the stated value and an average value that is within an acceptable range of variation from the particular value as determined by one of ordinary skill in the art taking into account the measurements in question and the errors associated with the measurement of the particular quantity (i.e., the limitations of the measurement system).

[0031] In the context of this application, the meaning of "on", "above", and "over" should be interpreted in the broadest manner, so that "on" not only means "directly on something", but also includes the meaning of "on something" with intervening features or layers in between, and "above" or "over" not only means "above" or "over" something, but also includes the meaning of "above" or "over" something without intervening features or layers in between (i.e., directly on something).

[0032] Since semiconductor manufacturing equipment is compatible with a wide variety of measurement devices and has different data interface forms, if the data is stored on the application server, engineers need to remotely log in to the jump server to obtain the data, which makes it difficult to filter the data, and it takes time and effort to query and analyze the data. Among them, the jump server (also called the front-end machine) is the only way for developers to log in to the application server assigned to the website. Developers must first log in to the jump server, and then log in to the application server through the jump server.

[0033] To improve the above problems, refer to Figure 1 As shown, the embodiment of the present application provides a database management system 100, including:

[0034] A data server 10 and a first client 20, wherein the first client 20 is connected to at least one terminal device 30, the first client 20 is connected to the data server 10, and the data server 10 includes a first database 11 and a second database 12; wherein,

[0035] The first client 20 is configured to receive the data to be processed sent by the terminal device 30, store and send the data to be processed to the data server 10;

[0036] The data server 10 is configured to receive the data to be processed, process the data to be processed whose data type is a text type to obtain structured data, and store it in the first database 11, and process the data to be processed whose data type is a non-text type to obtain unstructured data, and store it in the second database 12.

[0037] Specifically, Figure 1 As shown, the database management system 100 includes a data server 10, a first client 20 and at least one terminal device 30, wherein the at least one terminal device is respectively connected to the first client 20, and the first client 20 is connected to the data server 10. The data server 10 includes a first database 11 and a second database 12. The terminal device 30 can generate or store data to be processed. Since the interface type or communication type supported by the terminal device 30 is different, or the naming method of the data generated by the terminal device 30 is different, the data to be processed generated or stored at the terminal device 30 can be data in any format or with any naming method.

[0038] Among them, structured data is data that is logically expressed and implemented by a two-dimensional table structure. Structured data follows data format and length specifications and is mainly stored and managed through relational databases. Unstructured data is data that is not suitable for being represented by a two-dimensional table in a database. Unstructured data includes office documents of all formats (PDF, DOC, etc.), XML, HTML, pictures, audio, video information and other files.

[0039] In order to standardize the management of different data, the terminal device 30 sends the data to be processed to the first client 20. After receiving the data to be processed sent by the terminal device 30, the first client 20 caches the data to be processed in a local storage area or cache area according to the time sequence of receipt, and forwards the data to be processed to the connected data server 10. After receiving the data to be processed sent by the first client 20, the data server 10 analyzes the data to be processed in the time sequence of receipt to determine its data type. If the data type of the data to be processed is a text type, the text type of the data to be processed is processed to obtain structured data, and then the structured data is stored in the first database 11 of the data processor itself. Of course, if the data type of the data to be processed is a non-text type, the non-text type of the data to be processed is processed to obtain unstructured data, and then the unstructured data is stored in the second database 12 of the data processor itself.

[0040] The present application stores the data to be processed in the first database 11 and the second database 12 according to the text type and the non-text type respectively through the data server 10, so as to realize the separate storage of structured data and non-structured data, and improve the response rate of accessing data compared with traversing and searching in the same database.

[0041] In one embodiment of the present application, the first client 20 is configured as follows:

[0042] Parsing the data to be processed to obtain corresponding data types;

[0043] If the data type does not belong to the image format, determine that the data type of the data to be processed belongs to the text type, store the data to be processed and send it to the data server 10; the image format includes picture format, audio format and video format;

[0044] If the data type belongs to the image format, it is determined that the data type of the data to be processed belongs to the non-text type, and the data to be processed is stored and sent to the data server 10 .

[0045] Specifically, any data or file has its own file suffix or file extension, and the file extension includes but is not limited to txt (a text format for storing text information), audio format (including MP3, MPEG, WMA, etc.), picture format (including bmp, png, jpg, gif, etc.), and video format (MPEG, AVI, MOV, FLV, etc. video encoding files). Image formats include picture formats, audio formats, and video formats.

[0046] After the first client 20 obtains the file extension corresponding to the data to be processed, it can parse or identify the data type of the data to be processed. If the first client 20 identifies that the data type corresponding to the data to be processed does not belong to any of the image formats, the first client 20 determines that the data type of the data to be processed belongs to the text type, and the first client 20 stores the data to be processed that belongs to the text type locally, and sends the data to be processed that belongs to the text type to the data server 10. Of course, if the first client 20 identifies that the data type corresponding to the data to be processed belongs to any of the image formats, the first client 20 determines that the data type of the data to be processed belongs to the non-text type, and the first client 20 stores the data to be processed that belongs to the non-text type locally, and sends the data to be processed that belongs to the text type to the data server 10.

[0047] In the embodiment of the present application, the identification of the data type of the data to be identified is performed by the first client 20, which can reduce the resource usage of the data server 10, reduce the pressure on the data server 10 when there are many concurrent tasks in the system, and improve the efficiency and reliability of the database management system 100 for data management, thereby indirectly improving the response rate of accessing data. In addition, the separate storage of structured data and unstructured data not only achieves risk isolation and improves the response rate of accessing data, but also can achieve the purpose of fast access.

[0048] In one embodiment of the present application, the data server 10 is configured as:

[0049] The data to be processed whose data type belongs to the text type is formatted to generate the structured data in a unified naming format.

[0050] Specifically, the naming of data generally includes the main name of the file and the file extension. The main name of the file includes different dimensions, such as date, data source, key field, etc. Formatting refers to calling the naming rules deployed in the data server 10, formatting the data to be processed to obtain structured data, and formatting is used to convert the original name of the data into a unified naming format to achieve the unification of the data naming format. Assuming that the set naming rules are: key field + data source + date, then it is necessary to uniformly adjust the original names of all the data to be processed to comply with the above naming rules to achieve unified naming.

[0051] Exemplarily, assume that the preset naming rule is that the naming method of the key field is "chip", and the naming method of the chip production date is "year / month / day". Since there is a naming inconsistency problem in the key fields of the data to be processed, for example, the naming method of the key field of the chip may be "chip", "Chip", etc., or the naming method of the chip production date may be "2022-08-10", "2022 / 08 / 10", "2022.08.10", etc., this application uses the preset formatting rules to modify the naming of the data to be processed that does not comply with the above naming rules, so that the naming format is consistent with the above naming rules, and the final data naming format is unified.

[0052] In some embodiments, the storage method of structured data can be block storage, file storage and data dictionary storage. Among them, the data dictionary is a storage of relevant information used by the database. The descriptions of various types of data in the first database 11 are grouped together and can be compared to a dictionary. The data dictionary usually includes five parts: (1) data items; (2) data structures; (3) data flows; (4) data storage; and (5) processing procedures. Among them, data items are the smallest component units of data, and several data items can form a data structure. The data dictionary describes the logical content of data flows and data storage by defining data items and data structures.

[0053] In the embodiment of the present application, the data to be processed is formatted to achieve unified naming, which can improve data query efficiency, reduce the time for the data server 10 to index and query data, reduce the query pressure of the data server 10, and improve the efficiency and reliability of data management of the database management system 100, thereby improving the response rate of accessing data.

[0054] In some embodiments, before formatting the data to be processed, duplicate checking and cleaning are also performed on the data to be processed, that is, redundant or duplicate data with the same data content is found from all the data to be processed and deleted, and then the data to be processed after duplicate checking and cleaning are formatted. Through duplicate checking and cleaning, the number of times the data server 10 performs formatting processing on duplicate data to be processed can be reduced, the resource occupation of the data server 10 can be reduced, and the efficiency and reliability of data management by the database management system 100 can be improved, thereby improving the response rate of accessing data.

[0055] In one embodiment of the present application, the data to be processed further includes a key field, and the data server 10 is further configured as follows:

[0056] The data to be processed whose data type belongs to the non-text type is marked and named according to the key field or the storage path to form the unstructured data, and the storage path is a unique path allocated by the data server 10.

[0057] Specifically, the data to be processed in non-text format includes data in picture format, audio format, video format and other formats. Before the terminal device 30 sends the data to be processed in non-text format to the first client 20, the corresponding key fields will be extracted according to the information content contained in the data to be processed. The key fields can summarize or conclude the information content of the non-text type of data to be processed to the greatest extent. In addition, after the data server 10 obtains the non-text type of data to be processed, it can generate a unique storage path for the corresponding non-text type of data to be processed, or the first client 20 can identify that the data to be processed is of non-text type and apply to the data server 10 for a unique storage path. Then, the data server 10 can mark and name the non-text type of data to be processed by key fields or storage paths to form unstructured data.

[0058] In some embodiments, the storage method of unstructured data can be block storage, file storage, and object storage. Among them, there is no essential difference between object storage, file storage, and block storage, and their underlying hardware media are all hard disks. The difference is that their storage architecture systems are completely different. The operation objects of file storage are files and folders, the operation objects of block storage are disks, and the operation objects of object storage are objects. Among them, block storage has fast reading and writing but is not conducive to sharing, and file storage is conducive to sharing but slow reading and writing. The operation object of object storage is "object". Object storage will store a large number of objects, and each object contains a unique object name (Key UID), data body (that is, the data itself) and metadata (Metadata, data describing the content of the data, mainly information describing the property of the data attribute, used to support functions such as indicating storage location, historical data, resource search, file records, etc.). Among them, the container used to store the storage object (Object) is called storage space or storage bucket (Bucket), which can be referred to as "bucket". Each storage object must belong to a storage bucket. Different buckets have different configuration properties, including region, access rights, storage type, etc. You can create buckets with different properties based on the actual production needs of storing objects.

[0059] In the embodiment of the present application, the storage of unstructured data adopts the object storage method, for example, Figure 3As shown, the data server 10 regularly processes the received non-text type of data to be processed into a complete object, and stores it in the storage bucket corresponding to the storage address previously allocated for the data to be processed to realize object storage. The object storage adopted in this application can provide continuous I / O aggregation bandwidth and throughput for the back-end application services that require more computing nodes. The application services include, for example, consoles, software development kits (SDK) and application programming interfaces (API), with high performance, high reliability, cross-platform and secure data sharing, which greatly improves storage performance.

[0060] In one embodiment of the present application, the first client 20 is further configured as follows:

[0061] Receiving a search instruction from the second client 40, wherein the search instruction includes an index time range of the data to be queried;

[0062] Determine whether the index time range is within a valid storage period range according to the index time range; the valid storage period range is a valid period for the first client 20 to store data;

[0063] If the index time range is within the valid storage period, searching for corresponding data according to the search instruction;

[0064] If the index time range is outside the valid storage period range, the search instruction is forwarded to the data server 10 .

[0065] In one embodiment of the present application, the first client 20 is further configured as follows:

[0066] Delete data whose storage duration reaches the valid storage period.

[0067] Specifically, due to storage capacity reasons, the first client 20 will regularly clear or delete data whose storage time exceeds the preset effective storage time. For example, if the preset effective storage time is 7 days, the storage time is calculated from the time when the first client 20 stores some data, and the data whose storage time reaches 7 days is deleted after 7 days. Since the first client 20 will record the start time of receiving any piece of data to be processed when storing it, the corresponding effective storage period range can be obtained according to the start time of receiving each piece of data to be processed.

[0068] like Figure 4As shown, the database management system 100 further includes at least one second client 40, which is connected to the first client 20. The second client 40 can send a search instruction to the first client 20, and the search instruction includes an index time range of the data to be queried, and the index time range includes a start time and an end time. After receiving the search instruction, the first client 20 determines whether it is within the valid storage time period according to the index time range in the search instruction. If the index time range is within the valid storage time period, the first client 20 can directly search for the corresponding data according to the search instruction and return it to the second client 40. Of course, if the index time range is outside the valid storage time period, it means that the first client 20 has deleted or cleared the data within the index time range. Therefore, the first client 20 forwards the received search instruction to the data server 10, and the data server 10 searches for the corresponding data according to the search instruction, and returns it to the second client 40 directly or through the first client 20.

[0069] In the embodiment of the present application, the second client 40 can directly access the data cached or saved by the first client 20 when it is determined that the index time range is within the effective storage period. Since the amount saved by the first client 20 is small, the second client 40 can quickly find or index the required data, thereby improving data access efficiency. In addition, the search and indexing work of the data to be queried is partially performed by the first client 20, which can reduce the resource occupation of the data server 10, reduce the pressure on the data server 10 when there are many concurrent tasks in the system, and improve the efficiency and reliability of the database management system 100 for data management, thereby indirectly improving the response rate of accessing data.

[0070] In one embodiment of the present application, the search instruction further includes the data type and index condition, and the index condition includes a key field and a storage path; the data server 10 is configured as follows:

[0071] If the data type is the non-text type, searching the second database 12 for corresponding data according to the key field and / or the storage path;

[0072] If the data type is the text type, corresponding data is searched from the first database 11 according to the key field and / or the storage path.

[0073] Specifically, if it is determined that the index time range is outside the valid storage period, the first client 20 forwards the received search instruction to the data server 10. After receiving the search instruction, the data server 10 parses the data type and index condition therein, and the index condition includes a key field and a storage path. In this way, when the data server 10 determines that the data type of the data to be queried is a non-text type, it will search for the corresponding data from the second database 12 in the data server 10 according to the key field and / or storage path. Of course, if the data server 10 determines that the data type of the data to be queried is a text type, it will search for the corresponding data from the first database 11 in the data server 10 according to the key field and / or storage path.

[0074] In one embodiment of the present application, the first client 20 is configured as follows:

[0075] If the data type is the non-text type or the text type, the corresponding data is searched according to the key field and / or the storage path.

[0076] Specifically, if it is determined that the index time range is within the valid storage period, the first client 20 will parse the received search instruction to obtain the data type and index condition, and the index condition includes the key field and storage path. In this way, the first client 20 will search for the corresponding data from the local storage area according to the key field and / or storage path regardless of whether the data type of the data to be queried is a non-text type or a text type.

[0077] In an embodiment of the present application, at least two first clients 20 are included, each of the first clients 20 is connected to at least two terminal devices 30 , and each of the first clients 20 is connected to the data server 10 .

[0078] Specifically, Figure 2 and Figure 4 As shown, the number of first clients 20 includes at least two, the number of terminal devices 30 connected to each first client 20 includes at least two, and each first client 20 is connected to the data server 10. In this way, the embodiment of the present application can build a database management system 100 in the form of a scalable, stable, distributed database storage system + second client 40 architecture by adding distributed first clients 20 between the terminal device 30 and the data server 10. The distributed database management system 100 is built by increasing the number of first clients 20, reducing the resource usage of the data server 10, alleviating the pressure on the data server 10 when there are many concurrent tasks in the system, and improving the efficiency and reliability of the database management system 100 for data management, thereby improving the response rate of accessing data.

[0079] Continuing the above embodiment, the object storage method is used to store the unstructured data. The second client 40 sets a search instruction to the first client 20, and the first client 20 reads or downloads the corresponding data to be queried from the second database 12 in the data server 10. The data acquisition logic is that after the data server 10 obtains the search instruction, it first obtains the structured information table associated with the storage address in the second database 12 according to the search parameters or storage address in the search instruction, and uses the key fields in the structured information table to construct the storage path of the unstructured data associated with it, or the key fields of the unstructured data to access the second database 12 to find and obtain the corresponding unstructured data.

[0080] In one embodiment of the present application, the terminal device 30 includes a processing device 31 for processing and producing a semiconductor product, and a testing device 32 connected to the processing device 31 and used to test the semiconductor product.

[0081] Specifically, the terminal device 30 includes a processing equipment 31 (Equipment, abbreviated as EQP, is a machine used to actually perform semiconductor process operations on raw materials in the semiconductor process, which can set and control various parameters in the semiconductor process) for processing and producing semiconductor products. The processing equipment 31 includes a machine tool for processing and producing semiconductor structures such as wafers and bare crystals. The terminal device 30 can also include a variety of test equipment 32, and the test equipment 32 for various projects can include a test equipment 32 for testing surface defects of wafers, a test equipment 32 for verifying whether the wafer meets the design target, a test equipment 32 for aging test on bare crystals, and a test equipment 32 for electrical test on bare crystals. The present application connects a variety of different terminal devices 30 through the first client 20, provides a large amount of data of different types and dimensions, and improves the comprehensiveness and reliability of data management by the database management system 100.

[0082] In one embodiment of the present application, the data to be processed includes test data of the semiconductor product in a preset form during any batch, and a processing log of the semiconductor product in the processing equipment 31;

[0083] Among them, the preset forms include semiconductor bars, bare chips, wafers, and chips.

[0084] Specifically, the form of semiconductor products includes wafers, which refer to the chips used to make silicon semiconductor integrated circuits. Because of their round shape, they are called wafers. After being cut, the devices on the wafer are called bare crystals (Die), and the bare crystals are processed and packaged to become chips (Chip). Semiconductor bars are between wafers and bare crystals. A group of devices that form a long strip of multiple devices is a semiconductor bar (Bar). In this application, the data to be processed may include data from the test equipment 32 testing semiconductor products in any form. In addition, the data to be processed may also include processing logs of the processing equipment 31 producing and processing semiconductor product devices. The above test data and processing logs do not limit the batches and quantities of semiconductor products.

[0085] Exemplarily, the data to be processed generated by the terminal device 30 is stored in a designated location, and a distributed design is adopted. Each first client 20 (FTP Client, File Transfer Protocol Client, is a client that supports the file transfer protocol) is connected to n terminal devices 30. Once a problem occurs in a first client 20, the terminal device 30 corresponding to the first client 20 with the problem can be automatically allocated to other first clients 20. Based on the need for fast access to data, the second client 40 can directly read the data on the first client 20. Due to the capacity limitation of the first client 20, the first client 20 only stores data temporarily, and the first client 20 sends the data to the data server 10 for long-term storage. The database management system 100 includes a database storage system and a second client 40, wherein the data storage system is subdivided into three parts according to function:

[0086] The first client 20: ensures that the data to be processed generated by the terminal device 30 is output to the first client 20 in real time. Engineers can quickly and timely query the corresponding data to be processed from the first client 20 through the second client 40. At the same time, the potential risk of the second client 40 directly accessing the data from the terminal device 30 is isolated, thereby improving the security of data access.

[0087] Terminal device 30 database: collect, standardize, integrate and align text files from different terminal devices 30, different interfaces and different data formats, clean the data according to application requirements, form a data dictionary and store it in the terminal device 30 database.

[0088] The second database 12 uses object storage to store a huge amount of unstructured data over a long period of time to meet engineers' data needs for analyzing long-term yield trends, correlations between test items, and tracing and reviewing historical data, thereby realizing the function of analyzing long-term data trends.

[0089] Based on the above embodiment, the data type of the data to be processed is separated and stored. By adding a distributed first client 20 between the terminal device 30 and the data server 10, a database management system 100 in the form of an expandable, stable, and distributed database storage system + a second client 40 architecture can be constructed. By increasing the number of first clients 20 to build a distributed database management system 100, subsequent engineers only need to perform simple settings on the second client 40 to drive the database management system 100 to load data and monitor the loading process to ensure the correctness and completeness of the data, and realize data collection and analysis display based on different structural granularities such as batches, wafers, and bare crystals. It saves money on purchasing equipment supporting software, improves the response speed of software upgrades required by business, and is more conducive to customized development for specific needs. Although the integration of resources has increased some storage resources, it has greatly improved work efficiency and data utilization, and the benefits are far greater than the costs, which improves the efficiency of testing and analyzing data.

[0090] Based on the database management system 100 provided in the above embodiment, Figure 5 As shown, the present application also provides a data management method, comprising the steps of:

[0091] S100, a first client 20 receives data to be processed sent by at least one terminal device 30, stores and sends the data to be processed to a data server 10; the data server 10 includes a first database 11 and a second database 12;

[0092] S200, the data server 10 receives the data to be processed;

[0093] S300, the data server 10 processes the data to be processed of the text type to obtain structured data, and stores the structured data in the first database 11; and,

[0094] S400, the data server 10 processes the to-be-processed data of a non-text type to obtain unstructured data, and stores the unstructured data in the second database 12.

[0095] It should be noted that the embodiment of the data management method of the present application corresponds to the above-mentioned database management system 100. The same contents and effects can be found in the above-mentioned embodiment of the database management system 100, which will not be described one by one here.

[0096] In one embodiment of the present application, storing and sending the data to be processed to the data server 10 includes the steps of:

[0097] The first client 20 parses the data to be processed to obtain a corresponding data type;

[0098] If the data type does not belong to the image format, the first client 20 determines that the data type of the to-be-processed data belongs to the text type, stores the to-be-processed data and sends it to the data server 10; the image format includes picture format, audio format and video format;

[0099] If the data type belongs to the image format, the first client 20 determines that the data type of the to-be-processed data belongs to the non-text type, stores the to-be-processed data and sends it to the data server 10 .

[0100] In one embodiment of the present application, the step of performing the first processing to obtain structured data includes:

[0101] The data to be processed whose data type belongs to the text type is formatted to generate the structured data in a unified naming format.

[0102] In one embodiment of the present application, the step of performing the second processing to obtain unstructured data includes:

[0103] The data to be processed whose data type belongs to the non-text type is marked and named according to the key field or the storage path to form the unstructured data, and the storage path is a unique path allocated by the data server 10.

[0104] In one embodiment of the present application, the steps are also included:

[0105] The first client 20 receives a search instruction from the second client 40, wherein the search instruction includes an index time range of the data to be queried;

[0106] The first client 20 determines whether it is within a valid storage period range according to the index time range; the valid storage period range is a valid period for the first client 20 to store data;

[0107] If the index time range is within the valid storage period, the first client 20 searches for corresponding data according to the search instruction;

[0108] If the index time range is outside the effective storage period, the first client 20 forwards the search instruction to the data server 10, and the data server 10 searches for corresponding data according to the search instruction.

[0109] It should be noted that the embodiment of the data management method of the present application corresponds to the above-mentioned database management system 100. The same contents and effects can be found in the above-mentioned embodiment of the database management system 100, which will not be described one by one here.

[0110] The above is a detailed introduction to a database management system 100 and a data management method provided in an embodiment of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A database management system, characterized in that: include: A data server and a first client, wherein the first client is connected to at least one terminal device, the first client is connected to the data server, and the data server includes a first database and a second database; wherein, The first client is configured to receive the data to be processed sent by the terminal device, store and send the data to be processed to the data server; The data server is configured to receive the data to be processed, process the data to be processed whose data type is a text type to obtain structured data, and store it in the first database, and process the data to be processed whose data type is a non-text type to obtain unstructured data, and store it in the second database.

2. The database management system according to claim 1, characterized in that: The first client is configured as: Parsing the data to be processed to obtain corresponding data types; If the data type does not belong to the image format, determining that the data type of the data to be processed belongs to the text type, storing the data to be processed and sending it to the data server; the image format includes picture format, audio format and video format; If the data type belongs to the image format, it is determined that the data type of the data to be processed belongs to the non-text type, and the data to be processed is stored and sent to the data server.

3. The database management system according to claim 2, characterized in that: The data server is configured as follows: The data to be processed whose data type belongs to the text type is formatted to generate the structured data in a unified naming format.

4. The database management system according to claim 1, characterized in that: The data to be processed also includes key fields, and the data server is further configured to: The data to be processed whose data type belongs to a non-text type is marked and named according to the key field or the storage path to form the unstructured data, and the storage path is a unique path allocated by the data server.

5. The database management system according to claim 1, characterized in that: The first client is further configured as: Receiving a search instruction from a second client, wherein the search instruction includes an index time range of data to be queried; Determine whether the index time range is within a valid storage period range according to the index time range; the valid storage period range is a valid period for storing data by the first client; If the index time range is within the valid storage period, searching for corresponding data according to the search instruction; If the index time range is outside the valid storage period, forward the search instruction to the data server.

6. The database management system according to claim 5, characterized in that: The retrieval instruction also includes the data type and index conditions, and the index conditions include key fields and storage paths; the data server is configured to: If the data type is the non-text type, searching the second database for corresponding data according to the key field and / or the storage path; If the data type is the text type, corresponding data is searched from the first database according to the key field and / or the storage path.

7. The database management system according to claim 6, characterized in that: The first client is configured as: If the data type is the non-text type or the text type, the corresponding data is searched according to the key field and / or the storage path.

8. The database management system according to claim 1, characterized in that: The first client is further configured as: Delete data whose storage duration reaches the valid storage period.

9. The database management system according to claim 1, characterized in that: It comprises at least two first clients, each of which is connected to at least two terminal devices, and each of which is connected to the data server.

10. The database management system according to any one of claims 1 to 9, characterized in that: The terminal equipment includes processing equipment for processing and producing semiconductor products, and testing equipment connected to the processing equipment and used to test the semiconductor products.

11. The database management system according to claim 10, characterized in that: The data to be processed include test data of the semiconductor product in a preset form during any batch period, and a processing log of the semiconductor product in the processing equipment; Among them, the preset forms include semiconductor bars, bare chips, wafers, and chips.

12. A data management method, characterized in that: Includes steps: The first client receives the data to be processed sent by at least one terminal device, stores and sends the data to be processed to a data server; the data server includes a first database and a second database; The data server receives the data to be processed; The data server processes the to-be-processed data of the text type to obtain structured data, and stores the structured data in the first database; and, The data server processes the to-be-processed data of a non-text type to obtain unstructured data, and stores the unstructured data in the second database.

13. The data management method according to claim 12, characterized in that: The storing and sending of the to-be-processed data to the data server comprises the steps of: The first client parses the data to be processed to obtain a corresponding data type; If the data type does not belong to the image format, the first client determines that the data type of the data to be processed belongs to the text type, stores the data to be processed and sends it to the data server; the image format includes picture format, audio format and video format; If the data type belongs to the image format, the first client determines that the data type of the data to be processed belongs to the non-text type, stores the data to be processed and sends it to the data server.

14. The data management method according to claim 12, characterized in that: The step of performing the first processing to obtain structured data comprises: The data to be processed whose data type belongs to the text type is formatted to generate the structured data in a unified naming format.

15. The data management method according to claim 12, characterized in that: The data to be processed also includes key fields, and the step of performing the second processing to obtain unstructured data includes: The data to be processed whose data type belongs to a non-text type is marked and named according to the key field or the storage path to form the unstructured data, and the storage path is a unique path allocated by the data server.

16. The data management method according to any one of claims 12 to 15, characterized in that: Also includes the steps: The first client receives a search instruction from the second client, wherein the search instruction includes an index time range of the data to be queried; The first client determines whether the index time range is within a valid storage period range according to the index time range; the valid storage period range is a valid period for the first client to store data; If the index time range is within the valid storage period, the first client searches for corresponding data according to the search instruction; If the index time range is outside the valid storage time period, the first client forwards the search instruction to the data server, and the data server searches for corresponding data according to the search instruction.

Images