A data tiered storage system and method based on magneto-electro-optic medium

Abstract

The application relates to a data hierarchical storage system and method based on a magneto-electro-optical medium, and solves the technical problems that, in order to ensure management efficiency, existing database management data cannot fully utilize the storage security advantages of optical storage media, and source data cannot be decoupled from database dependence. The database management system comprises a record splitting module for splitting records in a database in units of fields, and a record transfer module for forming split field file blocks corresponding to splitting requirements. The optical disc library management system comprises a transition area establishing module for establishing a shared storage area, a file block splitting module for forming sub-file blocks, and a file block optical disc storage module for storing the sub-file blocks to optical discs. When database technology is used to manage key evidence type data assets, the storage security of the data assets is improved while the management efficiency is balanced, data loss caused by database hidden dangers is avoided, and the use approach and application independence of the data assets are further improved.

Description

Technical Field

[0001] This invention relates to the field of database technology, and specifically to a data hierarchical storage system and method based on magneto-electro-optical media. Background Technology

[0002] How to securely and sustainably preserve rapidly growing and accumulating digital information is a major technological challenge facing the information society. Current storage media primarily utilize magnetic media such as magnetic tapes and disks, electrical media such as solid-state drives (SSDs), and optical media such as optical discs. Compared to magnetic and electrical media, optical discs have a longer lifespan, are less affected by environmental factors, and possess energy-free data storage capabilities. The storage capacity of a single optical disc has exceeded 500GB, and with centralized management using optical disc libraries, storage capacity can reach the petabyte (PB) level. The significant advantage of magnetic and electrical media lies in data access and retrieval speeds. Optical discs, limited by speed and the storage structure of files, objects, and blocks, are not suitable for direct full-text retrieval. Existing technologies utilize the optical disc library building technology of patent CN102968460A, which divides a database into several independent sub-databases built on the optical disc according to its capacity. Furthermore, data related to these sub-databases, including but not limited to directory data, metadata, and content data, are stored as corresponding text search data on the disk. During full-text retrieval, all text search data is retrieved, forming an optical disc full-text retrieval technology. This overcomes the technical bottleneck of low content search efficiency in optical disc libraries and significantly improves the management and utilization level of optical disc data. However, since the content data of the original electronic documents or electronic archives is stored in the database, the retrieval process has to rely on the database system. There is a potential risk that such original electronic vouchers may be lost due to database file or database management system failures. Summary of the Invention

[0003] In view of the above problems, embodiments of the present invention provide a data hierarchical storage system and method based on magneto-electric-optical media, which solves the technical problem that existing database management cannot fully utilize the storage security advantages of optical storage media in order to ensure management efficiency, and also makes it impossible to decouple source data (files) from database dependencies.

[0004] The data hierarchical storage system based on magneto-electric-optical media according to this invention includes an optical disc library management system and a database management system, wherein the database management system includes: The record splitting module is used to split records in the database by field based on database feature data according to splitting requirements, and to enter the splitting mark information corresponding to the database feature data of the splitting field into the database management system. The record transfer module is used to transfer the source data of the corresponding split field from the hard disk database to the hard disk transition area according to the split mark information, forming the split field file block corresponding to the split requirements, and entering the file block feature data into the database management system according to the split mark information; The optical disc library management system includes: a transition area establishment module, which is used to respond to the requirements of the database management system, establish a hard disk transition area on the hard disk, and form a shared storage area for hard disk database splitting data transfer and optical disc data source construction; The file block splitting module is used to split the split field file block into sub-file blocks according to the optical disc specification and cache them in the hard disk transition area. The corresponding sub-file blocks are split into file block feature data and entered into the optical disc library management system. The file block optical disc storage module is used to generate control instructions, store sub-file blocks on the optical disc, and input the optical disc association data of the sub-file blocks into the optical disc library management system.

[0005] In one embodiment of the present invention, the database management system further includes: The text index generation module is used to create text index data for each record containing the splitting field in the hard disk database based on the splitting mark information, and write it into the database management system.

[0006] In one embodiment of the present invention, the database management system further includes: The library structure generation module is used to generate independent definition files based on the library structure definition of the database, and to create or extract the library structure of the hard disk database through the independent definition files; The field structure generation module is used to read the field structure information of each record in the hard disk database and write it into the database management system. The field structure information includes the data type and data scale of each field in the record. The index generation module is used to record the index information of each record in the hard disk database and write it into the database management system. The storage space allocation module is used to record the location information of the standard storage unit allocated to each record in the database file; The storage space status module is used to record the capacity information used in the allocated standard storage units in the database file; The record attribute linking module is used to merge the field structure information, index information, location information, and data volume information of records to form database feature data for entry into the database management system.

[0007] In one embodiment of the present invention, the split field file block is a file list organized in a folder structure, or a JSON data set organized in key-value pair form.

[0008] In one embodiment of the present invention, the control instruction includes content filtering / filtering parameters or record index information, and sub-file blocks are selected based on the parameters or index information.

[0009] The data hierarchical storage method based on magneto-electro-optical media according to embodiments of the present invention includes: In response to the requirements of the database management system, a hard disk transition area is established on the hard disk to form a shared storage area for hard disk database splitting and data transfer and optical disk data source construction; Based on the splitting requirements, the records in the database are split by field using database feature data, and the database feature data corresponding to the splitting fields are used to form splitting mark information and entered into the database management system. Based on the splitting marker information, the source data of the corresponding splitting field is transferred from the hard disk database to the hard disk transition area to form the splitting field file block corresponding to the splitting requirements. Based on the splitting marker information, the file block feature data is entered into the database management system. The split field file block is split into sub-file blocks according to the optical disc specification and cached in the hard disk transition area. The corresponding sub-file blocks are split into file block feature data and written into the optical disc library management system. Control commands are generated to store the sub-file blocks on the optical disc, and the optical disc association data of the sub-file blocks is entered into the optical disc library management system.

[0010] In one embodiment of the present invention, it further includes: Based on the splitting marker information, text index data is created for each record in the hard disk database that contains the splitting field, and then written into the database management system.

[0011] In one embodiment of the present invention, it further includes: An independent definition file is formed based on the database's library structure definition. The library structure of the hard disk database is established or extracted through the independent definition file. Read the field structure information of each record in the hard disk database and write it into the database management system. The field structure information includes the data type and data scale of each field in the record. Record the index information of each record in the hard disk database and write it into the database management system; The record contains the location information of the standard storage unit allocated to each record within the database file; Record the capacity information used in the allocated standard storage units in the database file; The recorded field structure information, index information, location information, and data volume information are merged to form database feature data, which is then entered into the database management system.

[0012] In one embodiment of the present invention, file retrieval includes: Based on file query requirements, the database management system locates the record and field containing the file. The field is determined to be in a hierarchical storage state based on the splitting marker information; Determine file block feature data based on splitting marker information; Determine the sub-file block feature data based on the file block feature data; The optical disc library management system determines the storage location of optical discs and files based on sub-file block characteristic data; Extract the CD and read files from it.

[0013] In one embodiment of the present invention, file retrieval includes: Submit a file query request to the CD-ROM library management system; The CD-ROM library management system retrieves and queries file information based on sub-file block feature data; Once it is determined that the disc is within the disc library, the disc is located based on the disc association data. Extract the CD and read files from it.

[0014] This invention relates to a data hierarchical storage system and method based on magneto-electric-optical media. The system extends the functionality of existing database and optical disc library management systems, providing a method for transferring source data of specific fields from a hard disk database to optical disc media. By leveraging the collaborative management of the database and optical disc library management systems, data is stored hierarchically across different media. This ensures that the source data of specific fields is both uniformly managed by the database management system and guarantees a high level of security and independent application flexibility for the source data storage. This is beneficial when using database technology to manage critical evidence-type data assets, effectively improving the storage security of data assets while balancing management efficiency, avoiding data loss due to database vulnerabilities, and further improving the usage and application independence of data assets. Attached Figure Description

[0015] Figure 1 The diagram shown is a schematic representation of the architecture of a data hierarchical storage system based on magneto-electro-optical media according to an embodiment of the present invention.

[0016] Figure 2 The diagram shown is a functional architecture diagram of a data hierarchical storage system based on magneto-electro-optical media according to an embodiment of the present invention.

[0017] Figure 3 The diagram shown is a flowchart of a data hierarchical storage method based on magneto-electro-optical media according to an embodiment of the present invention.

[0018] Figure 4 The diagram shown is a schematic flowchart of a file query service based on a data hierarchical storage method using magneto-electro-optical media according to an embodiment of the present invention.

[0019] Figure 5 The diagram shown is a schematic diagram of the architecture of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0020] To further illustrate the technical means and effects of the present invention in achieving its intended purpose, the following detailed description of the specific implementation methods, structures, features, and effects of the present invention, in conjunction with the accompanying drawings and preferred embodiments, is provided below.

[0021] An embodiment of the present invention provides a data hierarchical storage system based on magneto-electric-optical media, such as... Figure 1 As shown. In Figure 1 The system includes a server 100, an optical disc library 200, and a hard disk storage 300. The server 100 and the optical disc library 200 are connected via optical and electrical transmission links, as are the hard disk storage 300. The operating system on the server 100 includes a database management system 110 and an optical disc library management system 120. The hard disk storage 300 includes drives or drive arrays, and the storage medium can be a hard disk or a solid-state drive. The optical disc library 200 includes an optical drive assembly, a disc changer, and disc trays. The storage medium in the disc trays can be M-disc optical discs, Blu-ray discs, or glass discs.

[0022] The data hierarchical storage system based on magneto-electric-optical media in this invention utilizes common disk read / write technology and optical disk read / write technology to construct controllable storage resources based on magneto-electric and optical media, providing a basic storage architecture for the media and application requirements of data hierarchical storage.

[0023] The functional architecture of a data hierarchical storage system based on magneto-electric-optical media according to an embodiment of the present invention is as follows: Figure 2 As shown. In Figure 2 In China, combined Figure 1 As shown, this embodiment includes: The database management system 110 is used to respond to data requests and manage the hard disk database 310 and the data in the hard disk database.

[0024] The optical disc library management system 120 is used to respond to hierarchical storage requests, form a data cache to carry part of the data in the hard disk database, and manage file blocks 330 (or sub-file blocks 340) and data on the optical disc 230 based on the cached data. Simultaneously, the optical disc library management system 120 is also used to form state control and state awareness of the electromechanical control mechanism of the optical disc library. State control includes, but is not limited to, driving the optical disc drive, changing discs, and resetting the mechanism. State awareness includes, but is not limited to, optical disc type and quantity, burning status, current optical disc capacity, and data reading status. Depending on the matching degree between the optical disc capacity and the file block size, there are cases where file block 330 does not need to be split and can become sub-file block 340; that is, zero splitting of file block 330 results in sub-file block 340.

[0025] like Figure 2In one embodiment of the present invention, the data infrastructure management module in the database management system includes: The library structure generation module u1 is used to generate independent definition files based on the library structure definition of the database, and to create or extract the library structure of the hard disk database through the independent definition files.

[0026] The database structure definition includes, but is not limited to, database definitions, table column constraints, index definitions, views, stored procedures, triggers, and permission definitions. The database management system 110 establishes the basic structure and functions of the disk database through independent definition files. The database management system 110 can either create a corresponding disk database 310 on the disk storage 300 based on the independent definition files, or it can create independent definition files based on the database structure of the database files managed by the disk database.

[0027] The field structure generation module u2 is used to read the field structure information of each record in the hard disk database and write it into the database management system. The field structure information includes the data type and data scale of each field in the record.

[0028] In relational databases, the field structure within tables is stable, and the field structure of each record can remain consistent. In non-relational databases, the field structure within collections is flexible, and the field structure of each record can vary. The data organization structure of records in a database can be quantified by extracting information from the field structure.

[0029] The record index generation module u3 is used to record the index information of each record in the hard disk database and write it into the database management system.

[0030] Index information is formed by extracting the storage information of each record (or document) in the database on the hard disk, including but not limited to the control block, record number index, empty space table and data block of the database file managed by the database management system 110. Through the index information, fine-grained dynamic statistical information such as the modification time, modification content and data capacity of each field in the identified record can be obtained.

[0031] The storage space allocation module u4 is used to record the location information of the standard storage unit allocated to each record in the database file.

[0032] This method extracts the standard storage units allocated to all fields of a record to quantify the data location and maximum storage capacity usage of each record. The standard storage unit is related to the storage medium and management tools. For example, based on the partition version of the operating system, the standard storage unit can be a number of sectors.

[0033] The storage space status module u5 is used to record the capacity information used in the allocated standard storage units in the database file.

[0034] Based on the fields of a record, extract the utilization status of the standard storage units allocated to all fields of a record to quantify the actual data volume occupied by the effective data payload of each record during data location.

[0035] The effective data payload of each field is quantified by the maximum data occupancy and the actual data occupancy, thus filtering out the differences in storage capacity of the operating system for different physical storage media.

[0036] The record attribute linking module u6 is used to merge the field structure information, index information, location information, and data volume information of records to form database feature data for entry into the database management system.

[0037] The granularity of the effective data payload of each field in a database file is determined by combining field structure information, index information, location information, and data volume information. The database characteristic data of the database file is dynamically updated with database operations, serving as management data for the database management system of the online disk database.

[0038] The data hierarchical storage system based on magneto-electric-optical media in this invention responds to corresponding data requirements through the database management system and dynamically forms data characteristics of database files related to data organization during the data operation process. This ensures the continuous quantification of hard disk database structure, record structure, and data capacity, and provides quantification methods of different granularities and dimensions for data payload and database splitting, merging, and synchronization.

[0039] Combination Figure 1 and Figure 2 As shown, in one embodiment of the present invention, the hierarchical storage management module in the database management system includes: The record splitting module u7 is used to split records in the database by field based on database feature data according to splitting requirements, and to enter the splitting mark information corresponding to the database feature data of the splitting field into the database management system.

[0040] Database feature data allows for the quantification of records or documents within a database across different dimensions. Based on specific fields defined by the splitting requirements, database feature data can pinpoint the data type, volume, and location of these fields. It also determines the index relationship between the field and related records, clarifies the attributes and data source of the splitting field, and accurately quantifies the effective data payload of that specific field. By extracting database feature data from specific splitting fields to form splitting marker information, management mapping data is created within the database management system, mapping the attributes and data sources of the splitting fields (sets) that meet the splitting requirements.

[0041] The field transfer module u8 is used to transfer the source data of the corresponding split field from the hard disk database to the hard disk transition area 320 according to the split mark information, forming the split field file block 330 corresponding to the split requirements, and entering the file block feature data into the database management system according to the split mark information.

[0042] The source data for a split field typically refers to the formatted source data mapped to that field in a record, such as original public format files or original images, audio, and video (i.e., the content data of electronic archives). Different records can have the same field, and the source data for the same field has a consistent format. Source data with different fields in different records can have the same or different formats. The split field file block 330 normalizes the attributes and source data of the split field to the disk transition area, forming a data region relatively independent of the disk database.

[0043] In one embodiment of the present invention, the source data of the split field in the hard disk database is deleted after the hierarchical data storage is established. In another embodiment, the file block feature data, split marker information, and the attributes of the file block feature data have a corresponding or mapping relationship. The file block feature data includes, but is not limited to, attributes such as field structure information, index information, location information, and data volume information. The file block feature data may also include the data organization structure information of the mapped split field file blocks. The organization form of the split field file blocks is formed according to preset rules based on the field attributes. It can be a file list organized in a folder structure, or a JSON data collection organized in key-value pairs using split marker information.

[0044] like Figure 2 As shown, in one embodiment of the present invention, it further includes: The text index generation module u12 is used to create text index data for each record containing the splitting field in the hard disk database based on the splitting mark information, and write it into the database management system.

[0045] Text index data includes the frequency of each character in each field of a record and its position in each record. Characters include at least one of the following: words, phrases, and numbers. Text index data is correlated with the index information in the database feature data of the records, and the text index can be used to locate elements within the record index.

[0046] In one embodiment of the present invention, the text index data applies to all records in the hard disk database, including records containing split fields.

[0047] The data hierarchical storage system based on magneto-electric-optical media in this invention forms a hard disk transition area under indirect data management by the database management system based on the characteristics of field data types. Fields containing independent and complete source data are transferred from the hard disk database to the hard disk transition area as the focus of splitting, so that key source data can be used independently while being directly managed by the database management system.

[0048] Combination Figure 1 and Figure 2 As shown, in one embodiment of the present invention, the optical disc library management system includes: The transition zone creation module u9 is used to respond to the requirements of the database management system, create a hard disk transition zone on the hard disk, and form a shared storage area for hard disk database splitting and data transfer and optical disk data source construction.

[0049] By constructing a hard disk transition zone, the optical disc library management system gains read and write permissions to the hard disk authorized by the operating system. This authorization from the optical disc library management system then grants the database management system read and write permissions to the hard disk transition zone. Simultaneously, database data transfer processing occurs within the hard disk transition zone, and a process is initiated to reconstruct the optical disc (database) data source based on the database data. This ensures data exchange and synchronization between different fields of source data during the hierarchical storage process between magnetoelectric and optical storage media.

[0050] The file block splitting module u10 is used to split the split field file block 330 into sub-file blocks 340 according to the optical disc specification and cache them in the hard disk transition area. The corresponding sub-file blocks are split into file block feature data and entered into the optical disc library management system.

[0051] The optical disc library management system 120 splits the data volume according to the perceived optical disc specifications and capacity in the optical disc library. Each sub-file block corresponds to one optical disc (utilizing all or part of the effective storage space of the optical disc). The file block feature data is split according to the sub-file blocks to form sub-file block feature data corresponding to the sub-file blocks. The sub-file block feature data includes, but is not limited to, record index, field index and source data attributes, data location and data volume.

[0052] In one embodiment of the present invention, the sub-file block cache in the hard disk transition area can be either directly forming a set of sub-file blocks and replacing the original split field file, or performing logical splitting and marking on the existing split field file.

[0053] The file block optical disc storage module u11 is used to generate control commands to store sub-file blocks on the optical disc and to input the optical disc association data of the sub-file blocks into the optical disc library management system.

[0054] The control command can be triggered manually or by the optical disc library management system 120. The control command instructs the optical disc library to burn a sub-file block and its corresponding sub-file block feature data from the hard disk transition area onto an optical disc, until all sub-file blocks are burned onto the optical disc.

[0055] In one embodiment of the present invention, the control instructions include content filtering / selection parameters or record index information. By selecting sub-file blocks based on the parameters or index information, several sub-file blocks and their corresponding sub-file block feature data can be burned onto a high-capacity optical disc. Subsequent categorized storage and rapid retrieval can be achieved based on the sub-file block feature data in the optical disc library management system 120 and the sub-file block feature data on the optical disc.

[0056] In one embodiment of the present invention, the feature data of the corresponding sub-file block is recorded into an optical disc.

[0057] This invention's data tiered storage system based on magneto-electric-optical media extends the functionality of existing database and optical disc library management systems. It allows for the transfer of source data for specific fields from a hard disk database to optical disc media. By leveraging the collaborative management of both the database and optical disc library management systems, it achieves tiered data storage across different media. This ensures that the source data for specific fields is both uniformly managed by the database management system and guarantees a high level of security and independent application flexibility for the source data storage. This is beneficial when using database technology to manage critical evidence-type data assets, effectively improving data asset storage security while maintaining management efficiency. It also prevents data loss due to database vulnerabilities and further enhances the usability and application independence of data assets.

[0058] The database management system (DBMS) uses the resulting database feature data to define the source data of fields in database records. A source data transfer channel and a data organization structure conversion channel between the CD-ROM library management system and the DBMS are established through a hard disk transition area. By using the splitting marker information of split fields during the source data transfer process, the file block feature data of the hard disk transition area, and the sub-file block feature data of the CD-ROM, a dynamic association is formed with the records and fields in the database feature data. This allows the DBMS's retrieval and query services to be smoothly performed using the CD-ROM library management system, and to quickly locate data based on the sub-file block feature data. Furthermore, full-text text search of the split fields forms additional text search resources, ensuring that the DBMS's retrieval and query services for text content, (directory) structure data, and (summary) metadata maintain their original performance.

[0059] In one embodiment of the present invention, the database management system 110 adopts the YIYE database management system, the optical disc library 200 adopts the YIYE optical disc library, model YIYE105. The YIYE105 can hold 105 optical discs and install 4 optical drives. The optical disc library management system 120 adopts the YIYE optical disc library management software.

[0060] In practical applications, the database management system can perform full-text indexing on the hard disk database, store the text index data on the hard disk, and then separate the source data of some fields from the database and store them as sub-file blocks on the optical disc. When providing retrieval services, it is neither necessary to restore the sub-file blocks from each optical disc to the hard disk and then link them, nor is it necessary to restore the data of the sub-file blocks to the hard disk database. Instead, full-text retrieval is performed directly on the sub-file blocks of each optical disc in the optical disc library, achieving retrieval speeds in the second range. The optical disc library management system retrieves the data from the sub-file blocks on the optical disc based on the retrieval results and the sub-file block feature data, achieving retrieval speeds in the second range as well. This effectively solves the technical problems of managing and accessing large-scale data, making the response performance of the sub-file blocks in the optical disc library approach that of online storage on hard disks. This expands the application areas of optical storage media, can partially replace hard disks, solid-state drives, and magnetic tapes, and provides a good solution for widely implementing high-reliability data storage, demonstrating practical value.

[0061] An embodiment of the present invention provides a hierarchical data storage method based on magneto-electro-optical media, as follows: Figure 3 As shown. In Figure 3 In this embodiment, the data hierarchical storage system based on magneto-electro-optical media described in the above embodiments is included: Step 610: In response to the database management system's requirements, establish a hard disk transition area on the hard disk to form a shared storage area for hard disk database splitting and data transfer and optical disk data source construction; Step 620: Based on the splitting requirements, split the records in the database by field using database feature data, and enter the splitting mark information corresponding to the splitting fields into the database management system. Step 630: Transfer the source data of the corresponding split field from the hard disk database to the hard disk transition area according to the split mark information to form the split field file block corresponding to the split requirements, and enter the file block feature data into the database management system according to the split mark information; Step 640: The split field file block is split into sub-file blocks according to the optical disc specification and cached in the hard disk transition area. The corresponding sub-file blocks are split into file block feature data and written into the optical disc library management system. Step 650: Generate control instructions, store the sub-file block on the optical disc, and enter the optical disc association data of the sub-file block into the optical disc library management system.

[0062] The data hierarchical storage method based on magneto-electric-optical media in this invention, through the collaborative management of a database management system and an optical disc library management system, enables the transfer of source data across different storage media while maintaining the effectiveness and smoothness of the data services provided by the database management system. Data hierarchical storage enhances the flexibility of the transferred source data in various usage scenarios and improves storage security. Especially for the content data of electronic archives sealed in digital media, it can achieve extremely high secure storage durations and information security independent of the vulnerabilities of online management systems.

[0063] like Figure 3 As shown, in one embodiment of the present invention, it further includes: Step 600: Based on the splitting marker information, create text index data for each record in the hard disk database that contains the splitting field, and write it into the database management system.

[0064] The data hierarchical storage method based on magneto-electric-optical media in this invention constructs text index data by combining the fields corresponding to the hierarchically stored source data and the textual information in the records, and constructs full-text text index data by combining the textual information of other records. It utilizes the performance advantages of hard disk databases to provide high-performance retrieval and query services, and ensures the basic service performance of the database management system after data hierarchical storage.

[0065] like Figure 3 As shown, in one embodiment of the present invention, it further includes: Step 510: Create an independent definition file based on the database structure definition, and use the independent definition file to establish or extract the database structure of the hard disk database; Step 520: Read the field structure information of each record in the hard disk database and write it into the database management system. The field structure information includes the data type and data scale of each field in the record. Step 530: Record the index information of each record in the hard disk database and write it into the database management system; Step 540: Record the location information of the standard storage unit allocated for each record in the database file; Step 550: Record the capacity information used in the allocated standard storage units in the database file; Step 560: Merge the recorded field structure information, index information, location information, and data volume information to form database feature data and enter it into the database management system.

[0066] The data hierarchical storage method based on magneto-electric-optical media in this invention provides a fine-grained quantitative attribute extraction process for existing database files. It quantifies the accurate mapping and association between records, fields, and source data in the database file by forming database feature data. This allows the effective data payload of fields to be independently quantified, measured, and labeled.

[0067] In practical applications, a specific method for transferring partial data from a hard disk database to a sub-file block on an optical disc in an optical disc library involves the following steps: Step 1: Establish a connection between the server and the optical disc library, and establish a data connection between the server and the hard disk storage. Step 2: Install the database management system and CD-ROM library management system on the server; Step 3: Set the virtual CD-ROM library drive letter in the configuration file, such as MYBD=Z:\, where MYBD is the virtual CD-ROM library drive letter and Z is the CD-ROM library drive letter; Step 4: Use a database management system to create a hard disk database, such as an MDB, on the hard disk storage. Step 5: Create full-text text index data for the hard disk database MDB; use the optical disc library management system to create a hard disk transition area on the hard disk storage. Step 6: Use the database management system to create a file block, such as BU, in the hard disk transition area, and enter some data from the database into file block 330; Step 7: Use the optical disc library management system to split the file block into several sub-file blocks 340 according to the optical disc capacity, such as SBU1, SBU2, SBU3, etc. The capacity of each sub-file block is smaller than the capacity of a single optical disc, and they are stored in the hard disk transition area. Step 8: Use the optical disc library management system to create volume labels (disk names) on the optical discs in optical disc library 200. Step 9: Execute the command of the optical disc library management system, such as "MYBD:SBU", to move each sub-file block "SBU" in the hard disk transition area to optical disc 230 in the optical disc library.

[0068] An embodiment of the present invention provides a file query service based on a data hierarchical storage method using magneto-electro-optical media, such as... Figure 4 As shown. In Figure 4 In this embodiment, the following are included: Step 710: Based on the file query requirements, the database management system queries and locates the record and field containing the file; Step 720: Determine the field's hierarchical storage status based on the splitting marker information; Step 730: Determine file block feature data based on split marker information; Step 740: Determine the sub-file block feature data based on the file block feature data; Step 750: The optical disc library management system determines the storage location of the optical disc and files based on the sub-file block characteristic data; Step 760: Extract the CD and read the files from it.

[0069] The data hierarchical storage method based on magneto-electric-optical media in this invention provides an implementation process for the basic services of a database management system after data hierarchical storage. It utilizes the sequential mapping and association of feature data in the hierarchical process stored in the database management system and the optical disc library management system to form a query process for query content. It balances query performance according to the characteristics of different services. For queries of coded text, it uses full-text text index data for text query. For queries that retrieve the entire digital file, it uses sub-file block feature data and optical disc management data stored in the optical disc library management system for query.

[0070] An embodiment of the present invention provides a file query service based on a data hierarchical storage method using magneto-electro-optical media, as follows: Submit a file query request to the CD-ROM library management system; The CD-ROM library management system retrieves and queries file information based on sub-file block feature data; Once it is determined that the disc is within the disc library, the disc is located based on the disc association data. Extract the CD and read files from it.

[0071] The data hierarchical storage method based on magneto-electro-optical media in this invention can treat the optical disc library management system as an independent data management system for independent files, and can realize basic file services without relying on the database management system, providing a decoupling mechanism between database and data storage.

[0072] This application also provides an electronic device, the structure of which is as follows: Figure 5 As shown, the electronic device 4000 includes at least one processor 4001, a memory 4002, and a bus 4003. At least one processor 4001 is electrically connected to the memory 4002. The memory 4002 is configured to store at least one computer-executable instruction, and the processor 4001 is configured to execute the at least one computer-executable instruction, thereby performing the steps of the data hierarchical storage method based on magneto-electro-optical media provided in any embodiment or optional implementation of this application.

[0073] Furthermore, the processor 4001 can be an FPGA (Field-Programmable Gate Array) or other devices with logic processing capabilities, such as an MCU (Microcontroller Unit) or a CPU (Central Processing Unit).

[0074] This application also provides another computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the data hierarchical storage method based on magneto-electro-optical media provided in any embodiment or optional implementation of this application.

[0075] The computer-readable storage media provided in this application include, but are not limited to, any type of disk (including floppy disk, hard disk, optical disk, and magneto-optical disk), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, and magnetic cards. In other words, readable storage media include any medium by which a device (e.g., a computer) stores or transmits information in a readable form.

[0076] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention in any way. Although the present invention has been disclosed above with reference to preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications or alterations to the above-disclosed technical content to create equivalent embodiments without departing from the scope of the present invention. Any simple modifications, equivalent changes and alterations made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the scope of the present invention.

Claims

1. A data hierarchical storage system based on magneto-electric-optical media, comprising an optical disc library management system and a database management system, characterized in that, The database management system includes: The record splitting module is used to split records in the database by field based on database feature data according to splitting requirements, and to enter the splitting mark information corresponding to the database feature data of the splitting field into the database management system. The record transfer module is used to transfer the source data of the corresponding split field from the hard disk database to the hard disk transition area according to the split mark information, forming the split field file block corresponding to the split requirements, and entering the file block feature data into the database management system according to the split mark information; The optical disc library management system includes: a transition area establishment module, which is used to respond to the requirements of the database management system, establish a hard disk transition area on the hard disk, and form a shared storage area for hard disk database splitting data transfer and optical disc data source construction; The file block splitting module is used to split the split field file block into sub-file blocks according to the optical disc specification and cache them in the hard disk transition area. The corresponding sub-file blocks are split into file block feature data and entered into the optical disc library management system. The file block optical disc storage module is used to generate control instructions, store sub-file blocks on the optical disc, and input the optical disc association data of the sub-file blocks into the optical disc library management system.

2. The data hierarchical storage system based on magneto-electro-optical media according to claim 1, characterized in that, The database management system also includes: The text index generation module is used to create text index data for each record containing the splitting field in the hard disk database based on the splitting mark information, and write it into the database management system.

3. The data hierarchical storage system based on magneto-electro-optical media according to claim 1, characterized in that, The database management system also includes: The library structure generation module is used to generate independent definition files based on the library structure definition of the database, and to create or extract the library structure of the hard disk database through the independent definition files; The field structure generation module is used to read the field structure information of each record in the hard disk database and write it into the database management system. The field structure information includes the data type and data scale of each field in the record. The index generation module is used to record the index information of each record in the hard disk database and write it into the database management system. The storage space allocation module is used to record the location information of the standard storage unit allocated to each record in the database file; The storage space status module is used to record the capacity information used in the allocated standard storage units in the database file; The record attribute linking module is used to merge the field structure information, index information, location information, and data volume information of records to form database feature data for entry into the database management system.

4. The data hierarchical storage system based on magneto-electro-optical media according to claim 1, characterized in that, The split field file blocks are either a list of files organized in a folder structure or a collection of JSON data organized in key-value pairs.

5. The data hierarchical storage system based on magneto-electro-optical media according to claim 1, characterized in that, The control instructions include content filtering / filtering parameters or record index information, and sub-file blocks are selected based on the parameters or index information.

6. A hierarchical data storage method based on magneto-electro-optical media, characterized in that, include: In response to the requirements of the database management system, a hard disk transition area is established on the hard disk to form a shared storage area for hard disk database splitting and data transfer and optical disk data source construction; Based on the splitting requirements, the records in the database are split by field using database feature data, and the database feature data corresponding to the splitting fields are used to form splitting mark information and entered into the database management system. Based on the splitting marker information, the source data of the corresponding splitting field is transferred from the hard disk database to the hard disk transition area to form the splitting field file block corresponding to the splitting requirements. Based on the splitting marker information, the file block feature data is entered into the database management system. The split field file block is split into sub-file blocks according to the optical disc specification and cached in the hard disk transition area. The corresponding sub-file blocks are split into file block feature data and written into the optical disc library management system. Control commands are generated to store the sub-file blocks on the optical disc, and the optical disc association data of the sub-file blocks is entered into the optical disc library management system.

7. The data hierarchical storage method based on magneto-electro-optical media according to claim 6, characterized in that, Also includes: Based on the splitting marker information, text index data is created for each record in the hard disk database that contains the splitting field, and then written into the database management system.

8. The data hierarchical storage method based on magneto-electro-optical media according to claim 6, characterized in that, Also includes: An independent definition file is formed based on the database's library structure definition. The library structure of the hard disk database is established or extracted through the independent definition file. Read the field structure information of each record in the hard disk database and write it into the database management system. The field structure information includes the data type and data scale of each field in the record. Record the index information of each record in the hard disk database and write it into the database management system; The record contains the location information of the standard storage unit allocated to each record within the database file; Record the capacity information used in the allocated standard storage units in the database file; The recorded field structure information, index information, location information, and data volume information are merged to form database feature data, which is then entered into the database management system.

9. The data hierarchical storage method based on magneto-electro-optical media according to claim 6, characterized in that, Perform file searches, including: Based on file query requirements, the database management system locates the record and field containing the file. The field is determined to be in a hierarchical storage state based on the splitting marker information; Determine file block feature data based on splitting marker information; Determine the sub-file block feature data based on the file block feature data; The optical disc library management system determines the storage location of optical discs and files based on sub-file block characteristic data; Extract the CD and read files from it.

10. The data hierarchical storage method based on magneto-electro-optical media according to claim 6, characterized in that, Perform file searches, including: Submit a file query request to the CD-ROM library management system; The CD-ROM library management system retrieves and queries file information based on sub-file block feature data; Once it is determined that the disc is within the disc library, the disc is located based on the disc association data. Extract the CD and read files from it.

Images