A file label implementation method based on a distributed file system

Abstract

This invention discloses a method for implementing file tags based on a distributed file system, comprising: building a distributed file system on a multi-node server; establishing a file dimension tag information group storage facility, building a database to store tag group data, and periodically synchronizing the data to a full-text search engine to improve the retrieval speed of tag group information; constructing tag library rules, creating corresponding custom tag features on the distributed file system management platform by writing relevant programs for custom tag dimension management, and realizing the definition and management of tag dimensions for distributed file system files; and building an automatic tag identification capability for distributed system files, automatically identifying tags for distributed file system files based on pre-set word segmentation rules by writing relevant code for file tag setting logic, thereby meeting users' needs for classifying, managing, retrieving, collecting, and sharing distributed file system files.

Description

Technical Field

[0001] This invention relates to a file tag implementation method, and more particularly to a file tag implementation method based on a distributed file system. Background Technology

[0002] Big data storage technology has become a widely accepted next-generation information infrastructure. With the continuous development of technologies such as distributed storage, more and more enterprises are adopting Hadoop-based technologies to build big data platforms. As businesses grow, massive amounts of data are generated, and these massive amounts of data are stored on big data platforms. Managing and classifying this massive amount of data, as well as solving the problem of file management for multiple user accounts within an enterprise, requires considering the combination of public and personal file tags. Currently, distributed file systems do not provide a good method for managing, classifying, and quickly retrieving distributed files.

[0003] For file management, different management schemes are typically adopted based on file characteristics and application scenarios. The traditional scheme is to classify and catalog files according to their paths. This scheme is widely used and easy to understand, storing and managing files according to hierarchical relationships and categories with clear hierarchical logic. Currently, this scheme is commonly used in computer operating systems. However, when dealing with a large number of files from diverse sources and of diverse categories, it is necessary to manage and retrieve files from multiple dimensions. For file directory classification, achieving multi-dimensional file classification management requires establishing complex directory relationships, and this method is not conducive to file retrieval and searching, thus having significant limitations in file management.

[0004] The file tag management scheme manages files by constructing file tags. Multiple tag attributes can be set for the same file, describing and classifying it from multiple dimensions. The creation and setting of file tag attributes are achieved by defining rules and conditions. This file tag method is characterized by its flat structure; there are no obvious logical or hierarchical relationships between tags of different dimensions, allowing users to freely annotate and retrieve file tags. However, this also leads to a lack of standardization in file tag management.

[0005] Therefore, there is an urgent need for a flexible and efficient method for implementing file tags in distributed file systems. Summary of the Invention

[0006] Purpose of the invention: The technical problem to be solved by the present invention is to provide a file tag implementation method based on a distributed file system, which addresses the shortcomings of the existing technology.

[0007] To address the aforementioned technical problems, this invention discloses a file tag implementation method based on a distributed file system, comprising the following steps:

[0008] Step 1: Setting up a distributed file system environment: Building and deploying a distributed file system on a multi-node server;

[0009] Step 2: Establish a storage facility for dimensional information tags: Utilize a database and full-text search engine on the server to build a storage facility for file dimensional information tags.

[0010] Step 3, Custom Tag Dimension Management: Write a program to set custom tag dimensions, i.e., a custom tag module, to create and manage custom tags, and create custom tag features corresponding to custom tag dimensions on the distributed file system;

[0011] The custom tag module includes a tag service (TagServer) for creating, modifying, and deleting custom tags; tag information is obtained in real time through the tag service (TagServer), and the custom tag module is managed using big data technology;

[0012] Step 4, File Tag Setting: Write a program, namely the file tag setting module, based on the file tag setting logic. According to the file naming rules in the distributed file system, it realizes automatic identification of file tags, while providing manual verification and correction. Through the creation, modification and deletion of file tags, it assigns new file characteristics to files in the distributed file system for the management of the distributed file system.

[0013] Step 5: Distributed file system file retrieval and custom file collection: Determine the common characteristics of the files to be retrieved, organize and prepare the relevant dimension information tag groups of the files to be retrieved on the distributed file system, match the files that meet the information tag group data and display them in a list, and at the same time set up a custom file collection module to centrally store the retrieved files according to the tag dimensions for displaying multiple types of files;

[0014] Step 6: Distributed file system file and tag sharing: Build a user management module based on the distributed file system, set up a unique secure account for each user, and grant other users or user groups the right to access the user's custom favorite tags.

[0015] Furthermore, the specific method for establishing the dimensional information tag group storage facility described in step 2 includes:

[0016] Step 2-1: Prepare a server for installing database software and full-text search engine services;

[0017] Step 2-2: Modify the database configuration, set usernames and user access permissions, create and manage database tables according to the predefined file tag naming rules, and complete the definition and management of file tag dimensions;

[0018] Steps 2-3: Modify the full-text search engine configuration, set usernames and user access permissions, allocate storage memory and primary and secondary shards according to the amount of pre-stored data, create and manage indexes, and build a cache backup facility for file tag dimension information;

[0019] Steps 2-4: Establish the connection between the database and the full-text search engine.

[0020] Furthermore, the specific methods for establishing the association between the database and the full-text search engine as described in steps 2-4 include:

[0021] The file tag information of the distributed file system is stored and cached. First, the file tag information is stored in the database, and then the file tag information is synchronized to the full-text search engine.

[0022] Furthermore, the custom tag dimension management described in step 3 includes the following specific methods:

[0023] Step 3-1: Establish a tag library, configure file tags for the distributed system, and assign file tags to corresponding tag groups according to their file categories;

[0024] Step 3-2: Configure access control permissions for the configuration file based on the configured file tags, wherein the permissions include: deny, query, download, and preview;

[0025] Step 3-3: Manage tags in the tag library to create, modify, and delete custom tags.

[0026] Furthermore, the method for establishing the tag library described in step 3-1 includes:

[0027] The file tags and tag groups of the distributed file system are classified into hierarchical categories, and the subordinate relationship between tag groups and file tags in the tag library is configured.

[0028] Furthermore, the method for tag management in the tag library described in step 3-3 includes:

[0029] Users can perform operations such as creating, modifying, deleting, and querying file tags on the distributed file system through a visual interactive interface.

[0030] Furthermore, the specific methods for writing the file tag setting logic described in step 4 include:

[0031] Step 4-1: Using a pre-defined program, traverse the files on the distributed file system and obtain the file paths and file names;

[0032] Step 4-2: Establish a distributed system file name recognition method, split the file path and file name into file prefix, file suffix and separator, and perform word segmentation processing through word segmentation algorithm to obtain the keywords of the file;

[0033] Step 4-3: Based on the preset file tag division rules, identify each file by keywords, that is, associate files with file tags, and classify and manage files based on file tags.

[0034] Furthermore, the distributed file system file retrieval method described in step 5 includes:

[0035] Step 5-1: Determine the common characteristics of the files to be retrieved, and organize and prepare the file tag information group on the distributed file system to be retrieved;

[0036] Step 5-2: Confirm whether the tag information to be searched exists. If it does not exist, proceed to step 5-3. If it exists, proceed to step 5-5.

[0037] Step 5-3: Determine if the tag group information conditions are reasonable. If not, return to step 5-1.

[0038] Step 5-4: If the tag group information is reasonable, add the tag to the tag group, complete the file tag data information, and then return to step 5-2.

[0039] Step 5-5: Based on the set tag information groups, retrieve and list the files on the distributed file system that can match the tag information group data, and provide preview, download, and favorite operations.

[0040] Steps 5-6: Confirm whether you want to save the retrieved files and create custom save tags. If you want to save the files retrieved in step 5-5, save them to the corresponding save tags. If you want to continue searching for and saving files, go back to step 5-1.

[0041] Furthermore, the sharing of distributed file system files and tags described in step 6 specifically includes:

[0042] Step 6-1: Confirm the distributed file system files, tag information, and user group or user information to be authorized within the current user's custom collection;

[0043] Step 6-2: Confirm the permissions granted to the user group or user to be authorized, including at least: preview, download, and edit operations;

[0044] Step 6-3: Based on the information confirmed in Steps 6-1 and 6-2, share the operation permissions of the distributed file system files and tag information in the current user's custom collection with the user group or user to be authorized.

[0045] Furthermore, steps 2-4 involve synchronizing the file tag information to the full-text search engine using the binlog method.

[0046] Beneficial effects:

[0047] 1. This invention first establishes a distributed file system cluster and a storage facility for dimensional information tag groups; secondly, it defines distributed file tag dimension rules based on file characteristics and application scenarios, while also supporting custom tags to facilitate users in expanding tag content later and improve the applicability of the method.

[0048] 2. This invention uses a pre-defined Traversal program to traverse files at the same level to obtain file path and filename data. It then splits the file path and filename by delimiters, prefixes, and suffixes, and uses a word segmentation algorithm to segment the file path and filename to obtain basic data information for each distributed file, which is then used as subsequent tag information. A pre-defined distributed file tag automatic identification program is used to classify and label distributed files. Once the program obtains the distributed file tag data, it automatically writes it to the database for storage and adds extended file tag attributes to the distributed file, facilitating the management of the identified distributed files.

[0049] 3. This invention uses a customizable collection module and a tag sharing module to collect files retrieved multiple times into a personal collection space. Users can then choose to share files and tags within the personal collection space as needed, achieving flexibility in file management. This personalized file management from the user's perspective complements the unified file tag management, balancing efficiency and flexibility. Attached Figure Description

[0050] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments, and the advantages of the present invention in the above and / or other aspects will become clearer.

[0051] Figure 1 This is a flowchart illustrating the implementation method of file tags in a distributed file system.

[0052] Figure 2 This is a schematic diagram of the process of building a distributed file system infrastructure.

[0053] Figure 3 This is a diagram illustrating the process of managing custom tag dimensions.

[0054] Figure 4 This is a flowchart illustrating the file tag identification process in a distributed file system.

[0055] Figure 5 This is a flowchart illustrating the process of file retrieval and custom bookmarking in a distributed file system.

[0056] Figure 6 This is a flowchart illustrating the process of sharing files and tags in a distributed file system. Detailed Implementation

[0057] This invention proposes a file tag implementation method based on a distributed file system, which expands and improves the existing file management functions of distributed file systems to provide better distributed file management performance. The steps are as follows:

[0058] Step 1: Setting up the distributed file system environment: This involves building and deploying the distributed file system on a multi-node server. This can be achieved using Hadoop technology or other relevant existing technologies.

[0059] Step 2: Establish a storage facility for dimensional information tags: On a server (Linux or other servers can be used), a database (MySQL or other databases can be used) and a full-text search engine (Elasticsearch or other engines can be used) are used to build a storage facility for file dimensional information tags.

[0060] Step 3, Custom Tag Dimension Management (refers to the classification management of the tags themselves within custom tags, such as the tags mp4 and avi both belonging to the video category): Write relevant programs for setting custom tag dimensions, create corresponding custom tag features on the distributed file system management platform (tag features are a set of characteristics common to a certain type of thing, such as file format, file ownership organization, date, etc.), and persist the creation, modification, and deletion operations of custom tags to the TagServer (used to implement the creation, modification, and deletion of custom tags) and obtain tag information in real time (tag information refers to the characteristic information of a specific thing, such as the file format being video or image, the file owner being A or B, etc.), in order to achieve the goal of managing the custom tag module through big data technology.

[0061] Step 4: Write the file tag identification logic: Write the relevant code for setting file tags. On the big data platform, according to the file naming rules of the distributed file system, realize the automatic identification of file tags, and provide manual verification and correction functions. Through the creation, modification and deletion of file tags, new file characteristics are given to distributed files, which facilitates the management and retrieval of the file system.

[0062] Step 5: Distributed file system file retrieval and custom file favorites: Determine the tag group information of the files to be retrieved, use retrieval rules and programs to retrieve the required files, and at the same time, decide whether to add the retrieved files to a personal custom favorites group based on personal needs.

[0063] Step 6: Distributed file system file and tag sharing: The current user grants authorization to other users or user groups, enabling them to access the current user's personal custom favorite tags.

[0064] The file tags mentioned in the text refer to a set of tags for a file on a distributed file system.

[0065] File tag information, that is, a set of tags set for a file on a distributed file system, that is, the classification of the file;

[0066] File tag dimensions, that is: before setting tag information for a file, it is generally necessary to define what dimensions to use to classify the file, that is, to classify the file tags.

[0067] File tag dimension information: Dimension information refers to the tag information of file tags;

[0068] The specific steps for setting up the distributed file system environment in Step 1 are as follows:

[0069] Step 1-1: Prepare multiple Linux servers, ensuring they have the same CPU architecture, at least 16 CPU cores, 32GB of RAM and 4TB of hard drive space, and that they have a smooth network connection, synchronized time, and passwordless access between servers.

[0070] Steps 1-2: Configure the hostname and hosts file of each server so that they can recognize each other via DNS. Disable the firewall and SELinux on each server, set up time synchronization service, uniformly configure root user login, and enable passwordless login for inter-server access;

[0071] Steps 1-3: Install HDFS (a distributed file system, a basic software infrastructure for storing files; HDFS is deployed using yum, with NameNode providing access to and management of file metadata on the distributed system, and DataNode providing storage for file data on the distributed system) on each server.

[0072] Steps 1-4: Initialize and start a NameNode on the master node of the distributed file system. Start a DataNode on both the master and slave nodes. The DataNodes periodically send heartbeat signals to the NameNode to report their status and availability. The NameNode uses the heartbeat information to detect the health status of the DataNodes. The running status of each node in the cluster will show "Started", indicating that the distributed file system cluster environment has been successfully built.

[0073] Step 2, establishing the storage facility for dimensional information tag groups, involves the following specific steps:

[0074] Step 2-1: Prepare a Linux server for installing the database (MySQL can be used) and the full-text search engine (Elasticsearch can be used);

[0075] Step 2-2: Modify the database configuration, set usernames and user access permissions, and create and manage database tables according to the predefined file tag naming rules to define and manage file tag dimensions;

[0076] Steps 2-3: Modify the full-text search engine configuration, set the username and user access permissions, allocate storage memory and primary and secondary shards according to the amount of pre-stored data, create and manage indexes, and build a cache backup facility for file tag dimension information;

[0077] Steps 2-4: Establish the relationship between the database and the full-text search engine. First, store the file tag information in the database, and then synchronize the file tag information to the full-text search engine using binlog.

[0078] Step 3, custom tag dimension management, is further divided into the following specific steps:

[0079] Step 3-1: Establish a tag library, configure file tags, and categorize them into corresponding tag groups according to their file type;

[0080] Step 3-2: Configure access permissions for the file based on the configured file tags, wherein the permissions include: deny, query, download, and preview;

[0081] Step 3-3: Perform tag management in the tag library, including creating, modifying, deleting, and querying the file tag information, and return the operation results to the user through a visual interactive operation.

[0082] Step 4, the logic for setting file tags, is further divided into the following specific steps:

[0083] Step 4-1: Using the pre-defined Traversal program, traverse the files on the distributed file system and obtain file path and name data;

[0084] Step 4-2: Split the file prefix, file suffix and separator in the file path and name data, and process the file name and path data information on the distributed file system through word segmentation algorithm to obtain the keywords of the distributed file system files, providing a basis for the subsequent labeling of files on the distributed file system;

[0085] Step 4-3: Based on the preset file tag dimension classification rules, combined with the tags and tag group content already established in the tag library, store the identified file tag recognition results into the database, associate them with the files on the distributed file system, and provide tag identifiers to realize the classification management of files on the distributed file system.

[0086] Step 5, distributed file system file retrieval and custom file collection, is further divided into the following specific steps:

[0087] Step 5-1: Determine the tag group information for the file to be retrieved;

[0088] Step 5-2: Based on file tag group information, retrieve the required files and provide preview, download, and favorite operations;

[0089] Step 5-3: Create your own custom collection tags, determine whether to collect the files retrieved in step 5-2 based on your needs, and determine whether to repeat step 5-2.

[0090] Step 5-4: Users can view their favorite files by browsing their custom favorite tags.

[0091] Step 6, sharing files and tags in the distributed file system, is further divided into the following specific steps:

[0092] Step 6-1: Determine the files to be shared and their tag information on the distributed file system;

[0093] Step 6-2: Determine the information of the user or user group to be shared with;

[0094] Step 6-3: Users share files and tags on the distributed file system to other users or user groups through the sharing operation.

[0095] Example:

[0096] This invention addresses the massive file management needs of distributed file systems by establishing a foundational environment including a distributed file system and a database. It achieves file dimension and category classification on the distributed system by creating a tag library and allowing for custom management and settings of tags and tag groups. Based on agreed-upon naming rules for file paths and names on the distributed system, it provides feasible conditions for a file tag identification program, enabling automatic file identification on the distributed file system, reducing manual identification steps and improving work efficiency. Based on the file tags on the distributed file system, it employs a visual interactive operation method to achieve rapid retrieval and viewing of multi-category, multi-dimensional file types, enhancing the user experience and efficiency of file management on the distributed system. Finally, it determines the content shared by users on the distributed file system and provides operation permissions to unauthorized users or user groups.

[0097] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0098] Combination Figure 1 The flowchart of an embodiment of the file tag implementation method based on a distributed file system of the present invention specifically includes the following steps:

[0099] Step 1: Setting up a distributed file system environment;

[0100] Step 2: Establish a storage facility for dimensional information tag groups;

[0101] Step 3: Customize tag dimension management;

[0102] Step 4: Write the file tag setting logic;

[0103] Step 5: Distributed file system file management, retrieval, and custom favorites;

[0104] Step 6: Distributed file system file and tag sharing.

[0105] In this embodiment of the invention, a distributed file system environment is built to provide file storage infrastructure for storing massive amounts of files; a dimensional information tag group storage facility is established to provide storage and management infrastructure for tag information of files on the distributed file system; a custom tag dimension setting program is developed to achieve file tag management capabilities by establishing a tag library, configuring file tags and tag groups, and providing a visual and user-friendly verification interface; a file tag setting logic program is developed to traverse files on the distributed file system and obtain file dimension information through a preset Traversal program and word segmentation algorithm, thereby achieving automatic file identification; through the set file tag information, an interactive and user-friendly interface is provided to enable users to manage and retrieve files on the distributed file system; and by determining the needs of other users or user groups, file and tag information sharing is achieved.

[0106] In practice, Figure 2 This is a flowchart illustrating the specific steps involved in constructing the distributed file system infrastructure in this embodiment of the invention. Based on business characteristics and file features, the infrastructure environment for the distributed file system file tag implementation method is built, including: building the distributed file system environment and establishing a storage facility for dimensional information tag groups, providing necessary support for the implementation of this technical solution.

[0107] Prepare multiple Linux servers, ensuring they have the same CPU architecture, at least 16 CPU cores, 32GB of RAM, and 4TB of hard drive space. Ensure they are connected to a stable network, synchronized in time, and that passwordless login is enabled for inter-server access. Configure the hostname and hosts file for each server so they can recognize each other via DNS. Disable the firewall and SELinux on each server, set up time synchronization, and uniformly configure root user login, ensuring passwordless login for inter-server access.

[0108] To set up a distributed file system environment, install HDFS (a distributed file system, a basic software infrastructure for storing files; HDFS is deployed using yum, with NameNode providing access to and management of file metadata and DataNode providing storage for file data) on each server. Initialize and start a NameNode on the master node of the distributed file system using NameNode. Start a DataNode on both the master and slave nodes using DataNode. DataNodes periodically send heartbeat signals to the NameNode to report their status and availability. The NameNode uses the heartbeat information to detect the health of the DataNodes. When the status of each node in the cluster displays "Started," the distributed file system cluster environment has been successfully set up.

[0109] Establish a storage facility for dimensional information tag groups, and prepare a Linux server for installing the MySQL database and Elasticsearch full-text search engine service.

[0110] Modify the MySQL database configuration, set usernames and user access permissions, and create and manage database tables according to predefined file tag naming rules to achieve the definition and management of file tag dimensions;

[0111] Modify the Elasticsearch full-text search engine configuration, set usernames and user access permissions, allocate storage memory and primary and secondary shards according to the amount of data to be stored, create and manage indexes, and build a caching and backup facility for file tag dimension information;

[0112] To establish a relationship between MySQL and Elasticsearch, first store the file tag information in the database, and then synchronize the file tag information to the full-text search engine using binlog.

[0113] In practice, Figure 3 This is a flowchart illustrating the specific steps of custom tag dimension management in this embodiment of the invention. Based on the characteristics and features of the files stored on the distributed file system, the relevant information of file dimension tag classification is scientifically divided, defined, and managed.

[0114] Based on business characteristics, pre-defined rules and dimensional classification information for distributed system file tags are established, and a tag library is created. After establishing the tag library, the tags are managed in a customized manner, specifically including: grouping the tags; classifying the tags into hierarchical groups; supporting customized tag management, providing flexible management functions such as tag grouping and hierarchical classification, for example, tags can be divided into regional tags, subject tags, data category tags, etc., and subject tags can be managed hierarchically as "a major category of subject name - sub-subject name"; at the same time, the tags and tag groups in the tag library are configured, and the tags are assigned to tag groups, including: configuring the corresponding tags in the tag library and the hierarchical relationship of tag groups.

[0115] The pre-defined Traversal program traverses distributed files at the same level to obtain file path and file name data. The selection of file paths traversed by the pre-defined Traversal program is implemented according to pre-agreed terms, rule definitions, or custom methods.

[0116] Based on the delimiter, the prefix and suffix of the distributed file name, and the word segmentation algorithm, the distributed file path and file name data information is split and processed to obtain the keywords of each distributed file;

[0117] Based on the user's operation, the query information is returned to the user, specifically including: analyzing the user's needs based on the tags in the tag library and the tag library, combined with the algorithm, obtaining the analysis results, and outputting the corresponding distributed system file to the user based on the analysis results and the user's access permissions.

[0118] In practice, Figure 4 This is a flowchart illustrating the specific steps of the distributed file system file tag identification process in an embodiment of the present invention, which involves tagging files on the distributed file system and storing the tag information.

[0119] The system automatically labels distributed files using a pre-defined distributed file tagging program; it also identifies distributed file data information based on a pre-built tag library and sets tags such as region, subject, and data category.

[0120] The pre-defined distributed file tag automatic persistence program automatically writes file tag dimension data into the database for storage; file recognition and recognition results are stored in the database, and associated with the files on the distributed file system.

[0121] Identify distributed files and add file tag extended attributes to facilitate the identification and management of distributed files; after files on a distributed system are tagged, they should have relevant identifiers to facilitate users' management and viewing of files and file tags. File extended attributes are introduced as tag identifiers for files on the distributed file system.

[0122] In practice, Figure 5 This is a flowchart illustrating the specific steps of the file retrieval and custom collection process in an embodiment of the present invention. Based on the retrieval conditions, files on the distributed file system are queried and the results are returned in a list.

[0123] Users determine the common characteristics of the files to be retrieved based on business needs or work arrangements, and organize and prepare the relevant dimension tag information groups of the files on the distributed file system to be retrieved;

[0124] Confirm whether the tag information to be retrieved exists. If the dimension tag information does not exist, further determine whether the conditions of the tag information group are reasonable. If the division is correct and reasonable, consider supplementing the file tag information on the distributed file system, supplementing its relevant dimension attribute features, and improving the file tag data information. If the division is unreasonable, analyze the common features of the files to be retrieved again and organize the relevant dimension tag information groups.

[0125] Taking commonly used search dimension tag groups as an example, if you are studying or analyzing the data file information generated by the activities of a person or a group of people in a certain location and time range, you can select and set tag information such as geographical location information, personnel department information, personnel name information, and time range information.

[0126] Based on the set tag information groups, further analysis and matching of the desired information results can be performed. Precise or fuzzy matching of tag attribute keyword information can be set, and conditions such as AND and OR can be set to determine the logical conditions and search scope of the conditional search. Finally, the files that can match the tag information group data on the distributed file system are retrieved and listed, and users are provided with preview, download, and favorite operations.

[0127] Users can create custom collection tags as needed, and collect files found multiple times into their personal collection space, enabling users to personalize file management and view multiple types of files centrally.

[0128] In practice, Figure 6 This is a flowchart illustrating the specific steps of the file and tag sharing process in this embodiment of the invention, which involves sharing file and tag information on a distributed file system with other users and user groups.

[0129] The user can select the distributed file system file and tag content to be authorized based on business needs or requirements.

[0130] Grant other users or user groups access to distributed file system files and tags through the distributed file system file and tag sharing program.

[0131] Authorized users or user groups have authorized permissions to operate on files and tags in the distributed file system, enabling content sharing.

[0132] The purpose of this invention is to provide a file tagging method based on a distributed file system, which enables customized tag management for massive files and automatic on-demand tagging, thereby improving work efficiency; it provides file tag identification, increasing the recognizability of whether a file on the distributed file system has been tagged; it provides multi-dimensional and multi-angle attribute definitions for files on the distributed file system, and by combining search tag condition groups, it matches and returns a file list, allowing users to retrieve and save files to personal collection groups as needed, and also share files and tag information in personal collection groups, providing users with an interactive and easy-to-operate user experience.

[0133] In its specific implementation, this application provides a computer storage medium and a corresponding data processing unit. The computer storage medium is capable of storing a computer program, which, when executed by the data processing unit, can run the inventive content of a distributed file system file tag implementation method provided by this invention, as well as some or all of the steps in various embodiments. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0134] Those skilled in the art will clearly understand that the technical solutions in the embodiments of the present invention can be implemented using computer programs and their corresponding general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of computer programs, i.e., software products. These computer program software products can be stored in a storage medium and include several instructions to cause a device containing a data processing unit (which may be a personal computer, server, microcontroller, MUU, or network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments of the present invention.

[0135] This invention provides an idea and method for implementing file tags based on a distributed file system. Many methods and approaches exist for implementing this technical solution; the above description is merely a preferred embodiment of the invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of this invention, and these improvements and modifications should also be considered within the scope of protection of this invention. All components not explicitly stated in this embodiment can be implemented using existing technologies.

Claims

1. A method for implementing file tags based on a distributed file system, characterized in that, Includes the following steps: Step 1: Setting up a distributed file system environment: Building and deploying a distributed file system on a multi-node server; Step 2: Establish a storage facility for dimensional information tags: Utilize a database and full-text search engine on the server to build a storage facility for file dimensional information tags. Step 3, Custom Tag Dimension Management: Write a program to set custom tag dimensions, i.e., a custom tag module, to create and manage custom tags, and create custom tag features corresponding to custom tag dimensions on the distributed file system; The custom tag module includes a tag service (TagServer) for creating, modifying, and deleting custom tags; tag information is obtained in real time through the tag service (TagServer), and the custom tag module is managed using big data technology; Step 4, File Tag Setting: Write a program, namely the file tag setting module, based on the file tag setting logic. According to the file naming rules in the distributed file system, it realizes automatic identification of file tags, while providing manual verification and correction. Through the creation, modification and deletion of file tags, it assigns new file characteristics to files in the distributed file system for the management of the distributed file system. Step 5: Distributed file system file retrieval and custom file collection: Determine the common characteristics of the files to be retrieved, organize and prepare the relevant dimension information tag groups of the files to be retrieved on the distributed file system, match the files that meet the information tag group data and display them in a list, and at the same time set up a custom file collection module to centrally store the retrieved files according to the tag dimensions for displaying multiple types of files; Step 6: Distributed file system file and tag sharing: Build a user management module based on the distributed file system, set up a unique secure account for each user, and grant other users or user groups the right to access the user's custom favorite tags.

2. The file tag implementation method based on a distributed file system according to claim 1, characterized in that, Step 2 describes the establishment of a storage facility for dimensional information tag groups, specifically including the following methods: Step 2-1: Prepare a server for installing database software and full-text search engine services; Step 2-2: Modify the database configuration, set usernames and user access permissions, create and manage database tables according to the predefined file tag naming rules, and complete the definition and management of file tag dimensions; Steps 2-3: Modify the full-text search engine configuration, set usernames and user access permissions, allocate storage memory and primary and secondary shards according to the amount of pre-stored data, create and manage indexes, and build a cache backup facility for file tag dimension information; Steps 2-4: Establish the connection between the database and the full-text search engine.

3. The file tag implementation method based on a distributed file system according to claim 2, characterized in that, The specific methods for establishing the association between the database and the full-text search engine as described in steps 2-4 include: The file tag information of the distributed file system is stored and cached. First, the file tag information is stored in the database, and then the file tag information is synchronized to the full-text search engine.

4. The file tag implementation method based on a distributed file system according to claim 1, characterized in that, The custom tag dimension management described in step 3 includes the following specific methods: Step 3-1: Establish a tag library, configure file tags for the distributed system, and assign file tags to corresponding tag groups according to their file categories; Step 3-2: Configure access control permissions for the configuration file based on the configured file tags, wherein the permissions include: deny, query, download, and preview; Step 3-3: Manage tags in the tag library to create, modify, and delete custom tags.

5. The file tag implementation method based on a distributed file system according to claim 4, characterized in that, The specific method for establishing the tag library as described in step 3-1 includes: The file tags and tag groups of the distributed file system are classified into hierarchical categories, and the subordinate relationship between tag groups and file tags in the tag library is configured.

6. The file tag implementation method based on a distributed file system according to claim 4, characterized in that, The tag management in the tag library described in step 3-3 includes the following specific methods: Users can perform operations such as creating, modifying, deleting, and querying file tags on the distributed file system through a visual interactive interface.

7. A method for implementing file tags based on a distributed file system according to claim 1, characterized in that, The specific methods for writing the file tag setting logic described in step 4 include: Step 4-1: Using a pre-defined program, traverse the files on the distributed file system and obtain the file paths and file names; Step 4-2: Establish a distributed system file name recognition method, split the file path and file name into file prefix, file suffix and separator, and perform word segmentation processing through word segmentation algorithm to obtain the keywords of the file; Step 4-3: Based on the preset file tag division rules, identify each file by keywords, that is, associate files with file tags, and classify and manage files based on file tags.

8. A method for implementing file tags based on a distributed file system according to claim 1, characterized in that, The distributed file system file retrieval method described in step 5 includes: Step 5-1: Determine the common characteristics of the files to be retrieved, and organize and prepare the file tag information group on the distributed file system to be retrieved; Step 5-2: Confirm whether the tag information to be searched exists. If it does not exist, proceed to step 5-3. If it exists, proceed to step 5-5. Step 5-3: Determine if the tag group information conditions are reasonable. If not, return to step 5-1. Step 5-4: If the tag group information is reasonable, add the tag to the tag group, complete the file tag data information, and then return to step 5-2. Step 5-5: Based on the set tag information groups, retrieve and list the files on the distributed file system that can match the tag information group data, and provide preview, download, and favorite operations; Steps 5-6: Confirm whether you want to save the retrieved files and create custom save tags. If you want to save the files retrieved in step 5-5, save them to the corresponding save tags. If you want to continue searching for and saving files, go back to step 5-1.

9. A method for implementing file tags based on a distributed file system according to claim 1, characterized in that, The method for sharing files and tags in the distributed file system described in step 6 includes: Step 6-1: Confirm the distributed file system files, tag information, and user group or user information to be authorized within the current user's custom collection; Step 6-2: Confirm the permissions granted to the user group or user to be authorized, including at least: preview, download, and edit operations; Step 6-3: Based on the information confirmed in Steps 6-1 and 6-2, share the operation permissions of the distributed file system files and tag information in the current user's custom collection with the user group or user to be authorized.

10. A method for implementing file tags based on a distributed file system according to claim 3, characterized in that, Steps 2-4 involve synchronizing the file tag information to the full-text search engine using binlog.

Images