Data processing method, device, terminal device and storage medium

By obtaining user access instructions and user behavior tags, determining user tags, delaying initialization and regular cleaning, the problem of silent user data occupancy is solved and database performance is improved.

CN114880339BActive Publication Date: 2024-12-13CHINA MOBILEHANGZHOUINFORMATION TECH CO LTD +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202210598472.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-30
Publication Date
2024-12-13
Estimated Expiration
2042-05-30

AI Technical Summary

Technical Problem

As the user scale grows, the default data of silent users occupies a large amount of storage space, reducing the read and write performance of the database.

Method used

By obtaining user access instructions, the user tag is determined based on the pre-established user behavior tag, determining whether the default data initialization is performed, and the label is updated at a preset time to clean up user metadata, realizing delayed initialization and regular cleaning.

Benefits of technology

It greatly reduces data storage space, improves the read and write performance of the database and system response capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114880339B_ABST
    Figure CN114880339B_ABST
Patent Text Reader

Abstract

The present invention discloses a data processing method, apparatus, terminal device and storage medium, which obtains the user's access instruction; determines the user tag of the user based on a pre-established user behavior mark; determines whether to perform default data initialization according to the user tag and the access instruction; updates the user tag at a preset interval to obtain an update tag, and cleans up the user metadata obtained by the default data initialization according to the update tag. By determining whether to perform default data initialization according to the user tag and the access instruction, delayed initialization is achieved, and by cleaning up the user metadata according to the update tag, regular cleaning of huge user metadata is achieved, which greatly reduces data storage space while meeting user needs, thereby improving the read and write performance of the database and enhancing the system responsiveness.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of cloud storage technology, and in particular to a data processing method, apparatus, terminal equipment and storage medium. Background Art

[0002] With the development of Internet technology, information services have become an indispensable part of modern life. For example, the family cloud provides one-stop cloud services for family scenarios by uploading data assets, smart homes, home applications, and media content to the cloud, including cloud photo albums, cloud monitoring, WeChat backup and other functions. When a user registers, the default product promotion, operation guide and other files need to be initialized in their personal space, family space, and data safe, resulting in a large number of default directories / files for a single user. As the user scale grows to tens of millions, the default data of silent users occupies a large storage space, and also reduces the database read and write performance.

[0003] Therefore, it is necessary to propose a solution to improve the database reading and writing performance. Summary of the invention

[0004] The main purpose of the present invention is to provide a data processing method, apparatus, terminal equipment and storage medium, aiming to improve the read and write performance of a database.

[0005] To achieve the above object, the present invention provides a data processing method, the data processing method comprising:

[0006] Get the user's access instructions;

[0007] Determining a user tag of the user based on a pre-established user behavior tag;

[0008] Determining whether to perform default data initialization according to the user tag and the access instruction;

[0009] The user tag is updated at preset intervals to obtain an updated tag, and the user metadata obtained by initializing the default data is cleaned up according to the updated tag.

[0010] Optionally, before the step of obtaining the user's access instruction, the step further includes:

[0011] Get batch registered user information;

[0012] determining in sequence whether the user information includes activation usage information;

[0013] If the user information does not include activation and usage information, then record the relevant rights and interests information in the user information;

[0014] If the user information includes activation usage information, user registration is performed according to the user information to obtain system metadata corresponding to the user for subsequent access by the user.

[0015] Optionally, before the step of determining the user tag of the user based on the pre-established user behavior mark, the step further includes:

[0016] Record the login time of the user within a preset time range and generate corresponding login behavior;

[0017] Recording the user's access behavior, wherein the access behavior includes creating information, uploading files, or modifying files;

[0018] The user behavior tag is established according to the login behavior and the access behavior.

[0019] Optionally, the step of determining the user tag of the user based on a pre-established user behavior mark includes:

[0020] Determining whether the user has a login behavior or a visit behavior according to the user behavior mark;

[0021] If the user has a login behavior or a visit behavior, the user tag is recorded as an active user;

[0022] If the user has no login behavior or access behavior, the user tag is recorded as a silent user.

[0023] Optionally, the step of determining whether to perform default data initialization according to the user tag and the access instruction includes:

[0024] Determining whether the user is an active user according to the user tag;

[0025] If the user is an active user, identifying whether the access instruction includes an access default file instruction;

[0026] If the access instruction includes an access default file instruction, determining whether the default data corresponding to the user is not initialized;

[0027] If the default data corresponding to the user is not initialized, the default data is initialized according to the user default information to generate corresponding user metadata.

[0028] Optionally, the step of updating the user tag at a preset interval to obtain an updated tag, and cleaning the user metadata obtained by initializing the default data according to the updated tag includes:

[0029] Updating the user tag at a preset time interval to obtain an updated tag;

[0030] Determining whether the user is a silent user according to the update tag;

[0031] If the user is a silent user, the user metadata corresponding to the user is cleaned up.

[0032] Optionally, after the step of cleaning up the user metadata corresponding to the user, the step further includes:

[0033] The system metadata corresponding to the user is compressed to obtain a compressed file, and the compressed file is exported to a database for storage.

[0034] In addition, to achieve the above object, the present invention further provides a data processing device, the data processing device comprising:

[0035] An acquisition module is used to obtain the user's access instructions;

[0036] An identification module, used to determine a user tag of the user based on a pre-established user behavior tag;

[0037] An initialization module, used to determine whether to perform default data initialization according to the user tag and the access instruction;

[0038] The cleaning module is used to update the user tag at preset intervals to obtain an updated tag, and clean up the user metadata obtained by initializing the default data according to the updated tag.

[0039] In addition, to achieve the above-mentioned purpose, the present invention also provides a terminal device, which includes a memory, a processor, and a data processing program stored in the memory and executable on the processor, and the data processing program implements the steps of the data processing method described above when executed by the processor.

[0040] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a data processing program is stored, and when the data processing program is executed by a processor, the steps of the data processing method described above are implemented.

[0041] The data processing method, apparatus, terminal device and storage medium proposed in the embodiment of the present invention obtain the user's access instruction; determine the user tag of the user based on the pre-established user behavior mark; determine whether to perform default data initialization according to the user tag and the access instruction; update the user tag at a preset interval to obtain an update tag, and clean up the user metadata obtained by default data initialization according to the update tag. By determining whether to perform default data initialization according to the user tag and the access instruction, delayed initialization is achieved, and by cleaning up the user metadata according to the update tag, regular cleaning of huge user metadata is achieved, which greatly reduces data storage space while meeting user needs, thereby improving the read and write performance of the database and enhancing the system responsiveness. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is a functional module diagram of a terminal device to which the data processing device of the present invention belongs;

[0043] Figure 2 A flowchart of an exemplary embodiment of a data processing method of the present invention;

[0044] Figure 3 A flowchart of another exemplary embodiment of a data processing method of the present invention;

[0045] Figure 4 for Figure 2 A schematic diagram of a specific process of step S30 in the embodiment;

[0046] Figure 5 for Figure 2 A schematic diagram of a specific process of step S40 in the embodiment;

[0047] Figure 6 Schematic diagram of the system principle in an embodiment of the present invention.

[0048] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0049] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0050] The main solution of the embodiment of the present invention is: by obtaining the user's access instruction; based on the pre-established user behavior mark, determine the user tag of the user; determine whether to perform default data initialization according to the user tag and the access instruction; update the user tag at a preset interval to obtain an update tag, and clean up the user metadata obtained by default data initialization according to the update tag. By determining whether to perform default data initialization according to the user tag and the access instruction, delayed initialization is achieved, and by cleaning up the user metadata according to the update tag, regular cleaning of huge user metadata is achieved, which greatly reduces data storage space while meeting user needs, thereby improving the read and write performance of the database and enhancing the system responsiveness.

[0051] Specifically, refer to Figure 1 , Figure 1 Schematic diagram of the functional modules of the terminal device to which the data processing device of the present invention belongs. The data processing device may be a device that is independent of the terminal device and capable of performing data processing, and may be carried on the terminal device in the form of hardware or software. The terminal device may be an intelligent mobile terminal with data processing function, such as a mobile phone or a tablet computer, or may be a fixed terminal device or server with data processing function.

[0052] In this embodiment, the terminal device to which the data processing apparatus belongs includes at least an output module 110 , a processor 120 , a memory 130 and a communication module 140 .

[0053] The memory 130 stores an operating system and a data processing program. The data processing device can store information such as the access instructions of the acquired user, the user tag of the user determined based on the pre-established user behavior tag, and the updated tag obtained by updating the user tag at a preset interval in the memory 130; the output module 110 can be a display screen, etc. The communication module 140 can include a WIFI module, a mobile communication module, a Bluetooth module, etc., and communicates with an external device or server through the communication module 140.

[0054] When the data processing program in the memory 130 is executed by the processor, the following steps are implemented:

[0055] Get the user's access instructions;

[0056] Determining a user tag of the user based on a pre-established user behavior tag;

[0057] Determining whether to perform default data initialization according to the user tag and the access instruction;

[0058] The user tag is updated at preset intervals to obtain an updated tag, and the user metadata obtained by initializing the default data is cleaned up according to the updated tag.

[0059] Furthermore, when the data processing program in the memory 130 is executed by the processor, the following steps are also implemented:

[0060] Get batch registered user information;

[0061] determining in sequence whether the user information includes activation usage information;

[0062] If the user information does not include activation and usage information, then record the relevant rights and interests information in the user information;

[0063] If the user information includes activation usage information, user registration is performed according to the user information to obtain system metadata corresponding to the user for subsequent access by the user.

[0064] Furthermore, when the data processing program in the memory 130 is executed by the processor, the following steps are also implemented:

[0065] Record the login time of the user within a preset time range and generate corresponding login behavior;

[0066] Recording the user's access behavior, wherein the access behavior includes creating information, uploading files, or modifying files;

[0067] The user behavior tag is established according to the login behavior and the access behavior.

[0068] Furthermore, when the data processing program in the memory 130 is executed by the processor, the following steps are also implemented:

[0069] Determining whether the user has a login behavior or a visit behavior according to the user behavior mark;

[0070] If the user has a login behavior or a visit behavior, the user tag is recorded as an active user;

[0071] If the user has no login behavior or access behavior, the user tag is recorded as a silent user.

[0072] Furthermore, when the data processing program in the memory 130 is executed by the processor, the following steps are also implemented:

[0073] Determining whether the user is an active user according to the user tag;

[0074] If the user is an active user, identifying whether the access instruction includes an access default file instruction;

[0075] If the access instruction includes an access default file instruction, determining whether the default data corresponding to the user is not initialized;

[0076] If the default data corresponding to the user is not initialized, the default data is initialized according to the user default information to generate corresponding user metadata.

[0077] Furthermore, when the data processing program in the memory 130 is executed by the processor, the following steps are also implemented:

[0078] Updating the user tag at a preset time interval to obtain an updated tag;

[0079] Determining whether the user is a silent user according to the update tag;

[0080] If the user is a silent user, the user metadata corresponding to the user is cleaned up.

[0081] Furthermore, when the data processing program in the memory 130 is executed by the processor, the following steps are also implemented:

[0082] The system metadata corresponding to the user is compressed to obtain a compressed file, and the compressed file is exported to a database for storage.

[0083] This embodiment uses the above scheme to obtain the user's access instruction; determine the user tag of the user based on the pre-established user behavior mark; determine whether to perform default data initialization according to the user tag and the access instruction; update the user tag at a preset interval to obtain an update tag, and clean up the user metadata obtained through the default data initialization according to the update tag. By determining whether to perform default data initialization according to the user tag and the access instruction, delayed initialization is achieved, and by cleaning up the user metadata according to the update tag, regular cleaning of huge user metadata is achieved, which greatly reduces data storage space while meeting user needs, thereby improving the read and write performance of the database and enhancing the system responsiveness.

[0084] Based on the above terminal device architecture but not limited to the above architecture, an embodiment of the method of the present invention is proposed.

[0085] The execution subject of the method of this embodiment may be a data processing device or a terminal device, etc. This embodiment takes a data processing device as an example.

[0086] Reference Figure 2 , Figure 2 The following is a flow chart of an exemplary embodiment of a data processing method of the present invention. The data processing method comprises:

[0087] Step S10, obtaining the user's access instruction;

[0088] With the development of Internet technology, information services have become an indispensable part of modern life. Cloud disk is a professional Internet storage tool and a product of Internet cloud technology. It provides information storage, reading, downloading and other services for enterprises and individuals through the Internet. It has the characteristics of security, stability and massive storage. For example, for family cloud disks with strong privacy in the family field, it is usually necessary to create default albums and store default pictures in the user's home and personal space for subsequent access by users. When a user accesses, the system can obtain the user's access instruction, and then determine whether the default data needs to be initialized based on the user's user tag and the content of the access instruction.

[0089] Step S20, determining a user tag of the user based on a pre-established user behavior tag;

[0090] According to the user behavior tags in the cache records, users can be classified and managed, including:

[0091] Determining whether the user has a login behavior or a visit behavior according to the user behavior mark;

[0092] If the user has a login behavior or a visit behavior, the user tag is recorded as an active user;

[0093] If the user has no login behavior or access behavior, the user tag is recorded as a silent user.

[0094] Specifically, the user behavior tag is queried from the cache record. If the user has not logged in for a long time after registration, and has not accessed the user including uploading files, modifying default files, etc., the user tag of the user is recorded as a silent user; if the user has logged in or accessed the user within a preset time, such as within three months, the user tag of the user is recorded as an active user.

[0095] Optionally, user behavior tags may be established before this, including:

[0096] Record the login time of the user within a preset time range and generate corresponding login behavior;

[0097] Recording the user's access behavior, wherein the access behavior includes creating information, uploading files, or modifying files;

[0098] The user behavior tag is established according to the login behavior and the access behavior.

[0099] When a user accesses a cloud disk file, the system can record the user's login time and other information through cache to obtain the login behavior, and also record the user's access behavior, such as creating a common family album, uploading any file, modifying any default file, etc. User behavior tags are established based on the recorded login behavior and access behavior for classifying users.

[0100] Step S30, determining whether to perform default data initialization according to the user tag and the access instruction;

[0101] After classifying users according to their activity by recording user tags, if the user is an active user, it is identified whether the access instruction includes an instruction to access the default file. If the active user needs to access the default file, it is determined whether the user's default data has been initialized. If the user's default data has not yet completed the default data initialization, the default data is initialized to obtain the corresponding user metadata. In this way, delayed initialization can be achieved to avoid user metadata generated by a large number of silent users occupying storage space.

[0102] Step S40: Update the user tag at a preset interval to obtain an updated tag, and clean up the user metadata obtained by initializing the default data according to the updated tag.

[0103] Optionally, the system periodically performs scanning and identification through an automated method script, that is, updates user tags, identifies system silent users, and then cleans up the default files and user metadata of silent users. Delayed initialization can still be performed when users access them later, and default data initialization can be performed again after the silent user becomes an active user. The silent user information is managed through the silent user default file cleaning mechanism, avoiding the storage space occupation by large quantities of default information that has not been accessed by users for a long time.

[0104] In this embodiment, the user's access instruction is obtained; based on the pre-established user behavior mark, the user tag of the user is determined; according to the user tag and the access instruction, it is determined whether to perform default data initialization; the user tag is updated at a preset interval to obtain an update tag, and the user metadata obtained by the default data initialization is cleaned up according to the update tag. By determining whether to perform default data initialization according to the user tag and the access instruction, delayed initialization is achieved, and by cleaning the user metadata according to the update tag, regular cleaning of huge user metadata is achieved, which greatly reduces data storage space while meeting user needs, thereby improving the read and write performance of the database and enhancing the system responsiveness.

[0105] Reference Figure 3 , Figure 3This is a flow chart of another exemplary embodiment of the data processing method of the present invention. Figure 2 In the embodiment shown, in this embodiment, before the step of obtaining the user's access instruction, the data processing method further includes:

[0106] Step S01, obtaining user information of batch registration;

[0107] When a user becomes a pending registered user through large-scale operational activities such as a lottery for benefits or receiving benefits for free, you can first obtain the user information of batch registrations, and determine whether to trigger the registration logic based on whether the user has activated the use.

[0108] Step S02, determining in turn whether the user information includes activation usage information;

[0109] For the large amount of user information obtained, determine whether each user has activated the home cloud. That is, the registration logic is triggered only when the user activates the home cloud, so as to avoid silent user information taking up too much storage space and reducing system performance.

[0110] Step S03: if the user information does not include activation and usage information, then record the relevant rights and interests information in the user information;

[0111] If the user does not generate activation and usage information, the real registration process will not be triggered. The system only records the relevant rights and interests of the user for the subsequent registration process when the user activates and uses the system.

[0112] Step S04: if the user information includes activation usage information, user registration is performed according to the user information to obtain system metadata corresponding to the user for subsequent access by the user.

[0113] If activation and usage information is generated in the user information, the real registration process is triggered and the user is registered. When the user registers, the relevant default directories and default files are not actually created in the user's personal space and the default home space. Only the default album ID of the home space is recorded in the default home information, that is, the system metadata corresponding to the user is generated. When the subsequent user needs to view the file, the default data is initialized for the user according to the system metadata, and the creation time of the default file is filled with the user registration time, and the default album ID of the home space uses the album ID recorded in the default family information to achieve user unawareness.

[0114] This embodiment uses the above scheme to obtain batch registered user information; determine whether the user information includes activation and use information in turn; if the user information does not include activation and use information, record the relevant rights and interests information in the user information; if the user information includes activation and use information, perform user registration according to the user information, and obtain the system metadata corresponding to the user for subsequent access by the user. By delaying batch user registration, the registration logic is triggered only when the user activates and uses the home cloud, avoiding silent user information from occupying too much storage space and reducing system performance; user registration is performed after the user activates and uses it, and the relevant default directory and default file are not actually created, so as to delay the initialization of user default data and avoid large-scale occupation of system resources, thereby improving system performance.

[0115] Reference Figure 4 , Figure 4 for Figure 2 The specific flow chart of step S30 in the embodiment. Figure 2 In the embodiment shown, in this embodiment, the above step S30 includes:

[0116] Step S301, determining whether the user is an active user according to the user tag;

[0117] The user tag can be obtained by querying the user behavior mark from the cache record, so as to identify whether the user is an active user or a silent user according to the user tag.

[0118] Step S302, if the user is an active user, identifying whether the access instruction includes an instruction to access a default file;

[0119] If the user is an active user, it is identified whether the access instruction includes an instruction to access the default file. If the user's access instruction does not include an instruction to access the default file, there is no need to call the default file, and therefore there is no need to initialize the default data.

[0120] Step S303, if the access instruction includes an access default file instruction, determining whether the default data corresponding to the user is not initialized;

[0121] If an active user needs to access the default file, it is determined whether the default data of the user has been initialized. If the default data of the user has been initialized, it can be directly called for the user to view.

[0122] Step S304: If the default data corresponding to the user is not initialized, the default data is initialized according to the user default information to generate corresponding user metadata.

[0123] If the default data of the user has not yet completed the default data initialization, the default data is initialized to obtain the corresponding user metadata. In this way, delayed initialization can be achieved to avoid user metadata generated by a large number of silent users occupying storage space.

[0124] As another implementation, the order of determining the user tag, identifying the access instruction, and determining whether the default data is uninitialized is not limited and can be adjusted according to actual conditions.

[0125] This embodiment uses the above solution to determine whether the user is an active user based on the user tag; if the user is an active user, then identify whether the access instruction includes an access default file instruction; if the access instruction includes an access default file instruction, then determine whether the default data corresponding to the user is not initialized; if the default data corresponding to the user is not initialized, then initialize the default data based on the user default information to generate corresponding user metadata. This achieves delayed initialization of user default data, ensures that default data initialization is performed when necessary, and avoids a large amount of storage space occupied by user metadata generated by default data initialization of a large number of silent users.

[0126] Reference Figure 5 , Figure 5 for Figure 2 The specific flow chart of step S40 in the embodiment. Figure 2 In the embodiment shown, in this embodiment, the above step S40 includes:

[0127] Step S401, updating the user tag at a preset interval to obtain an updated tag;

[0128] In an embodiment of the present invention, the system can add a scheduled check task, and trigger the query of the user's active mark through the delayed task queue to check whether the user is active, thereby updating the user tag, that is, regularly checking and updating the user tag, and the preset time of the interval can be determined according to actual conditions.

[0129] Step S402, determining whether the user is a silent user according to the update tag;

[0130] After obtaining the user's update tag regularly, the user's type can be judged according to the update tag to determine whether the user is an active user or a silent user, and then the default cloud disk files of the silent user can be cleaned up.

[0131] Step S403: If the user is a silent user, the user metadata corresponding to the user is cleaned up.

[0132] If a user is identified as a silent user during the regular check, it means that the user has not logged in to access the default file for a long time. The user metadata corresponding to the user can be deleted to free up cloud disk storage space. When the user logs in and accesses the default file later, the default data can be re-initialized to generate user metadata, thereby saving cloud disk storage space without affecting user use, thereby improving the overall system performance.

[0133] In addition, while cleaning up the user metadata corresponding to the silent user, the user's system metadata can also be compressed and stored, including:

[0134] The system metadata corresponding to the user is compressed to obtain a compressed file, and the compressed file is exported to a database for storage.

[0135] When a user is identified as a silent user during the regular inspection process, the system metadata corresponding to the user can be exported and compressed for storage, and then imported into the database for user access after the user becomes active again, thereby further freeing up the storage space of the cloud disk, thereby improving the overall performance of the system without affecting the user experience.

[0136] Through the above scheme, this embodiment specifically updates the user tag at a preset interval to obtain an updated tag; determines whether the user is a silent user according to the updated tag; if the user is a silent user, cleans up the user metadata corresponding to the user. The user metadata of silent users is cleaned up regularly, and the system metadata of silent users is exported to release the storage space of the cloud disk, thereby improving the overall performance of the system without affecting the user experience.

[0137] In addition, an embodiment of the present invention further provides a data processing device, the data processing device comprising:

[0138] An acquisition module is used to obtain the user's access instructions;

[0139] An identification module, used to determine a user tag of the user based on a pre-established user behavior tag;

[0140] An initialization module, used to determine whether to perform default data initialization according to the user tag and the access instruction;

[0141] The cleaning module is used to update the user tag at preset intervals to obtain an updated tag, and clean up the user metadata obtained by initializing the default data according to the updated tag.

[0142] Reference Figure 6 , Figure 6 Schematic diagram of the system principle in an embodiment of the present invention. Figure 6As shown, a cloud disk-based data processing method is provided, the method comprising:

[0143] Delayed batch user registration. When a user becomes a registered user through large-scale operation activities such as lottery draws, free benefits, etc., the participating user does not trigger the real registration process, and the system only records the user's related benefits;

[0144] The method also includes triggering the registration logic only when the user activates the use of the home cloud, so as to avoid silent user information taking up too much space and reducing system performance;

[0145] Delay the initialization of user default files. When a user registers, the relevant default directories and default files are not actually created in the user's personal space and default home space. Only the default album ID of the home space is recorded in the default home information.

[0146] The method also includes triggering the default data initialization only when the user is active and viewing the file for the first time, and the creation time of the default file is filled with the user registration time, and the default album ID of the family space uses the album ID recorded in the default family information, so as to achieve user non-perception;

[0147] Regularly clean up the default files of silent users. Based on the user's behavior, the system identifies users who have not logged in for a long time after registration, have not created any ordinary households, have not uploaded any files, and have not modified any default files as silent users;

[0148] The method also includes that the system regularly scans and identifies silent users of the system through an automated method script, and regularly cleans up the default files and user file metadata of the user to improve the efficiency of system data retrieval. For the default file metadata of silent users, automatic cleaning and delayed initialization are performed; for the file metadata of silent users, export compression storage is performed, and then imported into the database when the user becomes active again.

[0149] The cloud disk-based data processing device provided by the present invention includes:

[0150] The data access module queries the user behavior tag from the cache record in advance when the user accesses the cloud disk file. When the user tag is determined to be a silent user, the silent user default file cleaning mechanism is automatically triggered;

[0151] The file management module, when a user accesses a cloud disk file, queries the user behavior tag from the cache record in advance, determines that the user tag is an active user, and when accessing the default file, when the user space is not initialized, triggers the user's home and personal space default file initialization task;

[0152] The task management module adds scheduled inspection tasks, and regularly cleans up the user's default files and user file metadata based on user behavior tags to improve system data retrieval efficiency. Automatically clean up and delay initialization are performed for silent user default file metadata; export and compress storage for silent user file metadata, and import it into the database when the user becomes active again.

[0153] After adopting the present invention, firstly, the time consumption of user registration is greatly reduced and the success rate is significantly improved. The average time consumption of user registration is reduced by 13.5 times, and the registration success rate is improved from 96.7% to 99.9%; secondly, the file data table is greatly reduced, and the size of the file-related data table is reduced to about 7% of the original; thirdly, the system performance is significantly improved, and the average time consumption of the file-related interface is reduced by 5 times.

[0154] In this embodiment, the data retrieval performance problem caused by user metadata during the rapid growth of business is solved by delaying batch user registration, delaying user default file initialization, and regularly cleaning up silent user default files. It allows users to use the home cloud disk service without noticing, including the default pictures, default albums, and default directories created in personal and family spaces. In response to the huge metadata caused by a large number of users, a three-level data processing optimization is carried out from delaying user registration to default file initialization and regular data cleaning, which can not only meet user needs, but also greatly reduce data storage space and improve system responsiveness.

[0155] In addition, an embodiment of the present invention also proposes a terminal device, which includes a memory, a processor, and a data processing program stored in the memory and executable on the processor, and the data processing program implements the steps of the data processing method described above when executed by the processor.

[0156] Since all the technical solutions of all the aforementioned embodiments are adopted when the data processing program is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0157] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a data processing program is stored. When the data processing program is executed by a processor, the steps of the data processing method described above are implemented.

[0158] Since all the technical solutions of all the aforementioned embodiments are adopted when the data processing program is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0159] Compared with the prior art, the data processing method, apparatus, terminal device and storage medium proposed in the embodiments of the present invention obtain the user's access instruction; determine the user tag of the user based on the pre-established user behavior mark; determine whether to perform default data initialization according to the user tag and the access instruction; update the user tag at a preset interval to obtain an update tag, and clean up the user metadata obtained by default data initialization according to the update tag. By determining whether to perform default data initialization according to the user tag and the access instruction, delayed initialization is achieved, and by cleaning up the user metadata according to the update tag, regular cleaning of huge user metadata is achieved, which greatly reduces data storage space while meeting user needs, thereby improving the read and write performance of the database and enhancing the system responsiveness.

[0160] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0161] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0162] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0163] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A data processing method, characterized in that: The data processing method comprises the following steps: Get the user's access instructions; Determine a user tag of the user based on a pre-established user behavior tag, wherein the user tag includes an active user and a silent user; Determining whether to perform default data initialization according to the user tag and the access instruction; updating the user tag at a preset interval to obtain an updated tag, and cleaning the user metadata obtained by initializing the default data according to the updated tag; The step of determining whether to perform default data initialization according to the user tag and the access instruction comprises: Determining whether the user is an active user according to the user tag; If the user is an active user, identifying whether the access instruction includes an access default file instruction; If the access instruction includes an access default file instruction, determining whether the default data corresponding to the user is not initialized; If the default data corresponding to the user is not initialized, the default data is initialized according to the user default information to generate corresponding user metadata; The steps of updating the user tag at a preset interval to obtain an updated tag, and cleaning the user metadata obtained by initializing the default data according to the updated tag include: Updating the user tag at a preset time interval to obtain an updated tag; Determining whether the user is a silent user according to the update tag; If the user is a silent user, the user metadata corresponding to the user is cleaned up.

2. The data processing method according to claim 1, characterized in that: The step of obtaining the user's access instruction also includes: Get batch registered user information; determining in sequence whether the user information includes activation usage information; If the user information does not include activation and usage information, then record the relevant rights and interests information in the user information; If the user information includes activation usage information, user registration is performed according to the user information to obtain system metadata corresponding to the user for subsequent access by the user.

3. The data processing method according to claim 1, characterized in that: Before the step of determining the user tag of the user based on the pre-established user behavior mark, the step further includes: Record the login time of the user within a preset time range and generate corresponding login behavior; Recording the user's access behavior, wherein the access behavior includes creating information, uploading files, or modifying files; The user behavior tag is established according to the login behavior and the access behavior.

4. The data processing method according to claim 1, characterized in that: The step of determining the user tag of the user based on the pre-established user behavior mark comprises: Determining whether the user has a login behavior or a visit behavior according to the user behavior mark; If the user has a login behavior or a visit behavior, the user tag is recorded as an active user; If the user has no login behavior or access behavior, the user tag is recorded as a silent user.

5. The data processing method according to claim 1, characterized in that: After the step of cleaning the user metadata corresponding to the user, the following step further includes: The system metadata corresponding to the user is compressed to obtain a compressed file, and the compressed file is exported to a database for storage.

6. A data processing device, characterized in that: The data processing device comprises: An acquisition module is used to obtain the user's access instructions; An identification module, configured to determine a user tag of the user based on a pre-established user behavior tag, wherein the user tag includes an active user and a silent user; An initialization module, used to determine whether to perform default data initialization according to the user tag and the access instruction; A cleaning module, used to update the user tag at a preset interval to obtain an updated tag, and clean up the user metadata obtained by initializing the default data according to the updated tag; The determining whether to perform default data initialization according to the user tag and the access instruction includes: Determining whether the user is an active user according to the user tag; If the user is an active user, identifying whether the access instruction includes an access default file instruction; If the access instruction includes an access default file instruction, determining whether the default data corresponding to the user is not initialized; If the default data corresponding to the user is not initialized, the default data is initialized according to the user default information to generate corresponding user metadata; The updating of the user tag at a preset interval to obtain an updated tag, and clearing the user metadata obtained by initializing the default data according to the updated tag includes: Updating the user tag at a preset time interval to obtain an updated tag; Determining whether the user is a silent user according to the update tag; If the user is a silent user, the user metadata corresponding to the user is cleaned up.

7. A terminal device, characterized in that: The terminal device includes a memory, a processor, and a data processing program stored in the memory and executable on the processor. When the data processing program is executed by the processor, the steps of the data processing method according to any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a data processing program, and when the data processing program is executed by a processor, the steps of the data processing method according to any one of claims 1 to 5 are implemented.

Citation Information

Patent Citations

  • User access data processing method and device, computer device and storage medium

    CN110659269A

  • Session state control method and device, electronic equipment and storage medium

    CN112565527A

  • Intelligent website data tamper-proofing system and method

    CN113704830A

  • Data processing method and device, electronic equipment and readable storage medium

    CN113947874A

  • Big data-based network literature movie recommendation management system

    CN117708436A