Mobile phone number big data general database construction method with low resource demand

Abstract

The invention provides a low-resource-demand mobile phone number big data general database construction method which comprises the following steps: acquiring a data type strongly associated with a mobile phone number, configuring a multi-dimensional general interface based on the data type, and automatically loading and generating a general database based on a configuration result; splitting the mobile phone number based on a preset number splitting rule, and taking a number segment obtained by splitting as an addressing address; performing address marking on the general database based on the addressing address, and performing multi-dimensional management configuration on the general database after address marking based on the multi-dimensional general interface; and converting the universal database into a deployment file based on the multi-dimensional management configuration result, and performing multi-category terminal difference deployment on the deployment file based on the deployment requirement. The deployment requirements of different environments are met, meanwhile, the resource demand quantity is reduced, and the storage efficiency and the management effect of the mobile phone number related data are improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method for constructing a general mobile phone number big data database with low resource requirements. Background Art

[0002] At present, in this information age, more and more information is bound to mobile phone numbers, involving all aspects of our lives such as food, clothing, housing and transportation. According to mobile phone numbers, we can quickly record, process and query related information, and then conduct big data analysis and utilization on this basis, which has become a topic worth exploring;

[0003] Nowadays, it is common to use distributed file systems, such as Hadoop Distributed File System (HDFS); columnar databases, such as Apache HBase; NoSQL databases, such as MongoDB; in-memory databases, such as Apache Ignite and MemSQL; relational databases, such as MySQL. Although these methods can realize functions, are highly scalable and fault-tolerant, and are very suitable for storing massive unstructured data, providing high availability and reliability, they have too many complex functions to meet general requirements and have the following common disadvantages:

[0004] The process of installation, configuration and maintenance is complex, not lightweight, not green enough, and increases maintenance costs;

[0005] Because there is no targeted optimization, storing the associated information of hundreds of millions of mobile phone numbers requires a large amount of server resources, increasing hardware costs;

[0006] The data backup and re-initialization speed is too slow to store the associated information of hundreds of millions of mobile phone numbers. It cannot meet the requirements of fast service restart, fast redeployment, and fast backup.

[0007] Because it is universal, it consumes a lot of system resources when querying and processing large amounts of data. The query efficiency is unstable and it is difficult to support high-concurrency, stable and efficient queries.

[0008] Therefore, in order to overcome the above-mentioned defects, the present invention provides a method for constructing a universal database of mobile phone number big data with low resource requirements. Summary of the invention

[0009] The present invention provides a method for constructing a universal database of mobile phone number big data with low resource demand, which is used to determine the data type strongly associated with the mobile phone number, realize the universal database corresponding to the data type definition, thereby facilitating the effective management of different types of data associated with the mobile phone number, secondly, split the mobile phone number, and realize the accurate and effective determination of the addressing addresses corresponding to different mobile phone numbers, thereby facilitating the fast and accurate storage and query of massive data, and finally, multi-dimensional management configuration of the universal database is performed through a universal interface, and the universal database after the multi-dimensional management configuration is differentially deployed, ensuring that the constructed universal database can run effectively and meet the deployment requirements of different environments. At the same time, the resource demand is reduced and the storage efficiency and management effect of mobile phone number related data are improved.

[0010] The present invention provides a method for constructing a universal database of mobile phone number big data with low resource requirements, comprising:

[0011] Step 1: Obtain data types that are strongly associated with mobile phone numbers, configure a multi-dimensional universal interface based on the data type, and automatically load and generate a universal database based on the configuration results;

[0012] Step 2: Split the mobile phone number based on the preset number splitting rule, and use the split number segments as the addressing address;

[0013] Step 3: address-marking the general database based on the addressing address, and performing multi-dimensional management configuration on the address-marked general database based on the multi-dimensional general interface;

[0014] Step 4: Convert the general database into deployment files based on the multi-dimensional management configuration results, and perform differential deployment of the deployment files on multiple categories of terminals based on deployment requirements.

[0015] Preferably, a method for constructing a general database of mobile phone number big data with low resource requirements, in step 1, obtaining a data type strongly associated with the mobile phone number, including:

[0016] Based on the big data network, multi-dimensional data associated with the mobile phone number is obtained, and time series analysis of the multi-dimensional data is performed based on preset correlation indicators to obtain state change characteristics of the multi-dimensional data;

[0017] Divide the multi-dimensional data into directly related data and data to be analyzed based on the state change characteristics, and determine the data regularity characteristics of the data to be analyzed based on the time series analysis results;

[0018] Determine the causal relationship between the mobile phone number and the data to be analyzed based on the data regularity characteristics, and determine the degree of association between the data to be analyzed and the mobile phone number based on the causal relationship, and extract the data to be analyzed with a degree of association greater than a preset threshold;

[0019] The extraction results and directly associated data are aggregated to obtain strongly associated data of the mobile phone number, and the data type strongly associated with the mobile phone number is determined based on the data attributes of the strongly associated data.

[0020] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements, in step 1, a multi-dimensional universal interface is configured based on the data type, and a universal database is automatically loaded and generated based on the configuration result, including:

[0021] Obtain the business requirements of the general database and determine the configuration items of the general interface based on the business requirements;

[0022] Call the corresponding interface function based on the configuration item, and adapt the function of the general interface based on the interface function;

[0023] Add database connection parameters to the general interface based on the function adaptation result, and bind the general interface and the obtained data type based on the added result;

[0024] The binding results and data types are encapsulated as a self-starting loading file, and a general database is automatically loaded and generated based on the self-starting loading file.

[0025] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements configures a multi-dimensional universal interface based on the data type, wherein the multi-dimensional universal interface includes a data length acquisition interface, a serialization interface, a deserialization interface, a query interface, and a data cleaning interface.

[0026] Preferably, a method for constructing a general database of mobile phone number big data with low resource requirements, in step 2, the mobile phone number is split based on a preset number splitting rule, and the number segments obtained by the splitting are used as addressing addresses, including:

[0027] Determine the split point of the mobile phone number based on the preset number splitting rule, and perform rule splitting on the mobile phone number based on the split point;

[0028] The number segments are obtained based on the rule splitting results, and the level priority of each number segment is determined based on the preset definition;

[0029] The auxiliary tags are added to the number segments based on the level priority, and the number segments are sorted bit by bit based on the adding result, and the addressing address is obtained based on the sorting result.

[0030] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements, in step 3, address marking is performed on the universal database based on the addressing address, and multi-dimensional management configuration is performed on the universal database after address marking based on the multi-dimensional universal interface, including:

[0031] Obtain the obtained addressing address, and convert the addressing address into an address index character. At the same time, create an address association table in a general database, map the addressing address and the address index character in the association table, and complete the address marking of the general data based on the mapping result;

[0032] A multi-dimensional management project for the address-tagged general database is obtained, and multi-dimensional management configuration is performed on the address-tagged general database according to the multi-dimensional management project based on a multi-dimensional general interface.

[0033] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements performs multi-dimensional management configuration on the universal database after address marking according to multi-dimensional management projects based on a multi-dimensional universal interface, including:

[0034] When configuring data storage for a general database:

[0035] Get the split result of the mobile phone number, and create an array of corresponding character length for each number segment based on the split result;

[0036] Based on the arrangement order of the number segments, the corresponding index number is matched bit by bit from the corresponding array, and the index number is used as the memory management address of the corresponding mobile phone number;

[0037] Determine the memory block based on the memory management address, and obtain the data to be stored corresponding to the mobile phone number;

[0038] Determine the data length of the data to be stored, and adaptively expand the memory block according to the data length based on a preset expansion rule;

[0039] The data to be stored is serialized based on the general interface to obtain a binary string corresponding to the data to be stored, and the binary string of the data to be stored is compressed and stored based on the expansion result.

[0040] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements performs multi-dimensional management configuration on the universal database after address marking according to multi-dimensional management projects based on a multi-dimensional universal interface, including:

[0041] When configuring data query for a general database:

[0042] Obtain the splitting result of the mobile phone number, and lock the memory addresses corresponding to different number segments of the mobile phone number based on the splitting result;

[0043] Addressing is performed based on memory addresses corresponding to different number segments, and a memory block corresponding to the mobile phone number is obtained based on the addressing result;

[0044] Based on the general interface, the data in the memory block is traversed according to the data query length, and the target binary string of the corresponding length is locked based on the traversal result;

[0045] Extract the data source attribute of the target binary string, and compare the data source attribute with the mobile phone number based on the general interface, and deserialize the target binary string after the comparison is passed;

[0046] Return the deserialization result.

[0047] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements performs multi-dimensional management configuration on the universal database after address marking according to multi-dimensional management projects based on a multi-dimensional universal interface, including:

[0048] When configuring data backup and recovery for a common database:

[0049] Obtaining the data volume scale in the general database, and determining the volume of step-by-step backup files for the general database based on the data volume scale;

[0050] Determine the target backup file corresponding to the mobile phone number based on the amount of the step backup file, and enter the compressed and stored binary string into the corresponding target backup file. At the same time, determine the storage identifier of the target backup file based on the data source, and enter the storage identifier into the target backup file synchronously, and complete the data backup based on the entry result;

[0051] At the same time, data recovery requests are monitored in real time, and the target backup files are read based on the monitoring results;

[0052] Based on the reading result, the compressed and stored binary string is reconstructed in the memory block according to the storage identifier, and the data is recovered based on the reconstruction result.

[0053] Preferably, a method for constructing a universal database of mobile phone number big data with low resource requirements, in step 4, converting the universal database into a deployment file based on the multi-dimensional management configuration result, and performing differential deployment of the deployment file for multiple categories of terminals based on the deployment requirements, including:

[0054] Obtain the multi-dimensional management configuration result of the general database, and convert the general database after the multi-dimensional management configuration into a deployment file;

[0055] Parse the deployment requirements, determine the deployment type of the deployment file, and adjust the parameters of the deployment environment based on the deployment type;

[0056] Based on the parameter adjustment results, the deployment files are deployed differently for multiple categories of terminals. At the same time, the changing trend of the data volume is monitored in real time. When the changing trend is greater than the preset requirement, distributed terminal differential deployment is performed on the terminal differential deployment.

[0057] Compared with the prior art, the present invention has the following beneficial effects:

[0058] 1. By determining the data type that is strongly associated with the mobile phone number, a universal database corresponding to the data type definition is implemented, thereby facilitating the effective management of different types of data associated with the mobile phone number. Secondly, the mobile phone number is split to achieve accurate and effective determination of the addressing addresses corresponding to different mobile phone numbers, thereby facilitating the fast and accurate storage and query of massive data. Finally, the universal database is managed and configured in multiple dimensions through a universal interface, and the universal database after the multi-dimensional management configuration is deployed differentially to ensure that the constructed universal database can run effectively and meet the deployment requirements of different environments. At the same time, the resource demand is reduced and the storage efficiency and management effect of mobile phone number related data are improved.

[0059] 2. By establishing an array of corresponding character length for each number segment according to the splitting result of the mobile phone number, and selecting the index number corresponding to the corresponding number segment from the corresponding array, the memory management addresses of different mobile phone numbers can be accurately and effectively determined. Secondly, the memory blocks corresponding to different mobile phone numbers are determined according to the obtained memory management addresses, so that the data to be stored corresponding to different mobile phone numbers are stored in the corresponding memory blocks, and the memory blocks are adaptively expanded according to the data length corresponding to the data to be stored, so as to effectively store the data to be stored. Finally, the data to be stored is serialized, and the data obtained by the serialization is compressed and stored, which improves the efficiency of storing the data to be stored corresponding to different mobile phone numbers.

[0060] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in this application document.

[0061] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0063] Figure 1This is a flow chart of a method for constructing a universal database of mobile phone number big data with low resource requirements in an embodiment of the present invention;

[0064] Figure 2 This is a flowchart of step 1 in a method for constructing a universal database of mobile phone number big data with low resource requirements in an embodiment of the present invention;

[0065] Figure 3 This is a flowchart of step 2 in a method for constructing a universal database of mobile phone number big data with low resource requirements in an embodiment of the present invention. DETAILED DESCRIPTION

[0066] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0067] Embodiment 1:

[0068] This embodiment provides a method for constructing a universal database of mobile phone number big data with low resource requirements, such as Figure 1 As shown, including:

[0069] Step 1: Obtain data types that are strongly associated with mobile phone numbers, configure a multi-dimensional universal interface based on the data type, and automatically load and generate a universal database based on the configuration results;

[0070] Step 2: Split the mobile phone number based on the preset number splitting rule, and use the split number segments as the addressing address;

[0071] Step 3: address-marking the general database based on the addressing address, and performing multi-dimensional management configuration on the address-marked general database based on the multi-dimensional general interface;

[0072] Step 4: Convert the general database into deployment files based on the multi-dimensional management configuration results, and perform differential deployment of the deployment files on multiple categories of terminals based on deployment requirements.

[0073] In this embodiment, the strongly associated data type refers to data that is directly related to the mobile phone number, such as number blacklist and whitelist data, number registration and login data, number sending and status data, and number online status data.

[0074] In this embodiment, the multi-dimensional universal interface refers to a data length acquisition interface, a serialization interface, a deserialization interface, a query interface, and a data cleaning interface.

[0075] In this embodiment, the multi-dimensional management configuration refers to the configuration of data storage, data query, data backup and data recovery for general data.

[0076] In this embodiment, the preset number splitting rule is set in advance, for example, 1391**8**** can be split into 139 / 1**8 / ** / **, where 139 represents the network identification number, 1**8 represents the area code, and ** / ** is a custom code used to represent the memory address code corresponding to the mobile phone number.

[0077] In this embodiment, the addressing address refers to the data content obtained after splitting the mobile phone number, that is, the network identification number, the area code and the custom code are used as the memory address corresponding to the mobile phone number.

[0078] In this embodiment, the multi-dimensional management configuration refers to configuring specific strategies for data storage, data query, data backup, and data recovery of a general database.

[0079] In this embodiment, the deployment file refers to converting the configured universal database into a dll file through a computer, thereby facilitating rapid deployment of the universal database on different servers or terminals.

[0080] In this embodiment, the deployment requirements are known in advance, for example, the deployment file may be used as a database embedded in a program, or may be run as a separate service.

[0081] In this embodiment, differential deployment on multiple types of terminals refers to deploying the deployment files on corresponding terminals according to the deployment requirements, including deploying them separately on the server and running them in cooperation with other programs on the terminal.

[0082] The working principle and beneficial effects of the above technical solution are: by determining the data type strongly associated with the mobile phone number, a universal database corresponding to the data type definition is implemented, thereby facilitating the effective management of different types of data associated with the mobile phone number; secondly, the mobile phone number is split to achieve accurate and effective determination of the addressing addresses corresponding to different mobile phone numbers, thereby facilitating the fast and accurate storage and query of massive data; finally, the universal database is managed and configured in multiple dimensions through a universal interface, and the universal database after the multi-dimensional management configuration is differentially deployed to ensure that the constructed universal database can operate effectively and meet the deployment requirements of different environments. At the same time, the resource demand is reduced and the storage efficiency and management effect of mobile phone number related data are improved.

[0083] Embodiment 2:

[0084] Based on Example 1, this embodiment provides a method for constructing a general database of mobile phone number big data with low resource requirements. In step 1, a data type strongly associated with a mobile phone number is obtained, including:

[0085] Based on the big data network, multi-dimensional data associated with the mobile phone number is obtained, and time series analysis of the multi-dimensional data is performed based on preset correlation indicators to obtain state change characteristics of the multi-dimensional data;

[0086] Divide the multi-dimensional data into directly related data and data to be analyzed based on the state change characteristics, and determine the data regularity characteristics of the data to be analyzed based on the time series analysis results;

[0087] Determine the causal relationship between the mobile phone number and the data to be analyzed based on the data regularity characteristics, and determine the degree of association between the data to be analyzed and the mobile phone number based on the causal relationship, and extract the data to be analyzed with a degree of association greater than a preset threshold;

[0088] The extraction results and directly associated data are aggregated to obtain strongly associated data of the mobile phone number, and the data type strongly associated with the mobile phone number is determined based on the data attributes of the strongly associated data.

[0089] In this embodiment, multi-dimensional data refers to multiple different types of data related to mobile phone numbers, including blacklist data, whitelist data, and number registration data.

[0090] In this embodiment, the preset correlation index is set in advance and is a reference for analyzing the correlation between multi-dimensional data and collected numbers.

[0091] In this embodiment, the state change feature refers to the situation in which the multi-dimensional data develops over time, the data value and the data state change.

[0092] In this embodiment, directly associated data refers to data that can be determined to be directly associated with a mobile phone number based on state change characteristics, such as text message data.

[0093] In this embodiment, the data to be analyzed refers to data that requires further analysis of the degree of association between the data and the mobile phone number, and is a part of the multi-dimensional data.

[0094] In this embodiment, the causal relationship is used to characterize the relationship in which the data to be analyzed changes with the change of the mobile phone number, thereby facilitating the determination of data that is strongly correlated with the mobile phone number.

[0095] In this embodiment, the preset threshold is set in advance.

[0096] In this embodiment, the data attribute refers to the data type and data format of the data that is strongly associated with the mobile phone number.

[0097] The working principle and beneficial effect of the above technical solution are: by parsing the multi-dimensional data related to mobile phone numbers, the data and data types that are strongly associated with mobile phone numbers can be accurately and effectively determined, thereby providing reliable data support for building a general database of mobile phone number big data.

[0098] Embodiment 3:

[0099] Based on Example 1, this example provides a method for constructing a general database of mobile phone number big data with low resource requirements, such as Figure 2 As shown, in step 1, a multi-dimensional universal interface is configured based on the data type, and a universal database is automatically loaded and generated based on the configuration result, including:

[0100] Step 101: Obtain business requirements of a general database, and determine configuration items of a general interface based on the business requirements;

[0101] Step 102: Retrieve the corresponding interface function based on the configuration item, and perform functional adaptation on the general interface based on the interface function;

[0102] Step 103: adding database connection parameters to the general interface based on the function adaptation result, and binding the general interface and the obtained data type based on the adding result;

[0103] Step 104: Encapsulate the binding result and the data type into a self-starting loading file, and automatically load and generate a general database based on the self-starting loading file.

[0104] In this embodiment, the business requirements are known in advance and are used to characterize the purpose of the general database and the objectives to be achieved.

[0105] In this embodiment, the configuration items refer to all types of general interfaces that need to be configured.

[0106] In this embodiment, the interface function is known in advance and is used to configure the general interface accordingly.

[0107] In this embodiment, the self-startup loading file refers to converting the format of the binding result and the data type, and its purpose is to automatically generate a general database of the corresponding data type when the database is started, and each data type corresponds to a database.

[0108] The working principle and beneficial effects of the above technical solution are: by determining the business needs of the general database, the type of the general interface is accurately and effectively determined according to the business needs; secondly, the corresponding interface function is called to effectively configure the general interface according to the interface function; finally, the configured general interface and data type are bound to generate a self-starting loading file according to the binding result, and the corresponding general database is automatically generated according to the self-starting loading file, thereby ensuring the reliability and timeliness of the construction of the general database.

[0109] Embodiment 4:

[0110] Based on Example 1, this embodiment provides a method for constructing a general database of mobile phone number big data with low resource requirements, and configures a multi-dimensional general interface based on the data type, wherein the multi-dimensional general interface includes a data length acquisition interface, a serialization interface, a deserialization interface, a query interface, and a data cleaning interface.

[0111] In this embodiment, the data length acquisition interface: the method for obtaining the data length returns the length of the data serialized into a binary string, for example: int GetByteLenth();

[0112] Serialization interface: The input parameter is data of this type, and the serialized binary string is returned. During serialization, various methods can be used to compress the data according to the needs to minimize the resources required for storage, for example: byte[]GetObjectData(T obj);

[0113] Deserialization interface: The input parameter is a binary string, and the data of this type is returned, for example: T GetObject(byte[]objData);

[0114] Query interface: Search for operation data in the database according to the query conditions and query type. Return whether the query is successful and the data found, for example: Boolean isFind(byte[]objData,ref T FindObj,intFindType);

[0115] Data cleaning interface: clear data according to query conditions and time range, for example: BooleanisClear(byte[]objData,UInt64 timeS,UInt64 timeS2).

[0116] Embodiment 5:

[0117] Based on Example 1, this example provides a method for constructing a general database of mobile phone number big data with low resource requirements, such as Figure 3As shown, in step 2, the mobile phone number is split based on a preset number splitting rule, and the number segments obtained by the splitting are used as the addressing address, including:

[0118] Step 201: Determine the split point of the mobile phone number based on the preset number splitting rule, and perform rule splitting on the mobile phone number based on the split point;

[0119] Step 202: Obtain number segments based on the rule splitting result, and determine the level priority of each number segment based on a preset definition;

[0120] Step 203: Adding an auxiliary tag to the number segment based on the level priority, sorting the number segment bit by bit based on the adding result, and obtaining the addressing address based on the sorting result.

[0121] In this embodiment, the preset number splitting rule is known in advance and is used to characterize a specific splitting strategy for the mobile phone number, which may be a group of three digits, a group of four digits, or two groups of two digits from the front to the back.

[0122] In this embodiment, the number segment refers to a number data segment obtained by splitting the mobile phone number, for example, it may be 139 in 139********.

[0123] In this embodiment, the preset definition is set in advance and is used to define the types represented by different number segments.

[0124] In this embodiment, the level priority refers to the definition level represented by different number segments, for example, it can be a network identification number (operator category), an area code, and a custom label.

[0125] In this embodiment, the subsidiary tag refers to the explanation added to different number segments according to the level priority, for example, it can be an operator identification number and an area code.

[0126] The working principle and beneficial effects of the above technical solution are: by splitting the mobile phone number according to the preset number splitting rules, and determining the level priority of the number segments obtained after the split, and adding subsidiary tags to different number segments according to the determined level priority, it is convenient to determine the addressing addresses of different mobile phone numbers according to the subsidiary tags, thereby improving the general management effect of mobile phone number big data.

[0127] Embodiment 6:

[0128] Based on Example 1, this embodiment provides a method for constructing a general database of mobile phone number big data with low resource requirements. In step 3, the general database is address-marked based on the addressing address, and the general database after address marking is multi-dimensionally managed and configured based on the multi-dimensional general interface, including:

[0129] Obtain the obtained addressing address, and convert the addressing address into an address index character. At the same time, create an address association table in a general database, map the addressing address and the address index character in the association table, and complete the address marking of the general data based on the mapping result;

[0130] A multi-dimensional management project for the address-tagged general database is obtained, and multi-dimensional management configuration is performed on the address-tagged general database according to the multi-dimensional management project based on a multi-dimensional general interface.

[0131] In this embodiment, the address index character refers to a result obtained after format conversion of the addressing address, and is a character that can be marked in a general database.

[0132] The working principle and beneficial effects of the above technical solution are: by converting the format of the addressing address, the address of the general database is marked according to the conversion result, so as to facilitate the multi-dimensional management and configuration of the general database according to the address marking result, thereby ensuring the accuracy and reliability of the construction of the general database.

[0133] Embodiment 7:

[0134] Based on Example 6, this embodiment provides a method for constructing a general database of mobile phone number big data with low resource requirements, which performs multi-dimensional management configuration on the general database after address marking according to multi-dimensional management projects based on a multi-dimensional general interface, including:

[0135] When configuring data storage for a general database:

[0136] Get the split result of the mobile phone number, and create an array of corresponding character length for each number segment based on the split result;

[0137] Based on the arrangement order of the number segments, the corresponding index number is matched bit by bit from the corresponding array, and the index number is used as the memory management address of the corresponding mobile phone number;

[0138] Determine the memory block based on the memory management address, and obtain the data to be stored corresponding to the mobile phone number;

[0139] Determine the data length of the data to be stored, and adaptively expand the memory block according to the data length based on a preset expansion rule;

[0140] The data to be stored is serialized based on the general interface to obtain a binary string corresponding to the data to be stored, and the binary string of the data to be stored is compressed and stored based on the expansion result.

[0141] In this embodiment, an array of corresponding character lengths is established for each number segment, specifically including:

[0142] Since the first digit of P1: network identification number is 1, we can create an array PS1

[100] with a length of 100, and each array element stores a pointer to an array PS2

[10000] with a length of 10000;

[0143] Split each number into four parts;

[0144] Take P1: the last two digits of the network identification number as index, get the address of the PS2 array from array PS1, take P2: the area code as index, get the pointer point2 stored in array PS2;

[0145] If point2 is empty, create an array PS3

[100] with a length of 100, take P3 as index, create an information storage object, and store the pointer of the final information storage object into the array;

[0146] If point2 is not empty, take P3 as index to obtain the pointer of the final information storage object from the array object PS3

[100] pointed to by point2.

[0147] The final information storage object PS4 manages a memory block that automatically expands according to the number and type of data stored.

[0148] In this embodiment, the memory block is adaptively expanded according to the data length based on the preset expansion rule, including:

[0149] The number of data n is 1, and the length of the memory block is 1 storage unit;

[0150] When the number of data n is less than 20, the memory block length will be automatically doubled if it is insufficient;

[0151] When the number of data n is greater than or equal to 20 and less than 40, the memory block length will automatically expand by 10 storage units if it is insufficient;

[0152] When the number of data n is greater than 40 and less than 100, the memory block length will be automatically expanded to 100 storage units if it is insufficient;

[0153] When it is greater than 100, the system automatically expands the capacity by 50 storage units.

[0154] In this embodiment, the index number refers to selecting corresponding data from the corresponding array according to the value of the mobile phone number segment. For example, for the number segment 139, the corresponding 39 is selected from the corresponding

[100] . Since 1 is fixed, only the following two digits need to be selected.

[0155] In this embodiment, the memory block is used to store strongly associated data corresponding to different mobile phone numbers, that is, the corresponding data to be stored.

[0156] In this embodiment, the preset expansion rule is set in advance and is used to automatically expand the memory block according to the data length when the storage space of the memory block is insufficient.

[0157] In this embodiment, serialization processing refers to converting the data to be stored into a binary string, so as to facilitate fast and efficient storage.

[0158] The working principle and beneficial effects of the above technical solution are: by establishing an array of corresponding character length for each number segment according to the splitting result of the mobile phone number, and selecting the index number corresponding to the corresponding number segment from the corresponding array, the memory management addresses of different mobile phone numbers are accurately and effectively determined. Secondly, the memory blocks corresponding to different mobile phone numbers are determined according to the obtained memory management addresses, so as to facilitate the storage of the data to be stored corresponding to different mobile phone numbers in the corresponding memory blocks, and the memory blocks are adaptively expanded according to the data length corresponding to the data to be stored, so as to facilitate the effective storage of the data to be stored. Finally, the data to be stored is serialized, and the data obtained by the serialization is compressed and stored, thereby improving the efficiency of storing the data to be stored corresponding to different mobile phone numbers.

[0159] Embodiment 8:

[0160] Based on Example 6, this embodiment provides a method for constructing a general database of mobile phone number big data with low resource requirements, which performs multi-dimensional management configuration on the general database after address marking according to multi-dimensional management projects based on a multi-dimensional general interface, including:

[0161] When configuring data query for a general database:

[0162] Obtain the splitting result of the mobile phone number, and lock the memory addresses corresponding to different number segments of the mobile phone number based on the splitting result;

[0163] Addressing is performed based on memory addresses corresponding to different number segments, and a memory block corresponding to the mobile phone number is obtained based on the addressing result;

[0164] Based on the general interface, the data in the memory block is traversed according to the data query length, and the target binary string of the corresponding length is locked based on the traversal result;

[0165] Extract the data source attribute of the target binary string, and compare the data source attribute with the mobile phone number based on the general interface, and deserialize the target binary string after the comparison is passed;

[0166] Return the deserialization result.

[0167] In this embodiment, the memory address is the different mobile phone number segments obtained by splitting the mobile phone number.

[0168] In this embodiment, the target binary character string refers to data that meets the query requirement and is obtained by retrieving data in the corresponding internal storage block according to the data query length.

[0169] In this embodiment, the data source attribute refers to the specific mobile phone number information corresponding to the target binary string, and the purpose is to verify the information of the target binary string.

[0170] In this embodiment, the deserialization process refers to restoring the data of the obtained target binary string.

[0171] The working principle and beneficial effects of the above technical solution are: by locking the memory address according to the result of splitting the mobile phone number, the corresponding memory block is determined according to the locked memory address, so as to facilitate the traversal of the data in the memory block according to the query data, and to achieve accurate and effective determination of the target binary string. Finally, the obtained target binary string is compared with parameters, and the target binary string is deserialized after the parameter comparison is passed, so as to restore the target binary string to its original state, and return the result after the deserialization processing to the query terminal, thereby ensuring the reliability of data query configuration for the general database.

[0172] Embodiment 9:

[0173] Based on Example 6, this embodiment provides a method for constructing a general database of mobile phone number big data with low resource requirements, which performs multi-dimensional management configuration on the general database after address marking according to multi-dimensional management projects based on a multi-dimensional general interface, including:

[0174] When configuring data backup and recovery for a common database:

[0175] Obtaining the data volume scale in the general database, and determining the volume of step-by-step backup files for the general database based on the data volume scale;

[0176] Determine the target backup file corresponding to the mobile phone number based on the amount of the step backup file, and enter the compressed and stored binary string into the corresponding target backup file. At the same time, determine the storage identifier of the target backup file based on the data source, and enter the storage identifier into the target backup file synchronously, and complete the data backup based on the entry result;

[0177] At the same time, data recovery requests are monitored in real time, and the target backup files are read based on the monitoring results;

[0178] Based on the reading result, the compressed and stored binary string is reconstructed in the memory block according to the storage identifier, and the data is recovered based on the reconstruction result.

[0179] In this embodiment, determining the amount of step-by-step backup files for a general database based on the data volume includes:

[0180] Determine the data volume and concurrency scale. When the data volume and concurrency are small, you can choose to store all the data in one file. As the data volume and concurrency increase, you can increase the number of files. For example, all data under a network identification number generates a file, for example: 139.bbb, or a regional code generates a file, for example: 1390221.bbb, which can be split into more files as needed.

[0181] In this embodiment, the data volume scale refers to the amount of data in the general database.

[0182] In this embodiment, the replacement backup file volume refers to determining the size of the backup file volume corresponding to different data volumes according to the data volume scale.

[0183] In this embodiment, the target backup file refers to the backup files corresponding to different mobile phone numbers, and is used to record and back up the data to be stored corresponding to different mobile phone numbers.

[0184] In this embodiment, the storage identifier is used to characterize the storage tags corresponding to different mobile phone numbers, and is used to distinguish the backup files corresponding to different mobile phone numbers.

[0185] The working principle and beneficial effects of the above technical solution are: dynamically determining the required collective backup file volume through the scale of the pattern data volume, so that the storage data corresponding to different mobile phone numbers are stored in the corresponding backup files; at the same time, when performing data backup, corresponding storage identifiers are added to different backup files according to the mobile phone numbers, so as to facilitate accurate and effective distinction of backup files corresponding to different mobile phone numbers; finally, real-time monitoring of data recovery requests is carried out, and when a data recovery request is received, the data in the backup file is read and rebuilt in time, so as to realize accurate and effective configuration of data backup and recovery of common data, thereby ensuring that the constructed common database can operate effectively and meet the deployment requirements of different environments.

[0186] Embodiment 10:

[0187] Based on Example 1, this embodiment provides a method for constructing a universal database of mobile phone number big data with low resource requirements. In step 4, the universal database is converted into a deployment file based on the multi-dimensional management configuration result, and the deployment file is deployed differently for multiple categories of terminals based on the deployment requirements, including:

[0188] Obtain the multi-dimensional management configuration result of the general database, and convert the general database after the multi-dimensional management configuration into a deployment file;

[0189] Parse the deployment requirements, determine the deployment type of the deployment file, and adjust the parameters of the deployment environment based on the deployment type;

[0190] Based on the parameter adjustment results, the deployment files are deployed differently for multiple categories of terminals. At the same time, the changing trend of the data volume is monitored in real time. When the changing trend is greater than the preset requirement, distributed terminal differential deployment is performed on the terminal differential deployment.

[0191] In this embodiment, performing distributed terminal difference deployment on terminal difference deployment includes:

[0192] When the amount of data is very large and the concurrency is very large, distributed deployment can be carried out. According to the provided number splitting rules, each group of servers can be set to be responsible for only one number segment. If the amount of data continues to increase, each group of servers can be set to be responsible for only one area of ​​one number segment, and so on. Distributed deployment can be carried out as needed.

[0193] In this embodiment, the deployment file refers to converting the multi-dimensionally configured universal database into a program format that can be quickly deployed in different terminals, thereby achieving effective deployment of the universal database.

[0194] In this embodiment, the deployment requirements are known in advance and are used to characterize the requirements for deployment of the deployment file and the deployment environment, wherein the deployment types include running alone in the server and running in collaboration with an existing program in the terminal.

[0195] In this embodiment, parameter adjustment refers to adapting the corresponding deployment environment according to the corresponding deployment type to ensure that the deployment file can be deployed accurately and effectively.

[0196] In this embodiment, the preset requirements are known in advance.

[0197] The working principle and beneficial effects of the above technical solution are: by converting the universal database after multi-dimensional management configuration into a deployment file, it is convenient to quickly and effectively deploy it in different terminals. Secondly, the deployment type is determined according to the deployment requirements, and the parameters of the corresponding deployment environment are adjusted according to the deployment type, thereby ensuring the reliability of the deployment of the deployment file. Finally, the changing trend of the data volume is monitored in real time, and the deployment status of the universal database is dynamically adjusted according to the changing trend, thereby ensuring the stable operation of the universal database.

[0198] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for constructing a universal database of mobile phone number big data with low resource requirements, characterized in that: include: Step 1: Obtain data types that are strongly associated with mobile phone numbers, configure a multi-dimensional universal interface based on the data type, and automatically load and generate a universal database based on the configuration results; Step 2: Split the mobile phone number based on the preset number splitting rule, and use the split number segments as the addressing address; Step 3: address-marking the general database based on the addressing address, and performing multi-dimensional management configuration on the address-marked general database based on the multi-dimensional general interface; Step 4: Convert the general database into deployment files based on the multi-dimensional management configuration results, and perform differential deployment of the deployment files on multiple categories of terminals based on deployment requirements.

2. According to the method for constructing a universal database of mobile phone number big data with low resource requirements in claim 1, it is characterized in that: In step 1, the data types strongly associated with the mobile phone number are obtained, including: Based on the big data network, multi-dimensional data associated with the mobile phone number is obtained, and time series analysis of the multi-dimensional data is performed based on preset correlation indicators to obtain state change characteristics of the multi-dimensional data; Divide the multi-dimensional data into directly related data and data to be analyzed based on the state change characteristics, and determine the data regularity characteristics of the data to be analyzed based on the time series analysis results; Determine the causal relationship between the mobile phone number and the data to be analyzed based on the data regularity characteristics, and determine the degree of association between the data to be analyzed and the mobile phone number based on the causal relationship, and extract the data to be analyzed with a degree of association greater than a preset threshold; The extraction results and directly associated data are aggregated to obtain strongly associated data of the mobile phone number, and the data type strongly associated with the mobile phone number is determined based on the data attributes of the strongly associated data.

3. According to the method for constructing a universal database of mobile phone number big data with low resource requirements in claim 1, it is characterized in that: In step 1, a multi-dimensional universal interface is configured based on the data type, and a universal database is automatically loaded and generated based on the configuration result, including: Obtain the business requirements of the general database and determine the configuration items of the general interface based on the business requirements; Call the corresponding interface function based on the configuration item, and adapt the function of the general interface based on the interface function; Add database connection parameters to the general interface based on the function adaptation result, and bind the general interface and the obtained data type based on the added result; The binding results and data types are encapsulated as a self-starting loading file, and a general database is automatically loaded and generated based on the self-starting loading file.

4. According to the method for constructing a universal database of mobile phone number big data with low resource requirements as claimed in claim 1, it is characterized in that: A multi-dimensional general interface is configured based on the data type, wherein the multi-dimensional general interface includes a data length acquisition interface, a serialization interface, a deserialization interface, a query interface, and a data cleaning interface.

5. According to the method for constructing a universal database of mobile phone number big data with low resource requirements in claim 1, it is characterized in that: In step 2, the mobile phone number is split based on a preset number splitting rule, and the number segments obtained by the splitting are used as the addressing address, including: Determine the split point of the mobile phone number based on the preset number splitting rule, and perform rule splitting on the mobile phone number based on the split point; The number segments are obtained based on the rule splitting results, and the level priority of each number segment is determined based on the preset definition; The auxiliary tags are added to the number segments based on the level priority, and the number segments are sorted bit by bit based on the adding result, and the addressing address is obtained based on the sorting result.

6. According to the method for constructing a universal database of mobile phone number big data with low resource requirements as claimed in claim 1, it is characterized in that: In step 3, the address of the general database is marked based on the addressing address, and multi-dimensional management configuration is performed on the address-marked general database based on the multi-dimensional general interface, including: Obtain the obtained addressing address, and convert the addressing address into an address index character. At the same time, create an address association table in a general database, map the addressing address and the address index character in the association table, and complete the address marking of the general data based on the mapping result; A multi-dimensional management project for the address-tagged general database is obtained, and multi-dimensional management configuration is performed on the address-tagged general database according to the multi-dimensional management project based on a multi-dimensional general interface.

7. The method for constructing a universal database of mobile phone number big data with low resource requirements according to claim 6, characterized in that: Based on the multi-dimensional general interface, multi-dimensional management configuration is performed on the general database after address marking according to the multi-dimensional management project, including: When configuring data storage for a general database: Get the split result of the mobile phone number, and create an array of corresponding character length for each number segment based on the split result; Based on the arrangement order of the number segments, the corresponding index number is matched bit by bit from the corresponding array, and the index number is used as the memory management address of the corresponding mobile phone number; Determine the memory block based on the memory management address, and obtain the data to be stored corresponding to the mobile phone number; Determine the data length of the data to be stored, and adaptively expand the memory block according to the data length based on a preset expansion rule; The data to be stored is serialized based on the general interface to obtain a binary string corresponding to the data to be stored, and the binary string of the data to be stored is compressed and stored based on the expansion result.

8. The method for constructing a universal database of mobile phone number big data with low resource requirements according to claim 6, characterized in that: Based on the multi-dimensional general interface, multi-dimensional management configuration is performed on the general database after address marking according to the multi-dimensional management project, including: When configuring data query for a general database: Obtain the splitting result of the mobile phone number, and lock the memory addresses corresponding to different number segments of the mobile phone number based on the splitting result; Addressing is performed based on memory addresses corresponding to different number segments, and a memory block corresponding to the mobile phone number is obtained based on the addressing result; Based on the general interface, the data in the memory block is traversed according to the data query length, and the target binary string of the corresponding length is locked based on the traversal result; Extract the data source attribute of the target binary string, and compare the data source attribute with the mobile phone number based on the general interface, and deserialize the target binary string after the comparison is passed; Return the deserialization result.

9. The method for constructing a universal database of mobile phone number big data with low resource requirements according to claim 6, characterized in that: Based on the multi-dimensional general interface, multi-dimensional management configuration is performed on the general database after address marking according to the multi-dimensional management project, including: When configuring data backup and recovery for a common database: Obtaining the data volume scale in the general database, and determining the volume of step-by-step backup files for the general database based on the data volume scale; Determine the target backup file corresponding to the mobile phone number based on the amount of the step backup file, and enter the compressed and stored binary string into the corresponding target backup file. At the same time, determine the storage identifier of the target backup file based on the data source, and enter the storage identifier into the target backup file synchronously, and complete the data backup based on the entry result; At the same time, data recovery requests are monitored in real time, and the target backup files are read based on the monitoring results; Based on the reading result, the compressed and stored binary string is reconstructed in the memory block according to the storage identifier, and the data is recovered based on the reconstruction result.

10. The method for constructing a universal database of mobile phone number big data with low resource requirements according to claim 1, characterized in that: In step 4, the general database is converted into a deployment file based on the multi-dimensional management configuration result, and the deployment file is deployed differently for multiple types of terminals based on the deployment requirements, including: Obtain the multi-dimensional management configuration result of the general database, and convert the general database after the multi-dimensional management configuration into a deployment file; Parse the deployment requirements, determine the deployment type of the deployment file, and adjust the parameters of the deployment environment based on the deployment type; Based on the parameter adjustment results, the deployment files are deployed differently for multiple categories of terminals. At the same time, the changing trend of the data volume is monitored in real time. When the changing trend is greater than the preset requirement, distributed terminal differential deployment is performed on the terminal differential deployment.

Images