Call record data processing method, device and equipment and storage medium
By generating a file header for the call detail record (CDR) file and performing two compression operations using repeating fields and dispersion, the problem of low efficiency in CDR data processing is solved, achieving more efficient data compression and processing.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-21
- Publication Date
- 2026-03-27
AI Technical Summary
Existing technologies suffer from low efficiency in call detail record (CDR) data processing, especially when merging and compressing CDR files, resulting in poor merging performance and significant waste of computational resources.
By generating the header of the call detail record (CDR) file, the first compression is performed using the repeating fields, and the second compression is performed based on the dispersion of the field elements. The header is then extracted and updated to further compress the CDR file.
It improves the compression efficiency and compression ratio of call detail record (CDR) data, reduces the waste of computing resources, and enhances the overall efficiency of data processing.
Smart Images

Figure CN116775586B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communication technology, and in particular to a method, apparatus, device and storage medium for processing call detail record (CDR) data. Background Technology
[0002] Call detail records (CDRs) in the telecommunications industry can contain hundreds of data fields, including but not limited to the calling number, the city / province of the calling number, the called number's city / province, the called number's city / province, the call start time, and the call end time. CDR processing programs need to process the information in each CDR, including converting numbers and user codes, querying product information, querying province / city codes, and converting key information. As more information is added to the CDR file, the final size of a single CDR increases dramatically. A single CDR file needs to be circulated among multiple programs, and the size of the CDR significantly impacts processing efficiency, storage capacity, I / O throughput, and external resource support.
[0003] Existing technologies can merge multiple call detail records (CDRs) in a call detail record (CDR) file, such as call records or data records, or compress individual CDRs in a CDR file using compression algorithms.
[0004] However, when merging multiple call detail records (CDRs), the number of CDRs that can be merged is limited, the compression effect is poor, and the compression algorithm wastes a lot of computing resources and is inefficient. Summary of the Invention
[0005] This application provides a call detail record (CDR) data processing method, apparatus, device, and storage medium to solve the problem of low CDR data processing efficiency.
[0006] Firstly, this application provides a method for processing call detail record (CDR) data, including:
[0007] Obtain a call detail record (CDR) file, which includes multiple CDR data entries, and the CDR data includes multiple fields;
[0008] The header of the call detail record (CDR) file is generated based on the duplicate fields in multiple CDR data entries, and the CDR file is compressed for the first time.
[0009] Based on the dispersion of each element in each field of the call detail record (CDR) file after the first compression, the header of the CDR file is updated to obtain the updated header, and the CDR file is then compressed a second time.
[0010] Secondly, this application provides a call detail record (CDR) data processing apparatus, comprising:
[0011] The acquisition module is used to acquire a call detail record (CDR) file, which includes multiple CDR data entries and multiple fields.
[0012] The compression module is used to generate the header of the call detail record (CDR) file based on the repeated fields in multiple CDR data, and to perform the first compression on the CDR file;
[0013] The compression module is also used to update the header of the call detail record (CDR) file based on the dispersion of each element in each field of the CDR file after the first compression, to obtain the updated header, and then to perform a second compression on the CDR file.
[0014] Thirdly, this application provides a call detail record (CDR) data processing device, comprising:
[0015] Processor, memory, communication interface;
[0016] The memory is used to store the executable instructions of the processor;
[0017] The processor is configured to execute the call detail record (CDR) data processing method described in the first aspect above by executing the executable instructions.
[0018] Fourthly, this application provides a readable storage medium, including: a computer program stored thereon, wherein the computer program, when executed by a processor, implements the call detail record (CDR) data processing method described in the first aspect above.
[0019] The call detail record (CDR) data processing method, apparatus, device, and storage medium provided in this application acquire a CDR file, generate a CDR file header based on duplicate fields in multiple CDR data entries, perform a first compression on the CDR file, update the CDR file header based on the dispersion of each element in each field of the first compressed CDR file, obtain an updated file header, and perform a second compression on the CDR file. The first compression of the CDR file is completed by extracting and summarizing duplicate fields based on the CDR file, which is a simple and efficient compression method. Furthermore, by identifying some duplicate fields based on the dispersion of each element in each field, a second compression is performed on the CDR file, which is also relatively simple and efficient. The addition of a second compression on top of the first compression increases the compression ratio of the CDR data to some extent. Attached Figure Description
[0020] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0021] Figure 1 A flowchart illustrating the call detail record (CDR) data processing method provided in this application embodiment;
[0022] Figure 2 Example diagram of a partial call detail record (CDR) file with repetitive fields;
[0023] Figure 3 Example diagram showing duplicate call detail records (CDRs) and the remaining CDR data after extracting duplicate fields;
[0024] Figure 4 This is a schematic diagram illustrating the process of generating a file header for a call detail record (CDR) file based on duplicate fields in multiple CDR data, and performing the first compression of the CDR file, as provided in this embodiment of the application.
[0025] Figure 5 This is a schematic diagram illustrating the process of updating the header of a call detail record (CDR) file based on the dispersion of each element in each field of the first compressed CDR file, obtaining the updated header, and then performing a second compression of the CDR file, as provided in this embodiment of the application.
[0026] Figure 6 A schematic diagram illustrating the process of reading a second-compressed call detail record (CDR) file, provided as an embodiment of this application.
[0027] Figure 7 A schematic diagram of a call detail record (CDR) data processing device provided in an embodiment of this application;
[0028] Figure 8 This is a schematic diagram of the structure of a call detail record (CDR) data processing device provided in an embodiment of this application.
[0029] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation
[0030] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.
[0031] Existing technologies can merge multiple call detail records (CDRs) in a CDR file, such as call records or data flow records, or compress individual CDRs in the CDR file using compression algorithms. However, when merging multiple CDRs, the number of CDRs that can be merged is limited, the compression effect is poor, and using compression algorithms to compress CDRs wastes a lot of computing resources and is inefficient.
[0032] This application obtains call detail records (CDRs), generates a CDR header based on duplicate fields in multiple CDR data entries, performs a first compression on the CDR file, updates the CDR header based on the dispersion of each element in each field of the first compressed CDR file, and then performs a second compression on the CDR file. The first compression of the CDR file is completed by extracting and summarizing duplicate fields based on the duplicate fields. This compression method is simple and efficient. Furthermore, by identifying some duplicate fields based on the dispersion of each element in each field, a second compression is performed on the CDR file. This compression method is also relatively simple and efficient. The addition of a second compression on top of the first compression increases the compression ratio of the CDR data to some extent.
[0033] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.
[0034] Figure 1 This is a flowchart illustrating the call detail record (CDR) data processing method provided in the first embodiment of this application. The executing entity is a CDR data processing device, which can generally be implemented through software, hardware, or a combination of both.
[0035] like Figure 1 As shown, the call detail record (CDR) data processing method in this embodiment may include the following steps:
[0036] Step S101: Obtain the call detail record (CDR) file. The CDR file contains multiple CDR data entries, and each CDR data entry contains multiple fields.
[0037] Specifically, it can obtain the call detail record (CDR) file to be processed, which contains multiple CDR data entries, and the CDR data includes multiple fields.
[0038] The fields in the call detail record (CDR) data include, but are not limited to: calling number, city of origin of calling number, province of origin of calling number, called number, city of origin of called number, province of origin of called number, call start time, and call end time.
[0039] Step S102: Generate the header of the call detail record (CDR) file based on the duplicate fields in multiple CDR data, and perform the first compression of the CDR file.
[0040] Call detail records (CDRs) are distributed through switches in various provinces and cities. Because switches of the same type are related by geographical location and related settings, some CDRs in the CDR data have duplicate fields. Figure 2This is an example diagram of a partial call detail record (CDR) file with repeated fields. Therefore, a file header can be generated based on the repeated fields from multiple CDR data entries, and the CDR file can be compressed for the first time. The file header refers to the header file that extracts and summarizes the repeated fields from the multiple CDR data entries. Optionally, the file header may include, but is not limited to: the repeated fields of the CDR data, the column numbers of the repeated fields, and the corresponding substitute characters for the repeated fields. The repeated fields described above are mostly common data. Figure 3 This is an example diagram showing the duplicate fields in call detail records (CDRs) and the remaining CDR data after extracting the duplicate fields.
[0041] Specifically, after generating the header of the call detail record (CDR) file based on the duplicate fields in multiple CDR data entries, the CDR file can be compressed for the first time based on the header, resulting in a first-compressed CDR file. Optionally, the first-compressed CDR file may include: a header, and multiple remaining CDR data entries including substitutes for the duplicate fields.
[0042] Step S103: Based on the dispersion of each element in each field of the call detail record (CDR) file after the first compression, update the header of the CDR file to obtain the updated header, and then compress the CDR file for the second time.
[0043] Specifically, after generating the header of the call detail record (CDR) file based on the duplicate fields in multiple CDR data, and performing the first compression on the CDR file to obtain the first compressed CDR file, the header of the CDR file can be updated based on the dispersion of each element in each field of the first compressed CDR file to obtain the updated header. Then, the CDR file is compressed a second time based on the updated header.
[0044] Specifically, in addition to the repeated fields described in step S102, the call detail record (CDR) file also includes some partially repeated fields. For example, among the fields of the CDR data, the called number's city of origin and the called number's province of origin are highly repeated. Therefore, the CDR file can be compressed a second time based on the aforementioned partially repeated fields. Optionally, based on the dispersion of each element in each field of the first compressed CDR file, the partially repeated fields can be obtained, and the file header of the CDR file can be updated to obtain the updated file header. Optionally, the added content in the updated file header includes, but is not limited to: partially repeated fields of the CDR data, column numbers of the partially repeated fields, and partial substitution characters corresponding to the partially repeated fields. The CDR data includes at least one partially repeated field; that is, the added content in the file header includes multiple lines, each line including a partially repeated field of the aforementioned CDR data, a column number of the partially repeated field, and a partial substitution character corresponding to the partially repeated field.
[0045] Specifically, after obtaining the updated header, the call detail record (CDR) file can be compressed a second time based on the updated header to obtain a second-compressed CDR file. Optionally, the second-compressed CDR file may include: the updated header, and multiple remaining CDR data entries, including duplicate fields and partially duplicated fields.
[0046] The call detail record (CDR) data processing method provided in this embodiment obtains a CDR file, generates a CDR file header based on duplicate fields in multiple CDR data, performs a first compression on the CDR file, updates the CDR file header based on the dispersion of each element in each field of the first compressed CDR file, and then performs a second compression on the CDR file. The first compression of the CDR file is completed by extracting and summarizing duplicate fields based on the duplicate fields. This compression method is simple and efficient. Furthermore, by identifying some duplicate fields based on the dispersion of each element in each field, a second compression is performed on the CDR file. This compression method is also relatively simple and efficient. The addition of a second compression on top of the first compression increases the compression ratio of the CDR data to some extent.
[0047] Figure 4 This is a schematic diagram illustrating the process of generating a call detail record (CDR) file header based on duplicate fields in multiple CDR data entries, as provided in the second embodiment of this application, and performing the first compression of the CDR file. Figure 1 Based on the illustrated embodiment, this embodiment elaborates on the process of generating the header of the call detail record (CDR) file based on the duplicate fields in multiple CDR data and performing the first compression of the CDR file.
[0048] like Figure 4 As shown, this embodiment generates the header of the call detail record (CDR) file based on duplicate fields in multiple CDR data entries. The first compression of the CDR file may include the following steps:
[0049] Step S401: Set corresponding substitutes for duplicate fields in multiple call detail records.
[0050] Specifically, during the process of generating the header of the call detail record (CDR) file, firstly, corresponding substitution characters can be set for duplicate fields in multiple CDR data. These substitution characters are used to replace duplicate fields in multiple CDR data, thus enabling the CDR file to complete the first compression of the substitution characters.
[0051] Step S402: Use the substitution symbol, the column number of the corresponding repeated field, and the content of the corresponding repeated field as the header of the call detail record (CDR) file.
[0052] Specifically, the substitution symbol set in step S401, the column number of the corresponding repeating field, and the content of the corresponding repeating field can be used as the header of the call detail record (CDR) file.
[0053] Step S403: Perform the first compression of the call detail record (CDR) file based on the file header to obtain the first compressed CDR file.
[0054] First, the substitution symbol and its corresponding repeating field can be extracted from the file header. Specifically, as described in step S401, the substitution symbol is used to replace the repeating field in multiple call detail record (CDR) data to complete the first compression of the CDR file. Therefore, the substitution symbol and its corresponding repeating field can be extracted from the file header of the CDR file generated in step S402.
[0055] Secondly, substitution characters can be used to replace corresponding duplicate fields in multiple call detail record (CDR) data entries to obtain a CDR file that has undergone the first compression. Specifically, the substitution characters extracted from the file header as described above can be used to replace corresponding duplicate fields in multiple CDR data entries to complete the first compression of the CDR file, resulting in a CDR file that has undergone the first compression.
[0056] Step S404: Store the first compressed call detail record (CDR) file into the CDR data processing device.
[0057] Specifically, the call detail record (CDR) file obtained in step S403 after the first compression can be stored in the CDR data processing device proposed in this application.
[0058] This embodiment provides a method for generating a call detail record (CDR) file header based on duplicate fields in multiple CDR data entries, and performing a first compression on the CDR file. This method generates the CDR file header by setting corresponding substitutes for duplicate fields in multiple CDR data entries, and then further compresses the CDR file based on the CDR file header. The compression method is simple and highly efficient.
[0059] Figure 5 This third embodiment of the application provides a flowchart illustrating the process of updating the header of a call detail record (CDR) file based on the dispersion of each element in each field of the first compressed CDR file, resulting in an updated header, and then performing a second compression of the CDR file. Figure 1 or Figure 2 Based on the illustrated embodiment, this embodiment elaborates on the process of updating the header of the call detail record (CDR) file according to the dispersion of each element in each field of the CDR file after the first compression, obtaining the updated header, and then performing a second compression on the CDR file.
[0060] like Figure 5 As shown, in this embodiment, the header of the call detail record (CDR) file is updated based on the dispersion of each element in each field of the CDR file after the first compression, resulting in an updated header. The process of compressing the CDR file for the second time may include the following steps:
[0061] Step S501: Calculate the dispersion of each element in each field of the single file after the first compression.
[0062] In the call detail record (CDR) file, each field has multiple element values, and the dispersion of each element value is not the same. The higher the dispersion of an element, the higher the repetition of the element.
[0063] Specifically, as described in step S102, the call detail record (CDR) file after the first compression may include: a file header and multiple remaining CDR data entries, including substitutes for repeated fields. Specifically, the dispersion of each element in each field within the remaining CDR data in the first compression CDR file can be statistically analyzed.
[0064] Step S502: Calculate the sum of the dispersion of a certain number of elements with high dispersion in each field.
[0065] Specifically, based on the dispersion of each element in each field of the single file after the first compression, as statistically analyzed in step S501, a certain number of elements with high dispersion in each field can be calculated, for example, the sum of the dispersion of 5 elements.
[0066] Step S503: Update the file header based on the sum of the dispersion of a certain number of elements with high dispersion in each field to obtain the updated file header.
[0067] Specifically, the file header can be updated based on the sum of the dispersion of a certain number of elements with high dispersion in each field.
[0068] First, you can filter by fields with high dispersion. Fields with high dispersion are those where the sum of the dispersion of a certain number of elements is greater than a dispersion threshold. This dispersion threshold can be preset according to user needs, for example, 60%.
[0069] Secondly, if there are a certain number of consecutive large discrete fields, the elements with the highest discreteness in the consecutive large discrete fields are cross-combined to obtain at least one partially repeated field.
[0070] Finally, the file header can be updated based on partially repeated fields.
[0071] Specifically, corresponding partial substitutes can be set for at least one partially repeated field. Based on the partial substitute, the column number of the corresponding partially repeated field, and the content of the corresponding partially repeated field, the file header is updated, and the updated file header includes multiple lines of file header data.
[0072] Step S504: Compress the call detail record (CDR) file a second time based on the updated header to obtain the CDR file after the second compression.
[0073] Specifically, partial substitution characters and their corresponding duplicate fields can be extracted from the updated file header. These partial substitution characters are then used to replace the corresponding duplicate fields in the first compressed call detail record (CDR) file, resulting in the second compressed CDR file.
[0074] Step S505: Store the second compressed call detail record (CDR) file into the CDR data processing device.
[0075] Specifically, the call detail record (CDR) file obtained in step S504 after the second compression can be stored in the CDR data processing device proposed in this application.
[0076] This embodiment provides a method for updating the header of a call detail record (CDR) file based on the dispersion of each element in each field of the first-compressed CDR file, resulting in an updated header. The second compression process involves statistically analyzing the dispersion of each element in each field of the first-compressed CDR file, calculating the sum of the dispersions of a certain number of elements with high dispersion in each field, and updating the header based on this sum. This method of determining partially duplicated fields in the CDR file using the dispersion of each element is relatively simple and efficient, thus improving the efficiency of further compressing the CDR file a second time based on the updated header.
[0077] Figure 6 This is a schematic diagram of the process for reading a second-compressed call detail record (CDR) file provided in the fourth embodiment of this application. Figure 1 , Figure 4 ,or Figure 5 Based on the illustrated embodiment, this embodiment elaborates on the process of reading the call detail record (CDR) file after a second compression.
[0078] like Figure 6 As shown, reading the call detail record (CDR) file after its second compression in this embodiment may include the following steps:
[0079] Step S601: Extract the second-compressed call detail record (CDR) file from the call detail record (CDR) data processing device. The second-compressed CDR file includes: an updated file header, and multiple remaining CDR data entries including substitute characters and partial substitute characters.
[0080] Specifically, as described in step S505, the second-compressed call detail record (CDR) file is stored in the CDR data processing device provided in this application. Therefore, the second-compressed CDR file can be extracted from the CDR data processing device. The second-compressed CDR file includes: an updated file header, and multiple remaining CDR data including substitute characters and partial substitute characters.
[0081] Step S602: Extract the substitution characters and their corresponding duplicate fields from the updated file header, and the partial substitution characters and their corresponding partial duplicate fields.
[0082] Specifically, substitution characters and their corresponding repeating fields, and partial substitution characters and their corresponding partial repeating fields can be extracted from the updated file header extracted in step S601, for use in decompressing the call detail record (CDR) file that has undergone a second compression.
[0083] Step S603: Replace the substitute characters and partial substitute characters in multiple remaining call detail records with the corresponding duplicate fields and the corresponding partially duplicate fields to obtain a complete call detail record file for use in other program processing.
[0084] Specifically, the corresponding substitution character can be replaced by a repeated field, and the corresponding partial substitution character can be replaced by a partially repeated field, so that the multiple remaining call detail records (CDRs) including substitution characters and partial substitution characters described in step S601 can be decompressed into multiple complete CDRs, i.e., complete CDR files.
[0085] Specifically, the complete call detail record (CDR) data can be sent to other processing programs for their corresponding processing. Note that the CDR data is stored sequentially during the storage process described above.
[0086] The process of reading the second-compressed call detail record (CDR) file provided in this embodiment involves storing the file header and the remaining CDR data in the CDR data processing device provided in this application, eliminating the need for reading from an additional database. Furthermore, during the reading process, all data in the file header and the remaining CDR data is valid, reducing invalid reads and improving data reading efficiency. The decompression process only involves concatenating repeated fields and the fields corresponding to some of the repeated fields with the remaining CDR data, resulting in high decompression efficiency. The high reading and decompression efficiency ensures the efficient processing of CDR data.
[0087] Figure 7 This is a schematic diagram of a call detail record (CDR) data processing device provided in the fifth embodiment of this application.
[0088] like Figure 7 As shown, the call detail record (CDR) data processing device 70 in this embodiment includes an acquisition module 71 and a compression module 72.
[0089] The acquisition module 71 is used to acquire call detail records (CDRs). The CDRs contain multiple CDR data entries, and each CDR data entry contains multiple fields.
[0090] Compression module 72 is used to generate the header of the call detail record (CDR) file based on the duplicate fields in multiple CDR data, and to perform the first compression of the CDR file.
[0091] Compression module 72 is also used to update the header of the call detail record (CDR) file based on the dispersion of each element in each field of the CDR file after the first compression, and then perform a second compression on the CDR file.
[0092] The apparatus provided in this embodiment can be used to execute the above-described method embodiments. Figures 1 to 4 The technical solution is similar in principle and effect, and will not be described again in this embodiment.
[0093] Figure 8 This is a schematic diagram of a call detail record (CDR) data processing device provided in the sixth embodiment of this application.
[0094] like Figure 8 As shown, the call detail record (CDR) data processing device 80 in this embodiment includes: a processor 81, a memory 82, and a communication interface 83.
[0095] Memory 82 is used to store the processor's executable instructions.
[0096] The processor 81 is configured to execute the above method embodiments by executing executable instructions. Figures 1 to 4 Any call detail record (CDR) data processing method.
[0097] This application also provides a readable storage medium storing a computer program thereon, wherein the computer program, when executed by a processor, performs the above-described method embodiments. Figures 1 to 4 Any call detail record (CDR) data processing method.
[0098] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.
[0099] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.
[0100] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.
Claims
1. A method for processing phone bill data, characterized by, The method comprises the following steps: obtaining a call record file, wherein the call record file comprises a plurality of call record data, and each of the call record data comprises a plurality of fields; generating a file header of the call record file according to repeated fields in the plurality of call record data, and performing first compression on the call record file; counting the dispersion of each element in each field in the call record file after the first compression; calculating the sum of the dispersion of a certain number of elements with higher dispersion in each field; selecting a large-dispersion field from the fields, wherein the large-dispersion field refers to a field whose sum of the dispersion of the certain number of elements with higher dispersion is greater than a dispersion threshold; if there is a certain number of continuous large-dispersion fields, performing cross combination on the element with the highest dispersion in the continuous large-dispersion fields to obtain at least one partial repeated field; updating the file header according to the partial repeated field; obtaining an updated file header, and performing second compression on the call record file.
2. The method of claim 1, wherein, The step of generating the file header of the call record file according to the repeated fields in the plurality of call record data comprises the following steps: setting a corresponding replacement symbol for the repeated fields in the plurality of call record data; taking the replacement symbol, the column number of the corresponding repeated field, and the content of the corresponding repeated field as the file header of the call record file.
3. The method of claim 2, wherein, The step of performing the first compression on the call record file comprises the following steps: extracting the replacement symbol and the corresponding repeated field from the file header; using the replacement symbol to replace the corresponding repeated field in the plurality of call record data to obtain the call record file after the first compression; storing the call record file after the first compression into a call record data processing device.
4. The method of claim 1, wherein, The step of updating the file header according to the partial repeated field comprises the following steps: setting a corresponding partial replacement symbol for each of the at least one partial repeated field; updating the file header according to the partial replacement symbol, the column number of the corresponding partial repeated field, and the content of the corresponding partial repeated field, wherein the updated file header comprises a plurality of file header data.
5. The method of claim 4, wherein, The step of performing the second compression on the call record file comprises the following steps: extracting the partial replacement symbol and the corresponding partial repeated field from the updated file header; using the partial replacement symbol to replace the corresponding partial repeated field in the call record file after the first compression to obtain the call record file after the second compression; storing the call record file after the second compression into the call record data processing device.
6. The method of claim 5, wherein, The method further comprises the following steps: extracting the call record file after the second compression from the call record data processing device, wherein the call record file after the second compression comprises the updated file header and a plurality of remaining call record data comprising the replacement symbol and the partial replacement symbol; extracting the replacement symbol and the corresponding repeated field from the updated file header, and extracting the partial replacement symbol and the corresponding partial repeated field; replacing the replacement symbol and the partial replacement symbol in the plurality of remaining call record data with the corresponding repeated field and the corresponding partial repeated field to obtain a complete call record file for use in other program processing.
7. A call data processing apparatus, characterized by comprising: The method comprises the following steps: An acquisition module is configured to acquire a call record file, wherein the call record file comprises a plurality of call record data, and each of the call record data comprises a plurality of fields; A compression module is configured to generate a file header of the call record file according to repeated fields in the plurality of call record data, and to perform a first compression on the call record file; The compression module is further configured to count a dispersion degree of each element in each field of the call record file after the first compression, to calculate a sum of dispersion degrees of a certain number of elements with higher dispersion degrees in each field, to filter a large dispersion degree field from the fields, wherein the large dispersion degree field refers to a field with a sum of dispersion degrees of the certain number of elements with higher dispersion degrees greater than a dispersion degree threshold, and to perform cross combination on an element with the highest dispersion degree in the large dispersion degree field if there are a certain number of continuous large dispersion degree fields, to obtain at least one partial repeated field, and to update the file header according to the partial repeated field; The updated file header is obtained, and a second compression is performed on the call record file.
8. A call data processing apparatus, characterized by comprising: An apparatus comprises: a processor, a memory, and a communication interface; the memory is configured to store executable instructions of the processor; the processor is configured to execute the executable instructions to perform the call record data processing method according to any one of claims 1 to 6.
9. A readable storage medium, having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the call record data processing method according to any one of claims 1 to 6.
10. A computer program product, characterised in that, The computer program product comprises a computer program, and the computer program is executed by the processor to implement the call record data processing method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Data compression method and related equipment
CN114745003A
Compression data processing program and compression data editing program
JP2015035207A