A fast real-time connection processing method and device based on communication call list

Abstract

The present invention discloses a fast real-time docking processing method and device based on communication call records, the method comprising: reading and parsing the field index table of each source call record, obtaining the corresponding relationship between the field name and the field index value of the source call record; obtaining the source call record, and storing the source call record one by one in the input queue after splitting the source call record according to the field; saving a single source call record in a vector after splitting it according to the field, and providing an external interface for extracting the corresponding field according to the field index value; after obtaining the source call record from the input queue, determining the target call record according to the external interface; and outputting the target call record. The present invention has a small workload and high efficiency, and can be widely used in the field of communication technology.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method and device for rapid real-time docking processing based on a communication call sheet. Background Art

[0002] The fast docking, real-time extraction and conversion processing device based on the communication bill is a basic functional component in various systems related to communication data, which provides data support for upper-level applications. Usually, the format of the target bill is relatively fixed, while the format of the source bill changes frequently. The upgrade of the source bill interface or the docking of different source bill manufacturers will cause the number or position of the source bill fields to change. Therefore, it is particularly important to design a flexible system to achieve fast docking when the source bill format changes and avoid frequent modification and update of program codes.

[0003] In the prior art, the extraction and conversion of communication call records are generally implemented by "hard coding" in the background ("hard coding" is an independently running program compiled by high-level languages ​​(such as C, C++) or scripts, or a dynamic link library embedded in the ETL framework). It has poor reusability, portability, and maintainability. When the number or position of source call record fields changes (for example, the source call record interface is upgraded or connected to different source call record manufacturers), developers need to modify and test the relevant codes, and operation and maintenance personnel need to redeploy them. The workload is large and the delivery cycle is long. It cannot meet the requirements of rapid delivery and is not suitable for data docking scenarios with complex and diverse environments and frequent changes. Summary of the invention

[0004] In view of this, an embodiment of the present invention provides a method and device for fast real-time connection processing based on communication call records with low workload and high efficiency.

[0005] One aspect of the present invention provides a fast real-time docking processing method based on a communication call record, comprising:

[0006] Read and parse the field index table of each source call record to obtain the corresponding relationship between the field name and the field index value of the source call record;

[0007] Obtaining a source call record, and splitting the source call record into items and storing them one by one in an input queue;

[0008] Split a single source call record into a vector according to fields, and provide an external interface for extracting corresponding fields based on field index values;

[0009] After obtaining the source call record from the input queue, determining the target call record according to the external interface;

[0010] Output the target call record.

[0011] Optionally, in the step of reading and parsing the field index table of each source call record to obtain the correspondence between the field name and the field index value of the source call record, the field index table includes field names and field index values; the field names and the field index values ​​match one-to-one; the field index value is used to represent the location information of the field in the source call record.

[0012] Optionally, in the step of obtaining a source call bill and splitting the source call bill into pieces and storing them one by one in an input queue, each of the split call bill fields is separated by a target character.

[0013] Optionally, the splitting of a single source call record according to fields and saving the splitted call record into a vector, and providing an external interface for extracting corresponding fields according to field index values, include:

[0014] Get a single source call record;

[0015] Traverse each source call record in byte order, and extract the fields in each source call record in order according to the separator;

[0016] Store the original content and field length corresponding to the field into the created target structure;

[0017] Add the target structure to the end of the vector;

[0018] All fields of the source call record are saved in a vector in order, where the vector index value in the vector corresponds to the field index value one by one;

[0019] According to the field index value, the corresponding field is extracted through the external interface;

[0020] Wherein, the vector is a sequential container encapsulating a dynamic size array, and is used to store various types of objects;

[0021] The configuration information of the external interface includes interface name, input parameters, return value and implementation description information.

[0022] Optionally, after acquiring the source call record from the input queue, determining the target call record according to the external interface includes:

[0023] Get the source call record from the input queue;

[0024] Obtain the field index table of the corresponding source call record according to the call record type;

[0025] According to the field index table, obtain the corresponding field index value according to the field name;

[0026] Extracting fields from a field module according to the field index value;

[0027] The extracted multiple fields and other backfill fields form the target call record.

[0028] Another aspect of the embodiment of the present invention further provides a fast real-time docking processing device based on a communication call record, comprising:

[0029] A configuration module is used to read and parse the field index table of each source call record to obtain the corresponding relationship between the field name and the field index value of the source call record;

[0030] An extraction module, used for obtaining a source call record, and splitting the source call record and storing it item by item in an input queue;

[0031] The field module is used to split a single source call record into fields and save them into vectors, and provide an external interface for extracting corresponding fields based on field index values;

[0032] A conversion module, configured to obtain a source call record from the input queue and determine a target call record according to the external interface;

[0033] An output module is used to output the target call record.

[0034] Another aspect of an embodiment of the present invention further provides an electronic device, including a processor and a memory;

[0035] The memory is used to store programs;

[0036] The processor executes the program to implement the method described above.

[0037] Another aspect of the embodiments of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a program, and the program is executed by a processor to implement the method described above.

[0038] Another aspect of an embodiment of the present invention further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the method described above is implemented.

[0039] The embodiment of the present invention also discloses a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device can read the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the above method.

[0040] The embodiment of the present invention reads and parses the field index table of each source call sheet to obtain the corresponding relationship between the field name and the field index value of the source call sheet; obtains the source call sheet, and stores the source call sheet item by item in the input queue after splitting the source call sheet; saves a single source call sheet in a vector after splitting it according to the field, and provides an external interface for extracting the corresponding field according to the field index value; after obtaining the source call sheet from the input queue, determines the target call sheet according to the external interface; and outputs the target call sheet. The present invention has a small workload and high efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0042] Figure 1 An overall structural block diagram provided for an embodiment of the present invention;

[0043] Figure 2 An overall step flow chart provided for an embodiment of the present invention;

[0044] Figure 3 A field mapping principle diagram provided for an embodiment of the present invention;

[0045] Figure 4 A processing flow chart of a field module provided in an embodiment of the present invention;

[0046] Figure 5 A processing flow chart of a conversion module provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0048] The existing "hard-coded" method has poor reusability, portability, and maintainability, a large upgrade workload, and a long delivery cycle. It cannot meet the requirements of rapid delivery and is not suitable for data docking scenarios with complex and diverse environments and frequent changes. The present invention makes up for these shortcomings of the existing "hard-coded" method, and its main technical advantages include: innovatively designing a field index table for the source call list that can be flexibly configured according to the changes in the source call list format, making full use of the characteristics of the vector elements being strictly sorted in linear order, and using a method in which the field index table and the vector container echo each other. During the extraction and conversion of the source call list, when the number or position of the source call list fields changes (for example, when the source call list interface is upgraded or docked with different source call list manufacturers, etc.), it is only necessary to modify the field index table to achieve rapid docking of the source call list. There is no need to modify any program code or recompile the program, thereby achieving the "low code" effect and meeting the requirements of rapid delivery.

[0049] One aspect of the present invention provides a fast real-time docking processing method based on a communication call record, comprising:

[0050] Read and parse the field index table of each source call record to obtain the corresponding relationship between the field name and the field index value of the source call record;

[0051] Obtaining a source call record, and splitting the source call record into items and storing them one by one in an input queue;

[0052] Split a single source call record into a vector according to fields, and provide an external interface for extracting corresponding fields based on field index values;

[0053] After obtaining the source call record from the input queue, determining the target call record according to the external interface;

[0054] Output the target call record.

[0055] Optionally, in the step of reading and parsing the field index table of each source call record to obtain the correspondence between the field name and the field index value of the source call record, the field index table includes field names and field index values; the field names and the field index values ​​match one-to-one; the field index value is used to represent the location information of the field in the source call record.

[0056] Optionally, in the step of obtaining a source call bill and splitting the source call bill into pieces and storing them one by one in an input queue, each of the split call bill fields is separated by a target character.

[0057] Optionally, the splitting of a single source call record according to fields and saving the splitted call record into a vector, and providing an external interface for extracting corresponding fields according to field index values, include:

[0058] Get a single source call record;

[0059] Traverse each source call record in byte order, and extract the fields in each source call record in order according to the separator;

[0060] Store the original content and field length corresponding to the field into the created target structure;

[0061] Add the target structure to the end of the vector;

[0062] All fields of the source call record are saved in a vector in order, where the vector index value in the vector corresponds to the field index value one by one;

[0063] According to the field index value, the corresponding field is extracted through the external interface;

[0064] Wherein, the vector is a sequential container encapsulating a dynamic size array, and is used to store various types of objects;

[0065] The configuration information of the external interface includes interface name, input parameters, return value and implementation description information.

[0066] Optionally, after acquiring the source call record from the input queue, determining the target call record according to the external interface includes:

[0067] Get the source call record from the input queue;

[0068] Obtain the field index table of the corresponding source call record according to the call record type;

[0069] According to the field index table, obtain the corresponding field index value according to the field name;

[0070] Extracting fields from a field module according to the field index value;

[0071] The extracted multiple fields and other backfill fields form the target call record.

[0072] Another aspect of the embodiment of the present invention further provides a fast real-time docking processing device based on a communication call record, comprising:

[0073] A configuration module is used to read and parse the field index table of each source call record to obtain the corresponding relationship between the field name and the field index value of the source call record;

[0074] An extraction module, used for obtaining a source call record, and splitting the source call record and storing it item by item in an input queue;

[0075] The field module is used to split a single source call record into fields and save them into vectors, and provide an external interface for extracting corresponding fields based on field index values;

[0076] A conversion module, configured to obtain a source call record from the input queue and determine a target call record according to the external interface;

[0077] An output module is used to output the target call record.

[0078] Another aspect of an embodiment of the present invention further provides an electronic device, including a processor and a memory;

[0079] The memory is used to store programs;

[0080] The processor executes the program to implement the method described above.

[0081] Another aspect of the embodiments of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a program, and the program is executed by a processor to implement the method described above.

[0082] Another aspect of an embodiment of the present invention further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the method described above is implemented.

[0083] The embodiment of the present invention also discloses a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device can read the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the above method.

[0084] The specific implementation principle of the present invention is described in detail below in conjunction with the accompanying drawings:

[0085] like Figure 1 As shown, the device of the present invention is mainly composed of a configuration module, an extraction module, a field module, a conversion module, and an output module.

[0086] Specifically, the overall implementation steps of the present invention are as follows: Figure 2As shown, it specifically includes starting the whole system, reading and parsing each source call order field index table through the configuration module to obtain the corresponding relationship between the field name and the field index value of the source call order; obtaining the source call order from the kafka cluster or file system through the extraction module, splitting them and storing them one by one in the input queue; the field module is responsible for splitting a single source call order by field and saving it to a vector, and providing an interface for extracting the corresponding field according to the field index value; obtaining the source call order from the input queue through the conversion module, obtaining the corresponding source call order field index table from the configuration module according to the call order type, extracting the field from the field module according to the field index value, and combining the extracted multiple fields with other backfill fields to form a target call order; outputting the converted target call order through the output module, and providing data support for the upper-level application after loading into the database. The field mapping principle of the embodiment of the present invention is as follows Figure 3 As shown, when the number or position of the source call record fields changes, the information can be updated by simply modifying the field index table of the source call record.

[0087] The following is a detailed description of the implementation principle of each module:

[0088] 1. Configuration module: When the program starts, this module will be run first, which is responsible for reading and parsing the field index table of each source call record to obtain the correspondence between the field name and the field index value of the source call record.

[0089] The design of the source call record field index table is shown in Table 1:

[0090] Table 1

[0091] Field Name Field index value FieldA 1 Field2 2 Field3 3 FieldB 4 Field5 5 FieldC 6 FieldD 7 Field8 8 Field… …

[0092] The field index value indicates the position of the field in the source call record. The field name can be customized, and the subsequent conversion module obtains the field index value based on the name.

[0093] 2. Extraction module: obtains source call records from the Kafka cluster or file system, splits them up and stores them one by one in the input queue.

[0094] The format of a single source call record is as follows:

[0095] A|B|C|D|E|…………;

[0096] In the embodiment of the present invention, the call record fields are separated by special characters, such as "|" or "," etc., and support dynamic configuration.

[0097] 3. Field module: responsible for splitting a single source call record by field and saving it into a vector (a vector is a sequential container that encapsulates a dynamic size array, which can store objects of various types. It can be simply considered that a vector is a dynamic array that can store any type of data. Its elements are strictly sorted in linear order, and the corresponding elements can be accessed by their position in the sequence), and provides an interface for extracting the corresponding field based on the field index value. The implementation logic is as follows: Figure 4 shown.

[0098] The structure FieldsBuffer for storing fields in the embodiment of the present invention is designed as follows:

[0099]

[0100] In addition, the external interface design of the field module of the embodiment of the present invention is shown in Table 2:

[0101] Table 2

[0102]

[0103] 4. Conversion module: Get the source call sheet from the input queue, get the corresponding source call sheet field index table from the configuration module according to the call sheet type, get the corresponding field index value according to the field name (such as FieldA, FieldB, FieldC, FieldD), extract the field from the field module according to the field index value, and combine the extracted multiple fields with other backfill fields to form the target call sheet. The implementation logic is as follows Figure 5 shown.

[0104] 5. Output module: Output the converted target call record, load it into the database and provide data support for upper-level applications.

[0105] In summary, the present invention solves the shortcomings of "hard coding" in terms of poor reusability, portability, and maintainability during the extraction and conversion of source call sheets. When the number or position of source call sheet fields changes (for example, when the source call sheet interface is upgraded or different source call sheet manufacturers are connected), only the source call sheet field index table needs to be modified to achieve rapid connection of the source call sheet. There is no need to modify any program code or recompile the program, thereby achieving a "low-code" effect and meeting the requirements of rapid delivery.

[0106] In some selectable embodiments, the function / operation mentioned in the block diagram may not occur in the order mentioned in the operation diagram. For example, depending on the function / operation involved, the two boxes shown in succession can actually be executed substantially simultaneously or the boxes can sometimes be executed in reverse order. In addition, the embodiment presented and described in the flow chart of the present invention is provided by way of example, for the purpose of providing a more comprehensive understanding of technology. The disclosed method is not limited to the operation and logic flow presented herein. Selectable embodiments are expected, wherein the order of various operations is changed and the sub-operation of a part for which is described as a larger operation is performed independently.

[0107] In addition, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise specified, one or more of the functions and / or features described may be integrated into a single physical device and / or software module, or one or more functions and / or features may be implemented in separate physical devices or software modules. It is also understood that a detailed discussion of the actual implementation of each module is unnecessary for understanding the present invention. More specifically, in view of the properties, functions, and internal relationships of the various functional modules in the device disclosed herein, the actual implementation of the module will be understood within the conventional skills of the engineer. Therefore, those skilled in the art can implement the present invention set forth in the claims without excessive experimentation using ordinary techniques. It is also understood that the specific concepts disclosed are merely illustrative and are not intended to limit the scope of the present invention, which is determined by the full scope of the appended claims and their equivalents.

[0108] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0109] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in conjunction with such instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in conjunction with such instruction execution systems, devices or apparatuses.

[0110] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0111] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0112] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0113] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

[0114] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the described embodiments. Those skilled in the art may make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of this application.

Claims

1. A fast real-time docking processing method based on communication call records, characterized in that: include: Read and parse the field index table of each source call record to obtain the corresponding relationship between the field name and the field index value of the source call record; Obtaining a source call record, and splitting the source call record into items and storing them one by one in an input queue; Split a single source call record into a vector according to fields, and provide an external interface for extracting corresponding fields based on field index values; After obtaining the source call record from the input queue, determining the target call record according to the external interface; Outputting the target call list; The method of splitting a single source call record according to fields and saving it into a vector, and providing an external interface for extracting corresponding fields according to field index values, includes: Get a single source call record; Traverse each source call record in byte order, and extract the fields in each source call record in order according to the separator; Store the original content and field length corresponding to the field into the created target structure; Add the target structure to the end of the vector; All fields of the source call record are saved in a vector in order, where the vector index value in the vector corresponds to the field index value one by one; According to the field index value, the corresponding field is extracted through the external interface; Wherein, the vector is a sequential container encapsulating a dynamic size array, and is used to store various types of objects; The configuration information of the external interface includes the interface name, input parameters, return value and implementation description information; After obtaining the source call record from the input queue, determining the target call record according to the external interface includes: Get the source call record from the input queue; Obtain the field index table of the corresponding source call record according to the call record type; According to the field index table, obtain the corresponding field index value according to the field name; Extracting fields from a field module according to the field index value; The extracted multiple fields and other backfill fields form the target call record.

2. A fast real-time docking processing method based on communication call records according to claim 1, characterized in that: In the step of reading and parsing the field index table of each source call record to obtain the correspondence between the field name and the field index value of the source call record, the field index table includes the field name and the field index value; The field name and the field index value are matched one by one; the field index value is used to represent the location information of the field in the source call record.

3. A fast real-time docking processing method based on communication call records according to claim 1, characterized in that: In the step of obtaining the source call bill and splitting the source call bill into pieces and storing them one by one in the input queue, each of the split call bill fields is separated by the target character.

4. A device for implementing the fast real-time docking processing method based on a communication call record as claimed in any one of claims 1 to 3, characterized in that: include: A configuration module is used to read and parse the field index table of each source call record to obtain the corresponding relationship between the field name and the field index value of the source call record; An extraction module, used for obtaining a source call record, and splitting the source call record and storing it item by item in an input queue; The field module is used to split a single source call record into fields and save them into vectors, and provide an external interface for extracting corresponding fields based on field index values; A conversion module, configured to obtain a source call record from the input queue and determine a target call record according to the external interface; The output module is used to output the target call record.

5. An electronic device, characterized in that: including a processor and a memory; The memory is used to store programs; The processor executes the program to implement the method according to any one of claims 1 to 3.

6. A computer-readable storage medium, characterized in that: The storage medium stores a program, and the program is executed by a processor to implement the method according to any one of claims 1 to 3.

7. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images