Advertisement information field automatic analysis method and device, equipment and storage medium

Abstract

The invention discloses an advertisement information field automatic analysis method, apparatus and device, and a storage medium. The method comprises the steps of obtaining at least one piece of delivered advertisement information corresponding to an advertisement information analysis instruction and sent by a media side server; performing data configuration on the put advertisement information based on the structural data configuration strategy so as to update the put advertisement information; performing field analysis and conversion on the put advertisement information based on a field analysis strategy to obtain analyzed advertisement information; and mapping and storing each field and the field value in the analyzed advertisement information into a target database based on the database field type and the database storage field. According to the embodiment of the invention, analysis and mapping relations of different media fields can be reduced, unified analysis and mapping of data fields of different media side servers are realized based on a field analysis strategy, and standardized data with a unified data structure and a unified field name is converted, so that subsequent big data analysis is facilitated.

Description

Technical Field

[0001] The present invention relates to the field of computer information technology, and in particular to an automatic parsing method, device, equipment and storage medium for advertising information fields. Background Art

[0002] Information promotion, such as advertising information promotion, helps to effectively spread information about the advertiser's products (such as software products, hardware products, etc.). Generally, an advertiser can push advertising information for the same product on multiple media information platforms, and after receiving the same advertising information, different media information platforms will convert the advertising information into converted advertising information that meets their own requirements based on their own data structure and field name requirements.

[0003] Afterwards, different media information platforms will send the actual promotional advertising information obtained by promoting the converted advertising information back to the advertiser's server, which will cause the actual promotional advertising information data structures corresponding to different media information platforms to be different. The advertiser's server needs to parse the fields included in the actual promotional advertising information data returned by different media information platforms to determine whether there are new field names. In addition, each time a new field name is pulled from the actual promotional advertising information data, it is necessary to publish it, and the database will add new fields for data storage; when too many new media fields are pulled, the database definition fields will increase, and the field parsing logic will become complicated, resulting in low efficiency in the advertiser's server parsing and storing data from different media information platforms. Summary of the invention

[0004] The embodiments of the present invention provide a method, device, equipment and storage medium for automatically parsing advertising information fields, aiming to solve the problem in the prior art that the advertiser's server needs to parse the fields included in the actual promotional advertising information data returned by different media information platforms. When there are new field names, not only does it need to be published, but also new fields need to be added to the database for data storage, resulting in low efficiency in the advertiser's server in parsing and storing data from different media information platforms.

[0005] In a first aspect, an embodiment of the present invention provides a method for automatically parsing an advertisement information field, comprising:

[0006] In response to the advertisement information parsing instruction, obtaining at least one delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server;

[0007] Performing data configuration on the delivered advertisement information based on a preset structural data configuration strategy to update the delivered advertisement information;

[0008] Performing field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information;

[0009] The database field type and the database storage field in the parsed advertisement information are obtained, and each field and field value in the parsed advertisement information are mapped and stored in the target database based on the database field type and the database storage field.

[0010] In a second aspect, an embodiment of the present invention further provides an automatic parsing device for advertisement information fields, comprising:

[0011] An information acquisition unit, configured to, in response to the advertisement information parsing instruction, acquire at least one piece of delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server;

[0012] A structure data configuration unit, configured to perform data configuration on the delivered advertisement information based on a preset structure data configuration strategy, so as to update the delivered advertisement information;

[0013] A field parsing and conversion unit, configured to perform field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information;

[0014] The data mapping storage unit is used to obtain the database field type and database storage field in the parsed advertisement information, and based on the database field type and database storage field, map and store each field and field value in the parsed advertisement information into a target database.

[0015] In a third aspect, an embodiment of the present invention further provides a computer device, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in the first aspect is implemented.

[0016] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the method described in the first aspect above can be implemented.

[0017] The embodiment of the present invention provides an automatic parsing method, device, equipment and storage medium for advertising information fields, the method comprising: in response to an advertising information parsing instruction, obtaining at least one advertising information that has been delivered and corresponds to the advertising information parsing instruction and is sent by a media side server; performing data configuration on the delivered advertising information based on a preset structural data configuration strategy to update the delivered advertising information; performing field parsing and conversion on the delivered advertising information based on a preset field parsing strategy to obtain parsed advertising information; obtaining a database field type and a database storage field in the parsed advertising information, and mapping and storing each field and field value in the parsed advertising information to a target database based on the database field type and the database storage field. The embodiment of the present invention can reduce the parsing and mapping relationships of different media fields, realize the unified parsing and mapping of data fields of different media side servers based on the field parsing strategy, and convert them into standardized data with a unified data structure and a unified field name, so as to facilitate subsequent big data analysis. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying any creative work.

[0019] Figure 1 A schematic diagram of an application scenario of the method for automatically parsing advertisement information fields provided by an embodiment of the present invention;

[0020] Figure 2 A schematic diagram of a flow chart of a method for automatically parsing advertisement information fields provided by an embodiment of the present invention;

[0021] Figure 3 A schematic diagram of a sub-flow diagram of a method for automatically parsing advertisement information fields provided by an embodiment of the present invention;

[0022] Figure 4 A schematic diagram of another sub-flow of the method for automatically parsing advertisement information fields provided by an embodiment of the present invention;

[0023] Figure 5 A schematic diagram of another sub-flow of the method for automatically parsing advertisement information fields provided by an embodiment of the present invention;

[0024] Figure 6 A schematic block diagram of an automatic parsing device for advertisement information fields provided by an embodiment of the present invention;

[0025] Figure 7 A schematic block diagram of a computer device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0028] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0029] It should be further understood that the term "and / or" used in the present description and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0030] Please also refer to Figure 1 and Figure 2 ,in Figure 1 Schematic diagram of a scenario of an automatic analysis method for advertisement information fields according to an embodiment of the present invention. Figure 2 FIG. 1 is a flow chart of a method for automatically parsing advertisement information fields provided by an embodiment of the present invention. Figure 1 As shown, the automatic parsing method for advertisement information fields provided by the embodiment of the present invention is applied to a business server 10 , and the business server 10 is communicatively connected with a plurality of media-side servers 20 .

[0031] like Figure 2 As shown, the method includes the following steps S110-S140.

[0032] S110. In response to the advertisement information parsing instruction, obtain at least one delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server.

[0033] In this embodiment, the technical solution is described with the business server used by the advertiser as the execution subject (of course, the business server can also be the server used by the agent commissioned by the advertiser). The business server is connected to multiple media-side servers, and the business server can send the advertising data to be pushed to multiple media-side servers to achieve the promotion of advertising information on different media platforms. For example, taking the example of the business server sending the advertising data A to be pushed to multiple media-side servers, when the pushed advertising data A is received by multiple media-side servers and the information is promoted on the platform accordingly, the business server can obtain the actual promotion data related to the advertising data A to be pushed from the media interface of each media-side server at the preset data pulling time (such as 1:00 every day), and then the actual promotion data of the advertising data A to be pushed in each media-side server within the time interval corresponding to the previous day can be obtained and further data analysis can be performed.

[0034] After receiving the advertisement data A to be pushed, each media side server will set its own data structure processing requirements (such as adding some specified fields start_time, end_time, etc. to the original data corresponding to the advertisement data A to be pushed), so each media side server extracts the data in the advertisement data A to be pushed and then performs corresponding processing in combination with the data processing requirements of the corresponding media side server to obtain processed advertisement data that meets the data requirements of each media side server. For example, taking the multiple media side servers including media side server A1 and media side server A2 as an example, after the media side server A1 receives the advertisement data A to be pushed, it retains all the original fields in the advertisement data A to be pushed and then adds the two fields start_time and end_time, thereby obtaining the processed advertisement data A1 with the media side server A1; after the media side server A2 receives the advertisement data A to be pushed, it retains all the original fields in the advertisement data A to be pushed and then adds the two fields begin_time and end_time, thereby obtaining the processed advertisement data A2 with the media side server A2. From the above example, it can be seen that although the two fields begin_time and start_time in the processed advertisement data A1 and the processed advertisement data A2 have the same meaning, there is a difference in the field names.

[0035] Continuing to refer to the above example, taking the 24-hour time interval corresponding to XX / XX / 20XX as an example, after the media-side server A1 collects data in the 24-hour time interval corresponding to XX / XX / 20XX based on the processed advertisement data A1 and fills it into the processed advertisement data A1, advertisement information A11 is obtained; after the media-side server A2 collects data in the 24-hour time interval corresponding to XX / XX / 20XX based on the processed advertisement data A2 and fills it into the processed advertisement data A2, advertisement information A21 is obtained. At this time, the advertisement information A11 is sent to the business server by the media-side server A1 at 1:00 on XX / XX / 20XX+1, and the advertisement information A21 is sent to the business server by the media-side server A2 at 1:00 on XX / XX / 20XX+1. After the business server receives the advertisement information A11 and the advertisement information A21, if no data parsing and mapping processing is performed, the advertisement information A11 and the advertisement information A21 will have different data structures and different field names. This makes it impossible for the business server to combine the advertisement information A11 and the advertisement information A21 for comprehensive data analysis. Comprehensive data analysis can only be performed by converting the combined advertisement information A11 and the advertisement information A21 into data with exactly the same data structure and exactly the same field names.

[0036] S120: Perform data configuration on the delivered advertisement information based on a preset structural data configuration strategy to update the delivered advertisement information.

[0037] In this embodiment, in order to perform data configuration processing on the delivered advertisement information in the service server, the data configuration processing on the delivered advertisement information may be performed in combination with the structured data configuration strategy preset locally in the service server. Specifically, the structured data configuration strategy is used to add multiple fields and corresponding field values ​​to the advertising information that has been delivered. The multiple newly added fields can be used as data common fields. For example, the multiple fields newly added based on the structured data configuration strategy include id (indicating the id value of the data), mediaId (indicating the media id value of the data), mediaCode (indicating the media encoding value of the data), amountConversionType (indicating the amount conversion type of the data), businessDepartment (indicating the business department of the data), databaseFieldType (indicating the database field type of the data), databaseSaveField (indicating the database save field of the data), dimension (indicating the dimension of the data), fieldBelongFunction (indicating the function to which the data field belongs), isCommonField (indicating whether the data is an identification value of a common field), mapperFieldCode (indicating the mapping field code of the data), mapperFieldType (indicating the mapping field type of the data), mediaFieldCode (indicating the media field code of the data), mediaFieldName (indicating the media field name of the data), mediaFieldType (indicating the media field type of the data) and status (indicating the status of the data), etc.

[0038] In one embodiment, step S120 includes:

[0039] A newly added public field set included in the structure data configuration strategy and a field value corresponding to each newly added public field in the newly added public field set are obtained, and added to the delivered advertisement information to update the delivered advertisement information.

[0040] In this embodiment, still referring to the above example, after adding the above listed fields to the original data fields of the placed advertisement information, specific values ​​can be assigned to each field to obtain the following results:

[0041] [{

[0042] "id":1,

[0043] "mediaId":3011,

[0044] "mediaCode":"XXXX",

[0045] "amountConversionType":0,

[0046] "businessDepartment":"channel_ad_marketing_server",

[0047] "databaseFieldType":"String",

[0048] "databaseSaveField":"common_budget_info",

[0049] "dimension":"1",

[0050] "fieldBelongFunction":"media-base-data",

[0051] "isCommonField":1,

[0052] "mapperFieldCode":"daily_budget",

[0053] "mapperFieldType":"Bigdecimal",

[0054] "mediaFieldCode":"daily_budget",

[0055] "mediaFieldName":"Daily Budget",

[0056] "mediaFieldType":"Number",

[0057] "status":1

[0058] }]

[0059] Among them, "XXXX" in ""mediaCode":"XXXX"" in the above example is the company name corresponding to the media-side server. That is to say, by adding multiple fields and corresponding field values ​​to the original data fields of the original advertising information that has been delivered based on the structural data configuration strategy, a unified public field configuration for the delivered advertising information can be achieved. Of course, the original data fields of the delivered advertising information and their corresponding field values ​​are not listed in the above example. It can be seen from the above example that the daily_budget field of the Number type in the original advertising information that has been delivered needs to be converted to the daily_budget field of the Bigdecimal type.

[0060] Of course, in the above example, "mediaFieldCode" includes not only "daily_budget", but also "start_time" and "end_time". Correspondingly, "mapperFieldCode" includes not only "daily_budget", but also "launch_start_time" corresponding to "start_time" and "launch_end_time" corresponding to "end_time". All fields included in "mediaFieldCode" are fields that need to be uniformly converted for the delivered advertising information later.

[0061] S130: Perform field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information.

[0062] In this embodiment, the delivered advertisement information includes not only the newly added fields and field values ​​corresponding to the structure data configuration strategy, but also the original fields and corresponding field values. At this time, multiple specified fields (such as mediaFieldCode, mapperFieldCode, etc. in the above example) and corresponding field values ​​in the delivered advertisement information can be obtained based on the field parsing strategy, and then the corresponding fields in the delivered advertisement information are obtained according to the field values ​​of these specified fields, and at least the corresponding field names are replaced with the field values ​​of the specified fields, so as to complete the field parsing and conversion of the delivered advertisement information and obtain the parsed advertisement information. Based on the field parsing strategy, the media field pulling and mapping relationship can be flexibly added / reduced without publishing (that is, when it is necessary to add / reduced the pulling field for the connected media, or modify the media field storage, the management end can be directly operated, and then the data can be re-pulled without publishing); and the field mapping relationship in the field parsing strategy can be flexibly adjusted based on actual needs.

[0063] In one embodiment, if Figure 3 As shown, step S130 includes:

[0064] S131. Acquire, based on the field parsing strategy, a first value corresponding to the media field code and a second value corresponding to the media field type in the delivered advertisement information;

[0065] S132: Acquire, based on the field parsing strategy, a third value corresponding to the mapping field code and a fourth value corresponding to the mapping field type in the delivered advertisement information;

[0066] S133: Convert all field names corresponding to the first value and the field type of each field name in the delivered advertisement information based on the third value and the fourth value in a field traversal manner to obtain the parsed advertisement information.

[0067] Among them, the first value includes multiple field names, and each field name has a corresponding field type in the second value; the third value includes multiple field names, each field name has a mapping relationship with one of the field names in the first value, and each field name has a corresponding field type in the fourth value.

[0068] In this embodiment, when the data of the delivered advertisement information is parsed and converted based on the field parsing strategy, not all fields in the delivered advertisement information are parsed and converted, but multiple field names corresponding to the first value in the delivered advertisement information are parsed and converted one by one in a field traversal manner. Moreover, after the multiple field names corresponding to the first value in the delivered advertisement information are converted into corresponding field names one by one in combination with the third value, the specific field types of the multiple field names corresponding to the first value in the delivered advertisement information need to be converted into corresponding field types in combination with the fourth value.

[0069] After the above-mentioned parsing and conversion processing, the obtained parsed advertising information has the same data structure and the same field name as other parsed advertising information uploaded by other media side servers and converted through parsing, which facilitates comprehensive big data analysis of data uploaded by different media side servers in the business server.

[0070] In one embodiment, if Figure 4 As shown, step S133 includes:

[0071] S1331. Based on the i-th field name in the first value, obtain the corresponding i-th initial field name and the i-th initial field value corresponding to the i-th initial field name from the advertisement information after the i-1-th round of parsing; wherein the initial value of i is 1, and the advertisement information after the 0th round of parsing is the initial delivered advertisement information;

[0072] S1332. Obtain the i-th initial field type corresponding to the i-th field name in the second value;

[0073] S1333. Obtain the i-th conversion field name corresponding to the i-th field name in the third value;

[0074] S1334. Obtain an i-th conversion field type corresponding to the i-th conversion field name in the fourth value;

[0075] S1335, converting the i-th initial field name into the i-th conversion field name, and converting the i-th initial field type into the i-th conversion field type, so as to obtain the advertisement information after the i-th round of parsing;

[0076] S1336, increment i by 1 to update the value of i;

[0077] S1337. If it is determined that i is less than or equal to N, return to execute step S1331; wherein N is the total number of field names included in the first value;

[0078] S1338: If it is determined that i is greater than N, the advertisement information after the Nth round of parsing is obtained and used as the parsed advertisement information.

[0079] In this embodiment, all field names and field name types corresponding to the first value in the delivered advertisement information are converted based on the third value and the fourth value in a traversal manner. For example, if the i-th initial field name is start_time and the field type is string, the i-th converted field name obtained after the conversion in combination with the third value is launch_start_time, and the i-th converted field type obtained after the conversion in combination with the fourth value is json. After the above parsing and conversion operations are completed, the parsed advertisement information and other parsed advertisement information in the business server have a unified data structure and fields.

[0080] In one embodiment, before step S1331, the method further includes:

[0081] Acquire, based on a traversal method, the first initial field name to the Nth initial field name corresponding to the first value in the delivered advertisement information;

[0082] Based on the traversal method, the field type corresponding to each initial field name from the 1st initial field name to the Nth initial field name is obtained from the second value; wherein the field type corresponding to each initial field name is stored in the format of a json array or a json object.

[0083] In this embodiment, the delivered advertisement information includes multiple fields and field values. For example, in the above example, "mediaId": 3011 is regarded as a group of fields and field values, and "mediaCode": "XXXX" is regarded as another group of fields and field values. Since these two groups of fields and field values ​​are separated by "," , when the 1st to Nth initial field names corresponding to the first value in the delivered advertisement information are obtained in a traversal manner, "," is used as the key identification point. Every time a "," separator is located, the string before the "," separator is obtained to obtain the initial field name and the initial field type (the initial field type can be understood as the specific field value of the initial field name). Moreover, when each group of initial field names and initial field types are obtained in the delivered advertisement information, it is necessary to specifically determine whether the field type corresponding to the initial field name is stored in the json array format or in the json object format. Of course, whether the field type corresponding to the initial field name is stored in the json array format or in the json object format, the specific content thereof can be read accordingly and used as the field type corresponding to the initial field name.

[0084] In one embodiment, after step S1335 and before step S1336, the method further includes:

[0085] If it is determined that the i-th conversion field name is an amount field type, the i-th initial field value corresponding to the i-th initial field name in the advertising information after the i-th round of parsing is converted based on the preset data amount conversion strategy to update the i-th initial field value corresponding to the i-th initial field name.

[0086] In this embodiment, the field name corresponding to the i-th initial field name in the advertisement information after the i-1th round of parsing and the field type corresponding to the field name are converted in combination with the second value to the fourth value, which is equivalent to converting the i-th initial field name into a standard field name in the business server, and the limited field type corresponding to the field name is also converted synchronously. In practical applications, there is also a need to convert the i-th initial field value corresponding to the i-th initial field name based on the data amount conversion strategy (for example, divided by a preset exchange rate value) to achieve flexible update processing of the i-th initial field value.

[0087] S140: Obtain a database field type and a database storage field in the parsed advertisement information, and map and store each field and field value in the parsed advertisement information into a target database based on the database field type and the database storage field.

[0088] In this embodiment, after obtaining the parsed advertisement information, since it has met the unified data structure requirements and unified field name requirements of the business server for advertisement information, it can be determined in which field of the target data table in the target database of the business server each field and field value in the parsed advertisement information needs to be stored in combination with the database field type and database storage field in the parsed advertisement information. Generally, each field and corresponding field value selected from the parsed advertisement information based on the database storage field is stored in a column with the same field name in the target database of the business server, thereby completing data mapping storage.

[0089] In one embodiment, if Figure 5 As shown, step S140 includes:

[0090] S141, determining a public field name to be stored in the parsed advertisement information based on the field name included in the database storage field;

[0091] S142. If it is determined that the database field type corresponding to the public field name to be saved is the same as the field type of the corresponding field in the parsed advertisement information, the field value corresponding to the public field name to be saved in the parsed advertisement information is saved to the corresponding target column in the target data table of the target database.

[0092] In this embodiment, one of the field names included in the database storage field is taken as an example, for example, one of the field names included in the database storage field is launch_start_time, and this field name in the parsed advertising information is converted to the field type of json based on the fourth value. Since the field type is set for each public field name to be saved in the database field type corresponding to the database storage field, after determining that the database field type corresponding to the public field name to be saved is the same as the field type of the corresponding field in the parsed advertising information, it means that the field type of the public field name to be saved, launch_start_time, has been verified, and the field value corresponding to the public field name to be saved, launch_start_time, is saved in the target data table of the target database in the corresponding target column (for example, the target column also has the field name launch_start_time).

[0093] It can be seen that the implementation of the method can reduce the parsing and mapping relationships of different media fields, realize unified parsing and mapping of data fields of different media side servers based on the field parsing strategy, and convert them into standardized data with unified data structure and unified field name, which is convenient for subsequent big data analysis.

[0094] Figure 6 FIG. 1 is a schematic block diagram of an automatic analysis device for advertisement information fields provided by an embodiment of the present invention. Figure 6 As shown, corresponding to the above advertisement information field automatic parsing method, the present invention also provides an advertisement information field automatic parsing device 100. The advertisement information field automatic parsing device 100 includes a unit for executing the above advertisement information field automatic parsing method. Figure 6 The advertisement information field automatic parsing device 100 includes: an information acquisition unit 110, a structure data configuration unit 120, a field parsing conversion unit 130 and a data mapping storage unit 140.

[0095] The information acquisition unit 110 is used to respond to the advertisement information parsing instruction and acquire at least one delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server.

[0096] In this embodiment, the technical solution is described with the business server used by the advertiser as the execution subject. The business server is connected to multiple media-side servers, and the business server can send the advertising data to be pushed to multiple media-side servers to promote advertising information on different media platforms. For example, taking the example of the business server sending the advertising data A to be pushed to multiple media-side servers, when the pushed advertising data A is received by multiple media-side servers and information is promoted on the platform accordingly, the business server can obtain the actual promotion data related to the advertising data A to be pushed from the media interface of each media-side server at the preset data pulling time (such as 1:00 every day), and then the actual promotion data of the advertising data A to be pushed in each media-side server within the time interval corresponding to the previous day can be obtained and further data analysis can be performed.

[0097] After receiving the advertisement data A to be pushed, each media side server will set its own data structure processing requirements (such as adding some specified fields start_time, end_time, etc. to the original data corresponding to the advertisement data A to be pushed), so each media side server extracts the data in the advertisement data A to be pushed and then performs corresponding processing in combination with the data processing requirements of the corresponding media side server to obtain processed advertisement data that meets the data requirements of each media side server. For example, taking the multiple media side servers including media side server A1 and media side server A2 as an example, after the media side server A1 receives the advertisement data A to be pushed, it retains all the original fields in the advertisement data A to be pushed and then adds the two fields start_time and end_time, thereby obtaining the processed advertisement data A1 with the media side server A1; after the media side server A2 receives the advertisement data A to be pushed, it retains all the original fields in the advertisement data A to be pushed and then adds the two fields begin_time and end_time, thereby obtaining the processed advertisement data A2 with the media side server A2. From the above example, it can be seen that although the two fields begin_time and start_time in the processed advertisement data A1 and the processed advertisement data A2 have the same meaning, there is a difference in the field names.

[0098] Continuing to refer to the above example, taking the 24-hour time interval corresponding to XX / XX / 20XX as an example, after the media-side server A1 collects data in the 24-hour time interval corresponding to XX / XX / 20XX based on the processed advertisement data A1 and fills it into the processed advertisement data A1, advertisement information A11 is obtained; after the media-side server A2 collects data in the 24-hour time interval corresponding to XX / XX / 20XX based on the processed advertisement data A2 and fills it into the processed advertisement data A2, advertisement information A21 is obtained. At this time, the advertisement information A11 is sent to the business server by the media-side server A1 at 1:00 on XX / XX / 20XX+1, and the advertisement information A21 is sent to the business server by the media-side server A2 at 1:00 on XX / XX / 20XX+1. After the business server receives the advertisement information A11 and the advertisement information A21, if no data parsing and mapping processing is performed, the advertisement information A11 and the advertisement information A21 will have different data structures and different field names. This makes it impossible for the business server to combine the advertisement information A11 and the advertisement information A21 for comprehensive data analysis. Comprehensive data analysis can only be performed by converting the combined advertisement information A11 and the advertisement information A21 into data with exactly the same data structure and exactly the same field names.

[0099] The structure data configuration unit 120 is used to perform data configuration on the delivered advertisement information based on a preset structure data configuration strategy to update the delivered advertisement information.

[0100] In this embodiment, in order to perform data configuration processing on the delivered advertisement information in the service server, the data configuration processing on the delivered advertisement information may be performed in combination with the structured data configuration strategy preset locally in the service server. Specifically, the structured data configuration strategy is used to add multiple fields and corresponding field values ​​to the advertising information that has been delivered. The multiple newly added fields can be used as data common fields. For example, the multiple fields newly added based on the structured data configuration strategy include id (indicating the id value of the data), mediaId (indicating the media id value of the data), mediaCode (indicating the media encoding value of the data), amountConversionType (indicating the amount conversion type of the data), businessDepartment (indicating the business department of the data), databaseFieldType (indicating the database field type of the data), databaseSaveField (indicating the database save field of the data), dimension (indicating the dimension of the data), fieldBelongFunction (indicating the function to which the data field belongs), isCommonField (indicating whether the data is an identification value of a common field), mapperFieldCode (indicating the mapping field code of the data), mapperFieldType (indicating the mapping field type of the data), mediaFieldCode (indicating the media field code of the data), mediaFieldName (indicating the media field name of the data), mediaFieldType (indicating the media field type of the data) and status (indicating the status of the data), etc.

[0101] In one embodiment, the structure data configuration unit 120 is used to:

[0102] A newly added public field set included in the structure data configuration strategy and a field value corresponding to each newly added public field in the newly added public field set are obtained, and added to the delivered advertisement information to update the delivered advertisement information.

[0103] In this embodiment, still referring to the above example, after adding the above listed fields to the original data fields of the delivered advertisement information, specific values ​​can be assigned to each field to obtain the result as in the corresponding example of the method embodiment:

[0104] Of course, the original data fields and corresponding field values ​​of the delivered advertisement information are not listed in the above example. From the above example, it can be seen that the daily_budget field of the Number type in the original delivered advertisement information needs to be converted to the daily_budget field of the Bigdecimal type.

[0105] Of course, in the above example, "mediaFieldCode" includes not only "daily_budget", but also "start_time" and "end_time". Correspondingly, "mapperFieldCode" includes not only "daily_budget", but also "launch_start_time" corresponding to "start_time" and "launch_end_time" corresponding to "end_time". All fields included in "mediaFieldCode" are fields that need to be uniformly converted for the delivered advertising information later.

[0106] The field parsing and conversion unit 130 is used to perform field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information.

[0107] In this embodiment, the delivered advertisement information includes not only the newly added fields and field values ​​corresponding to the structure data configuration strategy, but also the original fields and corresponding field values. At this time, multiple specified fields (such as mediaFieldCode, mapperFieldCode, etc. in the above example) and corresponding field values ​​in the delivered advertisement information can be obtained based on the field parsing strategy, and then the corresponding fields in the delivered advertisement information are obtained according to the field values ​​of these specified fields, and at least the corresponding field names are replaced with the field values ​​of the specified fields, so as to complete the field parsing and conversion of the delivered advertisement information and obtain the parsed advertisement information. Based on the field parsing strategy, the media field pulling and mapping relationship can be flexibly added / reduced without publishing (that is, when it is necessary to add / reduced the pulling field for the connected media, or modify the media field storage, the management end can be directly operated, and then the data can be re-pulled without publishing); and the field mapping relationship in the field parsing strategy can be flexibly adjusted based on actual needs.

[0108] In one embodiment, the field parsing conversion unit 130 is used to:

[0109] Based on the field parsing strategy, a first value corresponding to the media field code and a second value corresponding to the media field type in the delivered advertisement information are obtained; wherein the first value includes a plurality of field names, and each field name has a corresponding field type in the second value;

[0110] Based on the field parsing strategy, a third value corresponding to the mapped field code and a fourth value corresponding to the mapped field type in the delivered advertisement information are obtained; wherein the third value includes a plurality of field names, each field name has a mapping relationship with one of the field names of the first value, and each field name has a corresponding field type in the fourth value;

[0111] All field names corresponding to the first value and the field types of the field names in the delivered advertisement information are converted based on the third value and the fourth value in a field traversal manner to obtain the parsed advertisement information.

[0112] In this embodiment, when the data of the delivered advertisement information is parsed and converted based on the field parsing strategy, not all fields in the delivered advertisement information are parsed and converted, but multiple field names corresponding to the first value in the delivered advertisement information are parsed and converted one by one in a field traversal manner. Moreover, after the multiple field names corresponding to the first value in the delivered advertisement information are converted into corresponding field names one by one in combination with the third value, the specific field types of the multiple field names corresponding to the first value in the delivered advertisement information need to be converted into corresponding field types in combination with the fourth value.

[0113] After the above-mentioned parsing and conversion processing, the obtained parsed advertising information has the same data structure and the same field name as other parsed advertising information uploaded by other media side servers and converted through parsing, which facilitates comprehensive big data analysis of data uploaded by different media side servers in the business server.

[0114] In one embodiment, converting all field names corresponding to the first value and the field type of each field name in the delivered advertisement information based on the third value and the fourth value in a field traversal manner to obtain the parsed advertisement information includes:

[0115] Based on the i-th field name in the first value, the corresponding i-th initial field name and the i-th initial field value corresponding to the i-th initial field name are obtained from the advertisement information after the i-1-th round of parsing; wherein the initial value of i is 1, and the advertisement information after the 0th round of parsing is the initial advertisement information that has been delivered;

[0116] Obtaining the i-th initial field type corresponding to the i-th field name in the second value;

[0117] Obtaining the i-th conversion field name corresponding to the i-th field name in the third value;

[0118] Obtaining the i-th conversion field type corresponding to the i-th conversion field name in the fourth value;

[0119] Convert the i-th initial field name to the i-th converted field name, and convert the i-th initial field type to the i-th converted field type, so as to obtain the advertisement information after the i-th round of parsing;

[0120] Increment i by 1 to update the value of i;

[0121] If it is determined that i is less than or equal to N, then return to the step of obtaining the corresponding i-th initial field name from the advertisement information after the (i-1) round of parsing based on the i-th field name in the first value, and the i-th initial field value corresponding to the i-th initial field name; wherein N is the total number of field names included in the first value;

[0122] If it is determined that i is greater than N, the advertisement information after the Nth round of parsing is obtained and used as the parsed advertisement information.

[0123] In this embodiment, all field names and field name types corresponding to the first value in the delivered advertisement information are converted based on the third value and the fourth value in a traversal manner. For example, if the i-th initial field name is start_time and the field type is string, the i-th converted field name obtained after the conversion in combination with the third value is launch_start_time, and the i-th converted field type obtained after the conversion in combination with the fourth value is json. After the above parsing and conversion operations are completed, the parsed advertisement information and other parsed advertisement information in the business server have a unified data structure and fields.

[0124] In one embodiment, before obtaining the corresponding i-th initial field name and the i-th initial field value corresponding to the i-th initial field name from the advertisement information after the i-1-th round of parsing based on the i-th field name in the first value, the method further includes:

[0125] Acquire, based on a traversal method, the first initial field name to the Nth initial field name corresponding to the first value in the delivered advertisement information;

[0126] Based on the traversal method, the field type corresponding to each initial field name from the 1st initial field name to the Nth initial field name is obtained from the second value; wherein the field type corresponding to each initial field name is stored in the format of a json array or a json object.

[0127] In this embodiment, the delivered advertisement information includes multiple fields and field values. For example, in the above example, "mediaId": 3011 is regarded as a group of fields and field values, and "mediaCode": "XXXX" is regarded as another group of fields and field values. Since these two groups of fields and field values ​​are separated by "," , when the 1st to Nth initial field names corresponding to the first value in the delivered advertisement information are obtained in a traversal manner, "," is used as the key identification point. Every time a "," separator is located, the string before the "," separator is obtained to obtain the initial field name and the initial field type (the initial field type can be understood as the specific field value of the initial field name). Moreover, when each group of initial field names and initial field types are obtained in the delivered advertisement information, it is necessary to specifically determine whether the field type corresponding to the initial field name is stored in the json array format or in the json object format. Of course, whether the field type corresponding to the initial field name is stored in the json array format or in the json object format, the specific content thereof can be read accordingly and used as the field type corresponding to the initial field name.

[0128] In one embodiment, after the step of converting the i-th initial field name into the i-th converted field name, and converting the i-th initial field type into the i-th converted field type to obtain the i-th round of parsed advertising information, and before the step of incrementing i by 1 to update the value of i, the method further includes:

[0129] If it is determined that the i-th conversion field name is an amount field type, the i-th initial field value corresponding to the i-th initial field name in the advertising information after the i-th round of parsing is converted based on the preset data amount conversion strategy to update the i-th initial field value corresponding to the i-th initial field name.

[0130] In this embodiment, the field name corresponding to the i-th initial field name in the advertisement information after the i-1th round of parsing and the field type corresponding to the field name are converted in combination with the second value to the fourth value, which is equivalent to converting the i-th initial field name into a standard field name in the business server, and the limited field type corresponding to the field name is also converted synchronously. In practical applications, there is also a need to convert the i-th initial field value corresponding to the i-th initial field name based on the data amount conversion strategy (for example, divided by a preset exchange rate value) to achieve flexible update processing of the i-th initial field value.

[0131] The data mapping storage unit 140 is used to obtain the database field type and database storage field in the parsed advertisement information, and map and store each field and field value in the parsed advertisement information into a target database based on the database field type and database storage field.

[0132] In this embodiment, after obtaining the parsed advertisement information, since it has met the unified data structure requirements and unified field name requirements of the business server for advertisement information, it can be determined in which field of the target data table in the target database of the business server each field and field value in the parsed advertisement information needs to be stored in combination with the database field type and database storage field in the parsed advertisement information. Generally, each field and corresponding field value selected from the parsed advertisement information based on the database storage field is stored in a column with the same field name in the target database of the business server, thereby completing data mapping storage.

[0133] In one embodiment, the data mapping storage unit 140 is used to:

[0134] Determining a public field name to be stored in the parsed advertisement information based on the field name included in the database storage field;

[0135] If it is determined that the database field type corresponding to the public field name to be saved is the same as the field type of the corresponding field in the parsed advertisement information, the field value corresponding to the public field name to be saved in the parsed advertisement information is saved to the corresponding target column in the target data table of the target database.

[0136] In this embodiment, one of the field names included in the database storage field is taken as an example, for example, one of the field names included in the database storage field is launch_start_time, and this field name in the parsed advertising information is converted to the field type of json based on the fourth value. Since the field type is set for each public field name to be saved in the database field type corresponding to the database storage field, after determining that the database field type corresponding to the public field name to be saved is the same as the field type of the corresponding field in the parsed advertising information, it means that the field type of the public field name to be saved, launch_start_time, has been verified, and the field value corresponding to the public field name to be saved, launch_start_time, is saved in the target data table of the target database in the corresponding target column (for example, the target column also has the field name launch_start_time).

[0137] It can be seen that the implementation of the embodiment of the device can reduce the parsing and mapping relationships of different media fields, realize the unified parsing and mapping of data fields of different media side servers based on the field parsing strategy, and convert them into standardized data with a unified data structure and unified field name, which is convenient for subsequent big data analysis.

[0138] The above-mentioned advertisement information field automatic parsing device can be implemented in the form of a computer program. The computer program can be used in Figure 7 Runs on the computer device shown.

[0139] See also Figure 7 , Figure 7 The computer device 400 is a schematic block diagram of a computer device provided by an embodiment of the present invention. The computer device 400 integrates any automatic analysis device for advertisement information fields provided by an embodiment of the present invention.

[0140] See also Figure 7 The computer device 400 includes a processor 402 , a memory and a network interface 405 connected via a system bus 401 , wherein the memory may include a storage medium 403 and an internal memory 404 .

[0141] The storage medium 403 can store an operating system 4031 and a computer program 4032. The computer program 4032 includes program instructions, and when the program instructions are executed, the processor 402 can execute an automatic parsing method for advertisement information fields.

[0142] The processor 402 is used to provide computing and control capabilities to support the operation of the entire computer device.

[0143] The internal memory 404 provides an environment for the operation of the computer program 4032 in the storage medium 403. When the computer program 4032 is executed by the processor 402, the processor 402 can execute the above-mentioned method for automatically parsing the advertisement information field.

[0144] The network interface 405 is used to communicate with other devices over the network. Figure 7 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation on the computer device to which the solution of the present invention is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0145] The processor 402 is used to run the computer program 4032 stored in the memory to implement the following steps:

[0146] In response to the advertisement information parsing instruction, obtaining at least one delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server;

[0147] Performing data configuration on the delivered advertisement information based on a preset structural data configuration strategy to update the delivered advertisement information;

[0148] Performing field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information;

[0149] The database field type and the database storage field in the parsed advertisement information are obtained, and each field and field value in the parsed advertisement information are mapped and stored in the target database based on the database field type and the database storage field.

[0150] It should be understood that in the embodiment of the present invention, the processor 402 may be a central processing unit (CPU), and the processor 402 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0151] It can be understood by those skilled in the art that all or part of the processes in the method for implementing the above embodiment can be completed by instructing the relevant hardware through a computer program. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiment of the above method.

[0152] Therefore, the present invention also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor executes the following steps:

[0153] In response to the advertisement information parsing instruction, obtaining at least one delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server;

[0154] Performing data configuration on the delivered advertisement information based on a preset structural data configuration strategy to update the delivered advertisement information;

[0155] Performing field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information;

[0156] The database field type and the database storage field in the parsed advertisement information are obtained, and each field and field value in the parsed advertisement information are mapped and stored in the target database based on the database field type and the database storage field.

[0157] The storage medium may be any computer-readable storage medium that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk.

[0158] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0159] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of each unit is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0160] The steps in the method of the embodiment of the present invention can be adjusted in order, combined and deleted according to actual needs. The units in the device of the embodiment of the present invention can be combined, divided and deleted according to actual needs. In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0161] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, terminal, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention.

[0162] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A method for automatically parsing advertisement information fields, It is characterized in that include: In response to the advertisement information parsing instruction, obtaining at least one delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server; Performing data configuration on the delivered advertisement information based on a preset structural data configuration strategy to update the delivered advertisement information; Performing field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information; The database field type and the database storage field in the parsed advertisement information are obtained, and each field and field value in the parsed advertisement information are mapped and stored in the target database based on the database field type and the database storage field.

2. The method according to claim 1, It is characterized in that The step of configuring the delivered advertisement information based on a preset structure data configuration strategy to update the delivered advertisement information includes: A newly added public field set included in the structure data configuration strategy and a field value corresponding to each newly added public field in the newly added public field set are obtained, and added to the delivered advertisement information to update the delivered advertisement information.

3. The method according to claim 1, It is characterized in that The step of performing field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information includes: Based on the field parsing strategy, a first value corresponding to the media field code and a second value corresponding to the media field type in the delivered advertisement information are obtained; wherein the first value includes a plurality of field names, and each field name has a corresponding field type in the second value; Based on the field parsing strategy, a third value corresponding to the mapped field code and a fourth value corresponding to the mapped field type in the delivered advertisement information are obtained; wherein the third value includes a plurality of field names, each field name has a mapping relationship with one of the field names of the first value, and each field name has a corresponding field type in the fourth value; All field names corresponding to the first value and the field types of the field names in the delivered advertisement information are converted based on the third value and the fourth value in a field traversal manner to obtain the parsed advertisement information.

4. The method according to claim 3, It is characterized in that The converting all the field names corresponding to the first value and the field types of the field names in the delivered advertisement information based on the third value and the fourth value in a field traversal manner to obtain the parsed advertisement information includes: Based on the i-th field name in the first value, the corresponding i-th initial field name and the i-th initial field value corresponding to the i-th initial field name are obtained from the advertisement information after the i-1-th round of parsing; wherein the initial value of i is 1, and the advertisement information after the 0th round of parsing is the initial advertisement information that has been delivered; Obtaining the i-th initial field type corresponding to the i-th field name in the second value; Obtaining the i-th conversion field name corresponding to the i-th field name in the third value; Obtaining the i-th conversion field type corresponding to the i-th conversion field name in the fourth value; Convert the i-th initial field name to the i-th converted field name, and convert the i-th initial field type to the i-th converted field type, so as to obtain the advertisement information after the i-th round of parsing; Increment i by 1 to update the value of i; If it is determined that i is less than or equal to N, then return to the step of obtaining the corresponding i-th initial field name from the advertisement information after the (i-1) round of parsing based on the i-th field name in the first value, and the i-th initial field value corresponding to the i-th initial field name; wherein N is the total number of field names included in the first value; If it is determined that i is greater than N, the advertisement information after the Nth round of parsing is obtained and used as the parsed advertisement information.

5. The method according to claim 4, It is characterized in that Before the step of acquiring the corresponding i-th initial field name and the i-th initial field value corresponding to the i-th initial field name from the advertisement information after the i-1-th round of parsing based on the i-th field name in the first value, the method further includes: Acquire, based on a traversal method, the first initial field name to the Nth initial field name corresponding to the first value in the delivered advertisement information; Based on the traversal method, the field type corresponding to each initial field name from the 1st initial field name to the Nth initial field name is obtained from the second value; wherein the field type corresponding to each initial field name is stored in the format of a json array or a json object.

6. The method according to claim 4, It is characterized in that After the step of converting the i-th initial field name into the i-th conversion field name, and converting the i-th initial field type into the i-th conversion field type to obtain the i-th round of parsed advertising information, and before the step of increasing i by 1 to update the value of i, the method further includes: If it is determined that the i-th conversion field name is an amount field type, the i-th initial field value corresponding to the i-th initial field name in the advertising information after the i-th round of parsing is converted based on the preset data amount conversion strategy to update the i-th initial field value corresponding to the i-th initial field name.

7. The method according to claim 1, It is characterized in that The obtaining of the database field type and the database storage field in the parsed advertisement information, and mapping and storing each field and field value in the parsed advertisement information into a target database based on the database field type and the database storage field, comprises: Determining a public field name to be stored in the parsed advertisement information based on the field name included in the database storage field; If it is determined that the database field type corresponding to the public field name to be saved is the same as the field type of the corresponding field in the parsed advertisement information, the field value corresponding to the public field name to be saved in the parsed advertisement information is saved to the corresponding target column in the target data table of the target database.

8. An automatic parsing device for advertisement information fields, It is characterized in that include: An information acquisition unit, configured to, in response to the advertisement information parsing instruction, acquire at least one piece of delivered advertisement information corresponding to the advertisement information parsing instruction and sent by the media side server; A structure data configuration unit, configured to perform data configuration on the delivered advertisement information based on a preset structure data configuration strategy, so as to update the delivered advertisement information; A field parsing and conversion unit, configured to perform field parsing and conversion on the delivered advertisement information based on a preset field parsing strategy to obtain parsed advertisement information; The data mapping storage unit is used to obtain the database field type and database storage field in the parsed advertisement information, and based on the database field type and database storage field, map and store each field and field value in the parsed advertisement information into a target database.

9. A computer device, It is characterized in that The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the method for automatically parsing the advertisement information field according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the method for automatically parsing the advertisement information field according to any one of claims 1 to 7 can be implemented.

Images