Method and apparatus for generating information

By obtaining data processing methods for logistics operation indicators, generating common and differentiated indicator information sets, and using multi-threaded encoding programs for data processing, the problem of inability to meet hourly or minute-level indicator data statistics in the existing technology is solved, and efficient indicator data processing is achieved.

CN114443054BActive Publication Date: 2025-08-19BEIJING JINGDONG ZHENSHI INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210105223.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-28
Publication Date
2025-08-19
Estimated Expiration
2042-01-28

AI Technical Summary

Technical Problem

The existing technology cannot meet the hourly or minutely indicator data statistics requirements in the monitoring of logistics operation indicators, and the real-time data processing costs are high and cannot adapt to business needs.

Method used

By obtaining the pending data, based on the indicator identification and encoding content, using data processing methods and indicator configuration strategies, a common and differentiated indicator information set is generated, and a multi-threaded encoding program is used for data processing to generate the final information and data tables.

Benefits of technology

It realizes efficient statistics of hourly or minutely indicator data, reduces development complexity, reduces code redundancy, improves operational efficiency and development efficiency, and meets business needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114443054B_ABST
    Figure CN114443054B_ABST
Patent Text Reader

Abstract

The present application discloses a method and apparatus for generating information. The specific implementation scheme is as follows: obtaining data to be processed, wherein the data to be processed is used to represent data related to various indicators of a business; based on the data to be processed, obtaining indicator information corresponding to each indicator of the business, wherein the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier; based on each indicator identifier and each indicator encoding content, using the business data processing method and the business indicator configuration strategy to process each indicator information, generating final information corresponding to each indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to represent the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to represent the selection of each indicator identifier and the operating method of the encoding program according to requirements. This scheme implements a universal configurable indicator data processing method.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, specifically to the field of data processing technology, and more particularly to a method and apparatus for generating information. Background Art

[0002] Currently, when monitoring logistics operational indicators, data processing for these indicators typically utilizes a data processing model built using Hive, a data warehouse tool within a data warehouse analysis system. This model retrieves data from the previous period at the current time and then processes it based on that data. This period is typically T-1 days, with each indicator's data processing program written and run separately. However, for businesses that require frequent monitoring of indicator changes, current data processing methods offer excessively long processing cycles, failing to meet the business needs for hourly or minute-by-minute metric data statistics. Adopting a unified real-time data processing approach would be costly, and not all businesses require real-time processing. Summary of the Invention

[0003] The present application provides a method, apparatus, device, and storage medium for generating information.

[0004] According to the first aspect of the present application, a method for generating information is provided, the method comprising: obtaining data to be processed, wherein the data to be processed is used to represent data related to various indicators of a business; based on the data to be processed, obtaining indicator information corresponding to each indicator of the business, wherein the indicator information includes an indicator identifier of each indicator in the encoding program and an indicator encoding content corresponding to the indicator identifier; based on each indicator identifier and each indicator encoding content, performing data processing on each indicator information using a data processing method of the business and an indicator configuration strategy of the business to generate final information corresponding to each indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to represent the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to represent the selection of each indicator identifier and the operating mode of the encoding program according to demand.

[0005] In some embodiments, the indicator configuration strategy is generated by performing a differential analysis on each indicator information; the indicator configuration strategy generation process includes: comparing the indicator coding content in each indicator information, generating a common indicator information set and a differential indicator information set after comparison, wherein the common indicator information set is used to represent the indicator information with the same indicator coding content in each indicator information, and the differential indicator information set is used to represent the indicator information that does not have the same indicator coding content in each indicator information; based on each indicator information in the common indicator information set, generating a first encoding program corresponding to the common indicator information set; based on the differential indicator information set and the first encoding program, determining the indicator configuration strategy corresponding to the differential indicator information set and the first encoding program.

[0006] In some embodiments, the indicator information corresponding to each indicator of the business includes real-time indicator information and non-real-time indicator information; based on the data to be processed, the indicator information corresponding to each indicator of the business is obtained, including: based on the data to be processed, obtaining the real-time indicator information corresponding to each indicator of the business, wherein the real-time indicator information is used to represent the indicator information that needs to be monitored in real time in the various indicator information of the business; based on the data to be processed and a preset period, obtaining the non-real-time indicator information corresponding to each indicator of the business, wherein the non-real-time indicator information is used to represent other indicator information in all indicator information of the business except the real-time indicator information.

[0007] In some embodiments, based on each indicator identifier and each indicator coding content, each indicator information is processed using the business data processing method and the business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information, including: using the business data processing method to select real-time indicator information and non-real-time indicator information to generate indicator information to be processed corresponding to the real-time indicator information and non-real-time indicator information; using the business data processing method to select the running mode of the encoding program to determine that the running mode of the encoding program is multi-threaded; based on each indicator identifier in the indicator information to be processed and each indicator coding content in the indicator information to be processed, the multi-threaded running mode and the business indicator configuration strategy are used to process the indicator information to be processed to generate final information corresponding to the indicator information to be processed; based on the final information corresponding to the indicator information to be processed, a data table corresponding to the final information is generated, wherein the data table is used to store and display the final information.

[0008] In some embodiments, based on each indicator identifier and each indicator coding content, each indicator information is processed using the business data processing method and the business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information, including: based on each indicator identifier and each indicator coding content, each indicator information is converted, extracted and / or calculated using the business data processing method and the business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information.

[0009] In some embodiments, after obtaining the data to be processed, the method further includes: cleaning the data to be processed, wherein the cleaning is used to deduplicate the data to be processed according to the unique identifier and exclude invalid data in the data to be processed.

[0010] In some embodiments, the method further includes: generating a wide table corresponding to the data table and the data to be processed based on the generated data table and the data to be processed, wherein the wide table is used to characterize the association relationship between business and business attributes under different business indicator dimensions.

[0011] According to a second aspect of the present application, a device for generating information is provided, comprising: a first acquisition unit, configured to acquire data to be processed, wherein the data to be processed is used to represent data related to various indicators of a business; a second acquisition unit, configured to acquire indicator information corresponding to various indicators of the business based on the data to be processed, wherein the indicator information includes indicator identifiers of various indicators in the encoding program and indicator coding content corresponding to the indicator identifiers; a first generation unit, configured to perform data processing on various indicator information based on various indicator identifiers and various indicator coding contents using a data processing method of the business and an indicator configuration strategy of the business, to generate final information corresponding to various indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to represent the configuration method followed by various indicators when the encoding program is running, and the data processing method is used to represent the selection of various indicator identifiers and the operating mode of the encoding program according to requirements.

[0012] In some embodiments, the indicator configuration strategy in the first generation unit is generated by performing a difference analysis on each indicator information; the indicator configuration strategy in the first generation unit is generated by the following modules: a first generation module is configured to compare the indicator coding content in each indicator information, and generate a common indicator information set and a difference indicator information set after comparison, wherein the common indicator information set is used to represent the indicator information with the same indicator coding content in each indicator information, and the difference indicator information set is used to represent the indicator information that does not have the same indicator coding content in each indicator information; the second generation module is configured to generate a first encoding program corresponding to the common indicator information set based on each indicator information in the common indicator information set; the determination module is configured to determine the indicator configuration strategy corresponding to the difference indicator information set and the first encoding program based on the difference indicator information set and the first encoding program.

[0013] In some embodiments, the indicator information corresponding to each indicator of the business in the second acquisition unit includes real-time indicator information and non-real-time indicator information; the second acquisition unit includes: a first acquisition module, configured to obtain real-time indicator information corresponding to each indicator of the business based on the data to be processed, wherein the real-time indicator information is used to represent the indicator information that needs to be monitored in real time in the various indicator information of the business; a second acquisition module, configured to obtain non-real-time indicator information corresponding to each indicator of the business based on the data to be processed and a preset period, wherein the non-real-time indicator information is used to represent other indicator information in all indicator information of the business except the real-time indicator information.

[0014] In some embodiments, the first generation unit includes: a first selection module, configured to use the business data processing method to select real-time indicator information and non-real-time indicator information, and generate indicator information to be processed corresponding to the real-time indicator information and non-real-time indicator information; a second selection module, configured to use the business data processing method to select the running mode of the encoding program, and determine that the running mode of the encoding program is multi-threaded; an information generation module, configured to perform data processing on the indicator information to be processed based on each indicator identifier in the indicator information to be processed and each indicator encoding content in the indicator information to be processed, using the multi-threaded running mode and the indicator configuration strategy of the business, and generate final information corresponding to the indicator information to be processed; a data table generation module, configured to generate a data table corresponding to the final information based on the final information corresponding to the indicator information to be processed, wherein the data table is used to store and display the final information.

[0015] In some embodiments, the first generation unit is further configured to perform data conversion, data extraction and / or data calculation on each indicator information based on each indicator identifier and each indicator coding content, using the business data processing method and the business indicator configuration strategy, to generate final information corresponding to each indicator information and a data table corresponding to the final information.

[0016] In some embodiments, the apparatus further comprises: a data cleaning unit configured to clean the data to be processed, wherein the cleaning is used to deduplicate the data to be processed according to the unique identifier and to exclude invalid data in the data to be processed.

[0017] In some embodiments, the device also includes: a second generation unit, configured to generate a wide table corresponding to the data table and the data to be processed based on the generated data table and the data to be processed, wherein the wide table is used to characterize the association relationship between business and business attributes under different business indicator dimensions.

[0018] According to a third aspect of the present application, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method described in any implementation manner in the first aspect.

[0019] According to a fourth aspect of the present application, the present application provides a non-transitory computer-readable storage medium storing computer instructions, characterized in that the computer instructions are used to enable a computer to execute the method described in any implementation manner in the first aspect.

[0020] According to the technology of the present application, data to be processed is obtained, and based on the data to be processed, the indicator information corresponding to each indicator of the business is obtained, wherein the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier, based on each indicator identifier and each indicator encoding content, the business data processing method and the business indicator configuration strategy are used to process the data of each indicator information, and the final information corresponding to each indicator information and the data table corresponding to the final information are generated, wherein the indicator configuration strategy is used to characterize the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to characterize the selection of the operation mode of each indicator identifier and the encoding program according to the demand, so as to realize a universal configuration indicator data processing method, which solves the problem that the existing data processing method cannot meet the business's needs for hourly or minute-level indicator data statistics and the high timeliness requirement for indicator calculation. The indicator configuration method reduces the complexity of development, meets the business's needs for calculating various indicators based on large data volumes, and improves the timeliness of operation; the indicator code is written in a configuration manner, which avoids code redundancy and facilitates the modification and adjustment of the later code. For example, new indicators can be directly added to the configuration without other modifications, thereby improving development efficiency and reducing maintenance costs.

[0021] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present application.

[0023] Figure 1 is a schematic diagram of a first embodiment of a method for generating information according to the present application;

[0024] Figure 2 It is a scene diagram that can implement the method for generating information in the embodiment of the present application;

[0025] Figure 3 is a schematic diagram of a second embodiment of a method for generating information according to the present application;

[0026] Figure 4 is a structural diagram of an embodiment of a device for generating information according to the present application;

[0027] Figure 5 It is a block diagram of an electronic device used to implement the method for generating information in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The following description of exemplary embodiments of the present application is made in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding. These details should be considered as merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0029] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0030] Figure 1 A schematic diagram 100 of a first embodiment of a method for generating information according to the present application is shown. The method for generating information comprises the following steps:

[0031] Step 101: Obtain data to be processed.

[0032] In this embodiment, the execution entity (such as a server or terminal device) can obtain the data to be processed locally or remotely in a certain time period through a wired connection or a wireless connection. The data to be processed is used to characterize data related to various indicators of the business. The various indicators may include: order type, business type, logistics warehousing information, logistics delivery information, and the various indicators may also include: transaction order quantity, received order quantity, etc. It should be noted that the above-mentioned wireless connection method may include but is not limited to 3G, 4G, 5G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultrawideband) connection, and other wireless connection methods currently known or to be developed in the future.

[0033] Step 102: Based on the data to be processed, obtain indicator information corresponding to each indicator of the business.

[0034] In this embodiment, the execution entity can use the distributed log system Kafka and the distributed file system HDFS to parse the data to be processed or perform information query using the data to be processed based on the data to be processed obtained in step 101 to obtain the indicator information corresponding to each indicator of the business. Among them, the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier. The indicator information corresponding to each indicator of the business is the full amount of indicator data of the business to meet various requirements of subsequent indicator data processing. The indicator encoding content may include: indicator name, indicator code, indicator business logic start time, indicator business logic end time and indicator value conditions, etc.

[0035] In some optional implementations of this embodiment, after obtaining the data to be processed, it also includes: cleaning the data to be processed, wherein the cleaning is used to deduplicate the data to be processed according to the unique identifier and eliminate invalid data in the data to be processed, thereby improving the efficiency of data processing.

[0036] Step 103 : Based on each indicator identifier and each indicator coding content, each indicator information is processed using the business data processing method and the business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information.

[0037] In this embodiment, the execution entity can use Apache Spark and the business data processing method and business indicator configuration strategy to process each indicator information based on the indicator identifiers and the indicator encoding content in each indicator information obtained in step 102, and generate final information corresponding to each processed indicator information and a data table corresponding to the final information. The indicator configuration strategy is used to represent the configuration method followed by each indicator when the encoding program is running. The data processing method is used to represent the selection of each indicator identifier and the operation mode of the encoding program according to requirements. The operation mode of the encoding program can include multi-threading, single-threading, or a combination of multi-threading and single-threading. Data processing can include: data conversion, data extraction, data calculation, and at least one of various other data processing methods. Data processing here can refer to various data processing required by the business, such as analysis, statistics, and optimization of indicator data, such as data sorting and registration, batch image scanning, image error correction, barcode recognition, automatic upload, and CD publishing. The data table is used to represent, store, and display the final information. The data table can be a static data table manually configured by technical personnel or management personnel, or a dynamic data table generated using a data table generation algorithm.

[0038] In some optional implementations of this embodiment, an indicator configuration strategy is generated by performing a differential analysis on each indicator information. The indicator configuration strategy generation process includes: comparing the indicator coding content in each indicator information to generate a common indicator information set and a differential indicator information set after comparison, wherein the common indicator information set is used to represent indicator information with the same indicator coding content in each indicator information, and the differential indicator information set is used to represent indicator information with different indicator coding content in each indicator information; based on each indicator information in the common indicator information set, a first encoding program corresponding to the common indicator information set is generated; based on the differential indicator information set and the first encoding program, an indicator configuration strategy corresponding to the differential indicator information set and the first encoding program is determined. Generating a universal encoding program from the common indicator information eliminates the need for encoding configuration for each indicator, thereby reducing code redundancy and improving operational efficiency.

[0039] In some optional implementations of this embodiment, based on each indicator identifier and each indicator coding content, each indicator information is processed using a business data processing method and a business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information, including: based on each indicator identifier and each indicator coding content, each indicator information is processed using a business data processing method and a business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information. This implements the data processing process.

[0040] In some optional implementations of this embodiment, the method further includes: generating a wide table corresponding to the data table and the data to be processed based on the generated data table and the data to be processed, wherein the wide table is used to characterize the association between the business and the business attributes under different business indicator dimensions. Data information under different business indicator dimensions is obtained through the wide table to quickly respond to front-end page requirements. When the page is used, there is no need for repeated configuration. Data query is performed directly by matching the wide table with the latitude value, which increases the page display rate, reduces the complexity of configuration or query, and improves the user experience.

[0041] It should be noted that the above data processing process is a well-known technology that is currently widely studied and applied, and will not be described in detail here.

[0042] Continue to see Figure 2 The method 200 for generating information in this embodiment runs in an electronic device 201. First, the electronic device 201 obtains data to be processed 202, where the data to be processed is used to represent data related to various indicators of the business. Then, based on the data to be processed, the electronic device 201 obtains indicator information 203 corresponding to each indicator of the business, where the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier. Finally, based on each indicator identifier and each indicator encoding content, the electronic device 201 uses the business data processing method and the business indicator configuration strategy to process each indicator information, and generates final information corresponding to each indicator information and a data table 204 corresponding to the final information. The indicator configuration strategy is used to represent the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to represent the selection of each indicator identifier and the running mode of the encoding program according to requirements.

[0043] The method for generating information provided by the above-mentioned embodiment of the present application adopts the method of obtaining data to be processed, and based on the data to be processed, obtaining indicator information corresponding to each indicator of the business, wherein the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier, and based on each indicator identifier and each indicator encoding content, the business data processing method and the business indicator configuration strategy are used to perform data processing on each indicator information to generate final information corresponding to each indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to characterize the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to characterize the selection of each indicator identifier and the operating mode of the encoding program according to the needs, thereby realizing a universal configurable indicator data processing method, which solves the problem that the existing data processing method cannot meet the business's needs for hourly or minute-level indicator data statistics and the high requirements for indicator calculation timeliness. The indicator configuration method reduces the complexity of development, meets the business needs of calculating various indicators based on large amounts of data, and improves the timeliness of operation; indicator code is written in a configuration manner, avoiding code redundancy and facilitating subsequent code modification and adjustment. For example, new indicators can be directly added to the configuration without making other modifications, which improves development efficiency and reduces maintenance costs.

[0044] Further references Figure 3 , which shows a schematic diagram 300 of a second embodiment of a method for generating information. The process of the method includes the following steps:

[0045] Step 301: Obtain data to be processed.

[0046] Step 302: Based on the data to be processed, obtain real-time indicator information corresponding to each indicator of the business.

[0047] In this embodiment, the indicator information corresponding to each indicator of the business includes real-time indicator information and non-real-time indicator information. The execution entity can use the distributed log system Kafka and the distributed file system HDFS based on the data to be processed, and use the real-time information acquisition model to obtain the real-time indicator information corresponding to each indicator of the business. Among them, the real-time indicator information is used to represent the indicator information that needs to be monitored in real time among the various indicator information of the business. The real-time information acquisition model here can be constructed based on the Real Time File (RTF) file format, and based on the advantages of RTF itself, it makes information acquisition faster and more efficient.

[0048] Step 303: Based on the data to be processed and the preset period, non-real-time indicator information corresponding to each indicator of the business is obtained.

[0049] In this embodiment, the execution entity can utilize the distributed logging system Kafka and the distributed file system HDFS based on the data to be processed and a preset period to obtain non-real-time indicator information corresponding to various business indicators. The "all business indicator information" refers to the full set of business indicator data, while the non-real-time indicator information represents all indicator information of the business, excluding the real-time indicator information. Non-real-time indicator information is indicator information obtained at a specific time period.

[0050] Step 304 : Using the business data processing method, the real-time indicator information and the non-real-time indicator information are selected to generate indicator information to be processed corresponding to the real-time indicator information and the non-real-time indicator information.

[0051] In this embodiment, the execution entity can use the indicator information selection method in the business data processing method to select real-time indicator information and non-real-time indicator information to generate indicator information to be processed corresponding to the real-time indicator information and non-real-time indicator information. The indicator information to be processed is used to represent the portion of indicator information that requires data processing. The indicator information to be processed can be real-time indicator information or non-real-time indicator information, or it can be part or all of the real-time indicator information and non-real-time indicator information.

[0052] Step 305: Using the business data processing method, select the running mode of the encoding program and determine that the running mode of the encoding program is multi-threaded.

[0053] In this embodiment, the execution subject can use the operation mode selection strategy in the business data processing method to select the operation mode of the encoding program according to the business needs and determine that the operation mode of the encoding program is multi-threaded.

[0054] Step 306 : Based on each indicator identifier and each indicator code content in the indicator information to be processed, the indicator information to be processed is processed using a multi-threaded operation mode and a business indicator configuration strategy to generate final information corresponding to the indicator information to be processed.

[0055] In this embodiment, the execution entity can use Apache Spark, multi-threaded operation mode and business indicator configuration strategy to process the indicator information to be processed based on the various indicator identifiers and various indicator coding contents in the indicator information to be processed obtained in step 304, and generate final information corresponding to the indicator information to be processed.

[0056] Step 307: Based on the final information corresponding to the to-be-processed index information, a data table corresponding to the final information is generated.

[0057] In this embodiment, the execution entity generates a data table corresponding to the final information based on the final information corresponding to the indicator information to be processed, wherein the data table is used to store and display the final information.

[0058] In this embodiment, the specific operation of step 301 is the same as Figure 1 The operation of step 101 in the illustrated embodiment is substantially the same and will not be described in detail here.

[0059] from Figure 3 It can be seen that Figure 1 Compared with the corresponding embodiment, the schematic diagram 300 of the method for generating information in this embodiment adopts the method of obtaining real-time indicator information corresponding to each indicator of the business based on the data to be processed, obtaining non-real-time indicator information corresponding to each indicator of the business based on the data to be processed and the preset period, selecting the real-time indicator information and the non-real-time indicator information using the data processing method of the business, generating the indicator information to be processed corresponding to the real-time indicator information and the non-real-time indicator information, selecting the running mode of the encoding program using the data processing method of the business, determining that the running mode of the encoding program is multi-threaded, based on each indicator identifier in the indicator information to be processed and each indicator encoding content in the indicator information to be processed, utilizing the multi-threaded running mode and the indicator configuration strategy of the business to process the indicator information to be processed, generating final information corresponding to the indicator information to be processed, generating a data table corresponding to the final information based on the final information corresponding to the indicator information to be processed, realizing the data processing process of separating real-time indicator data and non-real-time indicator data, making data processing more flexible and diverse, and better meeting data processing of different needs and different dimensions. The distributed log system Kafka is used to build a model based on the Real Time File (RTF) file format to ensure efficient data sources. The parallel computing capabilities of the Spark engine are used to greatly improve the calculation efficiency of indicators. The multi-threaded operation mode is used to run the indicator encoding program in batches, improving the overall operation efficiency.

[0060] Further references Figure 4 , as a response to the above Figures 1 to 3 The present application provides an embodiment of a device for generating information. Figure 1 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0061] like Figure 4As shown, the device 400 for generating information in this embodiment includes: a first acquisition unit 401, a second acquisition unit 402 and a first generation unit 403, wherein the first acquisition unit is configured to acquire data to be processed, wherein the data to be processed is used to represent data related to various indicators of the business; the second acquisition unit is configured to acquire indicator information corresponding to various indicators of the business based on the data to be processed, wherein the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier; the first generation unit is configured to perform data processing on each indicator information based on each indicator identifier and each indicator encoding content using the data processing method of the business and the indicator configuration strategy of the business, and generate final information corresponding to each indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to represent the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to represent the selection of each indicator identifier and the running mode of the encoding program according to demand.

[0062] In this embodiment, the specific processing of the first acquisition unit 401, the second acquisition unit 402 and the first generation unit 403 of the apparatus 400 for generating information and the technical effects thereof can be referred to in Figure 1 The relevant descriptions of steps 101 to 103 in the corresponding embodiment are not repeated here.

[0063] In some optional implementations of this embodiment, the indicator configuration strategy in the first generation unit is generated by performing a difference analysis on each indicator information; the indicator configuration strategy in the first generation unit is generated by the following modules: a first generation module is configured to compare the indicator coding content in each indicator information, and generate a common indicator information set and a difference indicator information set after comparison, wherein the common indicator information set is used to represent the indicator information with the same indicator coding content in each indicator information, and the difference indicator information set is used to represent the indicator information that does not have the same indicator coding content in each indicator information; the second generation module is configured to generate a first encoding program corresponding to the common indicator information set based on each indicator information in the common indicator information set; the determination module is configured to determine the indicator configuration strategy corresponding to the difference indicator information set and the first encoding program based on the difference indicator information set and the first encoding program.

[0064] In some optional implementations of this embodiment, the indicator information corresponding to each indicator of the business in the second acquisition unit includes real-time indicator information and non-real-time indicator information; the second acquisition unit includes: a first acquisition module, configured to obtain real-time indicator information corresponding to each indicator of the business based on the data to be processed, wherein the real-time indicator information is used to characterize the indicator information that needs to be monitored in real time in the various indicator information of the business; a second acquisition module, configured to obtain non-real-time indicator information corresponding to each indicator of the business based on the data to be processed and a preset period, wherein the non-real-time indicator information is used to characterize other indicator information in all indicator information of the business except the real-time indicator information.

[0065] In some optional implementations of this embodiment, the first generation unit includes: a first selection module, configured to use the business data processing method to select real-time indicator information and non-real-time indicator information, and generate indicator information to be processed corresponding to the real-time indicator information and non-real-time indicator information; a second selection module, configured to use the business data processing method to select the running mode of the encoding program, and determine that the running mode of the encoding program is multi-threaded; an information generation module, configured to perform data processing on the indicator information to be processed based on each indicator identifier in the indicator information to be processed and each indicator encoding content in the indicator information to be processed, using the multi-threaded running mode and the indicator configuration strategy of the business, and generate final information corresponding to the indicator information to be processed; a data table generation module, configured to generate a data table corresponding to the final information based on the final information corresponding to the indicator information to be processed, wherein the data table is used to store and display the final information.

[0066] In some optional implementations of this embodiment, the first generation unit is further configured to perform data conversion, data extraction and / or data calculation on each indicator information based on each indicator identifier and each indicator coding content, using the business data processing method and the business indicator configuration strategy, to generate final information corresponding to each indicator information and a data table corresponding to the final information.

[0067] In some optional implementations of this embodiment, the device further includes: a data cleaning unit configured to clean the data to be processed, wherein the cleaning is used to deduplicate the data to be processed according to the unique identifier and exclude invalid data in the data to be processed.

[0068] In some optional implementations of this embodiment, the device also includes: a second generation unit, configured to generate a wide table corresponding to the data table and the data to be processed based on the generated data table and the data to be processed, wherein the wide table is used to characterize the association relationship between the business and business attributes under different business indicator dimensions.

[0069] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0070] like Figure 5 , is a block diagram of an electronic device for a method of generating information according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0071] like Figure 5 As shown, the electronic device includes: one or more processors 501, a memory 502, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 5 A processor 501 is taken as an example.

[0072] Memory 502 is the non-transitory computer-readable storage medium provided in this application. The memory stores instructions executable by at least one processor to cause the at least one processor to perform the method for generating information provided in this application. The non-transitory computer-readable storage medium of this application stores computer instructions for causing a computer to perform the method for generating information provided in this application.

[0073] The memory 502 is a non-transitory computer-readable storage medium that can be used to store non-transitory software programs, non-transitory computer executable programs and modules, such as the program instructions / modules corresponding to the method for generating information in the embodiment of the present application (for example, the attached Figure 4The processor 501 executes the non-transient software programs, instructions, and modules stored in the memory 502 to execute various functional applications and data processing of the server, that is, to implement the method for generating information in the above method embodiment.

[0074] The memory 502 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created based on the use of the electronic device used to generate information, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 502 may optionally include a memory remotely located relative to the processor 501, and these remote memories may be connected to the electronic device used to generate information via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0075] The electronic device for generating information may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected via a bus or other means. Figure 5 The bus connection is taken as an example.

[0076] The input device 503 can receive input digital or character information and generate key signal input related to user settings and function control of the electronic device used to generate information, such as input devices such as a touch screen, a keypad, a mouse, a trackpad, a touch pad, an indicator stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 504 may include a display device, an auxiliary lighting device (e.g., an LED), and a tactile feedback device (e.g., a vibration motor). The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

[0077] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0078] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for a programmable processor and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., a magnetic disk, an optical disk, a memory, a programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0079] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0080] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0081] Computer systems may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The client and server relationship arises through computer programs running on the respective computers and having a client-server relationship to each other.

[0082] According to the technical solution of the embodiment of the present application, the data to be processed is obtained, and based on the data to be processed, the indicator information corresponding to each indicator of the business is obtained, wherein the indicator information includes the indicator identifier of each indicator in the encoding program and the indicator encoding content corresponding to the indicator identifier. Based on each indicator identifier and each indicator encoding content, the business data processing method and the business indicator configuration strategy are used to process each indicator information, and the final information corresponding to each indicator information and the data table corresponding to the final information are generated. The indicator configuration strategy is used to characterize the configuration method followed by each indicator when the encoding program is running, and the data processing method is used to characterize the selection of each indicator identifier and the operation mode of the encoding program according to the requirements, so as to realize a universal configuration indicator data processing method, which solves the problem that the existing data processing method cannot meet the business's needs for hourly or minute-level indicator data statistics and the high timeliness requirement for indicator calculation. The indicator configuration method reduces the complexity of development, meets the business's needs for calculating various indicators based on large amounts of data, and improves the timeliness of operation; the indicator code is written in a configuration manner, which avoids code redundancy and facilitates the modification and adjustment of the later code. For example, a new indicator can be directly added to the configuration without other modifications, thereby improving development efficiency and reducing maintenance costs.

[0083] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this application can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this application can be achieved. This is not a limitation herein.

[0084] The above specific embodiments do not constitute a limitation on the scope of protection of this application. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application shall be included within the scope of protection of this application.

Claims

1. A method for generating information, comprising: Acquiring data to be processed, wherein the data to be processed is used to represent data related to various indicators of the business; Based on the data to be processed, obtain indicator information corresponding to each indicator of the business, wherein the indicator information includes an indicator identifier of each indicator in the encoding program and indicator encoding content corresponding to the indicator identifier, and the indicator information corresponding to each indicator of the business includes real-time indicator information and non-real-time indicator information; Based on each of the indicator identifiers and each of the indicator coding contents, data processing is performed on each of the indicator information using a business data processing method and a business indicator configuration strategy to generate final information corresponding to each of the indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to represent the configuration method followed by each of the indicators when the encoding program is running, the indicator configuration strategy is generated by performing a difference analysis on the each of the indicator information, and the data processing method is used to represent the selection of each of the indicator identifiers and the operating method of the encoding program according to requirements; The process of generating the indicator configuration strategy includes: comparing the indicator coding content in the various indicator information to generate a compared common indicator information set and a differential indicator information set; based on the various indicator information in the common indicator information set, generating a first encoding program corresponding to the common indicator information set; based on the differential indicator information set and the first encoding program, determining the indicator configuration strategy corresponding to the differential indicator information set and the first encoding program.

2. The method according to claim 1, wherein The common indicator information set is used to represent indicator information with the same indicator coding content among the various indicator information, and the different indicator information set is used to represent indicator information with different indicator coding content among the various indicator information.

3. The method according to claim 1, wherein The acquiring, based on the data to be processed, indicator information corresponding to each indicator of the business includes: Based on the data to be processed, real-time indicator information corresponding to each indicator of the business is obtained, wherein the real-time indicator information is used to represent the indicator information that needs to be monitored in real time among the various indicator information of the business; Based on the data to be processed and a preset period, non-real-time indicator information corresponding to each indicator of the business is obtained, wherein the non-real-time indicator information is used to represent other indicator information in all indicator information of the business except the real-time indicator information.

4. The method according to claim 3, wherein: The method of processing each indicator information based on each indicator identifier and each indicator coding content and using the business data processing method and business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information includes: Using the business data processing method, real-time indicator information and non-real-time indicator information are selected to generate indicator information to be processed corresponding to the real-time indicator information and non-real-time indicator information; Using a business data processing method, selecting an operation mode of the encoding program, and determining that the operation mode of the encoding program is multi-threaded; Based on each indicator identifier in the indicator information to be processed and each indicator code content in the indicator information to be processed, the indicator information to be processed is processed using the multi-threaded operation mode and the indicator configuration strategy of the business to generate final information corresponding to the indicator information to be processed; Based on the final information corresponding to the to-be-processed index information, a data table corresponding to the final information is generated, wherein the data table is used to store and display the final information.

5. The method according to claim 1, wherein The method of processing each indicator information based on each indicator identifier and each indicator coding content and using the business data processing method and business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information includes: Based on the identifiers of each indicator and the coding content of each indicator, the business data processing method and the business indicator configuration strategy are used to perform data conversion, data extraction and / or data calculation on each indicator information to generate the final information corresponding to each indicator information and the data table corresponding to the final information.

6. The method according to claim 1, wherein After obtaining the data to be processed, it also includes: The data to be processed is cleaned, wherein the cleaning is used to deduplicate the data to be processed according to the unique identifier and exclude invalid data in the data to be processed.

7. The method according to claim 1, further comprising: Based on the generated data table and the data to be processed, a wide table corresponding to the data table and the data to be processed is generated, wherein the wide table is used to characterize the association relationship between the business and business attributes under different business indicator dimensions.

8. A device for generating information, comprising: A first acquiring unit is configured to acquire data to be processed, wherein the data to be processed is used to represent data related to various indicators of the business; a second acquiring unit configured to acquire, based on the data to be processed, indicator information corresponding to each indicator of the business, wherein the indicator information includes an indicator identifier of each indicator in a coding program and indicator coding content corresponding to the indicator identifier, and the indicator information corresponding to each indicator of the business includes real-time indicator information and non-real-time indicator information; A first generating unit is configured to perform data processing on each indicator information based on each indicator identifier and each indicator coding content using a business data processing method and a business indicator configuration strategy to generate final information corresponding to each indicator information and a data table corresponding to the final information, wherein the indicator configuration strategy is used to represent a configuration method followed by each indicator when the encoding program is running, the indicator configuration strategy is generated by performing a difference analysis on each indicator information, and the data processing method is used to represent the selection of each indicator identifier and the running method of the encoding program according to requirements; The indicator configuration strategy in the first generation unit is generated by the following modules: a first generation module, configured to compare the indicator coding content in the various indicator information, and generate a compared common indicator information set and a difference indicator information set; a second generation module, configured to generate a first encoding program corresponding to the common indicator information set based on the various indicator information in the common indicator information set; a determination module, configured to determine the indicator configuration strategy corresponding to the difference indicator information set and the first encoding program based on the difference indicator information set and the first encoding program.

9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Automatic Spark parameter optimization method and system based on deep reinforcement learning

    CN111651220A

  • Method and device for building banking business service system

    CN113592620A