Configuration work order processing method, apparatus, device, medium, and product
By extracting the data features of configuration work orders and calculating the adaptation value of storage engines, the storage engine with the highest storage performance score is selected for storage, which solves the problem of low storage efficiency of configuration work orders and achieves high-efficiency storage and read/write performance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- QIANTANG CREDIT INFORMATION CO LTD
- Filing Date
- 2025-11-07
- Publication Date
- 2026-04-10
AI Technical Summary
The existing technology uses a fixed storage mode to store various types of configuration work orders, which leads to low storage efficiency for some configuration work orders.
By extracting data characteristics from configuration work orders, such as the total number of modifiable fields, read/write ratio, data volume, and configuration change frequency, the structure adaptation value, performance adaptation value, and change adaptation value of each storage engine are calculated. Taking into account the storage performance score, the storage engine with the highest storage performance score is selected for storage.
It enables the selection of the most suitable storage engine based on the characteristics of the configuration work order, improving storage efficiency and success rate, and ensuring rapid read and write of configuration work orders in the future.
Smart Images

Figure CN121094758B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] One or more embodiments of the present specification relate to the technical field of computer technology, and particularly relate to a configuration work order processing method, device, equipment, medium and product. BACKGROUND
[0002] For the needs of business agility, risk controllability, efficiency improvement and collaborative transparency, configuration work orders are also more and more widely used in the field of business configuration management. In the case of reconfiguring product information, relevant personnel only need to modify the corresponding content in the matching configuration work order, without modifying the code. It can be seen that the configuration work order is a bridge connecting business demand and technical implementation, which can make product business rules more quickly, safely and orderly.
[0003] After the configuration work order is changed, it usually needs to go through the links of verification, storage, release and monitoring. However, in the storage link, because the related technology usually stores configuration work orders in different scenarios through a fixed storage mode, and configuration work orders have different data complexity due to different scenarios, there is a problem of low storage efficiency of part of configuration work orders in the storage link. SUMMARY
[0004] Therefore, in order to at least solve the technical problem of low storage efficiency of part of configuration work orders caused by using a fixed storage mode to store configuration work orders of various types in related technologies, one or more embodiments of the present specification provide technical solutions as follows:
[0005] According to a first aspect of one or more embodiments of the present specification, a configuration work order processing method is provided, comprising:
[0006] According to the obtained configuration work order, the field total number of the changeable field contained in the configuration work order, the read-write ratio of the changeable field, the data volume of the configuration work order, and the configuration change frequency of the configuration work order are processed.
[0007] According to the field total number, the structure adaptation value of each storage engine for storing the configuration work order is calculated; according to the read-write ratio of the changeable field and the data volume of the configuration work order, the performance adaptation value of each storage engine is calculated; according to the configuration change frequency of the configuration work order, the change adaptation value of each storage engine is calculated; wherein the structure adaptation value is used to represent the adaptation degree of the storage structure of the storage engine to the configuration work order, the performance adaptation value is used to represent the adaptation degree of the storage performance of the storage engine to the configuration work order, and the change adaptation value is used to represent the adaptation degree of the storage overhead of the storage engine to the configuration work order.
[0008] According to the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine, a storage performance score of each storage engine for the configuration order is calculated;
[0009] The target storage engine with the highest storage performance score is called, and the configuration order is stored through the target storage engine.
[0010] According to a second aspect of one or more embodiments of the present specification, a configuration order processing apparatus is provided, comprising:
[0011] The order processing module is configured to process the total number of fields of the changeable fields contained in the configuration order, the read-write ratio of the changeable fields, the data volume of the configuration order and the configuration change frequency of the configuration order according to the obtained configuration order;
[0012] The adaptation value calculation module is configured to calculate the structure adaptation value of each storage engine for storing the configuration order according to the total number of fields; calculate the performance adaptation value of each storage engine according to the read-write ratio of the changeable fields and the data volume of the configuration order; and calculate the change adaptation value of each storage engine according to the configuration change frequency of the configuration order; wherein the structure adaptation value is used to represent the adaptation degree of the storage structure of the storage engine to the configuration order, the performance adaptation value is used to represent the adaptation degree of the storage performance of the storage engine to the configuration order, and the change adaptation value is used to represent the adaptation degree of the storage overhead of the storage engine to the configuration order;
[0013] The score calculation module is configured to calculate the storage performance score of each storage engine for the configuration order according to the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine;
[0014] The storage module is configured to call the target storage engine with the highest storage performance score, and store the configuration order through the target storage engine.
[0015] According to a third aspect of one or more embodiments of the present specification, an electronic device is provided, comprising: a processor; a memory for storing processor executable instructions; wherein the processor implements the steps of the configuration order processing method provided by the first aspect by running the executable instructions.
[0016] According to a fourth aspect of one or more embodiments of the present specification, a computer readable storage medium is provided, which stores computer instructions, and the instructions are executed by a processor to implement the steps of the configuration order processing method provided by the first aspect.
[0017] According to a fifth aspect of one or more embodiments of the present specification, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the steps of the configuration order processing method provided by the first aspect described above.
[0018] As can be seen from the above embodiments, the present specification first extracts the data features of the configuration order to obtain the field total number of the changeable fields in the configuration order, the read-write ratio of the changeable fields, the data volume of the configuration order, and the configuration change frequency of the configuration order and other data features, and then calculates the values of the adaptation degrees of the storage structure, the storage performance and the storage overhead of each storage engine for storing the configuration order based on these data features, and then comprehensively considers the storage performance scores of each storage engine for the configuration order by using these values, and takes the target storage engine with the highest storage performance score as the storage path of the configuration order, so as to realize that the storage engine most suitable for the current configuration order can be used to store the current configuration order, thereby ensuring the storage efficiency and the storage success rate of the configuration order, and facilitating subsequent fast reading and writing of the configuration order. BRIEF DESCRIPTION OF DRAWINGS
[0019] Figure 1 FIG. 1 is a schematic structural diagram of a configuration order service system provided by an exemplary embodiment.
[0020] Figure 2 FIG. 2 is a flowchart of a configuration order processing method provided by an exemplary embodiment.
[0021] Figure 3 FIG. 3 is a flowchart of another configuration order processing method provided by an exemplary embodiment.
[0022] Figure 4 FIG. 4 is a schematic structural diagram of a device provided by an exemplary embodiment.
[0023] Figure 5 FIG. 5 is a structural block diagram of a configuration order processing apparatus provided by an exemplary embodiment. DETAILED DESCRIPTION
[0024] In order for those skilled in the art to better understand the technical solutions in the present specification, the technical solutions in the present specification will be clearly and completely described below in conjunction with the drawings in the embodiments of the present specification. Obviously, the described embodiments are only part of the embodiments of the present specification, not all. Based on the embodiments in the present specification, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present specification.
[0025] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the specification are information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation portal for user to choose authorization or refusal.
[0026] First, some professional terms involved in the specification will be explained:
[0027] Configuration work order: a standardized electronic process document for applying, approving, executing and recording modifications to systems, products or business rules.
[0028] Changeable field: indicates the content in the configuration work order that allows relevant personnel to modify. Taking the configuration work order of insurance products as an example, the changeable fields include but are not limited to: effective date, expiration date, insurance amount, insurance rate; taking the configuration work order of loan products as an example, the changeable fields include but are not limited to: loan rate, payment date, repayment date, number of overdue times, compensation logic under different overdue times; taking the configuration work order of fund products as an example, the changeable fields include but are not limited to: fund rate, effective date, redemption date.
[0029] Total number of changeable fields: indicates the total number of changeable fields contained in the configuration work order. Taking the configuration work order of insurance products as an example, assuming it contains the following changeable fields: effective date, expiration date, insurance amount, insurance rate; then the total number of changeable fields of the configuration work order is 4.
[0030] Read-write ratio of changeable fields: after the configuration work order is released to the marketing platform through the product release stage, the changeable fields it contains will be divided into two categories for the user end, one category is the read-only field that the user end only has read permission, and the other category is the writable field that the user end has write permission, for example, for loan products, the repayment date field is a writable field that the user end has write permission, while the loan rate, payment date, number of overdue times, etc. are read-only fields. Based on this, the read-write ratio refers to the ratio of the average number of times the read-only field is read per day to the average number of times the writable field is written per day, for example, assuming that a configuration work order has 10 changeable fields, 8 of which are read-only fields and 2 of which are writable fields, the 8 read-only fields are read an average of 1000 times per day, and the 2 writable fields are written an average of 10 times per day, then the read-write ratio is 1000 / 10 = 100.
[0031] Storage engine: including KV storage engine (Key-Value Storage Engine), relational storage engine.
[0032] KV storage engine: A data storage engine specialized in storing and retrieving key-value pairs, with extremely high write performance and good scalability, but limited query capabilities and potentially unstable read performance.
[0033] Relational storage engine: A storage engine that manages data based on the relational model, with the core idea of organizing data in structured two-dimensional tables. It has strong query capabilities and the data stored in two-dimensional tables is intuitive, making it easier to understand and clarify the relationship between data and business logic. However, it has poor scalability and flexibility, and may face performance bottlenecks in scenarios with large data sets and high concurrency read-write.
[0034] Data volume of configuration work order: For a KV storage engine, the data volume of a configuration work order refers to the single key data volume, i.e., the data size of a changeable field. For a relational storage engine, the data volume of a configuration work order refers to the single table row count, i.e., the total row count in the data table corresponding to the entire configuration work order.
[0035] Configuration change frequency of configuration work order: It refers to the average change frequency of configuration work order, such as how many times it changes a day or how many times it changes an hour, but not limited to this. The calculation of average change frequency can be based on the historical change count and change duration of configuration work order, for example, assuming that the configuration work order is changed 30 times in 30 days, then the average change frequency is one change per day.
[0036] Structural adaptation value: used to represent the adaptation degree of the storage structure of the storage engine to the configuration work order. The larger the structural adaptation value, the higher the adaptation degree of the storage structure of the storage engine to the configuration work order.
[0037] Performance adaptation value: used to represent the adaptation degree of the storage performance of the storage engine to the configuration work order. Storage performance includes but is not limited to read performance and write performance. The larger the performance adaptation value, the higher the adaptation degree of the storage performance of the storage engine to the configuration work order.
[0038] Change adaptation value: used to represent the adaptation degree of the storage overhead of the storage engine to the configuration work order. The larger the change adaptation value, the higher the adaptation degree of the storage overhead of the storage engine to the configuration work order. The storage overhead refers to the overhead generated by the storage engine in storing the change data of the changeable field in the configuration work order.
[0039] Storage performance score: used to represent the storage performance of the storage engine to the configuration work order. The higher the storage performance score, the better the storage performance of the storage engine to the configuration work order.
[0040] Adapted field number: used to represent the number of fields adapted by the storage engine when the storage performance of the storage engine meets the set storage requirement. The set storage requirement can be set according to actual demand or experience, for example, the storage time consumption needs to be less than the set time consumption threshold, and the embodiments of the present specification do not limit this.
[0041] Maximum field number: used to represent the upper limit of the number of fields that can be supported by the storage engine. It can be pre-configured based on the capacity of the storage engine, and the embodiments of the present specification do not limit this.
[0042] Ideal read-write ratio: used to represent the read-write ratio adapted by the storage engine when the read-write performance of the storage engine meets the set read-write requirement. The set read-write requirement can be set according to actual demand or experience, for example, the read-write speed needs to reach the set speed threshold, and the embodiments of the present specification do not limit this.
[0043] Read-write ratio adaptation value: used to represent the adaptation degree of the read-write performance of the storage engine to the configuration order.
[0044] Adapted data volume: used to represent the data storage volume adapted by the storage engine when the storage performance of the storage engine meets the set storage requirement. The set storage requirement can be set according to actual demand or experience, and the embodiments of the present specification do not limit this.
[0045] Maximum data volume: used to represent the upper limit of the data volume that can be supported by the storage engine.
[0046] Data volume adaptation value: used to represent the adaptation degree of the storage capacity of the storage engine to the configuration order.
[0047] Ideal change frequency: used to represent the data change frequency adapted by the storage engine when the storage change data of the storage engine meets the set overhead requirement. The set overhead requirement can be set according to actual demand or experience, and the embodiments of the present specification do not limit this.
[0048] To at least solve the technical problem of low storage efficiency of part of configuration work orders caused by using a fixed storage mode to store various types of configuration work orders in the related art, the present specification obtains the field total number of changeable fields, the read-write ratio of changeable fields, the data amount of configuration work orders, and the configuration change frequency of configuration work orders and other data characteristics by first performing extraction processing on the data characteristics of configuration work orders, and then calculates the value of the adaptation degree of the storage structure, storage performance, and storage overhead of each storage engine for storing configuration work orders based on these data characteristics, and then utilizes these values to comprehensively consider the storage performance scores of each storage engine for configuration work orders, and takes the target storage engine with the highest storage performance score as the storage path of configuration work orders, so as to realize that the current configuration work order can be stored by using the storage engine most suitable for the current configuration work order, thereby ensuring the storage efficiency and storage success rate of configuration work orders, and facilitating subsequent rapid reading and writing of configuration work orders.
[0049] Based on this, an application scenario example of the configuration work order processing method provided by the present specification is first introduced as follows:
[0050] Figure 1 FIG. 1 is a schematic diagram of an architecture of a configuration work order service system according to an example embodiment. As shown in FIG. 1, the system can include a server 11, a network 12, and a plurality of electronic devices such as a PC (Personal Computer) 13, a mobile phone 14, and the like. Figure 1
[0051] The server 11 can be a physical server containing a standalone host, or the server 11 can be a virtual server carried by a host cluster. In the running process, the server 11 can run the server-side program of an application to realize the related functions of the application, such as when the server 11 runs the program of the configuration work order service, the corresponding configuration work order service platform can be realized.
[0052] PC 13, mobile phone 14 are only part of the types of electronic devices that users can use. In fact, users can obviously also use electronic devices of the following types: tablet devices, notebook computers, personal digital assistants (PDAs), wearable devices (such as smart glasses, smart watches, etc.), and the like, and one or more embodiments of the present specification do not limit this. During operation, the electronic device can run a client-side program of an application to implement the related functions of the application, such as when the electronic device runs the program of the configuration work order service, it can implement the client of the configuration work order service. The application program of the above-mentioned client of the configuration work order service can be started and run on the electronic device. The client-side program can be a native application program installed on the electronic device, or the client-side program can be an applet, a fast application, or other similar forms. Of course, when using web page technologies such as HTML5 or the like, the related functions can be implemented through a page displayed by a browser, and the browser can be a standalone browser application or a browser module embedded in some application.
[0053] As for the network 12 between the electronic devices such as PC 13, mobile phone 14 and the server 11, it can be based on the communication mode supported by the corresponding electronic device, and the wired or wireless network is specifically selected to realize communication, and the present specification does not limit this. For example, the PC 13 can support wired and wireless communication at the same time, so wired or wireless network can be used as needed to realize communication, and the mobile phone 14 usually only supports wireless communication, so wireless network can be used to realize communication.
[0054] The configuration work order processing method provided by one or more embodiments of the present specification can be applied to the above-mentioned server 11, please refer to Figure 2 , Figure 2 is a flowchart of a configuration work order processing method provided by an exemplary embodiment, the method comprising the following steps:
[0055] In step S400, according to the obtained configuration work order, the field total number of the changeable field contained in the configuration work order, the read-write ratio of the changeable field, the data volume of the configuration work order, and the configuration change frequency of the configuration work order are processed;
[0056] In step S500, the structure adaptation value of each storage engine for storing the configuration work order is calculated according to the field total number; the performance adaptation value of each storage engine is calculated according to the read-write ratio of the changeable field and the data volume of the configuration work order; and the change adaptation value of each storage engine is calculated according to the configuration change frequency of the configuration work order;
[0057] In step S600, the storage performance scores of the storage engines for the configuration order are calculated according to the structure adaptation values, the performance adaptation values and the change adaptation values of the respective storage engines.
[0058] In step S700, the target storage engine with the highest storage performance score is invoked, and the configuration order is stored through the target storage engine.
[0059] In the configuration order storage link, the configuration order processing method provided by one or more embodiments of the present specification can be executed to select a suitable storage path for the configuration order, so as to ensure the storage efficiency of the configuration order and the subsequent read-write efficiency. The configuration order processing method provided by one or more embodiments of the present specification is described below:
[0060] In the case of receiving the configuration order sent by the configuration end, step S400 is executed to perform data feature extraction on the currently obtained configuration order, so as to obtain the field total number of the changeable fields contained in the configuration order, the read-write ratio of the changeable fields, the data volume of the configuration order and the configuration change frequency of the configuration order.
[0061] In some embodiments, the data feature extraction and processing of the configuration order can be performed according to the meanings of the field total number of the changeable fields, the read-write ratio of the changeable fields, the data volume of the configuration order and the configuration change frequency of the configuration order, and in combination with the data feature analysis technology of related technologies.
[0062] In another embodiment, in order to improve the acquisition efficiency and accuracy of the field total number, the read-write ratio, the data volume of the configuration order and the configuration change frequency, the configuration order processing method provided by one or more embodiments of the present specification further provides a corresponding acquisition scheme, that is, in step S400, according to the obtained configuration order, the field total number of the changeable fields contained in the configuration order, the read-write ratio of the changeable fields, the data volume of the configuration order and the configuration change frequency of the configuration order are processed.
[0063] In step S410, the configuration order is parsed to obtain the changeable fields contained in the configuration order; wherein the changeable fields include read-only fields with read permission of the user end and writable fields with write permission of the user end;
[0064] In step S420, the number of changeable fields is counted to obtain the field total number;
[0065] In step S430, the read-write ratio of the changeable fields is calculated according to the historical read times of the read-only fields and the historical write times of the writable fields;
[0066] In step S440, the data amount of the configuration work order is calculated to obtain the data amount of the configuration work order.
[0067] In step S450, the configuration change frequency of the configuration work order is calculated according to the change number of the configuration work order in the historical period.
[0068] In steps S410-S450, steps S410, S440 and S450 can be executed in parallel or in series, and the execution sequence of the three is not limited in the case of serial execution. In addition, steps S420 and S430 are executed after step S410, but steps S420 and S430 can be executed in parallel or in series, and the execution sequence of the two is also not limited in the case of serial execution.
[0069] It can be understood that in the process of processing the configuration work order through step S400, step S410 is executed first, and the configuration work order can be parsed by using the field parsing tool in the related art or by using the pre-developed field parsing tool to obtain each changeable field contained in the configuration work order and the read-only field and writable field contained in each changeable field.
[0070] After parsing each changeable field contained in the configuration work order through step S410, steps S420 and S430 are executed. In the process of executing step S420, the total number of changeable fields contained in the configuration work order is counted to obtain the total number of fields. In the process of executing step S430, the historical reading number of the read-only field in the historical setting days and the historical writing number of the writable field in the historical setting days can be obtained from the historical database of the configuration work order recorded by the service system, then the ratio of the historical reading number to the historical setting days is calculated to obtain the number of times that the read-only field is read on average per day, and the ratio of the historical writing number to the historical setting days is calculated to obtain the number of times that the writable field is written on average per day, and then the ratio of the number of times that the read-only field is read on average per day to the number of times that the writable field is written on average per day is calculated to obtain the read-write ratio of the changeable field. The historical setting days can be set according to actual needs or experience, for example, the historical setting days can be 30 days before the current time, but are not limited thereto.
[0071] In the meantime of executing step S410, step S440 and step S450 can be executed in parallel. In the process of executing step S440, the data volume of the configuration work order can be calculated by using the data volume calculation technology in the related art, to obtain the data volume of the configuration work order. In the process of executing step S450, the number of changes of the configuration work order in the historical period can be obtained from the configuration work order change record recorded by the service system, wherein the historical period can be set according to actual demand or experience, for example, the historical period can be 10 days before the current time, but is not limited thereto. Then, the ratio of the number of changes to the historical period can be calculated to obtain the configuration change frequency of the configuration work order.
[0072] After obtaining the total number of the changeable fields, the read-write ratio of the changeable fields, the data volume of the configuration work order, and the configuration change frequency of the configuration work order by any of the above embodiments, step S500 is executed to further calculate the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine for the configuration work order. For this purpose, to ensure the accuracy of the calculation of the adaptation value, the configuration work order processing method provided by one or more embodiments of the present specification can include at least one of the following calculation schemes of the adaptation value:
[0073] First, the calculation scheme of the structure adaptation value
[0074] Since the structure adaptation value is used to represent the adaptation degree of the storage structure of the storage engine to the current configuration work order, in order to obtain an accurate structure adaptation value, the adaptation degree of the storage structure is evaluated from the data structure characteristics of the configuration work order, i.e., the number of fields.
[0075] Based on this, in step S500, the step of calculating the structure adaptation value of each storage engine for storing the configuration work order according to the total number of fields includes:
[0076] In step S510, for each storage engine, the structure adaptation value of the storage engine is calculated according to the total number of fields, and the adaptation field number and the maximum field number supported by the storage engine.
[0077] It can be understood that the calculation of the structure adaptation value of each storage engine can be realized by executing step S510 using a unified structure adaptation value calculation formula. The structure adaptation value calculation formula is:
[0078]
[0079] In the above formula, the adaptive field number and the maximum field number are pre-configured according to the more applicable data structure characteristics of each storage engine. For example, assuming that there are two storage engines, a KV storage engine and a relational storage engine, the KV storage engine is more suitable for storing configuration work orders with simple structures, and has better performance for configuration work orders with flat structures, while the relational storage engine can support structured data and is suitable for storing more complex configuration work orders. Based on this, it can be known that the adaptive field number and the maximum field number of the KV storage engine are less than those of the relational storage engine. Since the maximum field number that can be supported by the KV storage engine and the relational storage engine has been designed in the development stage, the maximum field number of the storage engine can be based on the maximum field number designed in the development stage, for example, the maximum field number of the KV storage engine can be in the range of [10, 20], and the maximum field number of the relational storage engine can be in the range of [30, 150], but is not limited thereto. The adaptive field number can be obtained by trial or experience, for example, the adaptive field number of the KV storage engine can be 5, and the adaptive field number of the relational storage engine can be 20, but is not limited thereto, and can be appropriately expanded according to actual use, for example, after the KV storage engine stores a configuration work order containing 8 fields, it is found that the difference between the storage performance of the configuration work order containing 8 fields and the storage performance of the configuration work order containing 5 fields is less than a set difference threshold, and then the adaptive field number is adjusted to 8. The set difference threshold can be set according to actual needs or experience, and will not be described here.
[0080] Second, the performance adaptation value calculation scheme
[0081] Since the performance adaptation value is used to represent the adaptation degree of the storage performance of the storage engine to the current configuration work order, in order to obtain an accurate performance adaptation value, the adaptation degree of the storage performance is evaluated from the data amount of the configuration work order and the read-write ratio of the changeable field.
[0082] Based on this, in step S500, the step of calculating the performance adaptation value of each storage engine according to the read-write ratio of the changeable field and the data amount of the configuration work order includes:
[0083] In step S520, for each storage engine, a read-write ratio adaptation value of the storage engine is calculated according to the read-write ratio of the changeable field and the ideal read-write ratio supported by the storage engine;
[0084] In step S530, for each storage engine, a data amount adaptation value is calculated according to the data amount of the configuration work order, and the adaptive data amount and the maximum data amount supported by the storage engine;
[0085] In step S540, the performance adaptation value of each storage engine is calculated according to the read-write ratio adaptation value and the quantity adaptation value of each storage engine.
[0086] In the above, the ideal read-write ratio, the adaptation data quantity and the maximum data quantity supported by each storage engine can be pre-configured according to the related description above combined with related technologies, which will not be described here.
[0087] Taking the storage engines applied in the present specification as examples, including KV storage engines and relational storage engines, since the KV storage engine has the characteristics of high read and low write, its read performance advantage is more obvious, while the relational storage engine has the characteristics of balanced read and write, its write operation is more efficient, so the ideal read-write ratio of the KV storage engine is obviously higher than that of the relational storage engine. As a value example, the ideal read-write ratio of the KV storage engine can be configured as 100:1, while the ideal read-write ratio of the relational storage engine can be configured as 10:1, but not limited to this, which can also be appropriately expanded according to the actual use.
[0088] Continuing to use the above example, since the structure of the KV storage engine is easier to expand horizontally, but the data quantity of a single key-value storage is limited, while the table structure of the relational storage engine has a capacity limit, but the data quantity depends on the number of rows that can be recorded in a single table, so the adaptation data quantity and the maximum data quantity of the KV storage engine are smaller than those of the relational storage engine. Based on this, as a value example, the adaptation data quantity of the KV storage engine can be configured as 1 million, and the adaptation data quantity of the relational storage engine can be configured as 5 million, but not limited to this, which can also be appropriately expanded according to the actual use.
[0089] Therefore, the calculation of the performance adaptation value of each storage engine can be realized by executing steps S520-S540. Among them, steps S520 and S530 can be executed in parallel or in series, and the order of the two can not be limited in the case of serial execution.
[0090] In the process of executing step S520, a unified read-write ratio adaptation value calculation formula can be used to calculate the read-write ratio adaptation value of each storage engine. The read-write ratio adaptation value calculation formula is as follows:
[0091]
[0092] In the above formula, The function is used to normalize the ratio of the read-write ratio of the variable field to the ideal read-write ratio, that is, to map the ratio to the interval .
[0093] In the process of performing step S530, a unified data volume adaptation value calculation formula can also be used to calculate the data volume adaptation value of each storage engine. The data volume adaptation value calculation formula is:
[0094]
[0095] After obtaining the read-write ratio adaptation value and the quantity adaptation value of each storage engine, step S540 is performed. In the process of performing step S540, a unified performance adaptation value calculation formula can also be used to calculate the performance adaptation value of each storage engine. The performance adaptation value calculation formula is:
[0096]
[0097] Through the above performance adaptation value calculation formula, the read-write ratio adaptation value and the data volume adaptation value can be better integrated, so that the storage performance of the storage engine for the current configuration order can be more accurately evaluated.
[0098] In other embodiments, the calculation method of the performance adaptation value can also use a weighted sum calculation method.
[0099] Third, the calculation scheme of the change adaptation value
[0100] Since the change adaptation value is used to represent the adaptation degree of the storage overhead of the storage engine to the current configuration order, in order to obtain an accurate change adaptation value, the adaptation degree of the storage overhead is evaluated from the change frequency of the changeable field included in the configuration order.
[0101] Based on this, in step S500, the change adaptation value of each storage engine is calculated according to the configuration change frequency of the configuration order. The step includes:
[0102] In step S550, for each storage engine, the change adaptation value of the storage engine is calculated according to the configuration change frequency of the configuration order and the ideal change frequency supported by the storage engine.
[0103] In the above, the ideal change frequency supported by each storage engine can be obtained by pre-configuration according to the related description in the above and related technologies, which will not be described here.
[0104] The storage engines applied in the present specification include a KV storage engine and a relational storage engine. The KV storage engine is more suitable for high-frequency changes, and has a small storage overhead for high-frequency change data. The relational storage engine is more suitable for low-frequency changes, and has a large storage overhead for high-frequency change data, and a high structure change cost. Therefore, the ideal change frequency of the KV storage engine is obviously higher than that of the relational storage engine. As an example, the ideal change frequency of the KV storage engine can be configured to be hourly, and the ideal change frequency of the relational storage engine can be configured to be daily, but is not limited thereto, and can be appropriately extended according to actual use.
[0105] Thus, the calculation of the change adaptation value of each storage engine can be implemented by performing step S550. In the process of performing step S550, a unified change adaptation value calculation formula can also be used to calculate the change adaptation value of each storage engine. The change adaptation value calculation formula is as follows:
[0106]
[0107] In the formula, is a decay coefficient for controlling the influence of the non-ideal change frequency on the change adaptation value. The decay coefficient can be determined according to the business sensitivity of the configuration work order or historical data. For example, if it is desired that the change frequency has a large influence on the storage performance score of the storage engine, the decay coefficient can be assigned a value of 0.1. If it is desired that the influence of the change frequency on the storage performance score of the storage engine is reduced, the decay coefficient can be assigned a value of 0.01. The decay coefficient can also be assigned different values to test or regress the storage performance of each storage engine, to obtain the optimal or better value of the decay coefficient.
[0108] After the structure adaptation value, the performance adaptation value, and the change adaptation value of each storage engine are calculated, step S600 is performed to calculate the storage performance score of each storage engine for the configuration work order according to the structure adaptation value, the performance adaptation value, and the change adaptation value of each storage engine. In some examples, the structure adaptation value, the performance adaptation value, and the change adaptation value of each storage engine can be added, and the sum value obtained after the addition is taken as the storage performance score.
[0109] However, different adaptation values may have different effects on the storage performance of the storage engine, and therefore, directly accumulating the adaptation values to obtain the sum as the storage performance score may result in the selected storage engine having a lower adaptation degree to the storage performance of the current configuration order than the storage engine that is not selected. Therefore, to solve this technical problem and better ensure and improve the adaptation degree of the selected storage engine to the storage performance of the current configuration order, in some embodiments, the configuration order processing method provided by one or more embodiments of the present specification further provides another calculation scheme of the storage performance score, that is, the step S600 of calculating the storage performance score of each storage engine for the configuration order according to the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine comprises:
[0110] In step S630, the weight coefficients pre-configured for each adaptation value are called to weight and calculate the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine, and the storage performance score of each storage engine for the configuration order is obtained.
[0111] It can be understood that the calculation of the storage performance score of each storage engine can be realized by performing step S630. The calculation process can be realized or expressed by the following calculation formula:
[0112]
[0113] As can be seen, the weight coefficient includes three weights, wherein, is the first weight, used to represent the influence degree of the structure adaptation value on the storage performance score; is the second weight, used to represent the influence degree of the performance adaptation value on the storage performance score; is the third weight, used to represent the influence degree of the change adaptation value on the storage performance score; Based on this, the values of , and may be configured according to actual requirements or experience.
[0114] In some embodiments, to further improve the adaptation degree of the selected storage engine to the configuration order, the configuration order processing method provided by one or more embodiments of the present specification further provides a scheme of adjusting the above weights based on the order type of the configuration order, that is, before calling the weight coefficients pre-configured for each adaptation value, the method can further comprise:
[0115] In step S610, it is determined whether to adjust the weight coefficients according to the order type of the configuration order;
[0116] In step S620, the weight coefficient is updated as the adjusted weight coefficient in the case of adjusting the weight coefficient.
[0117] It can be understood that before the pre-configured weight coefficient is called to perform the storage performance score calculation, step S610 is performed to determine whether the weight coefficient needs to be adjusted under the current configuration work order, and then the adjusted weight coefficient is used to perform the storage performance score calculation, so as to further improve the storage performance adaptation degree of the finally selected storage engine to the current configuration work order.
[0118] In the process of performing step S610, the work order type of the configuration work order is obtained. It can be understood that the corresponding product type information, such as a credit product or a marketing product, can also be stored in the configuration work order. Based on this, the work order type of the configuration work order can exist in two types, which are a credit product work order and a marketing product work order.
[0119] Because the data volume of the configuration work order involved in the credit scenario is usually much larger than that of the configuration work order involved in the marketing scenario, especially in data depth and importance, the storage structure is more important for the credit product work order, and the storage performance is more important for the marketing product work order. Therefore, for the credit product work order, the value of the first weight can be increased, and the second weight and / or the third weight can be adaptively reduced based on the increased first weight to ensure that the sum of the three weights is 1. For the marketing product work order, the value of the second weight can be increased, and the first weight and / or the third weight can be adaptively reduced based on the increased second weight, also to ensure that the sum of the three weights is 1.
[0120] Based on this, the step of determining whether to adjust the weight coefficient according to the work order type of the configuration work order in the above step S610 can include at least one of the following steps:
[0121] In step S611, in the case that the work order type of the configuration work order is a credit product work order, the first weight is increased, and the second weight and / or the third weight is reduced.
[0122] In step S612, in the case that the work order type of the configuration work order is a marketing product work order, the second weight is increased, and the first weight and / or the third weight is reduced.
[0123] Therefore, after the weight coefficient is adjusted based on the type of the configuration work order, step S620 is performed to update the originally configured weight coefficient to the adjusted weight coefficient, so that in the process of step S630, the adjusted weight coefficient is used to calculate the storage performance score of each storage engine, thereby realizing that different types of configuration work orders can select more suitable storage engines to complete more efficient, accurate and higher success rate storage operations, and the storage structure of the selected storage engine is more suitable for the configuration work order to be stored.
[0124] After the storage performance score of each storage engine for the current configuration work order is calculated by any of the above embodiments, step S700 is performed to select the storage engine with the highest storage performance score as the target storage engine, and the target storage engine is called to store the configuration work order through the target storage engine.
[0125] After the storage of the configuration work order is completed, in order to further improve the adaptability of the target storage engine selected based on subsequent configuration work orders, so that the selection strategy of the target storage engine can continue to learn, thereby better serving the configuration work order, in some embodiments, the configuration work order processing method provided by one or more embodiments of the present specification also provides a scheme for optimizing the selection strategy of the target storage engine, that is, after the configuration work order is stored through the target storage engine, the method can further include:
[0126] In step S800, the operation time and operation success rate generated after the target storage engine performs the storage operation on the configuration work order are obtained;
[0127] In step S900, according to the operation time and the operation success rate, it is determined whether to adjust the associated data that affects the storage performance score of the target storage engine, so that the storage performance score calculated based on the adjusted associated data matches the operation time and the operation success rate; wherein the associated data includes at least one of the following: the number of adaptation fields involved in the target storage engine, the ideal read-write ratio, the adaptation data volume, the ideal change frequency, the weight coefficient.
[0128] It can be understood that after the target storage engine performs the storage operation on the configuration work order, the service system can monitor the operation time and operation success rate of the target storage engine. The operation time can be understood as the processing speed of the target storage engine performing the storage operation, that is, the time consumed for completing one data read or write operation, for example, the time recorded by the service system from receiving the storage instruction / query instruction from the target storage engine to returning the result. The operation success rate can be understood as the ratio of the number of failed operations (such as write timeout or read error) to the total number of operations in a period of time.
[0129] Thus, in the process of performing step S800, the operation time and the operation success rate of the storage operation performed by the target storage engine for the current configuration order can be obtained by accessing the storage engine operation record library in the service system.
[0130] Then, step S900 is performed to determine whether to adjust the associated data according to the operation time and the operation success rate. If the operation time is higher than a set delay threshold or the operation success rate is lower than a set success rate threshold, it indicates that the storage effect of the target storage engine for the configuration order is not good, and the associated data needs to be adjusted. Taking the KV storage engine as an example, if the poor storage effect is caused by the operation time, it indicates that the storage performance of the KV storage engine is not suitable for the current configuration order and similar configuration orders whose gap between the read-write ratio and the data amount and the current configuration order satisfies a set threshold range, where the set threshold range can be set according to actual needs or experience, which is not limited in the present specification. Since the storage performance is represented by the performance adaptation value, and the size of the performance adaptation value is positively correlated with the size of the read-write ratio adaptation value and the amount adaptation value, the read-write ratio adaptation value is negatively correlated with the ideal read-write ratio, and the amount adaptation value is negatively correlated with the adapted data amount, in order to reduce the storage performance score of the KV storage engine for similar configuration orders, the related associated data can be adjusted, such as reducing the second weight, and / or increasing the value of the ideal read-write ratio and / or the adapted data amount, so that in the case of similar configuration orders, the adjusted associated data is used to calculate the storage performance score, and other storage engines except the KV storage engine can be selected with a higher probability. Based on this, the adjusted associated data can be mapped with the read-write ratio range and the data amount range of the configuration order, so that in the storage processing of subsequent configuration orders, the appropriate associated data can be selected based on the read-write ratio and the data amount of the configuration order to calculate the storage performance score of the corresponding storage engine, and the configuration order can be stored through a more appropriate storage path, which is conducive to further improving the storage efficiency, the storage success rate and the read-write efficiency.
[0131] Conversely, if the operation time consumption is lower than the set delay threshold value and the operation success rate is higher than the set success rate threshold value, it indicates that the target storage engine has good storage effect on the configuration work order, at this time the associated data can be adjusted or not. However, in order to enable other similar configuration work orders (such as the difference between the total number of fields, the read-write ratio and the data volume meet the set threshold range) similar to the current configuration work order to have a greater probability of selecting the target storage engine for storage in the subsequent, in order to ensure storage performance and storage efficiency, in some embodiments, in this case, the associated data can also be adjusted, but is adjusted in the direction of enhancing the storage strategy, that is, the associated data related to the structure performance and the storage performance, such as increasing the first weight and / or the second weight, and / or reducing the ideal read-write ratio and / or the adaptive data volume, and / or adjusting the adaptive field number in the direction close to the total number of fields of the current configuration work order, to improve the storage performance score of the target storage engine from the aspects of storage structure and storage performance, so that after the adjusted associated data is used to calculate the storage performance score in the case of similar configuration work order, the target storage engine with good storage effect verified can be selected with a greater probability. Similarly, the adjusted associated data can be mapped with the field total number range, the read-write ratio range and the data volume range of the configuration work order, so as to enable the selection of appropriate associated data to calculate the storage performance score of the corresponding storage engine based on the field number, the read-write ratio and the data volume of the configuration work order in the storage processing of the subsequent configuration work order, so that the configuration work order can be stored through a more appropriate storage approach, which is beneficial to further improve the storage efficiency, the storage success rate and the read-write efficiency.
[0132] After completing the storage of the configuration work order, in order to enable various versions of the configuration work order to be traced back, so as to realize the tracking of the whole life cycle of the change, in some embodiments, the configuration work order processing method provided by one or more embodiments of the present specification can further include:
[0133] In step S1000, a version snapshot matched with the configuration work order is generated, and the version snapshot before the update and the version snapshot after the update are stored.
[0134] Therefore, through step S1000, each change of the configuration work order can be recorded, facilitating the tracking of the whole life cycle of the change.
[0135] After storing the version snapshots, the product configuration data recorded by the configuration work order can also be published to multiple production environment platforms, the product configuration data is tested through the multiple environment platforms, and the related products are published after the test, so that the rapid publication of the products can be realized, and the configuration environment and the production environment can be isolated, realizing zero interference management of the configuration environment and the production environment.
[0136] Since there is a verification link before the storage link, and the verification link is a strict check on the configuration order through three dimensions of technology, business and security to ensure that each change of the configuration order is correct and complete, thereby preventing product failure after going online or causing the company to have capital loss. However, in the related art, many configuration centers of configuration orders do not automatically verify the configuration order, and need manual intervention for verification, thereby causing a large burden of manual verification, low verification efficiency, and easy errors. Therefore, to solve these technical problems, the configuration order processing method provided by one or more embodiments of the present specification also provides a verification scheme for the configuration order. Please refer to Figure 3 , Figure 3 is a flowchart of another configuration order processing method provided by an exemplary embodiment. The method can also include:
[0137] In step S100, in response to a configuration order change request of a configuration end, a verification engine is called, and the configuration order provided by the configuration end is parsed by the verification engine to extract the changeable fields contained in the configuration order.
[0138] In step S200, the verification engine obtains the verification script matched with each changeable field from the pre-configured rule library, and executes each verification script by the verification engine to verify whether the configuration content of the matched changeable field is qualified.
[0139] It can be understood that when the configuration order provided by the configuration end to the service system is received, it can be considered that the configuration end has proposed a configuration order change request. In this case, step S100 is executed to respond to the configuration order change request of the configuration end, and a pre-configured verification engine such as a Groovy verification engine is called, but is not limited thereto. Then, the configuration order is parsed by the verification engine to extract the changeable fields contained in the configuration order.
[0140] Then, step S200 is performed, and the verification engine further retrieves the verification scripts matched with the variable fields from the pre-configured rule library, and then the verification engine continues to execute the verification scripts to determine whether the configuration content in the variable fields matched with the verification scripts is qualified. For example, taking the variable field of the rate as an example, the verification script retrieved by the verification engine from the rule library based on the rate is a rate verification script. The rate verification script can record the qualified judgment logic of the rate, for example, the input is the value of the rate field in the current configuration work order, the judgment logic includes the logic of determining the value of the rate field by using the pre-configured rate threshold range, for example, determining whether the value of the rate field is in the rate threshold range; and the output is the rate verification qualified or unqualified, for example, if it is determined that the value of the rate field is not in the rate threshold range, the output result is that the rate verification is unqualified, otherwise, if it is determined that the value of the rate field is in the rate threshold range, the output result is that the rate verification is qualified. Thus, the verification engine can execute the verification script to implement the verification of the configuration content in the variable fields.
[0141] In the case that the verification results of the variable fields are all qualified, the above step S400 can be performed. Otherwise, in the case that the verification result of one of the variable fields is unqualified, the verification message indicating the unqualified variable field is returned to the configuration end to prompt the configuration end to reconfigure the unqualified variable field.
[0142] The above verification process can ensure the correctness and completeness of the configuration of the configuration work order. However, due to the adjustment of product strategies, the actual requirements of some configuration content may change slightly. Therefore, in some embodiments, the configuration work order processing method provided by one or more embodiments of the present specification further provides an approval flow scheme of the configuration work order, that is, the method can further include:
[0143] In step S300, in the case that the configuration content of each variable field is qualified, the configuration work order is sent to the approval end associated with the configuration work order.
[0144] Thus, by adding the further approval of the configuration work order by the approval end after the verification, it can be ensured that the configuration content of the configuration work order is more in line with the actual requirements, and the correctness and completeness of the configuration content can be further ensured.
[0145] Correspondingly, the above step S400 is performed in the case that the approval pass message fed back by the approval end is received.
[0146] Figure 4 is a schematic structural diagram of a device provided by an example embodiment. As shown in Figure 4As shown, the device 400 is comprised primarily of a communication interface 402, a user interface 404, a processor 406, and a data store 408, which are interconnected and communicate with each other through a system bus, network, or other connection mechanism 410. The communication interface 402 enables the device 400 to communicate with other devices, access networks, and transport networks through analog or digital modulation. For example, the communication interface 402 can include a chipset and antenna for wireless communication with a radio access network or access point. In addition, the communication interface 402 can be a wired interface such as an Ethernet, Token Ring, or USB port, or a wireless interface such as Wifi, Bluetooth, Global Positioning System (GPS), or a wide-area wireless interface (e.g., WiMAX or LTE). Of course, the communication interface 402 can support other forms of physical layer interface and standard or proprietary communication protocol. The communication interface 402 can also include multiple physical communication interfaces, such as a Wifi interface, a Bluetooth interface, and a wide-area wireless interface.
[0147] The user interface 404 includes receiving user input and providing output to a user. Thus, the user interface 404 can include input components such as a keypad, keyboard, touch- sensitive or presence-sensitive panel, computer mouse, trackball, joystick, microphone, still camera, and video camera, and output components such as a display screen (which can be combined with a touch-sensitive panel), CRT, LCD, LED, display using DLP technology, printer, other known or future developed equivalent devices. The user interface 404 can also generate audible output through a speaker, speaker jack, audio output port, audio output device, earphones, and other known or future developed equivalent devices. In some embodiments, the user interface 404 can include software, circuitry, or other form of logic that is capable of transmitting data to and receiving data from external user input / output devices. Additionally or alternatively, the device 400 can support remote access from other devices through the communication interface 402 or another physical interface (not shown). The user interface 404 can be configured to receive user input, the location and movement of which can be indicated by an indicator or cursor described herein. The user interface 404 can also be configured as a display device for rendering or displaying a text segment.
[0148] The processor 406 can include one or more general processors and / or specialized processors.
[0149] The data store 408 can include one or more volatile and / or non-volatile storage components, and can be integrated in whole or in part with the processor 406. The data store 408 can include removable and / or non-removable components.
[0150] The processor 406 is capable of executing program instructions 418 (e.g., compiled or interpreted program logic and / or machine code) stored in the data storage 408 to implement the various functionality described herein. The data storage 408 can include a non-transitory computer-readable medium having stored thereon program instructions that, when executed by the device 400, enable the device 400 to carry out any of the methods, processes, or functions disclosed in the specification and / or drawings. Execution of the program instructions 418 by the processor 406 can cause the processor 406 to utilize the data 412.
[0151] For example, the program instructions 418 can include an operating system 422 (e.g., an operating system kernel, device drivers, and / or other modules) installed on the device 400 as well as one or more application programs 420 (e.g., a browser, a social application, or a game application). Similarly, the data 412 can include operating system data 416 and application data 414. The operating system data 416 is primarily accessible to the operating system 422, while the application data 414 is primarily accessible to the one or more application programs 420. The application data 414 can be located in a file system that is visible or hidden to a user of the device 400.
[0152] The application programs 420 can communicate with the operating system 422 through one or more application programming interfaces (APIs). These APIs facilitate the application programs 420 in reading and / or writing application data 414, communicating or receiving information via the communication interface 402, receiving or displaying information on the user interface 404, and so on.
[0153] In some terminology, the application programs 420 can be referred to simply as “apps.” Furthermore, the application programs 420 can be downloaded to the device 400 through one or more online application stores or application markets. However, the application programs can also be installed on the device 400 through other means, such as through a web browser or a physical interface (e.g., a USB port) on the device 400.
[0154] Reference is made to Figure 5 , Figure 5 is a structural block diagram of a configuration work order processing apparatus provided by an example embodiment. The configuration work order processing apparatus can be applied to a device as shown in Figure 4 . The configuration work order processing apparatus 500 can include:
[0155] The work order processing module 510 is configured to: according to the obtained configuration work order, process to obtain a total number of fields of changeable fields contained in the configuration work order, a read-write ratio of the changeable fields, a data volume of the configuration work order, and a configuration change frequency of the configuration work order.
[0156] The adaptation value calculation module 520 is configured to: calculate a structure adaptation value of each storage engine for storing the configuration order according to the total number of fields; calculate a performance adaptation value of each storage engine for storing the configuration order according to the read-write ratio of the changeable field and the data amount of the configuration order; and calculate a change adaptation value of each storage engine for storing the configuration order according to the configuration change frequency of the configuration order; wherein the structure adaptation value is used to represent the adaptation degree of the storage structure of the storage engine to the configuration order, the performance adaptation value is used to represent the adaptation degree of the storage performance of the storage engine to the configuration order, and the change adaptation value is used to represent the adaptation degree of the storage overhead of the storage engine to the configuration order.
[0157] The score calculation module 530 is configured to: calculate a storage performance score of each storage engine for the configuration order according to the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine.
[0158] The storage module 540 is configured to: call a target storage engine with the highest storage performance score, and store the configuration order through the target storage engine.
[0159] In some embodiments, the process in which the order processing module 510 processes the total number of changeable fields contained in the configuration order, the read-write ratio of the changeable field, the data amount of the configuration order and the configuration change frequency of the configuration order according to the obtained configuration order is configured to include:
[0160] The configuration order is parsed to obtain the changeable field contained in the configuration order; wherein the changeable field includes a read-only field with reading permission of the user end and a writable field with writing permission of the user end;
[0161] The number of changeable fields is counted to obtain the total number of fields;
[0162] The read-write ratio of the changeable field is calculated according to the historical reading times of the read-only field and the historical writing times of the writable field;
[0163] The data amount of the configuration order is calculated to obtain the data amount of the configuration order;
[0164] The configuration change frequency of the configuration order is calculated according to the change times of the configuration order in the historical period.
[0165] In some embodiments, the process in which the adaptation value calculation module 520 calculates the structure adaptation value of each storage engine for storing the configuration order according to the total number of fields is configured to include:
[0166] For each storage engine, a structure adaptation value of the storage engine is calculated according to the total number of fields, and an adaptation field number and a maximum field number supported by the storage engine;
[0167] The adaptation field number is used to represent a field number adapted by the storage engine when storage performance of the storage engine reaches a set storage requirement, and the maximum field number is used to represent an upper limit of a field number supported by the storage engine.
[0168] In some embodiments, the process in which the adaptation value calculation module 520 calculates the performance adaptation value of each storage engine according to the read-write ratio of the changeable field and the data volume of the configuration work order is configured to include:
[0169] For each storage engine, a read-write ratio adaptation value of the storage engine is calculated according to the read-write ratio of the changeable field and an ideal read-write ratio supported by the storage engine, the ideal read-write ratio is used to represent a read-write ratio adapted by the storage engine when read-write performance of the storage engine reaches a set read-write requirement, and the read-write ratio adaptation value is used to represent an adaptation degree of the read-write performance of the storage engine to the configuration work order.
[0170] For each storage engine, a data volume adaptation value is calculated according to the data volume of the configuration work order, and an adaptation data volume and a maximum data volume supported by the storage engine, the adaptation data volume is used to represent a data storage volume adapted by the storage engine when storage performance of the storage engine reaches a set storage requirement, the maximum data volume is used to represent an upper limit of a data volume supported by the storage engine, and the data volume adaptation value is used to represent an adaptation degree of a storage capacity of the storage engine to the configuration work order.
[0171] According to the read-write ratio adaptation value and the quantity adaptation value of each storage engine, a performance adaptation value of each storage engine is calculated.
[0172] In some embodiments, the process in which the adaptation value calculation module 520 calculates the change adaptation value of each storage engine according to the configuration change frequency of the configuration work order is configured to include:
[0173] For each storage engine, a change adaptation value of the storage engine is calculated according to the configuration change frequency of the configuration work order and an ideal change frequency supported by the storage engine.
[0174] The ideal change frequency is used to represent a data change frequency adapted by the storage engine when an overhead of the storage engine for changing data reaches a set overhead requirement.
[0175] In some embodiments, the score calculation module 530 is configured to calculate the storage performance score of each storage engine for the configuration order according to the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine, and the process comprises:
[0176] calling a weight coefficient pre-configured for each adaptation value, weighting and calculating the structure adaptation value, the performance adaptation value and the change adaptation value of each storage engine to obtain the storage performance score of each storage engine for the configuration order.
[0177] In some embodiments, the configuration order processing apparatus 500 can further comprise:
[0178] an adjustment module configured to determine whether to adjust the weight coefficient according to the order type of the configuration order before the score calculation module 530 calls the weight coefficient pre-configured for each adaptation value;
[0179] an update module configured to update the weight coefficient to an adjusted weight coefficient in the case of adjustment of the weight coefficient.
[0180] In some embodiments, the weight coefficient comprises a first weight of the structure adaptation value, a second weight of the performance adaptation value and a third weight of the change adaptation value; the sum of the first weight, the second weight and the third weight is 1.
[0181] The process in which the adjustment module determines whether to adjust the weight coefficient according to the order type of the configuration order is configured to comprise:
[0182] in the case of the order type of the configuration order being a credit product order, increasing the first weight and decreasing the second weight and / or the third weight; and / or
[0183] in the case of the order type of the configuration order being a marketing product order, increasing the second weight and decreasing the first weight and / or the third weight.
[0184] In some embodiments, the above-mentioned adjustment module can be further configured to:
[0185] after the storage module 540 stores the configuration order through the target storage engine, obtaining the operation time consumption and operation success rate generated after the target storage engine performs a storage operation on the configuration order;
[0186] According to the operation time consumption and the operation success rate, it is determined whether to adjust associated data affecting a storage performance score of the target storage engine, so that a storage performance score calculated based on the adjusted associated data matches the operation time consumption and the operation success rate; wherein the associated data includes at least one of the following: a number of adaptation fields involved in the target storage engine, an ideal read-write ratio, an adaptation data volume, an ideal change frequency, and a weight coefficient.
[0187] In some embodiments, the configuration order processing apparatus 500 can further include:
[0188] The verification module is configured to, in response to a configuration order change request of a configuration end, invoke a verification engine, and parse a configuration order provided by the configuration end through the verification engine to extract variable change fields contained in the configuration order; and acquire, through the verification engine, verification scripts matched with each variable change field from a pre-configured rule library, and execute each verification script through the verification engine to verify whether the configuration content of the matched variable change field is qualified.
[0189] In some embodiments, the configuration order processing apparatus 500 can further include:
[0190] The approval module is configured to, in the case that the configuration content of each variable change field is qualified, send the configuration order to an approval end associated with the configuration order.
[0191] Correspondingly, the order processing module 510 processes the field total number of the variable change fields contained in the configuration order, the read-write ratio of the variable change fields, the data volume of the configuration order, and the configuration change frequency of the configuration order according to the obtained configuration order, and executes in the case that the approval module receives an approval passing message fed back by the approval end.
[0192] In some embodiments, the configuration order processing apparatus 500 can further include:
[0193] The snapshot module is configured to, after the storage module 540 completes the storage of the configuration order, generate a matched version snapshot according to the configuration order, and store the version snapshot before the update and the version snapshot after the update.
[0194] For ease of description, the above apparatus is described in various modules or units in terms of function. Of course, when implementing one or more of the present specification, the functions of each module or unit can be implemented in the same or more software and / or hardware, or the modules implementing the same function can be combined by a combination of sub-modules or sub-units, etc. The above-described apparatus embodiments are only illustrative, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed.
[0195] Based on the same concept as the above method, the present specification also provides an electronic device, comprising: a processor; a memory for storing processor executable instructions; wherein the processor implements the steps of the method according to any one of the above embodiments by running the executable instructions.
[0196] Based on the same concept as the above method, the present specification also provides a computer readable storage medium, which stores computer instructions, and the instructions are executed by a processor to implement the steps of the method according to any one of the above embodiments.
[0197] Based on the same concept as the above method, the present specification also provides a computer program product, which comprises computer program / instructions, and the computer program / instructions are executed by a processor to implement the steps of the method according to any one of the above embodiments.
[0198] Those skilled in the art can understand that:
[0199] In the present specification, the terms "comprise", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, product or device comprising a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, product or device. Without more limitations, it does not exclude the presence of other same or equivalent elements in the process, method, product or device comprising the elements.
[0200] In the present specification, "one", "a" and "the" do not refer to the singular, but also include the plural.
[0201] In the present specification, the first, second, etc. ordinal numbers do not necessarily indicate the order, and many times are used for the convenience of distinguishing the objects. For example, the first server and the second server usually refer to two servers. In order to distinguish the two servers, they are expressed as the first server and the second server. Of course, sometimes the two servers can also be the same server.
[0202] In this specification, unless specifically stated otherwise, "receiving, sending of data" is not necessarily direct receiving and sending, and can be indirect receiving and sending. For example, A receiving data sent by B can be understood as A directly receiving data sent by B, or can be understood as A indirectly receiving data sent by B through other subjects such as C. Similarly, B sending data to A can be understood as B directly sending data to A, or can be understood as B indirectly sending data to A through other subjects such as C. Here, C can be one subject, or two or more subjects.
[0203] In this specification, unless specifically stated otherwise, the association relationship generated between structures can be a direct association relationship or an indirect association relationship. For example, when describing "A is connected with B", unless it is specifically stated that A is directly connected with B, it should be understood that A can be directly connected with B, or A can be indirectly connected with B; for another example, when describing "A is on B", unless it is specifically stated that A is directly above B (AB is adjacent and A is above B), it should be understood that A can be directly above B, or A can be indirectly above B (there are other elements between AB and A is above B). By analogy.
[0204] This specification uses specific words to describe the embodiments of the specification. As "one embodiment", "an embodiment", and / or "some embodiments" means a certain feature, structure or characteristic related to at least one embodiment of the specification. Therefore, it should be emphasized and noted that the "an embodiment" or "one embodiment" or "one alternative embodiment" mentioned in different places in this specification does not necessarily refer to the same embodiment. In addition, the skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples without contradiction.
[0205] Although one or more embodiments of the specification provide method steps as described in the embodiments or flowcharts, it can be understood that the order of steps listed in the embodiments or flowcharts is only one of the many execution orders, and does not represent the only execution order. Therefore, when the claims involve method steps, the changes and adjustments of the order of the steps or the parallelism between the steps are also within the scope of protection of the claims.
Claims
1. A method for processing configuration work orders, comprising: Based on the obtained configuration work order, the total number of modifiable fields contained in the configuration work order, the read / write ratio of the modifiable fields, the data volume of the configuration work order, and the configuration change frequency of the configuration work order are obtained. For each storage engine, a structure adaptation value is calculated based on the total number of fields, the number of adaptable fields supported by the storage engine, and the maximum number of fields. This value is used to characterize the degree of adaptation of the storage structure of the storage engine to the configuration work order. Based on the read / write ratio of the changeable field, the data volume of the configuration work order, and the ideal read / write ratio, adapted data volume, and maximum data volume supported by the storage engine, a performance adaptation value is calculated to characterize the degree of adaptation of the storage performance of the storage engine to the configuration work order. Based on the configuration change frequency of the configuration work order and the ideal change frequency supported by the storage engine, a change adaptation value is calculated to characterize the degree of adaptation of the storage overhead of the storage engine to the configuration work order. Based on the structure adaptation value, performance adaptation value, and change adaptation value of each storage engine, the storage performance score of each storage engine for the configuration work order is calculated. The target storage engine with the highest storage performance score is invoked, and the configuration work order is stored through the target storage engine.
2. The method according to claim 1, wherein the steps of processing the obtained configuration work order to obtain the total number of modifiable fields included in the configuration work order, the read / write ratio of the modifiable fields, the data volume of the configuration work order, and the configuration change frequency of the configuration work order, include: The configuration work order is parsed to obtain the modifiable fields contained in the configuration work order; wherein, the modifiable fields include read-only fields with read permissions on the user side and writable fields with write permissions on the user side; The total number of the modifiable fields is obtained by counting the number of the fields. The read / write ratio of the changeable field is calculated based on the historical read count of the read-only field and the historical write count of the writable field. The data volume of the configuration work order is calculated to obtain the data volume of the configuration work order; The configuration change frequency of the configuration work order is calculated based on the number of changes made to the configuration work order within a historical period.
3. The method according to claim 1 or 2, wherein the number of adapted fields is used to characterize the number of fields adapted when the storage performance of the storage engine reaches the set storage requirements; and the maximum number of fields is used to characterize the upper limit of the number of fields that the storage engine can support.
4. The method according to claim 1, wherein the step of calculating a performance adaptation value characterizing the degree of adaptation of the storage performance of the storage engine to the configuration work order based on the read / write ratio of the changeable field, the data volume of the configuration work order, and the ideal read / write ratio, adapted data volume, and maximum data volume supported by the storage engine, comprises: Based on the read / write ratio of the changeable field and the ideal read / write ratio supported by the storage engine, the read / write ratio adaptation value of the storage engine is calculated; wherein, the ideal read / write ratio is used to characterize the read / write ratio adapted when the read / write performance of the storage engine reaches the set read / write requirements, and the read / write ratio adaptation value is used to characterize the degree of adaptation of the read / write performance of the storage engine to the configuration work order. Based on the data volume of the configuration work order, the adaptable data volume and the maximum data volume supported by the storage engine, a data volume adaptation value is calculated; wherein, the adaptable data volume is used to characterize the amount of data storage that the storage engine adapts to when its storage performance meets the set storage requirements, the maximum data volume is used to characterize the upper limit of the data volume that the storage engine can support, and the data volume adaptation value is used to characterize the degree of adaptation of the storage engine's storage capacity to the configuration work order. The performance adaptation value of the storage engine is calculated based on the read / write ratio adaptation value and the data volume adaptation value.
5. The method according to claim 1, wherein the ideal change frequency is used to characterize the data change frequency adapted when the overhead of the storage engine storing changed data reaches a set overhead requirement.
6. The method according to claim 1, wherein the step of calculating the storage performance score of each storage engine for the configuration work order based on the respective structure adaptation value, performance adaptation value, and change adaptation value of each storage engine includes: The pre-configured weighting coefficients for each adaptation value are invoked to perform a weighted sum calculation on the structure adaptation value, performance adaptation value, and change adaptation value of each storage engine, thereby obtaining the storage performance score of each storage engine for the configuration work order.
7. The method of claim 6, further comprising, before invoking the weight coefficients pre-configured for each fit value: Based on the work order type of the configured work order, determine whether to adjust the weighting coefficient; If the weighting coefficients are adjusted, the weighting coefficients are updated to the adjusted weighting coefficients.
8. The method according to claim 7, wherein the weighting coefficients include a first weight for the structural adaptation value, a second weight for the performance adaptation value, and a third weight for the change adaptation value; the sum of the first weight, the second weight, and the third weight is 1; The step of determining whether to adjust the weighting coefficient based on the work order type of the configured work order includes: When the work order type of the configured work order is a credit product work order, the first weight is increased, and the second weight and / or the third weight is decreased; and / or When the work order type of the configured work order is a marketing product work order, the second weight is increased, and the first weight and / or the third weight is decreased.
9. The method according to any one of claims 6 to 8, after storing the configuration work order through the target storage engine, the method further includes: Obtain the operation time and success rate of the target storage engine after performing storage operations on the configuration work order; Based on the operation time and the operation success rate, determine whether to adjust the associated data affecting the storage performance score of the target storage engine so that the storage performance score calculated based on the adjusted associated data matches the operation time and the operation success rate; wherein, the associated data includes at least one of the following: the number of adaptation fields involved in the target storage engine, the ideal read / write ratio, the amount of adaptation data, the ideal change frequency, and the weight coefficient.
10. The method according to claim 1, prior to the step of processing and obtaining the total number of modifiable fields included in the configuration work order, the read / write ratio of the modifiable fields, the data volume of the configuration work order, and the configuration change frequency of the configuration work order based on the obtained configuration work order, the method further includes: In response to a configuration work order change request from the configuration end, the verification engine is invoked, and the configuration work order provided by the configuration end is parsed through the verification engine to extract the changeable fields contained in the configuration work order. The verification engine retrieves verification scripts that match each mutable field from a pre-configured rule base, and executes each verification script to verify whether the configuration content of the matching mutable field is qualified.
11. The method of claim 10, further comprising: If the configuration content of each modifiable field is qualified, send the configuration work order to the approval terminal associated with the configuration work order; The step of processing the obtained configuration work order to obtain the total number of modifiable fields, the read / write ratio of the modifiable fields, the data volume of the configuration work order, and the configuration change frequency of the configuration work order is executed upon receiving an approval message from the approval end.
12. The method according to claim 1, after storing the configuration work order, the method further includes: Generate a matching version snapshot based on the configuration work order, and store the version snapshot before the update and the version snapshot after the update.
13. A work order processing device, comprising: The work order processing module is configured to: based on the obtained configuration work order, process and obtain the total number of modifiable fields contained in the configuration work order, the read / write ratio of the modifiable fields, the data volume of the configuration work order, and the configuration change frequency of the configuration work order; The adaptation value calculation module is configured to: for each storage engine, calculate a structure adaptation value that characterizes the degree of adaptation of the storage structure of the storage engine to the configuration work order based on the total number of fields, the number of adaptation fields supported by the storage engine, and the maximum number of fields. Based on the read / write ratio of the changeable field, the data volume of the configuration work order, and the ideal read / write ratio, adapted data volume, and maximum data volume supported by the storage engine, a performance adaptation value is calculated to characterize the degree of adaptation of the storage performance of the storage engine to the configuration work order. Based on the configuration change frequency of the configuration work order and the ideal change frequency supported by the storage engine, a change adaptation value is calculated to characterize the degree of adaptation of the storage overhead of the storage engine to the configuration work order. The score calculation module is configured to calculate the storage performance score of each storage engine for the configuration work order based on the structure adaptation value, performance adaptation value and change adaptation value of each storage engine. The storage module is configured to: call the target storage engine with the highest storage performance score, and store the configuration work order through the target storage engine.
14. An electronic device, characterized in that, include: processor; A memory for storing processor-executable instructions; wherein the processor implements the steps of the method as described in any one of claims 1 to 12 by executing the executable instructions.
15. A computer-readable storage medium, characterized in that, It stores computer instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1 to 12.
16. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the steps of the method as described in any one of claims 1 to 12.
Citation Information
Patent Citations
Data storage method and device, electronic equipment and storage medium
CN117742567A