Data storage method, device, equipment and storage medium

Abstract

The present invention discloses a data storage method, device, equipment and storage medium, and relates to the field of computer technology. The method includes: obtaining a number of target data of different field types; determining the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information; taking any of the target data as a value value to associate and store the value value and its corresponding key value. The present invention stores a number of target data of different field types in the form of key-value through customized data storage structure information, and realizes the transmission of customized key and value to the field specified by SDK. Therefore, the data collected by SDK is standardized, and users can directly select different business dimensions on the platform for multi-dimensional personalized analysis.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a data storage method, device, equipment and storage medium. Background Art

[0002] The SDK tracking method of traditional AB test experiments mainly records the traffic that hits the experiment in the AB experiment. For example, the specific information entering the experiment mainly includes: traffic ID (shunt_id), hit time (create_time), experiment ID (test_id), hit group (group_name), and other common fixed dimensions. The experiment report is an important data means to measure the effectiveness of AB experiments, so whether the experimental data is recovered comprehensively determines whether the experimental report is comprehensive. Based on the traditional ABSDK tracking method, the automated experiment report provided by the platform can produce experimental data performance of common fixed dimensions, but for uncommon, non-fixed or some new business dimensions, it cannot be produced through automated experiment reports, and needs to rely on data analysts for offline manual analysis. However, the dimensions that users of each business pay attention to are different. Therefore, manual analysis of the dimensional data that each user pays attention to requires more labor costs and time costs. Summary of the invention

[0003] Based on this, it is necessary to provide a data storage method, device, equipment and storage medium to solve at least one of the above technical problems.

[0004] The present invention provides a data storage method, comprising:

[0005] Get several target data of different field types;

[0006] Determine the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information;

[0007] Any of the target data is used as a value to associate the value with its corresponding key value and store it.

[0008] Optionally, according to a data storage method provided by the present invention, after associating and storing the value and its corresponding key value, the method further includes:

[0009] Associating the preset multiple business dimension field identifiers with each of the key values ​​one by one;

[0010] The business dimension field identifiers are displayed on the interface so that the user can select the corresponding key value in the preset search box to query data according to the business dimension field identifiers.

[0011] Optionally, according to a data storage method provided by the present invention, after taking any of the target data as a value to associate and store the value and its corresponding key value, the method further includes:

[0012] Receive a data query request from a user, wherein the data query request includes a key value to be queried;

[0013] Based on the key value to be queried, the value associated with the key value is queried.

[0014] Optionally, according to a data storage method provided by the present invention, after querying and obtaining the value associated with the key value based on the key value to be queried, the method further includes:

[0015] The value associated with the key value is analyzed, and the analysis result is pushed to the user for viewing.

[0016] Optionally, according to a data storage method provided by the present invention, the customized data storage structure information includes a preset key value and defines key-value format for storing data.

[0017] Optionally, according to a data storage method provided by the present invention, determining a key value corresponding to each target data according to a field type of each target data and customized data storage structure information includes:

[0018] Divide each target data according to the field type;

[0019] According to the data storage structure information, the key value corresponding to each divided target data is determined.

[0020] The present invention also provides a data storage device, comprising:

[0021] The acquisition module is used to obtain several target data of different field types;

[0022] A determination module, used to determine the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information;

[0023] The storage module is used to take any of the target data as a value to associate and store the value and its corresponding key value.

[0024] Optionally, according to a data storage device provided by the present invention, the data storage device further includes:

[0025] An association module, used to associate a plurality of preset business dimension field identifiers with each of the key values ​​one by one;

[0026] The display module is used to display the business dimension field identifiers on the interface so that the user can select the corresponding key value in the preset search box to query data according to the business dimension field identifiers.

[0027] The present invention also provides a computer device, comprising a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor, wherein the processor implements the above-mentioned data storage method when executing the computer-readable instructions.

[0028] The present invention also provides one or more readable storage media storing computer-readable instructions, and the computer-readable instructions implement the above data storage method when executed by a processor.

[0029] The present invention also provides a computer program product, comprising computer-readable instructions, which implement any of the above-mentioned data storage methods when executed by a processor.

[0030] The above-mentioned data storage method, device, equipment and storage medium, the method includes: obtaining a number of target data of different field types; determining the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information; taking any of the target data as a value value to associate and store the value value and its corresponding key value. The present invention stores a number of target data of different field types in the form of key-value through customized data storage structure information, and realizes the transmission of customized keys and values ​​to the fields specified by the SDK. Therefore, the data collected by the SDK is standardized, and users can directly select different business dimensions on the platform for multi-dimensional personalized analysis. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0032] Figure 1 It is one of the flowcharts of the data storage method in one embodiment of the present invention;

[0033] Figure 2 This is a second flow chart of a data storage method according to an embodiment of the present invention;

[0034] Figure 3 This is a third flow chart of a data storage method according to an embodiment of the present invention;

[0035] Figure 4 is a schematic diagram of a structure of a data storage device in one embodiment of the present invention;

[0036] Figure 5 is a schematic diagram of a computer device in one embodiment of the present invention. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] The terms used in one or more embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of the present invention. The singular forms of "a", "said" and "the" used in one or more embodiments of the present invention are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of the present invention refers to and includes any or all possible combinations of one or more associated listed items.

[0039] It should be understood that, although the terms first, second, etc. may be used to describe various information in one or more embodiments of the present invention, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present invention, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "when..." or "when...".

[0040] The SDK tracking method of traditional AB test experiments mainly records the traffic that hits the experiment in the AB experiment. For example, the specific information entering the experiment mainly includes: traffic ID (shunt_id), hit time (create_time), experiment ID (test_id), hit group (group_name), and other common fixed dimensions. The experiment report is an important data means to measure the effect of AB experiments, so whether the experimental data is fully recovered determines whether the experiment report is comprehensive. Based on the traditional ABSDK tracking method, the automated experiment report provided by the platform can produce experimental data performance of common fixed dimensions, but for uncommon, non-fixed or some new business dimensions, it cannot be produced through automated experiment reports, and it is necessary to rely on data analysts for offline manual analysis. However, the dimensions that users of each business pay attention to are different. For example, in the scheduling algorithm scenario, users pay attention to the impact of voice broadcasts of different lengths on indicators. At this time, "different time lengths" is a personalized dimension; for example, in the pricing scenario, users pay attention to the impact of different pricing types on indicators. At this time, "pricing type" is a personalized dimension. Therefore, manual analysis of the dimensional data that each user is concerned about requires a lot of labor and time costs.

[0041] In view of the above problems, the present invention provides the following embodiments. In one embodiment, specifically, Figure 1 As shown, Figure 1 This is one of the flow diagrams of a data storage method in an embodiment of the present invention. The embodiment of the present invention provides a data storage method, comprising the following steps:

[0042] Step S11, obtaining a number of target data of different field types;

[0043] It should be noted that, as a specific example, the traditional AB SDK tracking points include traffic ID (shunt_id), hit time (create_time), experiment ID (test_id), hit group (group_name), other common fixed dimensions (such as city ID, order vehicle ID, app version number, etc. in cargo transportation scenarios), and content (other non-standardized fields that users can pass according to their needs).

[0044] The code is as follows:

[0045] {

[0046] "shunt_id": 132, / / value of the shunt object

[0047] "create_time": "2020-05-26 11:21:33", / / The time point of the hit experiment

[0048] "test_id": 13, / / experiment id

[0049] "group_name": "Big disk 1", / / Group name

[0050] "group_id": 0, / / group id

[0051] "city_id": 999, / / Other common fixed-dimensional city IDs

[0052] "content": { / / Other non-standard fields, users can pass them according to their needs}

[0053] }

[0054] Although user-defined fields can be reported in the content part when SDK data is reported in the AB test experiment, these fields are non-standardized and unformatted, and the automated experiment report of the AB platform cannot process non-standardized data, and thus cannot parse the content in the content. In view of the above problem, this embodiment needs to standardize the non-standardized fields according to the customized storage structure of the non-standardized data.

[0055] It should be noted that the target data in this embodiment refers to the non-standardized, non-formatted fields reported by the user. The field types of the target data to be obtained are different depending on the business scenario dimensions that the user is concerned about.

[0056] Step S12, determining a key value corresponding to each target data according to the field type of each target data and the customized data storage structure information;

[0057] It should be noted that the customized data storage structure information includes a preset key value and a key-value format for storing data. In data storage, a key is usually a unique identifier.

[0058] Specifically, the key value corresponding to the target data of each field type is determined according to the data storage structure information. In another embodiment, the target data are divided according to the field type; for each field type, a key value is assigned to each field data according to the data storage structure information.

[0059] Step S13: taking any of the target data as a value, so as to associate and store the value and its corresponding key value.

[0060] Specifically, each target data is taken as a value, and each value and its corresponding key value are stored in association. Thus, data is stored in the form of value-key, that is, the data collected by the SDK is standardized, and subsequent users can directly select different business dimensions on the platform for personalized analysis.

[0061] The embodiment of the present invention, through the above scheme, includes: obtaining a number of target data of different field types; determining the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information; taking any of the target data as a value value to associate and store the value value and its corresponding key value. The embodiment of the present invention stores a number of target data of different field types in the form of key-value through customized data storage structure information, and realizes the transmission of customized keys and values ​​to the fields specified by the SDK. Therefore, the data collected by the SDK is standardized, and users can directly select different business dimensions on the platform for multi-dimensional personalized analysis.

[0062] like Figure 2 As shown, Figure 2 This is a second flow chart of a data storage method in one embodiment of the present invention; in one embodiment of the present invention, after the value value and its corresponding key value are stored in association, the method further includes:

[0063] Step S21, associating a plurality of preset business dimension field identifiers with each of the key values ​​one by one;

[0064] Step S22, displaying each of the business dimension field identifiers on an interface, so that the user can select a corresponding key value in a preset search box to perform data query based on the business dimension field identifier.

[0065] Specifically, associate the business dimension field identifier with the key value to ensure that each business dimension can access relevant data through the corresponding key value. Display these business dimension field identifiers on the user interface so that users can see and understand the available data dimensions. Users enter query conditions or directly select key values ​​in the preset search box based on the business dimension field identifier through the interface, and the platform retrieves the corresponding data based on the entered key value. For example, "d1, d2, d3, d4, d5" are used to represent business dimension field identifiers. Each user knows which d identifier is used for the business dimension based on the reported information, so that users can directly select different business dimensions on the AB platform for data query.

[0066] The embodiment of the present invention, through the above scheme, includes: associating multiple preset business dimension field identifiers with each of the key values ​​one by one; displaying each of the business dimension field identifiers on the interface, so that the user can select the corresponding key value in the preset search box to query data according to the business dimension field identifier. The interface display of each business dimension field identifier is realized, and the user can directly select different business dimensions on the platform to query data.

[0067] like Figure 3 As shown, Figure 3 This is a flow chart of a data storage method according to an embodiment of the present invention; in an embodiment of the present invention, after taking any of the target data as a value and associating and storing the value and its corresponding key value, it also includes:

[0068] Step S31, receiving a data query request from a user, wherein the data query request includes a key value to be queried;

[0069] Step S32: based on the key value to be queried, query and obtain the value associated with the key value.

[0070] In one embodiment, after querying and obtaining the value associated with the key value based on the key value to be queried, the method further includes:

[0071] Step S33, analyzing the value associated with the key value, and pushing the analysis result to the user for viewing.

[0072] Specifically, the user submits a data query request on the interface. The data query request includes the key value to be queried. These key values ​​are used to identify the data items that the user wants to retrieve. The system performs a query operation in the data storage system based on the received key value to query the value associated with the key value, that is, the data content requested by the user. Furthermore, after the query obtains the relevant data, the value associated with the key value can be aggregated and analyzed to extract valuable information. The analysis results obtained by the analysis are displayed to the user for viewing. The interface display of the field identifiers of each business dimension is realized, and users can directly select different business dimensions on the platform for data query.

[0073] The embodiment of the present invention, through the above scheme, includes: receiving a data query request from a user, wherein the data query request includes a key value to be queried; based on the key value to be queried, querying and obtaining a value associated with the key value. Analyzing the value associated with the key value, and pushing the analysis result to the user for viewing. After realizing the standardized storage of data in the form of key-value, the user can select different business dimensions on the platform for data query, and then perform statistical analysis on the data of the business dimension.

[0074] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0075] In one embodiment, a data storage device is provided, which corresponds one-to-one to the data storage method in the above embodiment. Figure 4 As shown, Figure 4 1 is a schematic diagram of a data storage device according to an embodiment of the present invention, wherein the data storage device comprises:

[0076] An acquisition module 41 is used to acquire a number of target data of different field types;

[0077] A determination module 42, configured to determine a key value corresponding to each target data according to a field type of each target data and user-defined data storage structure information;

[0078] The storage module 43 is used to take any of the target data as a value to associate and store the value and its corresponding key value.

[0079] Optionally, the data storage device further includes:

[0080] An association module, used to associate a plurality of preset business dimension field identifiers with each of the key values ​​one by one;

[0081] The display module is used to display the business dimension field identifiers on the interface so that the user can select the corresponding key value in the preset search box to query data according to the business dimension field identifiers.

[0082] Optionally, the data storage device further includes:

[0083] A receiving module, used to receive a data query request from a user, wherein the data query request includes a key value to be queried;

[0084] The query module is used to query and obtain the value associated with the key value based on the key value to be queried.

[0085] Optionally, the data storage device further includes:

[0086] The analysis module is used to analyze the value associated with the key value and push the analysis result to the user for viewing.

[0087] Optionally, the data storage device further includes:

[0088] The customized data storage structure information includes a preset key value and data stored in a key-value format.

[0089] The determining module 42 is further used for:

[0090] A division unit, used for dividing each target data according to the field type;

[0091] The determination unit is used to determine the key value corresponding to each divided target data according to the data storage structure information.

[0092] For the specific definition of the data storage device, please refer to the definition of the data storage method above, which will not be repeated here. Each module in the above data storage device can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0093] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 5 As shown, Figure 5 : is a schematic diagram of a computer device in one embodiment of the present invention. The computer device includes a processor, a memory, a network interface and a database connected by a device bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a readable storage medium and an internal memory. The readable storage medium stores an operating device, a computer-readable instruction and a database. The internal memory provides an environment for the operation of the operating device and the computer-readable instructions in the readable storage medium. The database of the computer device is used to store data involved in the data storage method. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer-readable instruction is executed by the processor, a data storage method is implemented. The readable storage medium provided in this embodiment includes a non-volatile readable storage medium and a volatile readable storage medium.

[0094] In one embodiment, a computer device is provided. The computer device may be a terminal device, and its internal structure diagram may be as follows: Figure 5 As shown. The computer device includes a processor, a memory, and a network interface connected through a device bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a readable storage medium. The readable storage medium stores computer-readable instructions. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer-readable instructions are executed by the processor, a data storage method is implemented. The method includes: obtaining a number of target data of different field types; determining the key value corresponding to each of the target data according to the field type of each of the target data and the customized data storage structure information; taking any of the target data as a value value to associate and store the value value and its corresponding key value. The readable storage medium provided in this embodiment includes a non-volatile readable storage medium and a volatile readable storage medium.

[0095] In one embodiment, a computer device is provided, including a memory, a processor, and a computer-readable instruction stored in the memory and executable on the processor, and the processor implements the steps of the above data storage method when executing the computer-readable instruction. The method includes: obtaining a plurality of target data of different field types; determining a key value corresponding to each target data according to the field type of each target data and the customized data storage structure information; taking any target data as a value value, so as to associate and store the value value and its corresponding key value.

[0096] In one embodiment, a readable storage medium is provided, the readable storage medium stores computer-readable instructions, and the computer-readable instructions are executed by the processor to implement the above-mentioned data storage method steps. A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through computer-readable instructions, and the computer-readable instructions can be stored in a non-volatile readable storage medium or a volatile readable storage medium. When the computer-readable instructions are executed, they may include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0097] In one embodiment, a computer program product is provided, which includes computer-readable instructions. The computer-readable instructions can be stored on a non-transitory computer-readable storage medium. When the computer-readable instructions are executed by a processor, the computer can execute the data storage methods provided by the above methods.

[0098] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0099] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0100] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A data storage method, characterized in that: include: Get several target data of different field types; Determine the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information; Any of the target data is used as a value to associate the value with its corresponding key value and store it.

2. The data storage method according to claim 1, characterized in that: After the value and its corresponding key value are stored in association, the following is further included: Associating the preset multiple business dimension field identifiers with each of the key values ​​one by one; The business dimension field identifiers are displayed on the interface so that the user can select the corresponding key value in the preset search box to query data according to the business dimension field identifiers.

3. The data storage method according to claim 1, characterized in that: After taking any of the target data as a value to associate and store the value and its corresponding key value, the method further includes: Receive a data query request from a user, wherein the data query request includes a key value to be queried; Based on the key value to be queried, the value associated with the key value is queried.

4. The data storage method according to claim 3, characterized in that: After querying and obtaining the value associated with the key value based on the key value to be queried, the method further includes: The value associated with the key value is analyzed, and the analysis result is pushed to the user for viewing.

5. The data storage method according to claim 1, characterized in that: The customized data storage structure information includes a preset key value and defines key-value format for storing data.

6. The data storage method according to claim 5, characterized in that: Determining the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information includes: Divide each target data according to the field type; According to the data storage structure information, the key value corresponding to each divided target data is determined.

7. A data storage device, characterized in that: include: The acquisition module is used to obtain several target data of different field types; A determination module, used to determine the key value corresponding to each target data according to the field type of each target data and the customized data storage structure information; The storage module is used to take any of the target data as a value to associate and store the value and its corresponding key value.

8. The data storage device according to claim 7, characterized in that: The data storage device further comprises: An association module, used to associate a plurality of preset business dimension field identifiers with each of the key values ​​one by one; The display module is used to display the business dimension field identifiers on the interface so that the user can select the corresponding key value in the preset search box to query data according to the business dimension field identifiers.

9. A computer device comprising a memory, a processor, and computer-readable instructions stored in the memory and executed on the processor, characterized in that: When the processor executes the computer-readable instructions, the data storage method according to any one of claims 1 to 6 is implemented.

10. A readable storage medium having computer readable instructions stored thereon, characterized in that: When the computer-readable instructions are executed by a processor, the data storage method according to any one of claims 1 to 6 is implemented.

Images