Data development method and device

Abstract

The invention discloses a data development method and device, and relates to the technical field of computers. The method is applied to equipment provided with a production environment and a development environment, and comprises the following steps: after a development operation in the development environment is monitored, generating to-be-published data based on the development operation; the to-be-published data is used for recording modification of target data and / or processing logic of the target data, and the modification meets a publishing condition; the conformity release condition is used for representing that the modification does not conflict with other processing logics; and in response to a publishing instruction, updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the to-be-published data.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data development method and device. Background Art

[0002] As technology continues to develop, data development technology also progresses. Currently, existing data development platforms all provide a one-stop development function that can support data development operations to modify and update target data.

[0003] At present, the existing data development process is generally for users to directly adjust and update a certain data processing logic. However, in actual applications, different development operations may lead to conflicts between the data processing logic modified or adjusted by different development operations due to the lack of unified management, which in turn leads to data development failure. Summary of the invention

[0004] The embodiment of the present application provides a data development method and device, the main purpose of which is to implement a data development method to solve the problem of data development failure caused by conflicts in data processing logic in the existing data development process.

[0005] In order to solve the above technical problems, the embodiments of the present application provide the following technical solutions:

[0006] In a first aspect, the present application provides a data development method, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other, and the method includes:

[0007] After monitoring the development operation in the development environment, generating data to be published based on the development operation; the data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the compliance with the publishing condition is used to indicate that the modification does not conflict with other processing logics;

[0008] In response to the publishing instruction, the target data in the production environment and / or the processing logic of the target data in the production environment are updated based on the data to be published.

[0009] Optionally, the target data includes first data and dependent data, wherein the dependent data is data having a dependent relationship with the first data;

[0010] After the development operation in the development environment is monitored and before the data to be published is generated based on the development operation, the method further includes:

[0011] In response to detecting the development request, determining whether the type of the development operation to be performed is data-dependent development; the data-dependent development is used to indicate that the development operation needs to be performed on the first data and the corresponding dependent data together;

[0012] If it is determined that the type of the development operation is the data-dependent development, the development operation is performed on the first data and the corresponding dependent data in the development environment.

[0013] Optionally, determining whether the type of the development operation to be performed is data-dependent development includes:

[0014] Determining whether the first data belongs to data corresponding to a target processing function, wherein the target processing function includes any one of data resource management, data development, data service, data governance, and task center;

[0015] If it is determined that the first data belongs to the data corresponding to the target processing function, then the type of the development operation to be performed is determined to be the data-dependent development.

[0016] Optionally, updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be published includes:

[0017] Determine the first data in the production environment, and determine the dependent data corresponding to the first data based on the dependency relationship;

[0018] Based on the data to be released, corresponding development operations are performed on the first data and the dependent data, and / or the processing logic of the first data and the dependent data.

[0019] Optionally, before generating the data to be published based on the development operation, the method further includes:

[0020] When the development operation performed by the development environment is completed, performing a logic check on the processing logic of the target data, and determining that the development operation meets the release condition after the processing logic of the target data passes the logic check;

[0021] and / or,

[0022] When it is determined that the development operation has been executed multiple times in the development environment, a conflict check is performed on the processing logic of multiple target data corresponding to the multiple development operations that have been executed, and when the processing logic of multiple target data passes the conflict check, it is determined that the multiple development operations meet the release conditions.

[0023] Optionally, in response to the publishing instruction, updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be published includes:

[0024] Determine the data to be published based on the publishing instruction, and when there are multiple data to be published, determine the publishing order among the multiple data to be published; wherein the publishing order is determined based on the execution order between the processing logics of the target data corresponding to the data to be published and / or the calling order between the target data;

[0025] Based on the release sequence among the plurality of release data, the target data is updated in the production environment in sequence.

[0026] Optionally, after determining whether the type of the development operation to be performed is data-dependent development, the method further includes:

[0027] If it is determined that the type of the development operation is not the data-dependent development, the development operation is performed on the target data in the production environment.

[0028] In a second aspect, the present application further provides a data development device, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other, and the device includes:

[0029] A generating unit, configured to generate data to be published based on the development operation after monitoring the development operation in the development environment; the data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the compliance with the publishing condition is used to indicate that the modification does not conflict with other processing logics;

[0030] The execution unit is used to update the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be released in response to the release instruction.

[0031] Optionally, the target data includes first data and dependent data, wherein the dependent data is data having a dependent relationship with the first data;

[0032] The device also includes:

[0033] a determination unit, configured to determine, in response to detecting a development request, whether the type of development operation to be performed is data-dependent development; the data-dependent development is used to indicate that the development operation needs to be performed on the first data and the corresponding dependent data together;

[0034] A control unit is configured to, if it is determined that the type of the development operation is the data-dependent development, execute the development operation on the first data and the corresponding dependent data in the development environment.

[0035] Optionally, the determining unit includes:

[0036] A first determination module, configured to determine whether the first data belongs to data corresponding to a target processing function, wherein the target processing function includes any one of data resource management, data development, data service, data governance, and task center;

[0037] The second determination module is used to determine that the type of the development operation to be executed is the data-dependent development if it is determined that the first data belongs to the data corresponding to the target processing function.

[0038] Optionally, the execution unit includes:

[0039] A dependent data determination module, configured to determine the first data in the production environment, and determine the dependent data corresponding to the first data based on the dependency relationship;

[0040] The development operation execution module is used to execute corresponding development operations on the first data and the dependent data based on the data to be released, and / or the processing logic of the first data and the dependent data.

[0041] Optionally, the device further comprises:

[0042] a logic verification unit, configured to perform a logic verification on the processing logic of the target data when the development operation performed by the development environment is completed, and determine that the development operation meets the release condition after the processing logic of the target data passes the logic verification;

[0043] A conflict checking unit is used to perform conflict checking on the processing logic of multiple target data corresponding to the multiple development operations that have been executed when it is determined that the development operation has been executed multiple times in the development environment, and to determine that the multiple development operations meet the release conditions when the processing logic of the multiple target data passes the conflict checking.

[0044] Optionally, the execution unit includes:

[0045] A publishing order determination module, used to determine the data to be published based on the publishing instruction, and when there are multiple data to be published, determine the publishing order among the multiple data to be published; wherein the publishing order is determined based on the execution order between the processing logics of the target data corresponding to the data to be published and / or the calling order between the target data;

[0046] The update module is used to update the target data in the production environment in sequence based on the release order of the plurality of release data.

[0047] Optionally, the device further comprises:

[0048] The operation execution unit is configured to execute the development operation on the target data in the production environment if it is determined that the type of the development operation is not the data-dependent development.

[0049] In a third aspect, an embodiment of the present application provides a storage medium, which includes a stored program, wherein when the program is running, the device where the storage medium is located is controlled to execute the data development method of the terminal device described in the first aspect.

[0050] In a fourth aspect, an embodiment of the present application provides a data development device, which includes a storage medium; and one or more processors, wherein the storage medium is coupled to the processor, and the processor is configured to execute program instructions stored in the storage medium; when the program instructions are executed, the data development method of the terminal device described in the first aspect is executed.

[0051] By means of the above technical solution, the technical solution provided by this application has at least the following advantages:

[0052] The present application provides a data development method and device, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment that are isolated from each other. The present application can first generate data to be published based on the development operation after monitoring the development operation in the development environment; the data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the compliance with the publishing condition is used to characterize that the modification does not conflict with other processing logics; then, in response to the publishing instruction, the target data in the production environment and / or the processing logic of the target data in the production environment are updated based on the data to be published, thereby realizing the data development function. Compared with the prior art, since the present application can ensure that after the development operation is executed in the development environment, the development operation that meets the publishing condition can be recorded as the corresponding data to be published, and after the publishing instruction issued by the user, the data to be published is updated to the target data in the production environment, so that the unified management of the development operation is played in the data development process, so that when the update is performed in the production environment, the development failure caused by the conflict between multiple different development operations can be avoided. At the same time, since the production environment and the development environment are isolated from each other during the data development process of the present application, that is, before the release instruction is issued, all development operations performed in the development environment, no matter which target data or the processing logic of the target data is developed, will not affect the target data and the processing logic of the target data in the production environment. This ensures that the functions corresponding to the processing logic in the development environment will not be changed due to the development operations, thereby ensuring that the development process will not affect the use of the target data and the processing logic of the target data in the production environment, thereby achieving flexible control of the data development process.

[0053] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] By reading the detailed description below with reference to the accompanying drawings, the above and other purposes, features and advantages of the exemplary embodiments of the present application will become easy to understand. In the accompanying drawings, several embodiments of the present application are shown in an exemplary and non-limiting manner, and the same or corresponding reference numerals represent the same or corresponding parts, wherein:

[0055] Figure 1 A flow chart of a data development method provided by an embodiment of the present application is shown;

[0056] Figure 2Another data development method flow chart provided by an embodiment of the present application is shown;

[0057] Figure 3 A block diagram showing a data development device provided in an embodiment of the present application is shown;

[0058] Figure 4 A block diagram showing the composition of another data development device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0059] The exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0060] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application should have the common meanings understood by technicians in the field to which this application belongs.

[0061] The present application embodiment provides a data development method, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other. Figure 1 As shown, wherein the method comprises:

[0062] 101. After monitoring the development operations in the development environment, generate data to be published based on the development operations.

[0063] The data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing conditions; the compliance with the publishing conditions is used to indicate that the modification does not conflict with other processing logics.

[0064] In the embodiment of the present application, two separate environments isolated from each other are set in the data development platform, one of which is a production environment and the other is a development environment. That is to say, applications or programs corresponding to the same data processing function are set in the two environments, and each application or program is actually composed of the processing logic of multiple data. In the process of data development, it is essentially to adjust the processing logic of a certain data in the application or program, or to adjust the data involved or called when the processing logic is running, that is, the processing logic and target data of the target data described in this embodiment. Therefore, in these two environments, since the application or program set is the same, the data and the processing logic of the data contained in the two are also the same. Then, in the process of development operation, the data or the processing logic of the data in the development environment are first developed according to the method described in this step, and the data and the processing logic of the data in the production environment are not involved in the development of the data and the processing logic of the data in the production environment. Therefore, in the process of developing the application or program in the development environment, the application or program in the production environment can actually be used as usual, so the method described in this embodiment will not be affected when the user needs to adjust the data or the processing logic of the data in advance.

[0065] Based on this, in this step, it is necessary to monitor in real time whether there is a development operation in the development environment. When it is determined that there is a development operation, it is necessary to record the development operation and verify on this basis that the development operation can be synchronized to the production environment. During verification, it can be specifically confirmed based on the release conditions. The release conditions can be understood as a method that can determine whether there will be conflicts between the processing logics of multiple data after this development operation, that is, whether the execution process of the development operation described in this step will cause the modified processing logic to conflict with other processing logics. If there is no conflict, it means that the development operation can be synchronized and updated to the production environment later. At this time, the corresponding data to be released can be recorded based on the development operation, that is, the process of processing the target data or the processing logic of the target data that meets the release conditions can be recorded.

[0066] 102. In response to the publishing instruction, update target data in the production environment and / or processing logic of the target data in the production environment based on the data to be published.

[0067] When at least one data to be published is generated, it can actually be understood that there is a development operation that needs to be synchronized and updated to the production environment. In this step, if a publishing instruction is detected, the instruction can be responded to so as to update a certain data or a certain data processing logic in the production environment through the data to be published, that is, to perform the same development operation on the target data or the processing logic of the target data in the production environment that has a mirror relationship with the development environment, thereby achieving the effect of data development.

[0068] The present application provides a data development method, which is applied to a data development platform, and the data development platform includes a production environment and a development environment that are isolated from each other. The present application can first generate data to be published based on the development operation after monitoring the development operation in the development environment; the data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the compliance with the publishing condition is used to characterize that the modification does not conflict with other processing logics; then in response to the publishing instruction, the target data in the production environment and / or the processing logic of the target data in the production environment are updated based on the data to be published, thereby realizing the data development function. Compared with the prior art, since the present application can ensure that after the development operation is performed in the development environment, the development operation that meets the publishing condition can be recorded as the corresponding data to be published, and after the publishing instruction issued by the user, the data to be published is updated to the target data in the production environment, so that the unified management of the development operation is played in the data development process, so that when the update is performed in the production environment, the development failure caused by the conflict between multiple different development operations can be avoided. At the same time, since the production environment and the development environment are isolated from each other during the data development process of the present application, that is, before the release instruction is issued, all development operations performed in the development environment, no matter which target data or the processing logic of the target data is developed, will not affect the target data and the processing logic of the target data in the production environment. This ensures that the functions corresponding to the processing logic in the development environment will not be changed due to the development operations, thereby ensuring that the development process will not affect the use of the target data and the processing logic of the target data in the production environment, thereby achieving flexible control of the data development process.

[0069] To explain in more detail below, the present application embodiment provides another data development method, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other, as shown in FIG. Figure 2 As shown, the method includes:

[0070] 201. In response to detecting a development request, determine whether the type of development operation to be performed is data-dependent development.

[0071] The target data includes first data and dependent data, wherein the dependent data is data having a dependent relationship with the first data; the dependent data development is used to represent that a development operation needs to be performed on the first data and the corresponding dependent data together.

[0072] Because in the process of users performing development operations, some development operations need to be performed in the development environment and synchronized to the production environment on this basis, while some development operations can actually be performed directly in the production environment. In fact, when the user's development request is detected, it can be determined through the request whether the development operation to be performed belongs to data-dependent development. That is to say, after detecting the development request, it can be responded to and start to determine the type of development operation to be performed, that is, whether the target data to be modified are two data with a dependent relationship, namely the first data and the dependent data.

[0073] Specifically, in this step, determining whether the type of the development operation to be performed is data-dependent development includes:

[0074] Determine whether the first data belongs to the data corresponding to the target processing function, wherein the target processing function includes any one of data resource management, data development, data service, data governance and task center; if it is determined that the first data belongs to the data corresponding to the target processing function, determine that the type of development operation to be performed is the dependent data development.

[0075] Since in the process of data development, once some functions in the application or program are modified, the processing logic of other subsequent functions will be affected. For example, function A is used to obtain data from data source 1 and data source 2, and function B is used to compare the obtained data of data source 1 with the data in data source 2 and filter out the larger data. Then once function A is modified to obtain data from data source 1, data source 2 and data source 3. Then the data processing logic of function B will change, from the original comparison and screening of data source 1 and data source 2 to the comparison and screening of three data from data source 1, data source 2 and data source 3. It can be seen from this example that once some functions are modified based on development operations, the data processing logic of some subsequent functions will also change. Therefore, in this embodiment, for whether the type of development operation belongs to the specific process of dependent data development, it can be determined from the function to which the first data in the target data belongs, that is, whether the first data is data of any target processing function including data resource management, data development, data service, data governance and task center, so that when it is determined that the first data belongs to the target processing function, it means that the type of development operation corresponding to the first data belongs to dependent data development.

[0076] In actual applications, the target processing function can actually be a variety of different functions that will affect the data processing logic, such as the ones shown above. At the same time, it may also be a modification of the specific details of these "big categories" of functions. Therefore, in this process, it can be further determined based on user needs, as shown in the following Table 1, taking data services and data development as an example:

[0077]

[0078] Table 1

[0079] It can be seen from the table that the above-mentioned data service and data development are first-level functions, that is, "major category" functions, while the second-level functions are "sub-category" functions under the "major category" functions. In other words, when the user performs a new operation of API interface synchronization, it can be determined based on the first-level function corresponding to the second-level function whether the function to which the first data corresponding to the current development operation belongs is the target processing function. Based on the table, it can be seen that the creation or modification of the API interface synchronization function belongs to the operation of the data service function, and in this case, the data service belongs to the target processing function, so it can be determined that the development operation belongs to the data development function that needs to be dependent.

[0080] Based on the judgment result of this step, steps 202 and 205 can be executed respectively; when it is determined that the development operation belongs to data-dependent development, step 202 is executed, otherwise it means that the development operation can be directly applied to the production environment, so step 205 can be executed at this time.

[0081] 202. If it is determined that the type of the development operation is data-dependent development, the development operation is performed on the first data and the corresponding dependent data in the development environment.

[0082] When it is determined that the type of development operation belongs to data-dependent development, it means that the first data that needs to be modified will affect the data processing logic of other related functions, that is, it is dependent data. Then it can be determined that the category of the development operation is data-dependent development, which means that it cannot be directly executed in the production environment based on the development operation, but development operations must be performed on the first data and the corresponding dependent data in the production environment.

[0083] 203. After the development operation in the development environment is monitored, data to be published is generated based on the development operation.

[0084] The data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing conditions; the compliance with the publishing conditions is used to indicate that the modification does not conflict with other processing logics.

[0085] During the application of the method described in this embodiment, the operation process actually performed by the user in the development environment may be to adjust certain target data, or to adjust the processing logic of the target data. Regardless of which of the above adjustment processes is used, there may be operational errors or incomplete operations after the user performs the development operation. In this case, if the data to be published is generated directly based on the development operation, the erroneous operation behavior or the incomplete operation behavior will be synchronized to the application or program in the production environment, thereby causing the application or program in the production environment to report an error.

[0086] Meanwhile, the data to be published actually records the data that meets the publishing conditions among the multiple data of the development operation. In order to avoid the aforementioned problem, before generating the data to be published based on the development operation, whether the development operation can generate the data to be published can also be confirmed in the following two ways, specifically including:

[0087] On the one hand, when the development operation performed by the development environment is completed, a logic check is performed on the processing logic of the target data, and after the processing logic of the target data passes the logic check, it is determined that the development operation meets the release condition;

[0088] On the other hand, when it is determined that the development operation has been executed multiple times in the development environment, a conflict check is performed on the processing logic of multiple target data corresponding to the multiple development operations that have been executed, and when the processing logic of multiple target data passes the conflict check, it is determined that the multiple development operations meet the release conditions.

[0089] As for the first aspect, when it is determined that the development operation is completed, the processing logic of the target data must be logically checked. This ensures that when the target data or the processing logic of the target data is modified, the modified logic can still meet the requirements of the logic check. Then, it can be ensured that after the development operation is executed, whether the target data is modified or the processing logic of the target data itself is modified, the operation function of the processing logic can be ensured to be normal after the modification. This avoids the problem of logical errors caused by certain erroneous operations during the development operation, and then ensures the accuracy of subsequent synchronization to the production environment based on user instructions, thereby improving the accuracy of data development as a whole.

[0090] Regarding the latter aspect, when it is determined that the user has performed multiple development operations, it means that the user has adjusted multiple target data or the processing logic of multiple target data. Since the user actually adjusted different processing logics in this process, it is necessary to determine whether these adjusted processing logics conflict with each other. If it is determined that there is a conflict between these processing logics, it means that one or some of these development operations have problems. At this time, these development operations cannot be directly recorded as corresponding data to be released. This avoids the situation where the behaviors of these development operations are synchronized in the production environment when there are problems in multiple development operations, and improves the accuracy of data development as a whole.

[0091] 204. In response to the publishing instruction, update the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be published.

[0092] Specifically, this step may be performed as follows:

[0093] First, the first data is determined in the production environment, and the dependent data corresponding to the first data is determined based on the dependency relationship;

[0094] Then, based on the data to be released, corresponding development operations are performed on the first data and the dependent data, and / or the processing logic of the first data and the dependent data.

[0095] In this step, since the corresponding target data and / or the processing logic of the target data in the production environment are updated, in fact, a certain data or a certain logic is adjusted, and the dependent data of the data or the logic must also be adjusted accordingly. Therefore, when this step is executed, it is necessary to determine the first data in the production environment, and then find the dependent data corresponding to the first data according to the dependency relationship. Of course, in this embodiment, the first data can be specific data content, or it can be the content in the processing logic of a certain data. Similarly, for the dependent data, it can also be a certain data content, or it can be the content in the processing logic of a certain data. Here, whether the data content or the content in the processing logic of the data is included between the two is not limited here, and can be determined based on actual conditions.

[0096] For example, in actual applications, the process of data development mainly revolves around two dimensions, one is the adjustment of data fields, and the other is the adjustment of data processing, that is, processing logic. Therefore, based on these two dimensions, in this embodiment, development operations can be performed from two angles: based on logic and fields. That is to say, when the first data is a field, the dependent data can be a field or logic; similarly, when the first data is logic, the dependent data can be logic or field. Furthermore, since the user may have performed multiple different development operations in the development environment during the development operation, in order to facilitate the effective transmission of the data to be published generated by multiple development operations, these data to be published can also be saved and transmitted in the form of a publishing queue.

[0097] In this embodiment, the publishing queue can be understood as a queue dedicated to storing and transmitting the data to be published in the production environment. Based on the above description, it can be seen that data development mainly revolves around the two perspectives of fields and logic. In this process, as long as the data to be published is generated, it can be sent to the queue first. This ensures that after the development environment monitors and generates the data to be published, these data to be published can be sent to the publishing center in the form of a queue, thereby facilitating the orderly transmission of the data to be published.

[0098] Furthermore, since there is a certain execution order between multiple processing logics in an application or program, in the process of executing development operations corresponding to the data to be released in the production environment, these development operations also need to be executed in a certain order. Therefore, in the step of updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be released in response to the release instruction, it may include:

[0099] First, the data to be published is determined based on the publishing instruction, and when there are multiple data to be published, the publishing order among the multiple data to be published is determined; wherein the publishing order is determined based on the execution order between the processing logics of the target data corresponding to the data to be published and / or the calling order between the target data;

[0100] Then, based on the release sequence among the plurality of release data, the target data is updated in the production environment in sequence.

[0101] Combined with the description of the previous content of this step, it can be known that when the user has performed multiple development operations in the development environment and corresponding data to be published are generated, then after these data to be published are transferred to the publishing queue, when the publishing center detects these data to be published, that is, when the publishing queue detects multiple data to be published, the publishing order between these data to be published can be determined. The published data is determined according to the execution order between the processing logics corresponding to these data to be published, or the calling order between the data. That is to say, when the calling order of data A is earlier than the calling order of data B, the publishing order of the corresponding data to be published between the two is that the data a to be published corresponding to data A is before the data b to be published corresponding to data B.

[0102] In this way, on the basis of determining the release order between the data to be released, the release operation is performed on multiple target data in the subsequent release order. Since the release order is determined based on the execution order of the processing logic or the calling order of the data, this ensures that multiple data processing logics in the production environment can also be updated in the order of execution, avoiding logical errors caused by inconsistencies between the execution order or the calling order and the release order during the update in certain cases, thereby ensuring the accuracy of data development.

[0103] 205. If it is determined that the type of development operation is not data-dependent development, the development operation is performed on the target data in the production environment.

[0104] Based on the above step description, it can be seen that since some development operations will not affect the data processing logic, nor will the development operations affect the operation of other processing logic, such development operations do not actually need to be performed in the development environment, but can be performed directly in the production environment. For example, if the descriptive information of the data in a certain field is modified, then the development operation will not actually affect the data processing logic or other processing logic. When the user issues a request corresponding to the development operation, it can be determined that the type of the development operation belongs to non-data-dependent development, and the descriptive information can be modified directly in the production environment. This saves the process of executing the development operation in the development environment and synchronizing it to the production environment, thereby simplifying the execution process of the development operation.

[0105] Furthermore, as a response to the above Figure 1 and Figure 2 In order to realize the method shown in the figure, another embodiment of the present application also provides a data development device. The data development device embodiment corresponds to the aforementioned method embodiment. For ease of reading, the data development device embodiment will not repeat the details of the aforementioned method embodiment one by one, but it should be clear that the device in this embodiment can correspond to all the contents of the aforementioned method embodiment. Figure 3As shown, the data development device can be used in a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other, and the device includes:

[0106] The generating unit 31 may be used to generate data to be published based on the development operation after monitoring the development operation in the development environment; the data to be published may be used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the publishing condition may be used to verify that the modification does not conflict with other processing logics;

[0107] The execution unit 32 may be configured to update the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be released in response to the release instruction.

[0108] Further, such as Figure 4 As shown, the target data includes first data and dependent data, wherein the dependent data is data having a dependent relationship with the first data;

[0109] The device also includes:

[0110] The determining unit 33 may be configured to determine, in response to detecting a development request, whether the type of development operation to be performed is data-dependent development; the data-dependent development may be used to indicate that the development operation needs to be performed on the first data and the corresponding dependent data together;

[0111] The control unit 34 may be configured to, if it is determined that the type of the development operation is the data-dependent development, execute the development operation on the first data and the corresponding dependent data in the development environment.

[0112] Further, such as Figure 4 As shown, the determining unit 33 includes:

[0113] A first determination module 331 may be used to determine whether the first data belongs to data corresponding to a target processing function, wherein the target processing function includes any one of data resource management, data development, data service, data governance, and task center;

[0114] The second determination module 332 may be configured to determine that the type of the development operation to be performed is the data-dependent development if it is determined that the first data belongs to the data corresponding to the target processing function.

[0115] Further, such as Figure 4 As shown, the execution unit 32 includes:

[0116] The dependency data determination module 321 may be used to determine the first data in the production environment, and determine the dependency data corresponding to the first data based on the dependency relationship;

[0117] The development operation execution module 322 may be configured to execute corresponding development operations on the first data and the dependent data based on the data to be published, and / or the processing logic of the first data and the dependent data.

[0118] Further, such as Figure 4 As shown, the device also includes:

[0119] The logic verification unit 35 may be used to perform a logic verification on the processing logic of the target data when the development operation performed by the development environment is completed, and determine that the development operation meets the release condition after the processing logic of the target data passes the logic verification;

[0120] The conflict check unit 36 ​​can be used to perform conflict check on the processing logic of multiple target data corresponding to the multiple development operations that have been executed when it is determined that the development operation has been executed multiple times in the development environment, and when the processing logic of multiple target data passes the conflict check, it is determined that the multiple development operations meet the release conditions.

[0121] Further, such as Figure 4 As shown, the execution unit 32 includes:

[0122] The publishing order determination module 323 may be used to determine the data to be published based on the publishing instruction, and when there are multiple data to be published, determine the publishing order among the multiple data to be published; wherein the publishing order is determined based on the execution order between the processing logics of the target data corresponding to the data to be published and / or the calling order between the target data;

[0123] The updating module 324 may be used to update the target data in the production environment in sequence based on the release sequence of the plurality of release data.

[0124] Further, such as Figure 4 As shown, the device also includes:

[0125] The operation execution unit 37 may be configured to execute the development operation on the target data in the production environment if it is determined that the type of the development operation is not the data-dependent development.

[0126] The embodiment of the present application provides a data development method and device, which is applied to a data development platform, and the data development platform includes a production environment and a development environment that are isolated from each other. In the embodiment of the present application, after the development operation in the development environment is monitored, the data to be released is generated based on the development operation; the data to be released is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the release condition; the compliance with the release condition is used to characterize that the modification does not conflict with other processing logics; then in response to the release instruction, the target data in the production environment and / or the processing logic of the target data in the production environment are updated based on the data to be released, thereby realizing the data development function. Compared with the prior art, since the present application can ensure that after the development operation is performed in the development environment, the development operation that meets the release condition can be recorded as the corresponding data to be released, and after the release instruction issued by the user, the data to be released is updated to the target data in the production environment, so that the unified management of the development operation is played in the data development process, so that when the update is performed in the production environment, the development failure caused by the conflict between multiple different development operations can be avoided. At the same time, since the production environment and the development environment are isolated from each other during the data development process of the present application, that is, before the release instruction is issued, all development operations performed in the development environment, no matter which target data or the processing logic of the target data is developed, will not affect the target data and the processing logic of the target data in the production environment. This ensures that the functions corresponding to the processing logic in the development environment will not be changed due to the development operations, thereby ensuring that the development process will not affect the use of the target data and the processing logic of the target data in the production environment, thereby achieving flexible control of the data development process.

[0127] An embodiment of the present application provides a storage medium, which includes a stored program, wherein when the program is executed, a device where the storage medium is located is controlled to execute the above-mentioned data development method.

[0128] The storage medium may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM, and the memory includes at least one storage chip.

[0129] An embodiment of the present application also provides a data development device, which includes a storage medium; and one or more processors, wherein the storage medium is coupled to the processor, and the processor is configured to execute program instructions stored in the storage medium; when the program instructions are executed, the data development method described above is executed.

[0130] An embodiment of the present application provides a device, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other; the device includes a processor, a memory, and a program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the program: after monitoring the development operation in the development environment, generating data to be published based on the development operation; the data to be published is used to record modifications to target data and / or processing logic of target data, and the modifications meet publishing conditions; the compliance with publishing conditions is used to characterize that the modifications do not conflict with other processing logics; and in response to a publishing instruction, updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be published.

[0131] Furthermore, the target data includes first data and dependent data, wherein the dependent data is data having a dependent relationship with the first data;

[0132] After the development operation in the development environment is monitored and before the data to be published is generated based on the development operation, the method further includes:

[0133] In response to detecting the development request, determining whether the type of the development operation to be performed is data-dependent development; the data-dependent development is used to indicate that the development operation needs to be performed on the first data and the corresponding dependent data together;

[0134] If it is determined that the type of the development operation is the dependent data development, the development operation is performed on the first data and the corresponding dependent data in the development environment.

[0135] Further, the determining whether the type of the development operation to be performed is data-dependent development includes:

[0136] Determining whether the first data belongs to data corresponding to a target processing function, wherein the target processing function includes any one of data resource management, data development, data service, data governance, and task center;

[0137] If it is determined that the first data belongs to the data corresponding to the target processing function, then the type of the development operation to be performed is determined to be the data-dependent development.

[0138] Further, the updating of the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be released includes:

[0139] Determine the first data in the production environment, and determine the dependent data corresponding to the first data based on the dependency relationship;

[0140] Based on the data to be released, corresponding development operations are performed on the first data and the dependent data, and / or the processing logic of the first data and the dependent data.

[0141] Furthermore, before generating the data to be published based on the development operation, the method further includes:

[0142] When the development operation performed by the development environment is completed, performing a logic check on the processing logic of the target data, and determining that the development operation meets the release condition after the processing logic of the target data passes the logic check;

[0143] and / or,

[0144] When it is determined that the development operation has been executed multiple times in the development environment, a conflict check is performed on the processing logic of multiple target data corresponding to the multiple development operations that have been executed, and when the processing logic of multiple target data passes the conflict check, it is determined that the multiple development operations meet the release conditions.

[0145] Further, in response to the publishing instruction, updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be published includes:

[0146] Determine the data to be published based on the publishing instruction, and when there are multiple data to be published, determine the publishing order among the multiple data to be published; wherein the publishing order is determined based on the execution order between the processing logics of the target data corresponding to the data to be published and / or the calling order between the target data;

[0147] Based on the release sequence among the plurality of release data, the target data is updated in the production environment in sequence.

[0148] Furthermore, after determining whether the type of the development operation to be performed is data-dependent development, the method further includes:

[0149] If it is determined that the type of the development operation is not the data-dependent development, the development operation is performed on the target data in the production environment.

[0150] The present application also provides a computer program product, which is applied to a data development platform, wherein the data development platform includes a production environment and a development environment isolated from each other, and when executed on a data processing device, is suitable for executing a program code that initializes the following method steps: after monitoring the development operation in the development environment, generating data to be published based on the development operation; the data to be published is used to record modifications to target data and / or processing logic of target data, and the modifications meet publishing conditions; the compliance with publishing conditions is used to characterize that the modifications do not conflict with other processing logics; in response to a publishing instruction, updating the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be published.

[0151] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0152] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0153] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0154] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0155] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0156] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0157] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0158] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0159] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0160] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A data development method, characterized in that: Applied to a data development platform, the data development platform includes a production environment and a development environment isolated from each other, the method includes: After monitoring the development operation in the development environment, generating data to be published based on the development operation; the data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the compliance with the publishing condition is used to indicate that the modification does not conflict with other processing logics; In response to the publishing instruction, the target data in the production environment and / or the processing logic of the target data in the production environment are updated based on the data to be published.

2. The method according to claim 1, characterized in that: The target data includes first data and dependent data, wherein the dependent data is data having a dependent relationship with the first data; After the development operation in the development environment is monitored and before the data to be published is generated based on the development operation, the method further includes: In response to detecting the development request, determining whether the type of the development operation to be performed is data-dependent development; the data-dependent development is used to indicate that the development operation needs to be performed on the first data and the corresponding dependent data together; If it is determined that the type of the development operation is the data-dependent development, the development operation is performed on the first data and the corresponding dependent data in the development environment.

3. The method according to claim 2, characterized in that The determining whether the type of the development operation to be performed is data-dependent development includes: Determining whether the first data belongs to data corresponding to a target processing function, wherein the target processing function includes any one of data resource management, data development, data service, data governance, and task center; If it is determined that the first data belongs to the data corresponding to the target processing function, then the type of the development operation to be performed is determined to be the data-dependent development.

4. The method according to claim 3, characterized in that The updating of the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be released includes: Determine the first data in the production environment, and determine the dependent data corresponding to the first data based on the dependency relationship; Based on the data to be released, corresponding development operations are performed on the first data and the dependent data, and / or the processing logic of the first data and the dependent data.

5. The method according to claim 3, characterized in that: Before generating the data to be published based on the development operation, the method further includes: When the development operation performed by the development environment is completed, performing a logic check on the processing logic of the target data, and determining that the development operation meets the release condition after the processing logic of the target data passes the logic check; and / or, When it is determined that the development operation has been executed multiple times in the development environment, a conflict check is performed on the processing logic of multiple target data corresponding to the multiple development operations that have been executed, and when the processing logic of multiple target data passes the conflict check, it is determined that the multiple development operations meet the release conditions.

6. The method according to claim 5, characterized in that The updating of the target data in the production environment and / or the processing logic of the target data in the production environment based on the to-be-published data in response to the publishing instruction includes: Determine the data to be published based on the publishing instruction, and when there are multiple data to be published, determine the publishing order among the multiple data to be published; wherein the publishing order is determined based on the execution order between the processing logics of the target data corresponding to the data to be published and / or the calling order between the target data; Based on the release sequence among the plurality of release data, the target data is updated in the production environment in sequence.

7. The method according to claim 2, characterized in that: After determining whether the type of the development operation to be performed is data-dependent development, the method further includes: If it is determined that the type of the development operation is not the data-dependent development, the development operation is performed on the target data in the production environment.

8. A data development device, characterized in that: Applied to a data development platform, the data development platform includes a production environment and a development environment isolated from each other, the device includes: A generating unit, configured to generate data to be published based on the development operation after monitoring the development operation in the development environment; the data to be published is used to record the modification of the target data and / or the processing logic of the target data, and the modification meets the publishing condition; the compliance with the publishing condition is used to indicate that the modification does not conflict with other processing logics; The execution unit is used to update the target data in the production environment and / or the processing logic of the target data in the production environment based on the data to be released in response to the release instruction.

9. A storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is executed, the device where the storage medium is located is controlled to execute the data development method according to any one of claims 1 to 7.

10. A data development device, characterized in that: The device includes a storage medium; and one or more processors, the storage medium is coupled to the processor, and the processor is configured to execute program instructions stored in the storage medium; when the program instructions are executed, the data development method described in any one of claims 1 to 7 is executed.

Images