Distributed network cross-network data ferrying method, device and equipment and storage medium
By automatically matching and performing cross-network data ferry tasks in distributed networks, the problems of low efficiency and insufficient security in the prior art are solved, and efficient, automated and secure data transmission is achieved.
Patent Information
- Application Number
- CN202411962517.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-30
- Publication Date
- 2025-05-23
AI Technical Summary
In the prior art, data ferrying between distributed networks is inefficient and insufficient in security, resulting in time-consuming manual operations and data being easily leaked.
By obtaining the cross-network data ferry task of the distributed network, monitoring the development progress information of each network, automatically matching the network that meets the cross-network data ferry conditions, generating cross-network data ferry instructions and issuing them to the corresponding network, realizing automatic data export, encryption and compression, decryption and extraction and functional testing of data.
Improve the automation and efficiency of data ferry, ensure the security of data transmission, and avoid the time-consuming and risk of data leakage.
Smart Images

Figure CN120034353A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data ferrying, and in particular to a distributed network cross-network data ferrying method, device, equipment and storage medium. Background Art
[0002] In some scenarios, based on confidentiality principles and security requirements, each network in a distributed network will be physically isolated. For example, software collaborative development and continuous integration platform R&D and operation and maintenance systems are usually distributed and deployed in several isolated networks under a distributed network, and each network is responsible for the development of a functional subsystem. However, in actual applications, the several functional modules corresponding to each functional subsystem usually have dependencies with the functional modules under other functional subsystems (for example, the dependencies between multiple functional modules under the ticketing system and the user system), so that each functional subsystem needs to temporarily call other functional subsystems when performing functional testing, which leads to the need for data ferrying in distributed networks.
[0003] Existing data ferrying usually uses manual data copying, replication and transfer, which has problems such as low data ferrying efficiency (testing a certain functional module requires manual understanding of the data system and file location of each functional module under each functional subsystem, which takes a lot of time) and data security (when the data ferry carrier is intercepted, it is easy for unrelated personnel to crack it and cause data leakage).
[0004] Therefore, how to improve the efficiency and security of data transfer between several networks in a distributed network is a technical problem that needs to be solved urgently. Summary of the invention
[0005] The present invention provides a distributed network cross-network data ferrying method, device, equipment and storage medium, aiming to solve at least one of the above-mentioned technical problems.
[0006] To achieve the above object, the present invention provides a distributed network cross-network data ferrying method, comprising the following steps:
[0007] Acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes first identification information of a data export network, second identification information of a data import network, and a set of triggering conditions for the data export network and the data import network to perform cross-network data ferrying;
[0008] Monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying, and if so, generate a cross-network data ferrying instruction;
[0009] Generate a cross-network data ferry key according to the received development progress information of the data export network and the data import network, attach the cross-network data ferry key to the cross-network data ferry instruction, and send the cross-network data ferry instruction to the data export network and the data import network respectively;
[0010] After receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferrying instruction, and stores the encrypted compressed file to the mobile storage device; after receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the decryption of the encrypted compressed file and the extraction of the first development data;
[0011] A development function test report is generated according to the result of executing the development function test on the data import network according to the acquired first development data and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction.
[0012] Optionally, obtain the distributed network cross-network data ferrying task steps, including:
[0013] Disassemble several functional subsystems of the target development system, and assign each functional subsystem to a corresponding network in the distributed network to execute the development of the functional subsystem;
[0014] Based on the dependency relationship between several functional modules of each functional subsystem, a functional test requirement set including several functional test requirements is established; wherein each functional test requirement includes a test functional module and a dependent functional module;
[0015] According to the test function modules and dependent function modules of each functional test requirement in the functional test requirement set, the network corresponding to the functional subsystem to which the dependent function module belongs is defined as a data export network, and the network corresponding to the functional subsystem to which the test function module belongs is defined as a data import network. The actual development progress of the functional subsystem corresponding to the dependent function module and the test function module is matched with the requirement development progress corresponding to each functional test requirement as the trigger condition for the data export network and the data import network to perform cross-network data ferrying, and a cross-network data ferrying task is generated.
[0016] Optionally, monitoring the development progress information reported by the data export network and the data import network in each progress reporting cycle, determining whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying, and if so, generating a cross-network data ferrying instruction step, specifically including:
[0017] Receiving development progress information reported by the data export network and the data import network in each progress reporting cycle; wherein the development progress information includes functional modules of the functional subsystems corresponding to the data export network and the data import network;
[0018] Determine whether the functional modules of the functional subsystems corresponding to the data export network and the data import network meet any triggering condition for executing cross-network data ferrying in the cross-network data ferrying task. If so, generate a cross-network data ferrying instruction.
[0019] Optionally, according to the received development progress information of the data export network and the data import network, a cross-network data ferry key is generated, the cross-network data ferry key is attached to the cross-network data ferry instruction, and the cross-network data ferry instruction is sent to the data export network and the data import network respectively, specifically including:
[0020] Obtain the receiving time when the development progress information of the data export network and the data import network that meets any trigger condition is received, encode it according to the preset rules, and generate a cross-network data ferry key;
[0021] The cross-network data ferrying key is attached to the cross-network data ferrying instruction, and the cross-network data ferrying instruction is sent to the data export network and the data import network respectively.
[0022] Optionally, after receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferrying instruction, and stores the encrypted compressed file in the mobile storage device, specifically including:
[0023] After receiving the cross-network data ferrying instruction, the data export network executes an export action of the first development data corresponding to the development progress information of the cross-network data ferrying instruction;
[0024] The first development data export action includes: creating new files according to the path of library name\table name\file; calling the mc command to obtain the minio data of the current environment and save the data in the form of files; calling the Jenkins command to obtain the Jenkins data of the current environment and save it in the form of files; exporting all the saved files;
[0025] The cross-network data ferrying key is used to perform an encryption and compression operation on the exported first development data, generate an encrypted compressed file and store it in a mobile storage device.
[0026] Optionally, after receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the encrypted compressed file decryption and first development data extraction steps, specifically including:
[0027] After receiving the cross-network data ferrying instruction, the data import network extracts the encrypted compressed file in the mobile storage device if it detects the access of the mobile storage device;
[0028] The encrypted compressed file is decrypted and the first development data is extracted using the cross-network data ferrying key in the cross-network data ferrying instruction.
[0029] Optionally, the step of generating a development function test report according to the result of executing the development function test on the data import network according to the first development data acquired and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction specifically includes:
[0030] The data import network performs development function tests of the dependent function modules corresponding to the first development data and the test function modules corresponding to the second development data according to the acquired first development data and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction;
[0031] The data is received and imported into the network to execute the development function test result for each test function module, and a development function test report of the target development system is generated.
[0032] In addition, in order to achieve the above-mentioned purpose, the present invention also provides a distributed network cross-network data ferrying device, comprising:
[0033] An acquisition module, used to acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes first identification information of a data export network, second identification information of a data import network, and a set of triggering conditions for the data export network and the data import network to perform cross-network data ferrying;
[0034] A monitoring module is used to monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, and determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying. If so, generate a cross-network data ferrying instruction;
[0035] A sending module, used for generating a cross-network data ferrying key according to the received development progress information of the data export network and the data import network, attaching the cross-network data ferrying key to the cross-network data ferrying instruction, and sending the cross-network data ferrying instruction to the data export network and the data import network respectively;
[0036] The ferry module is used for the data export network to use the cross-network data ferry key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferry instruction after receiving the cross-network data ferry instruction, and store the encrypted compressed file to the mobile storage device; the data import network to use the cross-network data ferry key in the cross-network data ferry instruction to perform the decryption of the encrypted compressed file and the extraction of the first development data after receiving the cross-network data ferry instruction;
[0037] A generation module is used to generate a development function test report according to the result of executing the development function test based on the data imported into the network according to the first development data acquired and the second development data corresponding to the development progress information of the stored cross-network data ferrying instruction.
[0038] In addition, in order to achieve the above-mentioned purpose, the present invention also provides a distributed network cross-network data ferrying device, which includes: a memory, a processor, and a distributed network cross-network data ferrying program stored in the memory and executable on the processor. When the distributed network cross-network data ferrying program is executed by the processor, the steps of the distributed network cross-network data ferrying method as described above are implemented.
[0039] In addition, in order to achieve the above-mentioned purpose, the present invention also provides a storage medium, on which a distributed network cross-network data ferrying program is stored. When the distributed network cross-network data ferrying program is executed by the processor, the steps of the above-mentioned distributed network cross-network data ferrying method are implemented.
[0040] The beneficial effects of the present invention are as follows: a distributed network cross-network data ferrying method, device, equipment and storage medium are proposed. By acquiring the cross-network data ferrying task of the distributed network, the development progress information of each network for the functional subsystem is systematically monitored, and it is determined whether the current development progress information meets any triggering condition of the cross-network data ferrying task, and the data export network and the data import network that meet the triggering condition for executing the cross-network data ferrying are automatically matched, and a cross-network data ferrying instruction is generated to drive the data export network and the data import network to automatically execute the development data export, encryption compression and decryption extraction, function testing and other processes. At the same time, considering the dependency of the corresponding functional modules of the data export network and the data import network and the development progress receiving time, a data ferrying key that is only applicable to the data export network and the data import network is generated, which ensures the security of the data ferrying on the basis of improving the automation and efficiency of the data ferrying. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 A schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention;
[0042] Figure 2A schematic diagram of a flow chart of an embodiment of a distributed network cross-network data ferrying method according to the present invention;
[0043] Figure 3 The present invention is a block diagram of a distributed network cross-network data ferrying device in an embodiment of the present invention.
[0044] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0045] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0046] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0047] like Figure 1 As shown, Figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.
[0048] like Figure 1 As shown, the device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or it may be a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0049] Those skilled in the art will understand that Figure 1 The structure of the device shown in the figure does not constitute a limitation of the device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0050] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a distributed network cross-network data ferrying program.
[0051] exist Figure 1 In the terminal shown, the network interface 1004 is mainly used to connect to the backend server and communicate data with the backend server; the user interface 1003 is mainly used to connect to the client (user end) and communicate data with the client; and the processor 1001 can be used to call the distributed network cross-network data ferry program stored in the memory 1005 and perform the following operations:
[0052] Acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes first identification information of a data export network, second identification information of a data import network, and a set of triggering conditions for the data export network and the data import network to perform cross-network data ferrying;
[0053] Monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying, and if so, generate a cross-network data ferrying instruction;
[0054] Generate a cross-network data ferry key according to the received development progress information of the data export network and the data import network, attach the cross-network data ferry key to the cross-network data ferry instruction, and send the cross-network data ferry instruction to the data export network and the data import network respectively;
[0055] After receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferrying instruction, and stores the encrypted compressed file to the mobile storage device; after receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the decryption of the encrypted compressed file and the extraction of the first development data;
[0056] A development function test report is generated according to the result of executing the development function test on the data import network according to the acquired first development data and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction.
[0057] The specific embodiments of the present invention applied to the device are basically the same as the embodiments of the distributed network cross-network data ferrying method described below, and will not be described in detail here.
[0058] The embodiment of the present invention provides a distributed network cross-network data ferrying method, referring to Figure 2 , Figure 2 The figure is a flow chart of an embodiment of a distributed network cross-network data ferrying method according to the present invention.
[0059] In this embodiment, the distributed network cross-network data ferrying method includes the following steps:
[0060] S100: Acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes first identification information of a data export network, second identification information of a data import network, and a trigger condition set for the data export network and the data import network to perform cross-network data ferrying;
[0061] S200: monitoring the development progress information reported by the data export network and the data import network in each progress reporting cycle, determining whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying, and if so, generating a cross-network data ferrying instruction;
[0062] S300: Generate a cross-network data ferry key according to the received development progress information of the data export network and the data import network, attach the cross-network data ferry key to the cross-network data ferry instruction, and send the cross-network data ferry instruction to the data export network and the data import network respectively;
[0063] S400: After receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferrying instruction, and stores the encrypted compressed file to the mobile storage device; after receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the encrypted compressed file decryption and first development data extraction;
[0064] S500: Generate a development function test report according to the result of executing the development function test on the data import network according to the first development data acquired and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction.
[0065] It should be noted that the existing data ferry usually adopts manual data copying, duplication and transfer, which has problems such as low data ferry efficiency (testing a certain functional module requires manual understanding of the data system and file location of each functional module under each functional subsystem, which takes a lot of time) and data security (the carrier of data ferry is easily cracked by irrelevant personnel when intercepted, resulting in data leakage). In order to solve the above problems, this embodiment obtains the cross-network data ferry task of the distributed network, systematically monitors the development progress information of each network for the functional subsystem, determines whether the current development progress information meets any triggering condition of the cross-network data ferry task, automatically matches the data export network and the data import network that meet the triggering condition for executing the cross-network data ferry, generates a cross-network data ferry instruction to drive the data export network and the data import network to automatically execute the development data export, encryption compression and decryption extraction, function testing and other processes, and at the same time, considering the dependency of the corresponding functional modules of the data export network and the data import network and the development progress reception time, generates a data ferry key that is only applicable to the data export network and the data import network, and ensures the security of the data ferry on the basis of improving the automation and efficiency of the data ferry.
[0066] In a preferred embodiment, the steps of obtaining the cross-network data ferrying task of the distributed network specifically include:
[0067] S110: disassembling several functional subsystems of the target development system, and allocating each functional subsystem to a corresponding network in the distributed network to execute development of the functional subsystem;
[0068] S120: establishing a functional test requirement set including a plurality of functional test requirements based on the dependency relationship between a plurality of functional modules of each functional subsystem; wherein each functional test requirement includes a test functional module and a dependent functional module;
[0069] S130: According to the test function modules and dependent function modules of each functional test requirement in the functional test requirement set, the network corresponding to the functional subsystem to which the dependent function module belongs is defined as a data export network, and the network corresponding to the functional subsystem to which the test function module belongs is defined as a data import network, and the actual development progress of the functional subsystem corresponding to the dependent function module and the test function module is matched with the requirement development progress corresponding to each functional test requirement as a trigger condition for the data export network and the data import network to perform cross-network data ferrying, thereby generating a cross-network data ferrying task.
[0070] In this embodiment, by disassembling several functional subsystems of the target development system, and allocating corresponding networks under the distributed network to each functional subsystem, a functional test requirement set containing several functional test requirements is established according to the dependency relationship between several functional modules of each functional subsystem, and finally a cross-network data ferrying task is generated according to the test functional modules and dependent functional modules under each functional test requirement set. In this way, the data export network, data import network and the triggering conditions for the data export network and the data import network to perform cross-network data ferrying for each functional test requirement under the target development system are summarized, which is convenient for subsequent monitoring of the development progress information of each network, and then triggering the execution of the distributed network cross-network data ferrying process.
[0071] In a preferred embodiment, the development progress information reported by the data export network and the data import network in each progress reporting cycle is monitored, and it is determined whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying. If so, the step of generating a cross-network data ferrying instruction specifically includes:
[0072] S210: receiving development progress information reported by the data export network and the data import network in each progress reporting cycle; wherein the development progress information includes functional modules of the functional subsystems corresponding to the data export network and the data import network;
[0073] S220: Determine whether the function modules of the function subsystems corresponding to the data export network and the data import network meet any triggering condition for executing cross-network data ferrying in the cross-network data ferrying task, and if so, generate a cross-network data ferrying instruction.
[0074] In this embodiment, the development progress information of each network is monitored mainly by receiving the development progress information reported by the data export network and the data import network in each progress reporting cycle, and matching the development progress information with any trigger condition for executing cross-network data ferrying in the cross-network data ferrying task. When the match is successful, a cross-network data ferrying instruction is generated for the data export network and the data import network.
[0075] In a preferred embodiment, according to the received development progress information of the data export network and the data import network, a cross-network data ferry key is generated, the cross-network data ferry key is attached to the cross-network data ferry instruction, and the cross-network data ferry instruction is sent to the data export network and the data import network respectively, specifically including:
[0076] S310: Obtain the receiving time when the development progress information of the data export network and the data import network that meets any trigger condition is received, encode it according to a preset rule, and generate a cross-network data ferry key;
[0077] S320: Attach the inter-network data ferrying key to the inter-network data ferrying instruction, and send the inter-network data ferrying instruction to the data export network and the data import network respectively.
[0078] In this embodiment, the dependency of the functional modules corresponding to the data export network and the data import network and the time of receiving the development progress are taken into consideration, and a data ferry key applicable only to the data export network and the data import network is generated. The data ferry key can drive the first development data to be ferried to perform data decryption and extraction only at the data import network, which can better locate and track the source of data leakage, and ensure the security of data ferrying on the basis of improving the automation and efficiency of data ferrying.
[0079] In a preferred embodiment, after receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation corresponding to the development progress information of the cross-network data ferrying instruction, and stores the encrypted compressed file to the mobile storage device, which specifically includes:
[0080] S410: After receiving the cross-network data ferrying instruction, the data export network executes an export action of the first development data corresponding to the development progress information of the cross-network data ferrying instruction;
[0081] The first development data export action includes: creating new files according to the path of library name\table name\file; calling the mc command to obtain the minio data of the current environment and save the data in the form of files; calling the Jenkins command to obtain the Jenkins data of the current environment and save it in the form of files; exporting all the saved files;
[0082] S420: Using the cross-network data ferrying key, perform encryption and compression operations on the exported first development data, generate an encrypted compressed file, and store it in a mobile storage device.
[0083] On this basis, after receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the encrypted compressed file decryption and the first development data extraction step, specifically including:
[0084] S430: After receiving the cross-network data ferrying instruction, if the data import network detects the access of the mobile storage device, the encrypted compressed file in the mobile storage device is extracted;
[0085] S440: Decrypting the encrypted compressed file and extracting the first development data using the cross-network data ferrying key in the cross-network data ferrying instruction.
[0086] In this embodiment, by acquiring the cross-network data ferrying tasks of the distributed network, the development progress information of each network for the functional subsystem is systematically monitored, and it is determined whether the current development progress information meets any triggering condition of the cross-network data ferrying task, and the data export network and the data import network that meet the triggering conditions for executing the cross-network data ferrying are automatically matched, and a cross-network data ferrying instruction is generated to drive the data export network and the data import network to automatically execute the development data export, encryption compression and decryption extraction, functional testing and other processes, thereby improving the automation and efficiency of data ferrying.
[0087] In a preferred embodiment, the step of generating a development function test report according to the result of executing the development function test on the data import network according to the first development data acquired and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction specifically includes:
[0088] S510: The data import network performs development function tests of the dependent function modules corresponding to the first development data and the test function modules corresponding to the second development data according to the acquired first development data and the stored second development data of the development progress information corresponding to the cross-network data ferrying instruction;
[0089] S520: Receive the result of the development function test executed on each test function module by the data import network, and generate a development function test report of the target development system.
[0090] In this embodiment, the data import network performs corresponding development function test actions based on the acquired first development data and the stored second development data, and finally generates a development function test report for feedback, which can help the main control network to understand the latest development progress and status of the target development system in real time.
[0091] Reference Figure 3 , Figure 3 It is a structural block diagram of an embodiment of a distributed network cross-network data ferrying device of the present invention.
[0092] like Figure 3 As shown, the distributed network cross-network data ferrying device proposed in the embodiment of the present invention includes:
[0093] The acquisition module 10 is used to acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes the first identification information of the data export network, the second identification information of the data import network, and a trigger condition set for the data export network and the data import network to perform the cross-network data ferrying;
[0094] The monitoring module 20 is used to monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, and determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying. If so, generate a cross-network data ferrying instruction;
[0095] The sending module 30 is used to generate a cross-network data ferrying key according to the received development progress information of the data export network and the data import network, attach the cross-network data ferrying key to the cross-network data ferrying instruction, and send the cross-network data ferrying instruction to the data export network and the data import network respectively;
[0096] The ferry module 40 is used for the data export network to use the cross-network data ferry key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferry instruction after receiving the cross-network data ferry instruction, and store the encrypted compressed file in the mobile storage device; the data import network to use the cross-network data ferry key in the cross-network data ferry instruction to perform the decryption of the encrypted compressed file and the extraction of the first development data after receiving the cross-network data ferry instruction;
[0097] The generating module 50 is used to generate a development function test report according to the result of executing the development function test according to the first development data acquired and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction based on the data import network.
[0098] Other embodiments or specific implementations of the distributed network inter-network data ferrying device of the present invention can refer to the above-mentioned method embodiments and will not be described in detail here.
[0099] In addition, the present invention also proposes a distributed network cross-network data ferrying device, which includes: a memory, a processor, and a distributed network cross-network data ferrying program stored on the memory and runnable on the processor. When the distributed network cross-network data ferrying program is executed by the processor, the steps of the distributed network cross-network data ferrying method as described above are implemented.
[0100] The specific implementation of the distributed network inter-network data ferrying device of the present application is basically the same as the various embodiments of the above-mentioned distributed network inter-network data ferrying method, and will not be repeated here.
[0101] In addition, the present invention also proposes a readable storage medium, which includes a computer-readable storage medium on which a distributed network cross-network data ferrying program is stored. The readable storage medium may be Figure 1The memory 1005 in the terminal may also be at least one of a ROM (Read-Only Memory) / RAM (Random Access Memory), a magnetic disk, and an optical disk. The readable storage medium includes a number of instructions for enabling a distributed network inter-network data ferrying device having a processor to execute the distributed network inter-network data ferrying method described in each embodiment of the present invention.
[0102] The specific implementation methods in the readable storage medium of the present application are basically the same as the above-mentioned embodiments of the distributed network cross-network data ferrying method, and will not be repeated here.
[0103] It is understood that, in the description of this specification, the description with reference to the terms "one embodiment", "another embodiment", "other embodiments", or "first to Nth embodiments" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.
[0104] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0105] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0106] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0107] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A distributed network cross-network data ferrying method, characterized in that: The following steps are involved: Acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes first identification information of a data export network, second identification information of a data import network, and a set of triggering conditions for the data export network and the data import network to perform cross-network data ferrying; Monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying, and if so, generate a cross-network data ferrying instruction; Generate a cross-network data ferry key according to the received development progress information of the data export network and the data import network, attach the cross-network data ferry key to the cross-network data ferry instruction, and send the cross-network data ferry instruction to the data export network and the data import network respectively; After receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferrying instruction, and stores the encrypted compressed file to the mobile storage device; after receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the decryption of the encrypted compressed file and the extraction of the first development data; A development function test report is generated according to the result of executing the development function test on the data import network according to the acquired first development data and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction.
2. The distributed network inter-network data ferrying method according to claim 1, characterized in that: Obtain the steps for cross-network data ferrying tasks in a distributed network, including: Disassemble several functional subsystems of the target development system, and assign each functional subsystem to a corresponding network in the distributed network to execute the development of the functional subsystem; Based on the dependency relationship between several functional modules of each functional subsystem, a functional test requirement set including several functional test requirements is established; wherein each functional test requirement includes a test functional module and a dependent functional module; According to the test function modules and dependent function modules of each functional test requirement in the functional test requirement set, the network corresponding to the functional subsystem to which the dependent function module belongs is defined as a data export network, and the network corresponding to the functional subsystem to which the test function module belongs is defined as a data import network. The actual development progress of the functional subsystem corresponding to the dependent function module and the test function module is matched with the requirement development progress corresponding to each functional test requirement as the trigger condition for the data export network and the data import network to perform cross-network data ferrying, and a cross-network data ferrying task is generated.
3. The distributed network inter-network data ferrying method according to claim 2, characterized in that: Monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, and determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying. If so, generate the cross-network data ferrying instruction steps, specifically including: Receiving development progress information reported by the data export network and the data import network in each progress reporting cycle; wherein the development progress information includes functional modules of the functional subsystems corresponding to the data export network and the data import network; Determine whether the functional modules of the functional subsystems corresponding to the data export network and the data import network meet any triggering condition for executing cross-network data ferrying in the cross-network data ferrying task. If so, generate a cross-network data ferrying instruction.
4. The distributed network inter-network data ferrying method according to claim 1, characterized in that: According to the received development progress information of the data export network and the data import network, a cross-network data ferry key is generated, the cross-network data ferry key is attached to the cross-network data ferry instruction, and the cross-network data ferry instruction is respectively issued to the data export network and the data import network step, specifically including: Obtain the receiving time when the development progress information of the data export network and the data import network that meets any trigger condition is received, encode it according to the preset rules, and generate a cross-network data ferry key; The cross-network data ferrying key is attached to the cross-network data ferrying instruction, and the cross-network data ferrying instruction is sent to the data export network and the data import network respectively.
5. The distributed network inter-network data ferrying method according to claim 1, characterized in that: After receiving the cross-network data ferrying instruction, the data export network uses the cross-network data ferrying key to perform the first development data export and encryption compression operation corresponding to the development progress information of the cross-network data ferrying instruction, and stores the encrypted compressed file in the mobile storage device, which specifically includes: After receiving the cross-network data ferrying instruction, the data export network executes an export action of the first development data corresponding to the development progress information of the cross-network data ferrying instruction; The first development data export action includes: creating new files according to the path of library name\table name\file; calling the mc command to obtain the minio data of the current environment and save the data in the form of files; calling the Jenkins command to obtain the Jenkins data of the current environment and save it in the form of files; exporting all the saved files; The cross-network data ferrying key is used to perform an encryption and compression operation on the exported first development data, generate an encrypted compressed file and store it in a mobile storage device.
6. The distributed network inter-network data ferrying method according to claim 1, characterized in that: After receiving the cross-network data ferrying instruction, the data import network uses the cross-network data ferrying key in the cross-network data ferrying instruction to perform the encrypted compressed file decryption and the first development data extraction step, which specifically includes: After receiving the cross-network data ferrying instruction, the data import network extracts the encrypted compressed file in the mobile storage device if it detects the access of the mobile storage device; The encrypted compressed file is decrypted and the first development data is extracted using the cross-network data ferrying key in the cross-network data ferrying instruction.
7. The distributed network inter-network data ferrying method according to claim 2, characterized in that: The step of generating a development function test report according to the result of executing the development function test on the data import network according to the first development data acquired and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction specifically includes: The data import network performs development function tests of the dependent function modules corresponding to the first development data and the test function modules corresponding to the second development data according to the acquired first development data and the second development data of the development progress information corresponding to the stored cross-network data ferrying instruction; The data is received and imported into the network to execute the development function test result for each test function module, and a development function test report of the target development system is generated.
8. A distributed network inter-network data ferrying device, characterized in that: include: An acquisition module, used to acquire a cross-network data ferrying task of a distributed network; wherein the cross-network data ferrying task includes first identification information of a data export network, second identification information of a data import network, and a set of triggering conditions for the data export network and the data import network to perform cross-network data ferrying; A monitoring module is used to monitor the development progress information reported by the data export network and the data import network in each progress reporting cycle, and determine whether the data export network and the data import network meet any condition in the trigger condition set for executing cross-network data ferrying. If so, generate a cross-network data ferrying instruction; A sending module, used for generating a cross-network data ferrying key according to the received development progress information of the data export network and the data import network, attaching the cross-network data ferrying key to the cross-network data ferrying instruction, and sending the cross-network data ferrying instruction to the data export network and the data import network respectively; The ferry module is used for the data export network to use the cross-network data ferry key to perform the first development data export and encryption compression operation of the development progress information corresponding to the cross-network data ferry instruction after receiving the cross-network data ferry instruction, and store the encrypted compressed file to the mobile storage device; the data import network to use the cross-network data ferry key in the cross-network data ferry instruction to perform the decryption of the encrypted compressed file and the extraction of the first development data after receiving the cross-network data ferry instruction; A generation module is used to generate a development function test report according to the result of executing the development function test based on the data imported into the network according to the first development data acquired and the second development data corresponding to the development progress information of the stored cross-network data ferrying instruction.
9. A distributed network inter-network data ferrying device, characterized in that: The distributed network cross-network data ferrying device includes: a memory, a processor, and a distributed network cross-network data ferrying program stored in the memory and executable on the processor. When the distributed network cross-network data ferrying program is executed by the processor, the steps of the distributed network cross-network data ferrying method as described in any one of claims 1 to 7 are implemented.
10. A storage medium, characterized in that: The storage medium stores a distributed network inter-network data ferrying program, and when the distributed network inter-network data ferrying program is executed by the processor, the steps of the distributed network inter-network data ferrying method as described in any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Software testing method and device, electronic equipment and storage medium
CN114443492A
Data ferrying method, data ferrying device, data transmission system and related equipment
CN116545744A
Cross-network data transmission method and cross-network data transmission system
CN116828079A
Data dependent task triggering method and related device
CN118708317A
Cited By
Data ferrying method, device, system and equipment and storage medium
CN120358088A