Data processing method, device, equipment and medium
By performing preset conditional checksum nested storage of data sources in the integrated platform, the complexity of data management and storage is solved, and the reliable persistence of data sources and the diversity of business processing is achieved.
Patent Information
- Application Number
- CN202210726489.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-24
- Publication Date
- 2025-08-26
- Estimated Expiration
- 2042-06-24
AI Technical Summary
How to effectively manage and store data in an integrated platform, especially complex nested data structures, ensure the reliability and diversity of data sources to support subsequent business processing.
By obtaining the data source to be stored in the integrated platform, performing preset conditions verification and persisting storage, and storing data sources in nested data structures, supporting the storage of complex data structures.
It realizes reliable and persistent storage of data sources, improves the diversity and efficiency of business processing, and ensures the reliability and integrity of data sources.
Smart Images

Figure CN115098735B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a data processing method, apparatus, device and medium. Background Art
[0002] With the continuous advancement of software technology, software systems are becoming increasingly large and complex. To enable enterprises to rapidly develop and maintain application software, integration platforms have emerged, providing open, easy-to-maintain, and reconfigurable application development and integration tools. Integration platforms offer universal communication and information access services, freeing application software functionality from dependence on specific hardware systems, operating systems, network protocols, and database management systems.
[0003] Typically, users create integrated data flows (integration flows) on an integration platform to implement a business. The operation of the integration flow uses some data. Managing data in the integration platform is a technical issue that urgently needs to be solved. Summary of the Invention
[0004] In view of this, embodiments of the present application provide a data processing method, apparatus, device, and medium to achieve persistent storage of data in an integrated platform, thereby providing a reliable data source for subsequent business.
[0005] To achieve the above objectives, the technical solutions provided by this application are as follows:
[0006] In a first aspect of the present application, a data processing method is provided, which is applied to an integrated platform and includes:
[0007] Get the data source to be stored;
[0008] If the data source to be stored meets a preset condition, the data source to be stored is persistently stored, and the data source to be stored is stored in the integration platform in a nested data structure.
[0009] In a second aspect of the present application, a data processing device is provided, which is applied to an integrated platform and includes:
[0010] A first acquiring unit, configured to acquire a data source to be stored;
[0011] The storage unit is used to persistently store the data source to be stored if the data source to be stored meets a preset condition, and the data source to be stored is stored in the integration platform in a nested data structure.
[0012] In a third aspect of the present application, an electronic device is provided, the device comprising: a processor and a memory;
[0013] The memory is used to store instructions or computer programs;
[0014] The processor is configured to execute the instructions or computer program in the memory so that the electronic device executes the method described in the first aspect.
[0015] In a fourth aspect of the present application, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium. When the instructions are executed on a device, the device executes the method described in the first aspect.
[0016] In a fifth aspect of the present application, a computer program product is provided, wherein the computer program product comprises a computer program / instructions, and when the computer program / instructions are executed by a processor, the method described in the first aspect is implemented.
[0017] It can be seen that the embodiments of the present application have the following beneficial effects:
[0018] In the embodiment of the present application, when the integration platform obtains a data source to be stored, it verifies the data source to be stored. If it meets the preset conditions, it will be persistently stored to provide reliable data for subsequent business operations. At the same time, the integration platform supports the storage of data sources to be stored in a nested data structure, thereby meeting the storage requirements of data with various complex data structures and improving the diversity of business processing. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0020] Figure 1 A flow chart of a data processing method provided in an embodiment of the present application;
[0021] Figure 2 A schematic diagram of an integrated flow construction scenario provided in an embodiment of the present application;
[0022] Figure 3 A schematic diagram of a data processing device provided in an embodiment of the present application;
[0023] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to help those skilled in the art better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.
[0025] An integration platform combines application system integration with an integrated architecture. By offering low construction costs and high integration capabilities, it addresses the issues of high enterprise integration costs and low efficiency. In this embodiment, the integration platform integrates multiple systems corresponding to an enterprise and provides a unified operation portal, allowing users to complete operations through this portal without having to access each system separately, thereby improving business processing efficiency.
[0026] Specifically, the integration platform can acquire data sources from multiple systems, persistently store those that meet the requirements, and then process these data sources by building integration flows. Integration flows are built on the integration platform, and multiple steps can be orchestrated within a single flow to complete the entire integration process. Within an integration flow, each step can process data obtained from the current connection or any previous step, and the resulting data can be used by the next step in the integration flow.
[0027] It is understandable that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.
[0028] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operation of the disclosed technical solution based on the prompt message.
[0029] As an optional but non-limiting implementation, in response to a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0030] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0031] To facilitate understanding of the technical solutions provided in the embodiments of the present application, they will be described below with reference to the accompanying drawings.
[0032] See also Figure 1 , which is a flow chart of a data processing method provided by an embodiment of the present application. The method can be executed by an integrated platform, which can be installed on an electronic device. The electronic device can include a mobile phone, a tablet computer, a laptop computer, a desktop computer, a vehicle terminal, a wearable electronic device, an all-in-one machine, a smart home device and other devices with communication functions, and can also be a device simulated by a virtual machine or a simulator. Figure 1 As shown, the method may include the following steps:
[0033] S101: Acquire a data source to be stored.
[0034] In this embodiment, to implement cross-system data processing through an integrated platform, a data source to be processed is obtained and stored. The data source may include field values corresponding to multiple data fields, and the data fields in the data source corresponding to different businesses may differ. For example, if the business is financial reimbursement, the corresponding data source includes an amount field; if the business is purchasing office supplies, the corresponding data source includes an office supply name field.
[0035] A data field in a data source can include nested data fields. That is, the data source to be stored has a nested data structure. For example, if the data field is a department field, the department field can include a project field, which can include a group field. For example, a department can be divided into Project 1 and Project 2, with Project 1 further divided into Groups 1 and 2, and Project 2 further divided into Groups 3, 4, and 5.
[0036] In one embodiment of the present disclosure, the integration platform may obtain the data source to be stored in the following manner:
[0037] One method is to obtain a data source to be stored in response to receiving a request to create a data source. Specifically, users can create data sources based on the integration platform. When creating a data source on the integration platform, users must first determine the integration project to which the data source belongs, and then create the data source within that integration project. An integration project is a container for creating and maintaining all resources associated with one or more integration flows. An integration project can correspond to multiple integration flows and multiple data sources. Integration flows belonging to that integration project can reference all data sources within that integration project to process those referenced data sources.
[0038] Another method is to obtain the data source to be stored in response to receiving an operation to upload the data source. That is, the integration platform supports obtaining the data source by uploading. Specifically, the data source to be stored can be uploaded to the integration platform by uploading a spreadsheet.
[0039] Another approach is to obtain the data source to be stored from the target system in response to detecting updated data in the target system. Specifically, the integration platform can detect whether data in the target system has been updated. If so, it can proactively read the data source to be stored from the target system or send an instruction to the target system, causing it to send the data source to be stored to the integration platform according to the instruction.
[0040] The integration platform can detect whether data updates have occurred in the target system in the following ways: one is to detect whether data updates have occurred in the target system in real time, so that when the target system is updated, the updated data source can be obtained in a timely manner, and then the updated data source can be processed to improve processing efficiency. Another is to pre-set a detection cycle. When the detection cycle is reached, the integration platform activates the detection mechanism to detect whether data updates have occurred in the target system. When the target system is updated, the updated data source can be obtained, and then the updated data within a period of time can be centrally processed to improve the working efficiency of the integration platform.
[0041] S102: If the data source to be stored meets a preset condition, the data source to be stored is persistently stored.
[0042] After obtaining the data source to be stored, the data source is first verified so that if the data source meets the preset conditions, the data source is persistently stored to provide data resources for the execution of the integration flow.
[0043] The preset conditions can be set according to actual application conditions. Specifically, the format of the data field in the data source can be verified. For example, if a data field is a network address field, the network address corresponding to the network address field is verified to be a valid network address. Alternatively, the field value of the data field in the data source can be verified. For example, if a data field is a department code, and the value range of the department code is [000,100], if the department code in the data source is 010, it indicates that the data source meets the preset conditions; if the department code in the data source is 999, it indicates that the data source does not meet the preset conditions, and the user can be prompted that there is an invalid value.
[0044] As can be seen, when the integration platform obtains a data source to be stored, it verifies it. If it meets the preset conditions, it will be persistently stored to provide reliable data for subsequent business operations. Furthermore, the integration platform supports storing data sources in nested data structures, thus accommodating data with various complex structures and increasing the diversity of business processing.
[0045] In one embodiment of the present disclosure, an integration flow can be created based on the integration platform, and then the required data source can be added to the integration flow, specifically, the integration flow is obtained; in response to receiving an add operation triggered for the integration flow, the data source referenced by the integration flow is determined. The integration flow is used to implement cross-system data processing, which can process the data in the referenced data source according to the corresponding processing operation. Specifically, an integration flow can include multiple processing steps (one processing step can correspond to one processing operation), each processing step can process the obtained data, and the processed result data can be used for the next step in the integration flow.
[0046] Among them, users can build integration flows through the components provided by the integration platform, such as Figure 2 As shown, the integration platform provides multiple types of components. Users can select the core components shown on the right and then build an integration flow. Users can add the data source to be referenced by triggering the data source component in the integration flow.
[0047] In one embodiment of the present disclosure, in response to receiving an add operation triggered for an integration flow, data sources that can be referenced by the integration flow are displayed; in response to receiving a select operation triggered for a data source, the selected data source is determined as the data source referenced by the integration flow. In other words, an integration flow has reference permissions for multiple data sources. When adding a data source to an integration flow, multiple data sources can be displayed for the user to select the desired data source, and the selected data source is then added as the data source referenced by the integration flow.
[0048] In one embodiment of the present disclosure, displaying data sources that can be referenced by an integration flow includes: in response to receiving an add operation triggered for the integration flow, determining the integration project to which the integration flow belongs; and displaying the data sources included in the integration project. In other words, an integration flow has reference permission for all data sources within the integration project to which it belongs. When a user needs to add a data source to the integration flow, all data sources corresponding to the integration project to which the integration flow belongs are displayed, allowing the user to select the desired data source.
[0049] It should be noted that the data source referenced in an integration flow is the data source included in the integration project to which it belongs, and cannot reference the data source included in other integration projects, thereby ensuring that the data source under a certain integration project cannot be changed or referenced by other integration projects.
[0050] In one embodiment of the present disclosure, the data source to which the integration flow is applied can be viewed or edited. Specifically, in response to a trigger operation on a target component in the integration flow, an operation control corresponding to the data source is displayed; in response to receiving a trigger operation on the operation control, an operation page is displayed; and in response to receiving an operation triggered on the operation page, data in the data source is processed.
[0051] The target component corresponds to the data source and is used to implement operations related to the data source. For example, the target component can be Figure 2 The data source component in the data source. Operation controls can include query controls and edit controls. The query control is used to query data in the data source, and the edit control is used to edit data in the data source. Specifically, the edit control can include delete controls, update controls, and add controls. The delete control is used to delete one or more data items in the data source, the update control is used to update one or more data items in the data source, and the add control is used to add one or more data items to the data source.
[0052] When the action control is a query control, the displayed action page is the query page. In response to an input action triggered on the query page, the input query parameters are retrieved; target data matching the query parameters is searched from the data source based on the query parameters; and the target data is displayed. In other words, the integration flow can query specific data in the referenced data source. The query parameters can be the field value of a data field in the data source.
[0053] Specifically, in response to a trigger operation on target data, a data detail page corresponding to the target data is displayed so that the user can view detailed information about the queried data. That is, the integrated flow can provide users with a visual data viewing function, making it easier for users to view data.
[0054] When the operation control is a delete control, the displayed operation page is a delete page, on which the data field or field value to be deleted can be entered, and the data field or field value entered will be deleted from the data source.
[0055] When the action control is an update control, the displayed action page is an update page. This update page may include various data fields included in the data source, and the user can enter updated field values on the update page. In response to a confirmation action triggered on the update page, the field value of the corresponding data field in the data source is updated.
[0056] When the control is a new control, the displayed operation page is the Add page. This page includes all the data fields included in the data source, and users can add a new item to the existing data field. For example, if the data source includes a product name field and product 1, users can add product 2 on the Add page. Alternatively, users can add a new data field and its corresponding field value. For example, if the data source does not include a brand field, users can add the brand field and the specific brand name on the Add page.
[0057] In one embodiment of the present disclosure, to ensure data security and prevent tampering, data usage permissions are managed and controlled. Specifically, in response to a trigger operation on a target component in an integration flow, the user permissions of the user who triggered the target component are determined; and operation controls corresponding to the data source that matches the user permissions are displayed. User permissions include viewing permissions and editing permissions. User permissions are determined when creating an integration project through the integration platform. When creating an integration project, the creator can determine which users have viewing permissions and which users have editing permissions.
[0058] Typically, the first node in an integration flow is a trigger, which determines how the integration flow is triggered. In one embodiment of the present disclosure, a change in data in a data source can be used as a trigger for the integration flow to trigger the integration flow to process the data source. Specifically, a change in data in the data source triggers the integration flow to process the data source.
[0059] The change in the data in the data source may be triggered by batches of data in the data source being updated according to a preset data update time, or by specifying a row of data in the data source to trigger data update.
[0060] Based on the above method embodiments, the embodiments of the present application provide a data processing device and equipment, which will be described below in conjunction with the accompanying drawings.
[0061] See also Figure 3 , which is a structural diagram of a data processing device provided in an embodiment of the present application, such as Figure 3As shown, the device 300 includes: a first acquisition unit 301 and a storage unit 302.
[0062] A first acquiring unit 301 is configured to acquire a data source to be stored;
[0063] The storage unit 302 is configured to persistently store the data source to be stored if the data source to be stored meets a preset condition. The data source to be stored is stored in the integration platform in a nested data structure.
[0064] In one embodiment of the present disclosure, the storage unit 302 is specifically configured to obtain the data source to be stored in response to receiving an operation to create a data source; obtain the data source to be stored in response to receiving an operation to upload a data source; and obtain the data source to be stored from the target system in response to detecting the presence of updated data in the target system.
[0065] In one embodiment of the present disclosure, the apparatus further includes: a second acquiring unit and a determining unit;
[0066] The second acquisition unit is used to acquire an integration flow, where the integration flow is built based on the integration platform and is used to implement cross-system data processing;
[0067] The determining unit is configured to determine a data source referenced by the integration flow in response to receiving an add operation triggered for the integration flow, wherein the integration flow is configured to process data in the data source according to a corresponding processing operation.
[0068] In one embodiment of the present disclosure, the apparatus further comprises: a display unit and a processing unit;
[0069] The display unit is configured to display an operation control corresponding to the data source in response to a trigger operation on a target component in the integration flow;
[0070] The display unit is further configured to display an operation page in response to receiving a trigger operation for the operation control;
[0071] The processing unit is configured to process the data in the data source in response to receiving an operation triggered on the operation page.
[0072] In one embodiment of the present disclosure, the display unit is used to determine the user rights of the user who triggers the target component, the user rights including viewing rights and editing rights; and display the operation controls corresponding to the data source that match the user rights.
[0073] In one embodiment of the present disclosure, the operation control includes one or more of the following: a query control and an edit control, the query control is used to query data in the data source, and the edit control is used to edit the data in the data source.
[0074] In one embodiment of the present disclosure, the operation control is the query control, and the processing unit is specifically used to obtain input query parameters in response to receiving an input operation triggered on the operation page; search for target data matching the query parameters from the data source according to the query parameters; and display the target data.
[0075] In one embodiment of the present disclosure, the display unit is further configured to display a data details page corresponding to the target data in response to a triggering operation on the target data.
[0076] In one embodiment of the present disclosure, the determining unit is specifically configured to, in response to receiving an add operation triggered for the integration flow, display data sources that can be referenced by the integration flow; and in response to receiving a select operation triggered for a data source, determine the selected data source as the data source referenced by the integration flow.
[0077] In one embodiment of the present disclosure, the determining unit is specifically configured to, in response to receiving an add operation triggered for the integration flow, determine the integration project to which the integration flow belongs; and display data sources included in the integration project.
[0078] In one embodiment of the present disclosure, the apparatus further comprises: a trigger unit;
[0079] The trigger unit is configured to trigger the integration flow to process the data source if the data in the data source changes.
[0080] It should be noted that the specific implementation of each unit in this embodiment can refer to the relevant description in the above method embodiment.
[0081] The division of units in the embodiments of the present application is schematic and is only a logical functional division. In actual implementation, there may be other division methods. The functional units in the embodiments of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. For example, in the above embodiment, the processing unit and the sending unit can be the same unit or different units. The above integrated units can be implemented in the form of hardware or in the form of software functional units.
[0082] See also Figure 4, which shows a schematic structural diagram of an electronic device 400 suitable for implementing the embodiments of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 4 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.
[0083] like Figure 4 As shown, the electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. Various programs and data required for the operation of the electronic device 400 are also stored in the RAM 403. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.
[0084] Typically, the following devices may be connected to the I / O interface 405: an input device 406 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 may allow the electronic device 400 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 4 The electronic device 400 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.
[0085] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
[0086] The electronic device provided by the embodiment of the present disclosure and the method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
[0087] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon. When the program is executed by a processor, the method provided in the above embodiment is implemented.
[0088] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0089] In some embodiments, the client and server can communicate using any currently known or future developed network protocol, such as HTTP (Hypertext Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0090] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0091] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device can perform the method.
[0092] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0093] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0094] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit / module does not, in some cases, limit the unit itself.
[0095] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0096] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0097] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Reference can be made to the common and similar parts between the various embodiments. For the systems or devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method description.
[0098] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0099] It should also be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or device comprising the element.
[0100] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0101] The above description of the disclosed embodiments is intended to enable one skilled in the art to implement or use the present application. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A data processing method, characterized in that: The method is applied to an integrated platform that integrates multiple systems and provides a unified operation portal, including: Acquire data sources to be stored from the plurality of systems; If the data source to be stored meets the preset conditions, the data source to be stored is persistently stored, and the data source to be stored is stored in the integration platform in a nested data structure; Acquire an integration flow, where the integration flow is built based on the integration platform and is used to implement cross-system data processing; In response to receiving an add operation triggered for the integration flow, determining a data source referenced by the integration flow, the integration flow being used to process data in the data source according to a corresponding processing operation; If the data in the data source changes, the integration flow is triggered to process the data source; wherein the change in the data in the data source serves as a trigger for executing the integration flow.
2. The method according to claim 1, characterized in that The acquiring of the data sources to be stored from the multiple systems includes at least one of the following: In response to receiving an operation to create a data source, obtaining a data source to be stored; In response to receiving an operation to upload a data source, obtaining a data source to be stored; In response to detecting that updated data exists in the target system, a data source to be stored is obtained from the target system.
3. The method according to claim 1, characterized in that The method further comprises: In response to a trigger operation on a target component in the integration flow, displaying an operation control corresponding to the data source; In response to receiving a trigger operation for the operation control, displaying an operation page; In response to receiving the operation triggered on the operation page, the data in the data source is processed.
4. The method according to claim 3, characterized in that The displaying, in response to the triggering operation on the target component in the integration flow, the operation control corresponding to the data source includes: In response to a triggering operation on a target component in the integration flow, determining user permissions of a user who triggers the target component, the user permissions including viewing permissions and editing permissions; Display the operation controls corresponding to the data source that match the user authority.
5. The method according to claim 3 or 4, characterized in that The operation control includes one or more of the following: a query control and an edit control, wherein the query control is used to query data in the data source, and the edit control is used to edit the data in the data source.
6. The method according to claim 5, characterized in that The operation control is the query control, and the processing of the data in the data source in response to receiving the operation triggered on the operation page includes: In response to receiving an input operation triggered on the operation page, obtaining an input query parameter; searching, from the data source according to the query parameters, for target data that matches the query parameters; The target data is displayed.
7. The method according to claim 6, characterized in that The method further comprises: In response to a triggering operation on the target data, a data details page corresponding to the target data is displayed.
8. The method according to claim 1, characterized in that In response to receiving an add operation triggered for the integration flow, determining a data source referenced by the integration flow includes: In response to receiving an add operation triggered for the integration flow, displaying data sources that can be referenced by the integration flow; In response to receiving a selection operation triggered on a data source, the selected data source is determined as a data source referenced by the integration flow.
9. The method according to claim 8, characterized in that In response to receiving an add operation triggered for the integration flow, displaying data sources that can be referenced by the integration flow includes: In response to receiving an add operation triggered for the integration flow, determining an integration project to which the integration flow belongs; Displays the data sources included in the integration project.
10. A data processing device, characterized in that: The device is applied to an integrated platform that integrates multiple systems and provides a unified operation portal, including: A first acquiring unit, configured to acquire data sources to be stored from the multiple systems; A storage unit, configured to persistently store the data source to be stored if the data source to be stored meets a preset condition, wherein the data source to be stored is stored in the integration platform in a nested data structure; A second acquisition unit is used to acquire an integration flow, where the integration flow is built based on the integration platform and is used to implement cross-system data processing; a determining unit, configured to determine, in response to receiving an add operation triggered for the integration flow, a data source referenced by the integration flow, the integration flow being configured to process data in the data source according to a corresponding processing operation; A triggering unit is used to trigger the integration flow to process the data source if the data in the data source changes; wherein the change in the data in the data source serves as a trigger for executing the integration flow.
11. An electronic device, characterized in that: The device includes: a processor and a memory; The memory is used to store instructions or computer programs; The processor is configured to execute the instructions or computer program in the memory, so that the electronic device executes the method according to any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores instructions, and when the instructions are executed on a device, the device is caused to execute the method according to any one of claims 1 to 9.
Citation Information
Patent Citations
Electronic government affair big data processing platform
CN112765245A
Collaborative driving data storage device, data processing method and roadside equipment
CN114461144A