Data transmission method, apparatus, device, and medium
By obtaining configuration information from the head office's big data platform within the bank's system, establishing temporary tables, and transmitting data, the problem of data sharing and integration between the branch's local application system and the head office's big data platform was solved, achieving efficient and convenient data transmission and unified management.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- INDUSTRIAL AND COMMERCIAL BANK OF CHINA
- Filing Date
- 2022-10-17
- Publication Date
- 2026-06-16
Smart Images

Figure CN115544167B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of big data technology, and in particular to a data transmission method, apparatus, device and medium. Background Technology
[0002] With the advent and development of the digital economy, banks, as an industry with a deep integration of financial technology, have accumulated massive amounts of user data, transaction data, and external data in the process of providing financial services. The sheer scale and rich variety of data make bank data extremely valuable. To fully leverage the value of this data, each bank has established its own big data platform, integrating data from various internal application systems into the platform to achieve the unification and sharing of basic data across the entire bank.
[0003] Currently, the construction and management of bank big data platforms are generally led and managed by the head office. Data, as a high-value and highly sensitive asset, is subject to strict control over its sharing and use. Therefore, even individual branches within a bank cannot be authorized to directly use data from the data lake. In terms of process, branches need to go through multiple layers of data permission applications and authorizations before data can be transferred to their local systems for secondary processing. This requires significant time and technical costs for branches, leading many to prefer obtaining data by directly requesting files from upstream application systems. Therefore, to better improve the data sharing services of bank big data platforms, enhance their functionality, and fully leverage the advantages and value of big data platforms...
[0004] Therefore, there is an urgent need for a data transfer method that can efficiently and conveniently achieve data sharing from the head office's big data platform to the branch's local application system, and can also meet the requirement of integrating special data in the branch's local application system with data from the head office's big data platform. Summary of the Invention
[0005] This application provides a data transmission method, apparatus, device, and medium that can efficiently and conveniently realize data sharing from the head office's big data platform to the branch's local application system, and can meet the requirement of data fusion between the special data in the branch's local application system and the head office's big data platform.
[0006] Firstly, this application provides a data transmission method, including:
[0007] The configuration information is obtained from the database in the first target cloud platform, and a first temporary table is created on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database.
[0008] Based on the first temporary table, a second temporary table is determined on the second target cloud platform; wherein, the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table;
[0009] The second temporary table is passed to the first target cloud platform.
[0010] In one example, passing the second temporary table to the first target cloud platform includes:
[0011] Obtain the second temporary table from the second target cloud platform;
[0012] Receive the data request message from the first target cloud platform;
[0013] Based on the data request message, the second temporary table is transmitted to the first target cloud platform.
[0014] In one example, after passing the second temporary table to the first target cloud platform according to the data request message, the method further includes:
[0015] Obtain a first data table from the first target cloud platform; wherein the first data table is obtained by updating the second temporary table on the first target cloud platform;
[0016] Based on the configuration information, a second data table is established on the second target cloud platform;
[0017] Update the data information in the second data table based on the data information in the first data table.
[0018] In one example, establishing a second data table on the second target cloud platform based on the configuration information includes:
[0019] Obtain the data table field information from the configuration information;
[0020] Based on the data table field information, a second data table is created on the second target cloud platform.
[0021] In one example, the second data table can be accessed by the first local data system.
[0022] In one example, the method further includes:
[0023] The data information in the database of the first target cloud platform is obtained from the second local data system; wherein the database in the first target cloud platform and the second local data system have a mapping relationship; wherein the number of the second local data system is at least one.
[0024] In one example, the first target cloud platform and the second target cloud platform together constitute a data cloud platform.
[0025] Secondly, this application provides a data transmission apparatus, the apparatus comprising:
[0026] The first acquisition unit is used to acquire configuration information from the database in the first target cloud platform and to establish a first temporary table on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database.
[0027] The writing unit is used to determine a second temporary table on the second target cloud platform based on the first temporary table; wherein the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table;
[0028] The transmission unit is used to transmit the second temporary table to the first target cloud platform.
[0029] In one example, the transmission unit includes:
[0030] The acquisition module is used to acquire the second temporary table from the second target cloud platform;
[0031] The receiving module is used to receive data request messages from the first target cloud platform;
[0032] The transmission module is used to transmit the second temporary table to the first target cloud platform according to the data request message.
[0033] In one example, the device further includes:
[0034] The second acquisition unit is used to acquire a first data table from the first target cloud platform; wherein the first data table is obtained by the first target cloud platform after updating the second temporary table on the first target cloud platform;
[0035] A setup unit is used to establish a second data table on the second target cloud platform according to the configuration information;
[0036] The update unit is used to update the data information in the second data table based on the data information in the first data table.
[0037] In one example, the cell is constructed, including:
[0038] The acquisition module is used to acquire data table field information from the configuration information;
[0039] A module is established to create a second data table on the second target cloud platform based on the data table field information.
[0040] In one example, the second data table can be accessed by the first local data system.
[0041] In one example, the apparatus further includes: the data information of the database in the first target cloud platform is obtained from a second local data system; wherein the database in the first target cloud platform and the second local data system have a mapping relationship; wherein the number of the second local data systems is at least one.
[0042] In one example, the first target cloud platform and the second target cloud platform together constitute a data cloud platform.
[0043] Thirdly, this application provides an electronic device, including: a processor, and a memory communicatively connected to the processor;
[0044] The memory stores computer-executed instructions;
[0045] The processor executes computer execution instructions stored in the memory to implement the method as described in the first aspect.
[0046] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method described in the first aspect.
[0047] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the method described in the first aspect.
[0048] This application provides a data transmission method, apparatus, device, and medium. The method involves obtaining configuration information from a database in a first target cloud platform and establishing a first temporary table on a second target cloud platform based on the configuration information. The configuration information represents the attribute information of a data table in the database. A second temporary table is determined on the second target cloud platform based on the first temporary table. The second temporary table is obtained by writing original data information from the second target cloud platform into the first temporary table. The second temporary table is then transmitted to the first target cloud platform. The first target cloud platform is a branch cloud platform, where each branch cloud platform can serve as a cloud storage for a branch's local application system. The second target cloud platform can be a big data platform for the head office application system, used to store the database of the head office application system. This technical solution enables efficient and convenient data sharing from the head office big data platform to the branch's local application system, and can also meet the data fusion requirements of special data in the branch's local application system and the head office big data platform. Attached Figure Description
[0049] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0050] Figure 1 This is a flowchart illustrating a data transmission method according to Embodiment 1 of this application;
[0051] Figure 2 This is a flowchart illustrating a data transmission method according to Embodiment 2 of this application;
[0052] Figure 3 This is an interactive diagram of data transmission according to Embodiment 2 of this application;
[0053] Figure 4 This is a schematic diagram of a data transmission device according to Embodiment 3 of this application;
[0054] Figure 5 This is a schematic diagram of a data transmission device according to Embodiment 4 of this application;
[0055] Figure 6 This is a block diagram illustrating an electronic device according to an exemplary embodiment.
[0056] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation
[0057] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.
[0058] The data transmission method provided in this application aims to solve the above-mentioned technical problems of the prior art.
[0059] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.
[0060] Currently, the common approach to resolving data sharing issues between bank data cloud platforms and branch office local application systems is to achieve data interconnection between heterogeneous clusters through data synchronization technology. This involves installing a client on a server, which is used to parse the rule information of the migration data. The branch office's local application system submits the migration data to the migration scheduling server through this client. The migration scheduling server retrieves the migration data, places it in a queue, allocates the data, and then pushes it to the source cluster containing the data based on filtering conditions for data retrieval. Finally, the data is migrated to the target cluster.
[0061] However, the target cluster is generally a tenant space allocated to the branch's local application system by the head office application system in the cluster where the data cloud platform is located, and the data is not in the database of the branch's local application system.
[0062] While the above solution can migrate the required data from the data cloud platform to a designated cluster, this cluster, as described, is typically a tenant space allocated by the head office application system to the branch's local application system within the cluster hosted on the data cloud platform. Therefore, the data is still migrated to the cluster provided by the head office application system. The branch's local application system can only process data within this tenant space. If the branch's local application system needs to use the data locally, it must export the data to its local application system before subsequent integration operations between the application system and the migrated data can proceed.
[0063] Furthermore, branch local application systems increasingly require the use of data analysis tools provided by the head office application system for data processing, which necessitates interfacing with the branch tenants mentioned above. If the head office tools are needed to process the unique data of the branch local application systems, the branch local application systems must export their local data and then upload it to the tenant's domain on the head office application system's data cloud platform via interconnection tools.
[0064] Therefore, the steps for these two data migration and synchronization scenarios are cumbersome and technically costly, resulting in high technical costs and poor data timeliness for the branch's local application system.
[0065] Figure 1 This is a flowchart illustrating a data transmission method according to Embodiment 1 of this application. Embodiment 1 includes the following steps:
[0066] S101. Obtain configuration information from the database in the first target cloud platform, and create a first temporary table on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database.
[0067] In one example, the first target cloud platform is a cloud platform capable of storing a MySQL database, and there can be more than one first target cloud platform. In this embodiment, the first target cloud platform can be a branch cloud platform, and each branch cloud platform can serve as a cloud storage for a branch's local application system.
[0068] The configuration information is the configuration file for the data tables in the database of the first target cloud platform. The configuration information may include the database name of the source database, the table name of the data table in the source database, the database name of the target database, and the table name of the data table in the target database.
[0069] In this embodiment, the second target cloud platform is a computing platform equipped with a Hadoop cluster, which can store and analyze the data tables on the second target cloud platform. The Hadoop cluster can fully utilize the cluster for high-speed computing and storage. Furthermore, the second target cloud platform can be the head office's big data platform.
[0070] In this embodiment, the execution entity is a synchronization tool on the server. This tool is a plugin used to store and execute data transfer scripts, and to receive imported and exported data. Furthermore, the synchronization tool can access data tables in both the first and second target cloud platforms. The second target cloud platform includes a source cluster and multiple target clusters. A first temporary table is established from a subset of these target clusters, where the source clusters store the original data information from the second target cloud platform. Further, if the name of the original data table in the original data information is A, then the name of the first temporary table established in the target clusters can be A-TMP table. There is a one-to-one correspondence between the original data table and the first temporary table.
[0071] S102. Based on the first temporary table, determine the second temporary table on the second target cloud platform; wherein, the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table.
[0072] In one example, on the second target cloud platform, based on the data interaction and mapping relationships between the source cluster and the target cluster, the original data information from the source cluster is written into a first temporary table in the target cluster, resulting in a second temporary table populated with data information. Further, if the first temporary table is named A-TMP, the second temporary table can be named A-TMP-1. Specifically, the original data information from the source cluster can be written into the first temporary table A-TMP to obtain the second temporary table A-TMP-1.
[0073] S103. Transfer the second temporary table to the first target cloud platform.
[0074] In this embodiment, the second temporary table is transferred to the first target cloud platform using a synchronization tool, and stored on the first target cloud platform using the same naming convention. For example, if the name of the second temporary table on the second target cloud platform is A-TMP-1, then the name of the second temporary table after it is transferred to the first target cloud platform is also A-TMP-1.
[0075] This application provides a data transmission method, apparatus, device, and medium. The method involves obtaining configuration information from a database in a first target cloud platform and establishing a first temporary table on a second target cloud platform based on the configuration information. The configuration information represents the attribute information of a data table in the database. A second temporary table is determined on the second target cloud platform based on the first temporary table. The second temporary table is obtained by writing the original data information from the second target cloud platform into the first temporary table. The second temporary table is then transmitted to the first target cloud platform. This technical solution enables efficient and convenient data sharing between the head office's big data platform and branch office local application systems, and can also meet the requirements for integrating special data from branch office local application systems with data from the head office's big data platform.
[0076] Figure 2 This is a flowchart illustrating a data transmission method according to Embodiment 2 of this application. Embodiment 2 includes the following steps:
[0077] S201. Obtain configuration information from the database in the first target cloud platform, and create a first temporary table on the second target cloud platform based on the configuration information; the configuration information represents the attribute information of the data table in the database.
[0078] In one example, the data information in the database of the first target cloud platform is obtained from the second local data system; wherein the database in the first target cloud platform and the second local data system have a mapping relationship; wherein the number of second local data systems is at least one. In this embodiment, the second local data system may be a branch local application system, and different branch application systems have different databases in the first target cloud platform, and the first target cloud platform migrates the databases on the second local data systems.
[0079] In one example, the first target cloud platform and the second target cloud platform together constitute a data cloud platform.
[0080] In this embodiment, both the first target cloud platform and the second target cloud platform are data cloud platforms. The advantage of this configuration is that the database of the head office application system and the database of the branch local application system are on the same data cloud platform. This enables the integration of the database of the head office application system and the database of the branch local application system, allowing different branch local databases to access each other. Furthermore, since they are on the same data cloud platform, the branch local application system can quickly access the database of the head office application system.
[0081] S202. Based on the first temporary table, determine the second temporary table on the second target cloud platform; wherein, the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table.
[0082] For example, this step can refer to step S102 above, and will not be repeated here.
[0083] S203. Obtain the second temporary table from the second target cloud platform.
[0084] In this embodiment, after obtaining the second temporary table from the second target cloud platform through the command message hadoop fs-get in the server, it is stored in the server.
[0085] S204. Receive the data request message from the first target cloud platform.
[0086] In this embodiment, the first target cloud platform periodically sends data request messages to the server to obtain a second temporary table from the server. The periodic interval can be 24 hours.
[0087] S205. Based on the data request message, transmit the second temporary table to the first target cloud platform.
[0088] In this embodiment, the second temporary table is loaded into the first target cloud platform using the mysqlimport client, a plugin tool within the first target cloud platform. Specifically, the command message mysqlimport-Phu can be used.
[0089] S206. Obtain the first data table from the first target cloud platform; wherein the first data table is obtained by updating the second temporary table on the first target cloud platform.
[0090] In this embodiment, the data in the second temporary table on the first target cloud platform is merged with the data in the first target cloud platform to obtain the first data table. The data information in the first data table can be either newly added to the data information in the second temporary table or updated from the data information in the second temporary table. Further, if the name of the second temporary table is A-TMP-1, then the name of the first data table can be A-NEW. Specifically, the command to retrieve the first data table from the first target cloud platform can be mysql -u hpe "select * from Mysql table">data file.txt.
[0091] S207. Based on the configuration information, establish a second data table on the second target cloud platform.
[0092] In this embodiment, the data information in the second data table is the same as that in the first data table, and the name of the second data table is the same as that of the first data table. The difference is that the second data table is stored in the second target cloud platform.
[0093] In one example, based on configuration information, a second data table is created on the second target cloud platform, including:
[0094] Obtain the data table field information from the configuration information; based on the data table field information, create a second data table on the second target cloud platform.
[0095] In this embodiment, the field information of the first data table in the configuration information is obtained, and a second data table is created on the second target cloud platform based on the field information. Specifically, the second data table is created in the target cluster of the second target cloud platform. The command to create the second data table is beeline-e "create table A_NEW". Furthermore, the second data table is a Hive table.
[0096] S208. Update the data information in the second data table based on the data information in the first data table.
[0097] In this embodiment, the data information in the first data table is the merged data information from the branch's local application system and the head office's application system. Based on the data information in the first data table, the data information in the first data table is filled into the second data table to update the data information in the second data table. Specifically, this can be achieved through the synchronization tool's command messages `hadoop fs-moveFromLocal` and `beeline -e "load data inpath. 'overwrite into table"`.
[0098] In one example, the second data table can be accessed by the first local data system.
[0099] In one example, the first local data system is the head office application system. The head office application system can access the second data table from the second target cloud platform. Since the data in the second data table is a fusion of data from the branch's local application system and the head office application system, the first local data system can simultaneously use data from both the branch's local application system and the head office application system.
[0100] In this embodiment, for a better illustration of the data transmission process, please refer to [link / reference needed]. Figure 3 The diagram illustrates an interactive data transfer process. Figure 3 As can be seen, the data cloud platform includes a second target cloud platform, a server, and a first target cloud platform. The second target cloud platform includes a source cluster and a target cluster. The source cluster stores the original data information, while the target cluster stores a first temporary table, a second temporary table, and a second data table. The server includes configuration information retrieved from the database of the first target cloud platform, as well as synchronization tools within the server. The first target cloud platform includes a database, which contains a second temporary table and a first data table. The second local data system can access the first data table in the database.
[0101] This application provides a data transfer method that involves obtaining configuration information from a database in a first target cloud platform and establishing a first temporary table on a second target cloud platform based on the configuration information. The configuration information represents the attribute information of a data table in the database. Based on the first temporary table, a second temporary table is determined on the second target cloud platform, retrieved from the second target cloud platform, receiving a data request message from the first target cloud platform, transferring the second temporary table to the first target cloud platform according to the data request message, retrieving a first data table from the first target cloud platform, establishing a second data table on the second target cloud platform based on the configuration information, and updating the data information in the second data table based on the data information in the first data table. This technical solution solves the problem of cumbersome and inefficient data synchronization between branch local application systems and head office application systems. Furthermore, it enables both head office application system data and branch local application system data to be stored in a data cloud platform, facilitating unified management of data from both systems.
[0102] Figure 4 This is a schematic diagram of a data transmission device according to Embodiment 3 of this application. The device 40 in Embodiment 3 includes:
[0103] The first acquisition unit 401 is used to acquire configuration information from the database in the first target cloud platform and establish a first temporary table on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database.
[0104] The writing unit 402 is used to determine a second temporary table on the second target cloud platform based on the first temporary table; wherein the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table.
[0105] The transfer unit 403 is used to transfer the second temporary table to the first target cloud platform.
[0106] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0107] Figure 5 This is a schematic diagram of a data transmission device according to Embodiment 4 of this application. The device 50 in Embodiment 4 includes:
[0108] The first acquisition unit 501 is used to acquire configuration information from the database in the first target cloud platform and to create a first temporary table on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database.
[0109] The writing unit 502 is used to determine a second temporary table on the second target cloud platform based on the first temporary table; wherein the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table.
[0110] The transfer unit 503 is used to transfer the second temporary table to the first target cloud platform.
[0111] In one example, the transmission unit 503 includes:
[0112] The acquisition module 5031 is used to acquire the second temporary table from the second target cloud platform.
[0113] The receiving module 5032 is used to receive data request messages from the first target cloud platform.
[0114] The transmission module 5033 is used to transmit the second temporary table to the first target cloud platform according to the data request message.
[0115] In one example, the device also includes:
[0116] The second acquisition unit 504 is used to acquire a first data table from the first target cloud platform; wherein the first data table is obtained by the first target cloud platform after updating the second temporary table on the first target cloud platform.
[0117] Establishment unit 505 is used to establish a second data table on the second target cloud platform according to the configuration information.
[0118] The update unit 506 is used to update the data information in the second data table based on the data information in the first data table.
[0119] In one example, cell 505 is created, including:
[0120] The acquisition module 5051 is used to obtain data table field information from the configuration information.
[0121] Module 5052 is used to create a second data table on the second target cloud platform based on the data table field information.
[0122] In one example, the second data table can be accessed by the first local data system.
[0123] In one example, the apparatus further includes: data information in the database of the first target cloud platform is obtained from a second local data system; wherein the database in the first target cloud platform and the second local data system have a mapping relationship; wherein the number of second local data systems is at least one.
[0124] In one example, the first target cloud platform and the second target cloud platform together constitute a data cloud platform.
[0125] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0126] Figure 6 This is a block diagram illustrating an electronic device according to an exemplary embodiment. The device may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc.
[0127] The device 600 may include one or more of the following components: a processing component 602, a memory 604, a power supply component 606, a multimedia component 608, an audio component 610, an input / output (I / O) interface 612, a sensor component 614, and a communication component 616.
[0128] Processing component 602 typically controls the overall operation of device 600, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 602 may include one or more modules to facilitate interaction between processing component 602 and other components. For example, processing component 602 may include a multimedia module to facilitate interaction between multimedia component 608 and processing component 602.
[0129] Memory 604 is configured to store various types of data to support the operation of device 600. Examples of such data include instructions for any application or method operating on device 600, contact data, phonebook data, messages, pictures, videos, etc. Memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0130] Power supply component 606 provides power to the various components of device 600. Power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 600.
[0131] Multimedia component 608 includes a screen that provides an output interface between device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of a touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 608 includes a front-facing camera and / or a rear-facing camera. When device 600 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0132] Audio component 610 is configured to output and / or input audio signals. For example, audio component 610 includes a microphone (MIC) configured to receive external audio signals when device 600 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 604 or transmitted via communication component 616. In some embodiments, audio component 610 also includes a speaker for outputting audio signals.
[0133] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0134] Sensor assembly 614 includes one or more sensors for providing status assessments of various aspects of device 600. For example, sensor assembly 614 may detect the on / off state of device 600, the relative positioning of components such as the display and keypad of device 600, changes in the position of device 600 or a component of device 600, the presence or absence of user contact with device 600, the orientation or acceleration / deceleration of device 600, and temperature changes of device 600. Sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 614 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.
[0135] Communication component 616 is configured to facilitate wired or wireless communication between device 600 and other devices. Device 600 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 616 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 616 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0136] In an exemplary embodiment, the apparatus 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0137] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, which can be executed by a processor 620 of the device 600 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0138] A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the aforementioned data transfer method.
[0139] This application also discloses a computer program product, including a computer program that, when executed by a processor, implements the method described in this embodiment.
[0140] Various embodiments of the systems and technologies described above in this application can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.
[0141] The program code used to implement the methods of this application may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that when executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or electronic device.
[0142] In the context of this application, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0143] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0144] The systems and technologies described herein can be implemented in computing systems that include back-end components (e.g., as data electronic devices), or computing systems that include middleware components (e.g., application electronic devices), or computing systems that include front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.
[0145] Computer systems can include client and electronic devices. Clients and electronic devices are generally geographically separated and typically interact via communication networks. The client-electronic device relationship is created by computer programs running on the respective computers and having a client-electronic device relationship with each other. The electronic device can be a cloud electronic device, also known as a cloud computing electronic device or cloud host, a host product within the cloud computing service system, addressing the shortcomings of traditional physical hosts and VPS services ("Virtual Private Server," or simply "VPS") in terms of management difficulty and weak business scalability. The electronic device can also be an electronic device in a distributed system or an electronic device incorporating blockchain technology. It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this application is achieved, and this is not limited herein.
[0146] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.
[0147] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.
Claims
1. A data transmission method, characterized in that, The method includes: The configuration information is obtained from the database in the first target cloud platform, and a first temporary table is created on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database, the first target cloud platform is the branch cloud platform, and the second target cloud platform is the head office big data platform; Based on the first temporary table, a second temporary table is determined on the second target cloud platform; wherein, the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table; Obtain the second temporary table from the second target cloud platform; Receive the data request message from the first target cloud platform; According to the data request message, the second temporary table is transmitted to the first target cloud platform; Obtain a first data table from the first target cloud platform; wherein the first data table is obtained by updating the second temporary table on the first target cloud platform; Obtain the field information of the first data table in the configuration information; based on the field information of the data table, establish a second data table on the second target cloud platform; Based on the data information in the first data table, update the data information in the second data table. The data information in the first data table is the data information after merging the data information in the branch local application system and the head office application system. Based on the data information in the first data table, fill the data information in the first data table into the second data table so that the data information in the second data table is updated. The second data table can be accessed by the first local data system, which is the head office application system.
2. The method according to claim 1, characterized in that, The method further includes: The data information in the database of the first target cloud platform is obtained from the second local data system; wherein the database in the first target cloud platform and the second local data system have a mapping relationship; wherein the number of the second local data system is at least one.
3. The method according to any one of claims 1-2, characterized in that, The first target cloud platform and the second target cloud platform together constitute a data cloud platform.
4. A data transmission device, characterized in that, The device includes: The first acquisition unit is used to acquire configuration information from the database in the first target cloud platform and to establish a first temporary table on the second target cloud platform according to the configuration information; the configuration information represents the attribute information of the data table in the database, the first target cloud platform is a branch cloud platform, and the second target cloud platform is a head office big data platform; The writing unit is used to determine a second temporary table in the second target cloud platform based on the first temporary table; wherein the second temporary table is obtained by writing the original data information in the second target cloud platform into the first temporary table; The transmission unit includes an acquisition module, a receiving module, and a transmission module; The acquisition module is used to acquire the second temporary table from the second target cloud platform; The receiving module is used to receive data request messages from the first target cloud platform; The transmission module is used to transmit the second temporary table to the first target cloud platform according to the data request message; The second acquisition unit is used to acquire a first data table from the first target cloud platform; wherein the first data table is obtained by the first target cloud platform after updating the second temporary table on the first target cloud platform; A setup unit is used to obtain field information of the first data table in the configuration information; and to set up a second data table on the second target cloud platform based on the data table field information. The update unit is used to update the data information in the second data table according to the data information in the first data table. The data information in the first data table is the data information after merging the data information in the branch local application system and the head office application system. The data information in the first data table is filled into the second data table according to the data information in the first data table so that the data information in the second data table is updated. The second data table can be accessed by the first local data system, which is the head office application system.
5. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1-3.
6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-3.
7. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1-3.