Government affair decision support platform based on big data technology

Abstract

A government affair decision support platform based on a big data technology comprises a data layer used for performing multi-dimensional fusion on electric power data and industry data, constructing a structured database cluster, an unstructured data storage system, a full-text retrieval data storage and a cache data storage; the data analysis layer is used for constructing a multi-dimensional comprehensive analysis theme achievement support model based on the multi-dimensional data fused by the data layer, and the multi-dimensional comprehensive analysis theme achievement support model comprises a decision data thematic database, a real estate analysis model, an enterprise operation analysis model and an industry analysis model; the service layer is used for adopting various micro-service architectures, providing government affair decision support channel services and continuously and dynamically monitoring risks; and the display layer is used for visually exporting and displaying the analysis result by adopting a plurality of interface display technologies. According to the invention, a service platform for supporting the unification of government policy research is constructed.

Description

Technical Field

[0001] The present invention belongs to the field of big data, and in particular relates to a government decision-making support platform based on big data technology. Background Art

[0002] With the requirements of vigorously promoting digital construction and realizing the strategic deployment of digital transformation, it is necessary to better serve internal units, national departments and research institutions based on power data, and to innovatively build a power data government decision-making support platform based on demand analysis, data fusion and application service capabilities. Therefore, it is crucial to build a government big data service channel for internal and external units.

[0003] Government data is large in scale, diverse in types, and high in value. It involves data on people's production, life, and social operation, such as energy, public security, transportation, taxation, and the environment. The circulation and application of government data will release huge energy. In recent years, local governments have actively promoted the open sharing of government data, but data islands between different departments are difficult to eliminate quickly, and government data involves social livelihood, and data compliance and security management requirements are more stringent. Therefore, data sharing and application between government departments and between the government and enterprises are very difficult. At present, there are still problems such as poor convenience, security risks, low real-time performance, inconvenient data integration, and difficulty in using expert experience between enterprises and internal and external service objects. Summary of the invention

[0004] In order to solve the deficiencies in the prior art, the present invention provides a government decision-making support platform based on big data technology to solve the technical problem of building a unified service platform to support government policy research.

[0005] In order to solve the above technical problems, the present invention adopts the following technical solutions.

[0006] The present invention first discloses a government decision support platform based on big data technology, including:

[0007] The data layer is used to integrate power data and industry data in multiple dimensions, build structured database clusters, unstructured data storage systems, full-text search data storage, and cache data storage;

[0008] The data analysis layer is used to build a multi-dimensional comprehensive analysis theme achievement support model based on the multi-dimensional data fused by the data layer, including a decision-making data thematic library, a real estate analysis model, an enterprise operation analysis model, and an industry analysis model;

[0009] The service layer is used to adopt a variety of microservice architectures to provide government decision-making support channel services and continuously and dynamically monitor risks. The microservices include gateway services, user front desk services, product services, monitoring services, search services, file services, permission services, intelligent tool services, service management services, scheduled task services, and decision analysis services;

[0010] The presentation layer is used to visually export and display the analysis results using a variety of interface presentation technologies, including Html5, JavaScript, Vue / Element, JQuery, Echarts front-end components and report components.

[0011] The present invention further includes the following preferred embodiments:

[0012] The decision-making data database includes a macroeconomic database, a key industry development database, and a key enterprise directory database.

[0013] The government decision support platform adopts the SG-UAP 3.0 development platform, Tomcat 8.5.57 middleware, and MySQL5.7 / State Grid Cloud Component RDS (MySQL) V5.7 database.

[0014] The various interface presentation technologies include Html5, JavaScript, Vue / Element, JQuery, Echarts front-end components and report components.

[0015] The decision-making data database is used to provide retrieval and index viewing of macro data, technical reports, papers and monographs, standards and specifications, and news information data, and save them to the analysis workbench, export them, and display them visually.

[0016] The industry data include electricity-related administrative regulations data, standard specification data, foreign literature data, economic data published by the national and local governments, and real estate enterprise data.

[0017] The decision-making data thematic library includes a report generation module, which is used for editing the text format of the report, searching, inserting and saving charts.

[0018] The government decision support platform is further used to circulate and record customer demand collection, demand approval and feedback in an online form, receive optimization and improvement suggestions from users on the platform's functions, and the administrator will answer them based on the suggestions.

[0019] Accordingly, the present application also discloses a terminal, including a processor and a storage medium;

[0020] The storage medium is used to store instructions;

[0021] The processor is used to operate according to the instructions to execute the steps of the aforementioned government decision support platform based on big data technology.

[0022] Correspondingly, the present application also discloses a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the aforementioned government decision support platform based on big data technology are implemented.

[0023] The beneficial effect of the present invention is that, compared with the prior art, the present invention provides a government decision-making support platform based on big data technology, which integrates high-value external data from multiple parties, jointly develops high-quality products and service capabilities, forms a systematic and normalized research mechanism, reporting mechanism and digital support capability for government departments, and builds a digital government service capability system of co-construction, sharing and co-creation. The construction includes the construction of decision-making data thematic database, service opening, application results management, partner workbench, service center, intelligent tools and other functional constructions, and uses the accumulated existing data products to build a platform-based, systematic and normalized demand analysis, data service capabilities and a unified external service platform. Based on the point-to-point connection of the dedicated line network, supporting privacy computing, data desensitization, authority management, encrypted storage, encrypted transmission and other technical means, it is ensured that power data and industry data can be circulated, integrated and applied in a relatively closed, safe and efficient environment. Relying on the government decision-making support platform, the relevant analysis results such as the small and micro prosperity index and real estate risk monitoring are reported on demand or regularly, and macroeconomic monitoring and risk monitoring are optimized to support policy research and decision support, and visualization services are provided through various forms such as monitoring and display large screens, providing decision analysis support for various departments in multiple dimensions. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a technical architecture diagram of the government decision support platform based on big data technology in the present invention.

[0025] Figure 2 and 3 It is a schematic diagram of the decision-making data thematic library in the present invention.

[0026] Figure 4 It is a schematic diagram of the macroeconomic library indicator management page in the present invention.

[0027] Figure 5 It is a schematic diagram of the report generation page in the present invention.

[0028] Figure 6 It is a schematic diagram of the data service open page in the present invention.

[0029] Figure 7 It is a schematic diagram for visually displaying the application results of the present invention.

[0030] Figure 8and 9 It is a schematic diagram of the intelligent tool in the present invention.

[0031] Fig.10 It is a schematic diagram of the user demand personalization module in the present invention. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solution and advantages of the present invention more clear, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0033] The embodiments described in this application are only some embodiments of the present invention, not all embodiments. Based on the spirit of the present invention, other embodiments obtained by ordinary technicians in this field without creative work are all within the protection scope of the present invention.

[0034] In view of the shortcomings of the existing technology, the present invention proposes a government decision-making support platform based on big data technology, which supports the research capacity building of the government decision-making support platform through power data, builds a decision-making data thematic library and analytical decision-making capabilities, and uses existing data, algorithms, functions, and data products to build a unified service platform to support government policy research, and promote the establishment of a digital service capability system for co-construction, sharing, and co-creation. Based on the internal network and dedicated line network, a unified service channel is provided for internal and external parties; functions such as online access to services, personalized demand submission, data fusion application, and knowledge sharing are supported; and the needs of relevant units, departments, and research institutions for economic analysis, decision support, and risk monitoring are better met.

[0035] See also Figure 1 As shown, the government decision support platform based on big data technology disclosed in the present invention follows the iterative research and development of the SG-UAP technical route, is based on the integrated State Grid cloud platform, according to the unified technical route requirements of the State Grid, and in order to make full use of the support capabilities of the State Grid cloud platform, it is gradually transformed according to the SG-UAP-based Java technology stack, and adopts a mode of direct transformation of new requirements and gradual replacement of existing functions. It realizes dynamic expansion of system resources, meets the storage of structured data, unstructured data, cached data and full-text retrieval data, builds government decision support channel service capabilities based on the service layer, and adopts microservice mode based on soft load balancing, hierarchical design and development to ensure flexible deployment of applications and safe and stable operation.

[0036] The point-to-point connection of the dedicated line network is the basis for ensuring the secure transmission of data. The dedicated line network provides a multi-rate data transmission function that combines the high reliability of the SDH network with the ease of use of Ethernet. It has the characteristics of point-to-point communication, physical isolation, security, reliability, and strong real-time performance. The dedicated line network has high transmission quality, low bit error rate, and low network delay. The delay per thousand kilometers is less than 12ms, and the bit error rate is less than 10 -7 .

[0037] The government decision-making support platform includes the following technical architectures:

[0038] The data layer is used for multi-dimensional integration of power data and industry data, including the construction of structured database clusters, unstructured data storage systems, full-text retrieval data storage, and cache data storage.

[0039] The data analysis layer is used to build a multi-dimensional comprehensive analysis theme results support model based on the multi-dimensional data integrated by the data layer, including a decision-making data thematic library, a real estate analysis model, an enterprise operation analysis model and an industry analysis model.

[0040] The service layer is used to adopt a variety of microservice architectures to provide government decision-making support channel service capabilities and continuously monitor risks dynamically. It includes microservices such as gateway services, user front desk services, product services, monitoring services, search services, file services, permission services, intelligent tool services, service management services, scheduled task services, and decision analysis services. The microservice architecture technology includes Java, Springcloud, Springboot, MybatisPlus, and JDK1.8.

[0041] The presentation layer is used to visually export and display the analysis results. It uses a variety of interface presentation technologies, including popular front-end components and report components such as Html5, JavaScript, Vue / Element, JQuery, and Echarts.

[0042] The government decision support platform adopts the SG-UAP 3.0 development platform, Tomcat 8.5.57 middleware, MySQL5.7 / State Grid Cloud Component RDS (MySQL) V5.7 database, adopts the microservice / microapplication model, and uses containers on the cloud; it is deployed in the State Grid Cloud Management Information Area.

[0043] The data is uniformly encoded in UTF-8; the front-end Web is divided into two application services: decision-front and decision-plat.

[0044] The government decision-making support platform supports the research and analysis of government affairs, combines key technologies such as multi-source data fusion and privacy computing, integrates power data and industry data to form data results products, and accurately responds to customers' needs for integrated data services. It integrates multi-source and multi-dimensional data, builds a multi-dimensional comprehensive analysis theme results support model, provides State Grid Corporation with platform-based, systematic, and normalized demand analysis, data fusion, and application service capabilities, continuously and dynamically monitors risks, and provides timely decision-making responses for government users. It realizes privacy computing in the process of multi-dimensional data fusion, ensures the security of multi-party data, and makes sensitive data available but invisible.

[0045] The privacy computing is used to implement data analysis and computing under the premise of protecting the data itself from external leakage, so as to achieve the purpose of making the data available but invisible. The present invention mainly adopts federated learning, a technology derived from the fusion of artificial intelligence and privacy protection technology, and completes multi-party joint machine learning training by circulating and processing intermediate encrypted data without the original local data being stored.

[0046] In a further embodiment, the present invention adopts differential privacy computing to protect personal privacy by adding random noise to the query results.

[0047] For a dataset D and a query function f, for any two adjacent datasets D 1 and D 2 (i.e. they differ by only one data item), and the set S of all possible outputs:

[0048] Pr[f(D 1 )∈S]≤e ∈ ·Pr[f(D 2 )∈S]

[0049] Where, ∈ is the privacy budget parameter, which is used to determine the degree of privacy protection. 1 )∈S] means in the dataset D 1 Running algorithm f on the above results in the probability that the result belongs to the set S; Pr[f(D 2 )∈S] means in the dataset D 2 Run algorithm f on it and get the probability that the result belongs to set S.

[0050] In a further embodiment, in the federated learning, a similarity metric is used to calculate the similarity between data points. For data points x and y, the similarity metric f(x, y) is expressed by any of the following formulas:

[0051] 1: f'(x,y) = f(x,y) + Lap(λ), where Lap(λ) is the Laplace distributed noise of scale λ.

[0052] 2:f'(x,y)=f(x,y)+N(0,σ 2 ), where N(0,σ 2 ) has a mean of 0 and a standard deviation of σ 2 Gaussian distributed noise.

[0053] 3: Calculate the sensitivity of the query f(x,y): Δf = max|f(x,y)-f(x',y')|, where x' and y' are datasets adjacent to x and y: f'(x,y) = f(x,y)+Lap(λΔf), where λ is a parameter related to the privacy budget.

[0054] Through the data desensitization algorithm, certain sensitive information is deformed according to the desensitization rules to achieve reliable protection of sensitive privacy data, prevent the abuse of privacy data within the enterprise and the outflow of privacy data from the enterprise without desensitization, and meet the enterprise's needs for protecting privacy data.

[0055] The permission service performs permission management according to the security rules or security policies set by the system to ensure that users can only access the resources they are authorized to access.

[0056] The following describes the specific application scenarios of the system.

[0057] The system first builds a government decision-making analysis database. Based on the State Grid data center and State Grid's outsourced data sources, it uses multi-source data fusion technology to carry out internal and external data fusion processing by field, and develops a decision-making data thematic database, including a macroeconomic database, a key industry development database, and a key enterprise directory database.

[0058] The decision-making data database provides functions such as retrieval, index viewing, saving to the analysis workbench, exporting, and visual display of macro data, technical reports, papers, monographs, standards, news information, etc. Figure 2 and 3 shown.

[0059] The decision-making data database includes a macroeconomic database indicator management module, which supports the entry, editing, and deletion of national macroeconomic indicator trees, regional macroeconomic indicator trees, and industry indicator trees. Figure 4 shown.

[0060] The decision-making data library includes a report generation module that supports text format editing, chart search, insertion, report saving and other operations. Figure 5 shown.

[0061] The system provides the platform data service opening function. It provides data catalog, data information, data application and other functions for target customers, so that customers can intuitively understand the data catalog that has been integrated into the platform. The interface is shown as follows Figure 6 shown.

[0062] The system provides a visualization function for the platform application results. It provides relationship thematic maps for government users and provides multiple model applications such as real estate enterprise cluster identification model, electricity consumption trend similarity model, enterprise operation status identification model, construction status change warning model, macroeconomic development model, etc. The interface display is as follows Figure 7 shown.

[0063] The intelligent tools in the system provide user profile matching tools to improve data processing capabilities. They also provide industry knowledge base construction functions, which can manage power-related administrative regulations data, standard specification data, foreign literature data, national and local government economic data, and real estate enterprise data. After uploading relevant data through the above functions, it can be published, and after approval, it can be put on and off the shelves. The interface is shown as follows Figure 8 and 9 shown.

[0064] The specific analysis process of the micro-enterprise prosperity index is as follows:

[0065] (1) Input the financial statements, operating data, and macroeconomic data released by the government of small and micro enterprises;

[0066] (2) First, preprocess and standardize the data; second, select a suitable algorithm (such as weighted average method) for calculation; finally, derive the micro-enterprise prosperity index based on the calculation results;

[0067] (3) The index value obtained reflects the economic vitality and development status of small and micro enterprises, which can be used to compare the degree of prosperity at different time points.

[0068] The specific analysis process of real estate risk monitoring and analysis is as follows:

[0069] (1) Input real estate market transaction data, price trends, policy changes, etc.

[0070] (2) First, preprocess the data and extract features; second, select a suitable machine learning algorithm for training and prediction; finally, evaluate the stability and potential risks of the real estate market based on the prediction results.

[0071] (3) Obtain an assessment report that reflects the stability and potential risks of the real estate market, including market trend forecasts and risk point identification.

[0072] The system includes a personalized user demand submission module, which provides data demand, platform experience, data error correction and consulting services. The data demand module collects customer demand, approves demand and feedback online and records them. Users can make optimization and improvement suggestions for the platform functions, and the administrator will answer them based on the suggestions. The interface is shown below: Fig.10 shown.

[0073] In order to protect the stored data from unauthorized access, the data is stored in encrypted form, for example, using a symmetric encryption algorithm (such as AES) or an asymmetric encryption algorithm (such as RSA).

[0074] During the data transmission process, in order to ensure the security of the data, it is necessary to use encryption transmission technology to encrypt and authenticate the data during the data transmission process to ensure that the data is not eavesdropped or tampered with during the transmission process.

[0075] The encryption algorithm first obtains two large prime numbers p and q, as well as the modulus n and Euler function calculated from them. The RSA encryption and decryption process is as follows:

[0076] 1. Calculate the public modulus n = p*q based on p and q;

[0077] 2. Calculate Euler function

[0078] 3. Calculate the public key e so that e takes an integer and e and mutually prime;

[0079] 4. Calculate the private key d so that

[0080] 5. Encryption phase: Calculate the ciphertext C=M based on the plaintext M e (mod n).

[0081] Decryption phase, calculate M = C d (mod n).

[0082] The beneficial effect of the present invention is that, compared with the prior art, the present invention provides a government decision-making support platform based on big data technology, which integrates high-value external data from multiple parties, jointly cultivates high-quality products and service capabilities, forms a systematic and normalized research mechanism, reporting mechanism and digital support capability for government departments, and builds a digital government service capability system that is jointly built, shared and created. The main technical effects include:

[0083] 1. Build a unified service platform to support government policy research: Build a decision-making data database, open services, application results management, partner workbench, service center, intelligent tools and other functions, and use the accumulated data products to build a platform-based, systematic, and normalized demand analysis, data service capabilities and a unified external service platform.

[0084] 2. Build a safe and efficient data fusion application system: Based on point-to-point connection of dedicated network, supporting privacy computing, data desensitization, permission management, encrypted storage, encrypted transmission and other technical means, to ensure that power data and industry data can be circulated, integrated and applied in a relatively closed, safe and efficient environment.

[0085] 3. Build a decision-making capability system: The company can rely on the government decision-making support platform to report relevant analysis results such as the small and micro business climate index and real estate risk monitoring on demand or regularly, optimize macroeconomic monitoring and risk monitoring, support policy research and decision-making support, and provide visualization services through various forms such as monitoring display large screens, providing decision-making analysis support for various departments in multiple dimensions.

[0086] Based on the spirit of the present invention, those skilled in the art can easily think that a computer program product can be obtained based on the aforementioned government decision support platform based on big data technology. The computer program product may include a computer-readable storage medium on which computer-readable program instructions for enabling a processor to implement various aspects of the present disclosure are loaded. That is, the present application also includes a terminal, including a processor and a storage medium; the storage medium is used to store instructions; the processor is used to operate according to the instructions to execute the steps of the aforementioned government decision support platform based on big data technology.

[0087] Computer readable storage medium can be a tangible device that can keep and store the instructions used by the instruction execution device. Computer readable storage medium can be, for example, - but not limited to - electrical storage device, magnetic storage device, optical storage device, electromagnetic storage device, semiconductor storage device or any suitable combination of the above. More specific examples (non-exhaustive list) of computer readable storage medium include: portable computer disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, for example, punch card or groove protrusion structure with instructions stored thereon and any suitable combination of the above. Computer readable storage medium used here is not interpreted as instantaneous signal itself, such as radio wave or other free propagating electromagnetic wave, electromagnetic wave propagated by waveguide or other transmission medium (for example, light pulse by optical fiber cable) or electrical signal transmitted by wire.

[0088] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0089] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages-such as Smalltalk, C++, etc., and conventional procedural programming languages-such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network-including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA) may be personalized by utilizing the state information of a computer-readable program instruction, and the electronic circuit may execute a computer-readable program instruction, thereby realizing various aspects of the present disclosure.

[0090] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents, and any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A government decision-making support platform based on big data technology, characterized in that: The following steps are involved: The data layer is used to integrate power data and industry data in multiple dimensions, build structured database clusters, unstructured data storage systems, full-text search data storage, and cache data storage; The data analysis layer is used to build a multi-dimensional comprehensive analysis theme achievement support model based on the multi-dimensional data fused by the data layer, including a decision-making data thematic library, a real estate analysis model, an enterprise operation analysis model, and an industry analysis model; The service layer is used to adopt a variety of microservice architectures to provide government decision-making support channel services and continuously and dynamically monitor risks. The microservices include gateway services, user front desk services, product services, monitoring services, search services, file services, permission services, intelligent tool services, service management services, scheduled task services, and decision analysis services; The presentation layer is used to visually export and display the analysis results using a variety of interface presentation technologies.

2. The government decision-making support platform based on big data technology according to claim 1 is characterized in that: The decision-making data database includes a macroeconomic database, a key industry development database, and a key enterprise directory database.

3. The government decision-making support platform based on big data technology according to claim 2 is characterized in that: The government decision support platform adopts SG-UAP 3.0 development platform, Tomcat 8.5.57 middleware, MySQL 5.7 / State Grid Cloud Component RDS V5.7 database.

4. The government decision support platform based on big data technology according to claim 3 is characterized in that: The various interface presentation technologies include Html5, JavaScript, Vue / Element, JQuery, Echarts front-end components and report components.

5. The government decision support platform based on big data technology according to claim 4 is characterized in that: The decision-making data database is used to provide retrieval and index viewing of macro data, technical reports, papers and monographs, standards and specifications, and news information data, and save them to the analysis workbench, export them, and display them visually.

6. The government decision-making support platform based on big data technology according to claim 5 is characterized in that: The industry data include electricity-related administrative regulations data, standard specification data, foreign literature data, economic data published by the national and local governments, and real estate enterprise data.

7. The government decision-making support platform based on big data technology according to claim 6 is characterized in that: The decision-making data database includes a report generation module, which is used to edit the text format, search, insert and save charts in reports.

8. The government decision-making support platform based on big data technology according to claim 7 is characterized in that: The government decision-making support platform is further used to circulate and record customer demand collection, demand approval and feedback online, receive users' optimization and improvement suggestions for the platform's functions, and administrators provide answers based on the suggestions.

9. A terminal comprising a processor and a storage medium; characterized in that: The storage medium is used to store instructions; The processor is used to operate according to the instructions to implement the government decision support platform based on big data technology according to any one of claims 1-8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, it implements the government decision-making support platform based on big data technology as described in any one of claims 1 to 8.

Images