Port market mining analysis and management method and system
Through the construction of data integration, standardization and multi-dimensional data models, the problems of cross-departmental data sharing and low efficiency in port market mining and analysis are solved, efficient market analysis and prediction are achieved, and scientific decision-making basis is provided.
Patent Information
- Application Number
- CN202411412071.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-11
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing port market mining and analysis methods lack a cross-departmental data sharing system, low statistical analysis efficiency, unable to adapt to business changes, and lack deep data analysis and prediction capabilities, resulting in the market mining and analysis process relying on manual statistics and historical data.
Through data integration, standardization, multi-dimensional data model construction, data governance and visual presentation, cross-departmental statistics and in-depth analysis are realized, market mining special reports are formed, and multi-dimensional data analysis and prediction are supported.
It improves the real-time, efficiency and interactivity of market mining and analysis, provides scientific decision-making basis, realizes in-depth data mining and analysis, and supports business management and decision-making.
Smart Images

Figure CN118941328A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of port market analysis, and in particular to a port market mining analysis and management method and system thereof. Background Art
[0002] Port market mining can help ports identify potential market opportunities and gain a deeper understanding of consumer needs, preferences, and purchasing behaviors. It can also comprehensively assess market competition and predict future market trends. However, current port market mining analysis relies on manual data collection and aggregation based on decentralized transactional business system data. This lacks a market mining analysis business processing process and platform, and there is no subsequent business support for analytical indicators. Existing statistical analysis techniques for market mining analysis suffer from the following issues: 1. The lack of a shared exchange system makes it impossible to support cross-departmental statistics. Statistical data is stored in multiple business departments and systems. The lack of a cross-departmental shared exchange system leads to low efficiency in market mining, analysis, summary and processing.
[0003] 2. The statistical analysis process is simple and lacks a quick configuration method for statistical analysis, resulting in an inability to adapt to business changes and the diversity of business needs. The existing business system cannot provide systematic statistical analysis capabilities, resulting in a long analysis cycle and poor timeliness.
[0004] 3. The current business system lacks the ability to build thematic and special databases, and lacks the tools and capabilities to analyze and mine the value of massive data. It is unable to convert data into information and knowledge, and provide the ability to provide in-depth analysis, early warning and forecasting of the business. As a result, the corresponding market mining and analysis process and decision-making can only rely on historical statistical data or personal experience.
[0005] Therefore, there is a need for a port market mining analysis and management method and system that can collect market mining index data across departments, has strong real-time performance, high efficiency and strong interactivity. Summary of the Invention
[0006] In order to solve the defects of existing market mining and analysis methods that rely on manual data statistics and analysis, have poor real-time performance, low efficiency, and poor interactivity, the present invention provides a port market mining analysis and management method and system that can collect market mining indicator data across departments, has strong real-time performance, high efficiency, and strong interactivity.
[0007] The port market mining, analysis and management method of the present invention comprises the following steps: S1. Integrate market mining dimension data scattered across various transactional business systems; S2. Standardize the integrated market mining dimension data; S3. Construct a multidimensional data model and a data mining data model for the standardized market mining dimension data; S4. Conduct comprehensive data governance on the standardized market mining dimension data; S5. Visualize the market mining dimension data after comprehensive data management; S6. Conduct multidimensional data analysis, data mining analysis and prediction on the market mining dimension data after comprehensive data management; S7. Conduct special market mining dimension data analysis on market mining indicators and form a special market mining data analysis report to achieve business management.
[0008] The beneficial effects of adopting the above technical solution are: Through multi-dimensional analysis of statistical forecasts of market mining analysis and thematic analysis models and analysis processes of market mining reports; it has strong data mining and analysis capabilities, can conduct in-depth mining and analysis of large amounts of business data, and provide enterprises with scientific and reasonable decision-making basis.
[0009] Furthermore: in S1, the data integration is to obtain the market mining dimension data of each transactional business system, and perform corresponding data type conversion according to the data type of the market mining dimension data.
[0010] Further: in S2, the data standardization is to standardize the integrated market mining indicator data according to the preset business management requirements and specifications, establish a unified market mining indicator data standard system, and formulate market mining indicator data standards at the same time. The market mining indicator data standards include data classification standards, metadata management standards, data exchange standards and / or data quality management standards.
[0011] Furthermore: in S3, the multidimensional data model construction is designed based on the market mining dimensions and market mining indicators completed based on data governance.
[0012] Further: in S4, the comprehensive data governance includes data quality governance, data security management and metadata management, and the data quality governance, data security management and metadata management respectively perform comprehensive data governance according to corresponding data standards.
[0013] Further: in S6, the multidimensional data analysis includes drilling, slicing, dicing, rotating and / or filtering; the slicing of the multidimensional data analysis is performed by data analysis in the form of data charts.
[0014] Further: in S7, the thematic analysis model of the thematic analysis of the market mining dimension data includes a market mining customer analysis model and a market mining transaction factor analysis model; The market mining customer analysis model is used to provide a comprehensive analysis scenario for the target customers of market mining based on the market mining dimension data; The market mining transaction factor analysis model is used to analyze the market mining benefits based on market mining dimension data.
[0015] Further: in S7, the market mining special data analysis report is used to summarize and integrate all data analysis models to form a report, complete the closed-loop management of the market mining analysis business, and support special report push, browsing and / or sharing operations.
[0016] The beneficial effects of adopting the above technical solution are: Through the management of market mining and analysis special reports and the business closed-loop process, data analysis is accurate and in-depth, and the analysis dimensions are comprehensive.
[0017] The port market mining analysis and management system described in the present invention includes a data center and a data analysis management system. The data center is used to interact and coordinate market mining dimension data in various business systems, and the data analysis management system is used to analyze and manage market mining dimension data. The data center platform includes a basic platform and a data governance platform. The data governance platform includes a metadata management module, a data integration development module, a data standardization module, and a multi-dimensional market mining indicator data model. The basic platform is used to obtain market mining dimension data from various transactional business systems and collect it into the basic data base of the data center; The metadata management module is used to manage the customer information dimension data business system and data model, as well as the indicator data business system and data model corresponding to the customer information dimension data; The data integration development module is based on the data governance platform, collects and synchronizes data from business systems and external platforms, collects market mining dimension data scattered in business systems and files into the basic data base of the data center, and converts data types; The data standardization module is used to sort out the integrated market mining indicator data according to the business management requirements and corresponding data specifications, establish a unified market mining indicator data standard system, and formulate market mining indicator data standards; The multi-dimensional market mining indicator data model is used to complete the design of the data model according to the data application requirements of the customer value analysis indicators and output the corresponding customer value analysis data model.
[0018] The beneficial effects of adopting the above technical solution are: The capabilities of big data processing and data governance for market mining and analysis related data include data integration, specification design, data development, data storage, metadata management, data asset management, data openness, and data security management; it can automatically integrate various business processes, reduce the time and cost of manual operations, thereby improving work efficiency and achieving a high level of automation.
[0019] Furthermore: the market mining indicator data standards include data classification standards, metadata management standards, data exchange standards and data quality management standards.
[0020] The beneficial effects of the present invention are: This paper provides a system and method for managing market mining and analysis based on big data processing technology. This system enables rapid and effective market mining and analysis, and features a well-designed platform interface, addressing the shortcomings of traditional businesses that lacked a market mining and analysis process. The statistical analysis capabilities based on big data and data governance address the real-time, efficiency, and interactivity limitations of traditional data processing methods, assisting companies in managing statistical forecasts of market mining and analysis indicators, thereby improving management efficiency and business processing capabilities for these indicators.
[0021] After conducting a customer analysis process for market exploration, strategies can be developed based on the analysis results (such as reducing rates) to improve customer retention and explore new customers. After analyzing transaction factors, strategies can be developed (such as targeted reductions in inventory time) to improve market inventory turnover, with the goal of improving customer satisfaction. The analysis content can be synthesized into a report and submitted to the market management department for effective management decision-making.
[0022] The present invention has the following advantages: 1. Fast processing speed: The system architecture adopts big data technology to reasonably schedule data calculations and adopts effective data analysis technology to quickly process corresponding statistical forecasting and other businesses; 2. Good user experience: The system supports multiple terminals, supports real-time visualization at all levels, and provides effective and intuitive interaction methods; 3. High flexibility: The analysis model can be flexibly created and configured according to the actual situation of the enterprise. The system adopts a layered design, which is easy to deploy, implement, upgrade and maintain. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1 It is a flowchart of the port market mining analysis and management method; Figure 2 The development interface diagram of each layer is completed based on the data platform; Figure 3 This is an example diagram of slice analysis for visualization and data analysis; Figure 4This is an example diagram of the comprehensive model of transaction factors. DETAILED DESCRIPTION
[0024] The following are only preferred specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or replacements that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the scope of protection of the present invention. The embodiments described below are only used to explain the present invention and cannot be interpreted as limiting the present invention. The scope of protection of the present invention should be based on the scope of protection of the claims. The embodiments of the present invention are described in detail below. In order to facilitate the description of the present invention and simplify the description, the technical terms used in the description of the present invention should be interpreted broadly, including but not limited to conventional replacement schemes not mentioned in this application, and also including direct implementation and indirect implementation.
[0025] Example 1 Combine Figures 1-4 This embodiment describes a port market mining, analysis, and management method disclosed in this embodiment, including the following steps: S1. Integrate market mining dimension data scattered across various transactional business systems; S2. Standardize the integrated market mining dimension data; S3. Construct a multidimensional data model and a data mining data model for the standardized market mining dimension data; The construction process of the multidimensional data model and the data mining data model is as follows: For example, when designing a "multi-dimensional analysis of market customers" model, dimension tables are designed based on different dimensions of customers, including "customer type, business segment, order type, logistics type", etc., and fact tables are designed based on key business indicators such as "throughput, order volume". For example, the "order fact table" design includes fields such as "customer type, business segment, order type, order volume".
[0026] The design of data mining models is mainly based on the application of market mining analysis, and the model design on the application side is carried out. For example, for the "transaction sensitive factor analysis" of market mining analysis applications, the application fields need to include "cost impact classification, impact coefficient, cost value" and so on.
[0027] S4. Conduct comprehensive data governance on the standardized market mining dimension data; S5. Visualize the market mining dimension data after comprehensive data management; S6. Conduct multidimensional data analysis, data mining analysis and prediction on the market mining dimension data after comprehensive data management; S7. Conduct special market mining dimension data analysis on market mining indicators and form a special market mining data analysis report to achieve business management.
[0028] The multidimensional data analysis process is to directly configure the required dimensions and corresponding indicators based on the designed multidimensional model in the data application analysis system to conduct analysis, and quickly and flexibly generate corresponding graphics, reports and other presentation content.
[0029] The data mining analysis process is to present the results of the corresponding data mining algorithm through the data application system. For example, in the above-mentioned "cost factor analysis" process, the "cost influencing factors" component data is calculated through the clustering algorithm of the sample data, and then presented in the form of graphics of the data application system for analysis and use.
[0030] This embodiment mainly provides a thematic model for market mining analysis and management of corresponding thematic data analysis reports. A closed-loop system for thematic market mining analysis is provided. According to business operation and management requirements, the data and business objects of market mining analysis are analyzed and summarized thematically, and conclusions on business development problems and improvement directions are given, as well as optimization and improvement suggestions. The statistical forecasting and business processing of market mining analysis indicators include the construction of a platform with market mining analysis capabilities, a data analysis application system with unified standards, unified management, and unified services. The thematic data analysis of the market mining dimension is achieved through the market mining thematic analysis model.
[0031] The market mining thematic analysis model includes the following data models and analysis processes: (1) Market mining customer analysis model, relying on the data analysis application system, provides a comprehensive analysis scenario for the target customer situation of market mining; Existing customer situation: Comprehensive analysis indicators, customer segmentation (identify important customers based on customer value analysis), retained volume (monitor throughput and consumption loss through the data application system, and set early warnings to ensure retained volume), and incremental business expansion (set business growth rules and analyze business expansion effects through the data application system).
[0032] New business mining situation: order information, business segment information (use data analysis charts of these two pieces of information to confirm weakly related business links, and subsequently use management means to mine new business in the market).
[0033] New customer mining: business segment information (same as above, confirm the growth of new customers through the data application system of this information segment).
[0034] (2) Market mining transaction factor analysis model, providing a comprehensive transaction factor model based on the market mining efficiency. The model verification direction includes cost sensitivity, efficiency sensitivity, quality sensitivity and service sensitivity factor analysis.
[0035] Cost sensitivity: cost impact (cost type, inventory, transportation type), customer quotation.
[0036] Efficiency sensitivity: impact of operation time, operation efficiency, and efficiency-cost ratio.
[0037] Quality sensitive: delivery quality, order fulfillment.
[0038] Service sensitivity: customer satisfaction, value-added services, and service composition.
[0039] Managers can analyze the weight ratios of the above sensitive factors to identify factors that affect market transactions, and then formulate suggestions to improve transactions, such as Figure 3 As shown, the following suggestions can be made as examples: it is recommended to reduce rates to reduce costs; it is recommended to reduce inventory time to reduce costs; it is recommended to give away inventory time and other supporting services; it is recommended to use water and rail transportation to reduce transportation costs, etc.
[0040] The market mining special data analysis report is based on the data application system, which summarizes and integrates the above-mentioned market mining customer analysis model and market mining transaction factor analysis model to form a report, completes the closed-loop management of market mining analysis business, provides the ability to push special reports to corresponding managers and business personnel for browsing and sharing, and provides business analysis operations for business personnel based on special reports.
[0041] Reports can have the following capabilities: (1) The underlying data of the data analysis report is provided by the data middle platform system, which guarantees two aspects: first, the data analysis models in the market mining analysis report can be generated effectively and quickly; second, the timeliness of the market mining analysis is guaranteed, and the data analysis report can be generated directly in real time based on the current situation; (2) The analysis report provided by the data application system has editing and configuration functions. The size, background color, background image, theme style and other contents of the report can be adjusted at will. Various data analysis models in the report can be generated with parameter settings according to business requirements. Subsequent report maintenance can be carried out based on templates; (3) The ultimate management goal of the report is to generate a document for push. At the same time, managers who receive the data analysis report can further share and subscribe to it, supporting all aspects of market exploration and decision-making.
[0042] Example 2 This embodiment is described in conjunction with Example 1. This embodiment discloses a port market mining analysis and management system, including a data center and a data analysis management system. The data center is used to interact and coordinate market mining dimension data in various business systems, and the data analysis management system is used to analyze and manage market mining dimension data. The data center platform includes a basic platform and a data governance platform. The data governance platform includes a metadata management module, a data integration development module, a data standardization module, and a multi-dimensional market mining indicator data model. The basic platform is used to obtain market mining dimension data from various transactional business systems and collect it into the basic data base of the data center; The metadata management module is used to manage the customer information dimension data business system and data model, as well as the indicator data business system and data model corresponding to the customer information dimension data; The data integration development module is based on the data governance platform, collects and synchronizes data from business systems and external platforms, collects market mining dimension data scattered in business systems and files into the basic data base of the data center, and converts data types; The data standardization module is used to sort out the integrated market mining indicator data according to the business management requirements and corresponding data specifications, establish a unified market mining indicator data standard system, and formulate market mining indicator data standards; The multi-dimensional market mining indicator data model is used to complete the design of the data model according to the data application requirements of the customer value analysis indicators and output the corresponding customer value analysis data model.
[0043] In order to achieve the above goals, we first provide a data middle-office system. The data middle-office system provides a unified data base for the horizontal data interaction and collaboration of various business systems of the port. Through the basic platform and data governance platform, it realizes data collection, data governance, data storage, data sharing and exchange, data management, data services and other data services, and realizes the unified management of data tools.
[0044] The data middle platform is used to perform data governance on the indicator-related data of this embodiment. The data governance process includes data integration, specification design, data development, data storage, metadata management, data asset management, data openness, data security management and other processes, and an integrated and highly integrated data governance platform tool system is provided through the data middle platform.
[0045] The metadata management module is a crucial source of data knowledge. Metadata management encompasses the entire data collection, processing, storage, and governance process, managing the entire process of metadata creation, description, presentation, integration, and control. This provides the foundation for metadata-based data processing, governance, and sharing. The data in this example is targeted at market mining analysis. Specifically, metadata management encompasses the customer information dimension data business system and model, as well as the corresponding indicator data business system and model (such as cost, operational efficiency, and customer satisfaction).
[0046] Data development capabilities provide low-threshold drag-and-drop configuration data orchestration services, supporting big data processing scenarios such as data integration, batch processing, and policy orchestration, enabling business personnel to quickly develop their own big data applications. The actual business of data development completes the processing of market mining dimension data and the corresponding analytical indicator data (cost, operating efficiency, customer satisfaction, etc.) from the business system to the ODS layer, then to the CDM layer, and then to the ADS layer. The development interface of each layer is completed according to the data platform. Figure 1 shown.
[0047] Figure 2 It also represents the processing of data integration. Data integration is based on the data governance platform. It collects and synchronizes data from business systems and external platforms, collects market mining indicator data scattered in business systems and files into the basic data base of the data middle platform, and performs necessary conversions on data types to prepare for subsequent data processing, mining, and application. The integration platform can provide visual orchestration, and integrated business development adopts interface orchestration to reduce code development. It supports real-time monitoring of integration tasks, supports reporting or alarming of the execution process and results of integration tasks, and provides data integrity check reports. It can support the access of multiple third-party data sources such as MySQL, Oracle and other databases, and file data collection in CSV / XM / JSON formats. Data integration refers to the business process, which solves the processing of multiple business systems and multiple data types. Data development usually refers to the technical implementation of data integration.
[0048] The data standards and data planning process involves organizing integrated market mining indicator data according to the management requirements of each business and corresponding data specifications, establishing a unified market mining indicator data standard system, and formulating standards for market mining indicator data classification, metadata management, data exchange, and data quality management to effectively ensure data quality. Data standards and planning capabilities support functions such as data planning, custom data models, unified data standards, visual data modeling, and data labeling. They connect the data governance chain from the data source to the standard layer and application layer, and implement data standards and data assets. Data standardization is achieved through relational modeling and dimensional modeling; the indicator system is standardized through indicator construction, eliminating ambiguity, unifying the caliber, and unifying the calculation logic, and providing thematic data query and mining services to the outside world.
[0049] Provide a multi-dimensional market mining indicator data model that meets the general data governance process hierarchy. The layers include the operational data layer (ODS layer), the common dimension data layer (CDM layer), and the data application layer (ADS layer). Based on the data application requirements of the market mining and analysis indicators, and taking into account factors such as query delay and concurrency of data access, the data model design is completed, including the data model (conceptual, logical, physical), mapping relationship, and the corresponding market mining and analysis data model is output.
[0050] Through the data governance platform, market mining indicator data included in the business is cleansed, integrated, and confirmed, forming data assets related to market mining indicators. This platform provides unified data asset management, externally visualizes market mining indicator data assets, and enables data consumers to quickly search, view, and subscribe to various data assets. It also supports cataloging different types of metadata and data. It provides rich data openness capabilities and enables open sharing of data within the data service platform.
[0051] Data security management provides a comprehensive data security strategy to carry out data permission control, sensitive data desensitization, and data classification and grading management, etc., to ensure the storage security and access security of data during its life cycle.
Claims
1. A port market mining analysis and management method, characterized in that: The steps include: S1. Integrate the market mining dimension data scattered in various transactional business systems; S2. Standardize the integrated market mining dimension data; S3. Construct multidimensional data model and data mining data model for the standardized market mining dimension data; S4. Conduct comprehensive data management on the standardized market mining dimension data; S5. Visualize the market mining dimension data after comprehensive data management; S6. Conduct multidimensional data analysis, data mining analysis and prediction on the market mining dimension data after comprehensive data management; S7. Conduct thematic analysis of market mining dimension data on market mining indicators, and form a market mining thematic data analysis report to achieve business management.
2. A port market mining analysis and management method according to claim 1, characterized in that: In S1, the data integration is to obtain the market mining dimension data of each transactional business system, and perform corresponding data type conversion according to the data type of the market mining dimension data.
3. A port market mining analysis and management method according to claim 1, characterized in that: In S2, the data standardization is to standardize the integrated market mining indicator data according to the preset business management requirements and specifications, establish a unified market mining indicator data standard system, and formulate market mining indicator data standards. The market mining indicator data standards include data classification standards, metadata management standards, data exchange standards and / or data quality management standards.
4. A port market mining analysis and management method according to claim 1, characterized in that: In S3, the multidimensional data model construction is designed based on the market mining dimensions and market mining indicators completed based on data governance.
5. A port market mining analysis and management method according to claim 1, characterized in that: In S4, the comprehensive data governance includes data quality governance, data security management and metadata management, and the data quality governance, data security management and metadata management respectively perform comprehensive data governance according to corresponding data standards.
6. A port market mining analysis and management method according to claim 1, characterized in that: In S6, the multidimensional data analysis includes drilling, slicing, dicing, rotating and / or filtering; the slicing of the multidimensional data analysis performs data analysis in the form of data charts.
7. A port market mining analysis and management method according to claim 1, characterized in that: In S7, the thematic analysis model of the thematic analysis of the market mining dimension data includes a market mining customer analysis model and a market mining transaction factor analysis model; The market mining customer analysis model is used to provide a comprehensive analysis scenario for the target customer situation of market mining based on the market mining dimension data; The market mining transaction factor analysis model is used to analyze the market mining benefits based on market mining dimension data.
8. A port market mining analysis and management method according to claim 1, characterized in that: In S7, the market mining special data analysis report is used to summarize and integrate all data analysis models to form a report, complete the closed-loop management of the market mining analysis business, and support special report push, browsing and / or sharing operations.
9. A port market mining analysis and management system, characterized in that: It includes a data center and a data analysis management system. The data center is used to interact and coordinate the market mining dimension data in each business system. The data analysis management system is used to analyze and manage the market mining dimension data. The data middle platform includes a basic platform and a data governance platform, and the data governance platform includes a metadata management module, a data integration development module, a data standardization module and a multi-dimensional market mining indicator data model; The basic platform is used to obtain market mining dimension data in each transactional business system and collect it into the basic data base of the data center; The metadata management module is used to manage the customer information dimension data business system and data model, as well as the indicator data business system and data model corresponding to the customer information dimension data; The data integration development module is based on the data governance platform, collects and synchronizes data from business systems and external platforms, collects market mining dimension data scattered in business systems and files into the basic data base of the data center, and converts data types; The data standardization module is used to sort out the integrated market mining indicator data according to the business management requirements and corresponding data specifications, establish a unified market mining indicator data standard system, and formulate market mining indicator data standards; The multi-dimensional market mining indicator data model is used to complete the design of the data model according to the data application requirements of the customer value analysis indicators, and output the corresponding customer value analysis data model.
10. A port market mining analysis and management system according to claim 9, characterized in that: The market mining indicator data standards include data classification standards, metadata management standards, data exchange standards and data quality management standards.
Citation Information
Patent Citations
Automatic excavation system for analogous customer groups
CN102163205A
OLAP multi-dimensional analysis and data mining system
CN107704608A
A multi-source data multi-dimensional reconstruction method for service market access requirements
CN109145031A
Data visualization method based on OLAP system
CN113157191A
Big data experiment system for science and technology service
CN115309749A
