Data mining method based on set coverage model

Abstract

The invention provides a data mining method based on a set coverage model, which comprises the following steps: presenting a graphical user interface with a plurality of set image nodes on user computing equipment through operation of a computer, each set image node being associated with a basic attribute data set; according to a predefined interface protocol of the set coverage model, performing one-to-one mapping on the basic attribute data set and an element subset participating in execution of logical operation in the set coverage model through operation of a computer, and receiving a user command for setting a logical operation condition through a predefined interface, and displaying the result set of the logical operation to a user through a graphical user interface. According to the method, the optimization advantages of the set coverage model can be combined, the operation process is simplified, the data processing efficiency is improved, and the requirement for flexible integration of multi-source data is met.

Description

Technical Field

[0001] The invention belongs to the technical field of communications and relates to a data mining method based on a set covering model. Background Art

[0002] With the rapid growth of data volume and increasing complexity, how to effectively extract valuable information from massive multi-source data has become a major challenge facing current data mining technology. Existing data mining methods mostly rely on complex programming and algorithm design, and the operation threshold is high. It is especially difficult for users without programming background to use these tools. In addition, traditional data mining technology lacks flexibility and efficiency when processing multidimensional data and multi-source data. Most existing methods use fixed data structures and predefined query statements, which makes the operation complicated and inefficient when facing dynamically changing data sources.

[0003] The set covering model is a set-based optimization algorithm that has been successfully applied in fields such as logistics scheduling and facility site selection. However, it has not been widely used in the field of data mining, especially in visualization operations, data modeling and query optimization, where there are still technical gaps.

[0004] Therefore, how to provide a data mining method based on a set covering model is an urgent problem that those skilled in the art need to solve. Summary of the invention

[0005] In view of this, the present invention proposes a data mining method based on a set covering model, which can combine the optimization advantages of the set covering model, simplify the operation process, improve data processing efficiency, and adapt to the flexible integration requirements of multi-source data.

[0006] In order to achieve the above object, the present invention adopts the following technical solution:

[0007] The present invention discloses a data mining method based on a set covering model, comprising the following steps:

[0008] Presenting a graphical user interface having a plurality of set image nodes on a user computing device through the operation of a computer, wherein each of the set image nodes is associated with a basic attribute data set;

[0009] According to the predefined interface protocol of the set coverage model, the basic attribute data set is mapped one-to-one with the subset of elements in the set coverage model that participate in performing logical operations through computer operation, and user commands for setting logical operation conditions are received through the predefined interface, and the result set of the logical operation is displayed to the user through the graphical user interface.

[0010] Preferably, the collection image node is presented in the graphical user interface with a specified shape outline; and further comprises the step of receiving a user command for setting a basic attribute data set corresponding to the collection image node:

[0011] A click operation of the user on the shape outline corresponding to the set image node is received, and a setting instruction box of the corresponding basic attribute data set is triggered to start, and the setting instruction box of the basic attribute data set is used to receive the basic attribute data input by the user.

[0012] Preferably, the collection image node is presented in the graphical user interface with a specified shape outline; the result set of the logical operation is displayed to the user, including: the shape outline of the collection image after the operation is obtained by changing the shape outline corresponding to the collection image node.

[0013] Preferably, the graphical user interface has a data set definition area and a data set operation area;

[0014] The data set definition area is used to display the plurality of set image nodes to the user, and receive a drag operation from the user to move the set image nodes to the data set operation area;

[0015] The data set operation area is used to display the dragged set image node and the result set of the logical operation to the user.

[0016] Preferably, the basic attribute data set includes at least one or more of the following: data to be mined having a data range, and data to be mined having a data field.

[0017] Preferably, the graphical user interface has a logic operation relationship tool area for receiving a user command for setting a logic operation condition; the step of receiving a user command for setting a logic operation condition comprises:

[0018] A click operation of the user on the logic operation relationship tool area is received, and the setting instruction box of the logic operation condition is triggered to start. The setting instruction box of the logic operation condition is used to receive the logic operation condition input by the user.

[0019] Preferably, the logic operation includes: intersection operation, union operation, complement operation between element subsets or screening of basic attribute data.

[0020] Preferably, displaying the result of the logical operation to the user includes: receiving a click operation of the user on the result set on the graphical user interface, triggering the start of a corresponding detailed result view, including a table, a distribution diagram and / or a logical operation condition.

[0021] The present invention also provides a data mining system according to the data mining method based on the set covering model, comprising:

[0022] A visualization display module, used for presenting a graphical user interface having a plurality of set image nodes on a user computing device through computer operation, wherein each of the set image nodes is associated with a basic attribute data set;

[0023] The set logic definition module is used to perform a one-to-one mapping between the basic attribute data set and the element subset participating in the logical operation in the set coverage model through computer operation according to the predefined interface protocol of the set coverage model, receive the user command for setting the logical operation condition through the predefined interface, obtain the result set of the logical operation, and send it to the visualization display module through the predefined interface, and display the result set of the logical operation to the user through the graphical user interface.

[0024] The present invention also provides a user computing device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the data mining method based on the set covering model when executing the program.

[0025] It can be seen from the above technical solution that, compared with the prior art, the beneficial effects of the present invention include:

[0026] The present invention combines the operation characteristics of the intersection, union, complement, etc. of the set covering model to develop a graphical visualization operation method, so that users do not need to write complex query statements, but can intuitively complete data modeling, data association and analysis operations through simple drag and selection, thereby greatly reducing the technical threshold and allowing non-professional users to quickly get started and use it efficiently, with good user-friendliness.

[0027] The present invention provides powerful real-time interactive capabilities, and users can adjust set definitions or logical relationships at any time and obtain updated analysis results instantly. This flexibility makes the data analysis process more intuitive and efficient, and is suitable for changing data scenarios.

[0028] The data mining process of the present invention is displayed graphically, so that users can quickly understand the data logic and analysis results, avoiding the complexity of tables and text results in traditional tools. At the same time, the operation results of the set coverage model are presented in a graphical way, which becomes simpler and more intuitive, further improving the user experience.

[0029] The present invention has strong versatility and expansibility, can provide more efficient and real-time analysis capabilities in scenarios with massive data, and can be widely used in multiple fields such as data analysis, report statistics, and business intelligence. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below. Obviously, the drawings in the following description are only embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on the provided drawings without creative work.

[0031] Figure 1 A schematic diagram of a data mining method based on a set covering model provided by an embodiment of the present invention;

[0032] Figure 2 A schematic diagram of the visualization operation of the set coverage model provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] like Figure 1 As shown, the embodiment of the present invention provides a data mining method based on a set covering model, comprising the following steps:

[0035] Presenting a graphical user interface having a plurality of set image nodes on a user computing device through the operation of a computer, wherein each set image node is associated with a basic attribute data set;

[0036] According to the predefined interface protocol of the set covering model, the basic attribute data set is mapped one-to-one with the element subset participating in the logical operation in the set covering model through computer operation, and the user command for setting the logical operation conditions is received through the predefined interface, and the result set of the logical operation is displayed to the user through the graphical user interface.

[0037] It should be noted that the basic attributes of the collection image node are defined and passed to the collection coverage model in the form of model parameters for initialization, supporting multi-dimensional and multi-conditional collection operations. The collection attribute parameters on the front-end graphical user interface and the internal parameters of the model are mapped one-to-one through a predefined interface protocol, thereby completing the association between the model and the interface logic.

[0038] In one embodiment, the collection image node is presented in a graphical user interface with a specified shape outline, such as Figure 2As shown, the collection image node is an elliptical contour area with a fixed size; and the method also includes receiving a user command step for setting a basic attribute data set corresponding to the collection image node:

[0039] Receive the user's click operation on the shape outline corresponding to the collection image node, trigger and start the setting instruction box of the corresponding basic attribute data set, and the setting instruction box of the basic attribute data set is used to receive the basic attribute data input by the user. In specific execution, the user inputs the basic attribute data of the collection image node by clicking the elliptical outline area.

[0040] In one embodiment, the collection image node is presented in a graphical user interface with a specified shape outline; and the result set of the logical operation is presented to the user, including: the shape outline of the collection image after the operation is obtained by changing the shape outline corresponding to the collection image node. Figure 2 As shown, for the intersection operation result, set 1 and set 2 generate a graphic intersection, and the basic attribute data set associated with the intersection part contains the attribute data subjected to logical operation, and the attribute data subjected to logical operation of the two are consistent in the intersection part.

[0041] In one embodiment, Figure 2 As shown, the graphical user interface has a data set definition area and a data set operation area;

[0042] The data set definition area is used to display a number of set image nodes to the user, and receive a drag operation from the user to move the set image node to the data set operation area;

[0043] The data set operation area is used to display the dragged set image nodes and the result set of logical operations to the user.

[0044] Figure 2 In the data set definition area, there are X set image nodes. Users can obtain multiple set graphic nodes in the data set operation area by dragging and dropping. For each set image node (representing a data set), users can intuitively configure the set logic and property settings by clicking the node.

[0045] In one embodiment, the basic attribute data set includes at least one or more of the following: data to be mined having a data range, and data to be mined having a data field.

[0046] In one embodiment, Figure 2 As shown, the graphical user interface has a logic operation relationship tool area for receiving a user command for setting a logic operation condition; the step of receiving a user command for setting a logic operation condition includes:

[0047] Receive a user's click operation on the logic operation relationship tool area, trigger and start the logic operation condition setting instruction box, and the logic operation condition setting instruction box is used to receive the logic operation condition input by the user.

[0048] During the specific execution, when adjusting the logical operation conditions (such as time interval, field screening conditions, and logical operation relationships) in the front-end graphical user interface, these dynamic conditions are passed to the set coverage model through the interface. Using the set operation module, the updated conditions are used to recalculate and generate an updated data set to ensure real-time data analysis.

[0049] In one embodiment, the logical operation includes: an intersection operation, a union operation, a complement operation between element subsets, or a screening of basic attribute data.

[0050] In one embodiment, displaying the results of logical operations to the user includes: receiving a user click operation on a result set on a graphical user interface, triggering the launch of a corresponding detailed result view, including a table, a distribution chart and / or logical operation conditions, so that the user can quickly understand the data logic and operation results.

[0051] like Figure 2 As shown, click the collection node to view detailed data analysis results (such as the number of data entries, field distribution, etc.), and click the intersection part to view the filtered data analysis results.

[0052] In one embodiment, the present invention uses a lightweight JSON format to store collection data and model logic information, such as the rules of intersection, union, and complement operations and the corresponding data fields, time ranges, and other information. It supports the persistence of complex logic and can be loaded and adjusted at any time. This design supports multi-version management of data models and provides a flexible solution for analysis needs in different scenarios.

[0053] In this embodiment, only necessary logic and data fields are stored in the JSON record to avoid redundant data occupying storage space. In addition, the system supports distributed storage and reading mechanisms, which can perform efficient access operations on large-scale collection data, significantly reducing I / O load, and improving data storage performance and the overall operating efficiency of the system.

[0054] In this embodiment, the stored JSON data is not only used to record the set logic, but also directly serves as the basis for query statement generation. Whenever the user adjusts the set logic, the system can dynamically generate new SQL query statements based on the updated JSON data, and improve query performance through the query optimization module. For example, for complex operations such as intersection and complement sets, the system can automatically decompose the logic and generate the optimal query path.

[0055] In order to facilitate those skilled in the art to understand and implement the present invention, the present invention is further described in detail below with reference to examples:

[0056] S1: Build the data front-end interactive interface.

[0057] S11: Build a graphical visualization interface; display the set and its operation results in a graphical form, including the number of data items, field distribution, etc.; support clicking on the set node to view detailed data samples. Among them, the visualization operation does not involve code writing, all are visual interactive operations.

[0058] S12: Build an intuitive and interactive graphical drawing board interface. On the drawing board, multiple collection graphics U are created by dragging operations. Each collection graphic U is presented in the form of a node, representing a specific data range or data set. The drawing board design takes into account the simplicity of operation. The creation and management of collections can be completed by clicking and dragging operations. In addition, the collection graphics support real-time visualization, allowing users to intuitively understand the properties and logical relationships of the collection.

[0059] S2: Establishment of set covering model and parameter association.

[0060] S21: The data logic integration among multiple data sources is realized through the basic operations (intersection, union, complement) of the set covering model. The formulas of intersection, union, and complement are:

[0061] S ∩ ={x|x∈A and x∈B} (1)

[0062] S ∪ ={x|x∈A or x∈B} (2)

[0063]

[0064] Among them, U represents a set graph, which represents a specific data range or data set.

[0065] S22: Parameter association of the set covering model:

[0066] To further enhance the flexibility of set logic operations, the graphical visualization interface supports filter conditions set on the interface. These filter conditions include but are not limited to:

[0067] Numerical filtering: such as greater than, less than, equal to, not equal to, etc.

[0068] Text filtering: such as contains, does not contain, is empty, is not empty and other conditions.

[0069] Multi-select conditions: supports multi-value matching and non-multi-value matching.

[0070] After setting the filtering conditions, associate the conditional parameters with the calculation parameters inside the set coverage model one by one, update the set operation results and present them on the drawing board in real time.

[0071] When the user selects the time range as 2023, the model parameter mapping is: _where{c_left:”time”,c_join:”=”,c_value:”2023”}, to pass the parameter value to the interface for modification. When the user adjusts the parameter filtering range to change the collection logic, the system updates the model parameters in real time through the interface: updateModelParameters(newcondition); the updated conditions are passed, such as time range, field filtering conditions, etc.

[0072] S3: Dynamic update of input conditions and model calculation.

[0073] S31: In order to provide fast calculation results, the model provides set logic operations, including intersection, union, complement and other operations, using several sets to cover at the minimum cost. i (i=1,2,……,n), introduce decision variables:

[0074]

[0075] in,

[0076] The following set coverage model is established:

[0077]

[0078] Using the x variables that meet the screening conditions, the minimum cost coverage of several subsets is achieved.

[0079] S32: Dynamic update of input conditions and model calculation:

[0080] Previously, data results have been displayed on the visualization drawing board. By updating the input filtering conditions, the results that meet the conditions in the multi-source data can be filtered out. The data results after calculation are displayed in real time on the visualization drawing board interface. It also provides interactivity and supports subsequent input condition updates.

[0081] S4: Graphical display of calculation results.

[0082] S41: After the calculation is completed, the data is returned to the front-end graphical user interface through the interface. The data is displayed on the graphical interface in the form of set nodes, intuitively showing the data results of each set, such as the number of data entries, field distribution, logical relationships, etc.

[0083] At the same time, after completing the data result calculation task, the data results can be statically saved in the form of a chart in Excel format, which expands the scope of use of this patent.

[0084] The present invention introduces the set coverage model into the field of data mining for the first time, and realizes the definition and analysis of complex data logic through a visual operation method. Traditional data mining technology usually requires users to have professional programming skills, while the present invention constructs a graphical operation interface, so that users can complete the definition and logical operation of data sets through simple operations such as dragging and clicking. In the specific implementation, the system supports users to create multiple set graphics in the drawing board interface, and realizes the dynamic integration of data through the intersection, union, and complement operations of the set coverage model. The intersection is used to filter the intersection data of multiple sets, the union integrates multiple sets to generate a new data range, and the complement excludes the data of one set from another set. This graphical operation not only improves the user experience, but also provides technical guarantees for the flexibility and efficiency of data mining. The interactive design of the present invention enhances the user's sense of control, makes the data mining process more flexible and efficient, and provides a means of rapid verification for the adjustment of analysis strategies.

[0085] The second aspect of the embodiment of the present invention further provides a data mining system according to the data mining method based on the set covering model provided by the first aspect of the embodiment, comprising:

[0086] A visualization display module, used for presenting a graphical user interface having a plurality of set image nodes on a user computing device through computer operation, wherein each set image node is associated with a basic attribute data set;

[0087] The set logic definition module is used to perform a one-to-one mapping between the basic attribute data set and the element subset participating in the logical operation in the set coverage model through computer operation according to the predefined interface protocol of the set coverage model, receive the user command for setting the logical operation conditions through the predefined interface, obtain the result set of the logical operation, and send it to the visualization display module through the predefined interface, and display the result set of the logical operation to the user through the graphical user interface.

[0088] The third aspect of an embodiment of the present invention also provides a user computing device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the steps of a data mining method based on a set covering model provided in the first aspect of the embodiment are implemented.

[0089] The data mining method based on the set covering model provided by the present invention is introduced in detail above. In this embodiment, specific examples are applied to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

[0090] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined in the present embodiments may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown in the present embodiment, but will conform to the widest range consistent with the principles and novel features disclosed in the present embodiment.

Claims

1. A data mining method based on a set covering model, characterized in that: The steps include: Presenting a graphical user interface having a plurality of set image nodes on a user computing device through the operation of a computer, wherein each of the set image nodes is associated with a basic attribute data set; According to the predefined interface protocol of the set coverage model, the basic attribute data set is mapped one-to-one with the subset of elements in the set coverage model that participate in performing logical operations through computer operation, and user commands for setting logical operation conditions are received through the predefined interface, and the result set of the logical operation is displayed to the user through the graphical user interface.

2. A data mining method based on a set covering model according to claim 1, characterized in that: The collection image node is presented in the graphical user interface with a specified shape outline; and the step of receiving a user command to set a basic attribute data set corresponding to the collection image node is also included: A click operation of the user on the shape outline corresponding to the set image node is received, and a setting instruction box of the corresponding basic attribute data set is triggered to start, and the setting instruction box of the basic attribute data set is used to receive the basic attribute data input by the user.

3. The data mining method based on set covering model according to claim 1 is characterized in that: The set image node is presented in the graphical user interface with a specified shape outline; The result set of the logical operation is displayed to the user, including: the shape outline of the set image after the operation is obtained by changing the shape outline corresponding to the set image node.

4. The data mining method based on set covering model according to claim 1 is characterized in that: The graphical user interface has a data set definition area and a data set operation area; The data set definition area is used to display the plurality of set image nodes to the user, and receive a drag operation from the user to move the set image nodes to the data set operation area; The data set operation area is used to display the dragged set image node and the result set of the logical operation to the user.

5. The data mining method based on set covering model according to claim 1 is characterized in that: The basic attribute data set includes at least one or more of the following: data to be mined having a data range, and data to be mined having a data field.

6. The data mining method based on set covering model according to claim 1, characterized in that: The graphical user interface has a logic operation relationship tool area for receiving user commands for setting logic operation conditions; The step of receiving a user command for setting a logical operation condition comprises: A click operation of the user on the logic operation relationship tool area is received, and the setting instruction box of the logic operation condition is triggered to start. The setting instruction box of the logic operation condition is used to receive the logic operation condition input by the user.

7. The data mining method based on set covering model according to claim 1 is characterized in that: The logical operation includes: intersection operation, union operation, complement operation between element subsets or screening of basic attribute data.

8. The data mining method based on set covering model according to claim 1, characterized in that: The presenting the result of the logic operation to the user comprises: receiving a click operation of the user on the result set on the graphical user interface, triggering the start of a corresponding detailed result view, including a table, a distribution diagram and / or a logic operation condition.

9. A data mining system according to any one of claims 1 to 8, characterized in that: include: A visualization display module, used for presenting a graphical user interface having a plurality of set image nodes on a user computing device through computer operation, wherein each of the set image nodes is associated with a basic attribute data set; The set logic definition module is used to perform a one-to-one mapping between the basic attribute data set and the element subset participating in the logical operation in the set coverage model through computer operation according to the predefined interface protocol of the set coverage model, receive the user command for setting the logical operation condition through the predefined interface, obtain the result set of the logical operation, and send it to the visualization display module through the predefined interface, and display the result set of the logical operation to the user through the graphical user interface.

10. A user computing device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of a data mining method based on a set covering model as described in any one of claims 1 to 8 are implemented.

Images