Enterprise evaluation method and system based on big data analysis

Abstract

The invention relates to the field of enterprise evaluation, in particular to an enterprise evaluation method based on big data analysis, which comprises the following steps: acquiring target enterprise data of a target evaluation enterprise; performing data division on the target enterprise data of the target evaluation enterprise to obtain a target evaluation subset; determining a subset processing strategy according to the fragment execution state of each target evaluation subset; in the first confidence analysis mode, fragment quality parameters of one type of evaluation subsets are determined according to the subset execution efficiency and the reference correlation index, an efficiency adjustment mode is determined according to the fragment quality parameters, and confidence reference coefficients of the correlation analysis texts are determined; in the second confidence analysis mode, determining a subset execution coefficient of the second-class evaluation subset according to a reference association index and a theme association proportion, and determining a set setting mode and an effective evaluation strategy according to the subset execution coefficient; and determining the final evaluation score of each piece of target evaluation data. According to the method and the device, the accuracy of effectiveness evaluation of the obtained webpage information is improved.

Description

Technical Field

[0001] The present invention relates to the field of enterprise evaluation, and in particular to an enterprise evaluation method and system based on big data analysis. Background Art

[0002] The enterprise evaluation process requires obtaining a large amount of enterprise-related information, and obtaining enterprise-related information through crawler technology can effectively reduce human resource consumption and time consumption in the information acquisition stage. Information mining is continuously performed based on the determined key content and crawler technology. However, the mined information often contains invalid data for enterprise evaluation, which can easily lead to poor data analysis efficiency in the enterprise evaluation process. Therefore, how to conduct targeted analysis based on the task execution of different subsets in the actual data acquisition process to ensure the data analysis efficiency of the subsequent enterprise evaluation process is an urgent problem to be solved by technical personnel in this field.

[0003] Chinese patent publication number CN113239253A discloses a web crawler implementation method, which is suitable for execution in a web crawler implementation system, and the method includes the following steps: a message queue server receives a web crawler task from a user; the message queue server establishes multiple message queues according to multiple query keywords of the web crawler task; a web page acquisition server crawls multiple web pages related to the query keyword from the Internet according to a query keyword, and sends the URLs of the multiple web pages to the message queue server; the message queue server receives the URLs of the multiple web pages, and stores the URLs of the multiple web pages in a message queue corresponding to the target query keyword; a content crawler obtains the URLs of the multiple web pages related to the query keyword from a message queue, downloads multiple web pages according to the URL of each web page, and crawls information from the multiple web pages to generate a web crawler result. However, the above scheme has the following problems: it fails to determine a targeted subset analysis process according to the information processing conditions at different stages in the actual information acquisition process, which makes the effectiveness of the obtained enterprise-related information low, and further leads to low data analysis efficiency in the subsequent enterprise evaluation process. Summary of the invention

[0004] To this end, the present invention provides an enterprise evaluation method and system based on big data analysis, which is used to overcome the problem in the prior art of determining a targeted subset analysis process according to the information processing conditions at different stages in the actual information acquisition process, resulting in low effectiveness of the acquired enterprise-related information, and further leading to low data analysis efficiency in the subsequent enterprise evaluation process.

[0005] To achieve the above objectives, the present invention provides an enterprise evaluation method based on big data analysis, comprising: Obtain target enterprise data of target assessment enterprises; Dividing the target enterprise data of the target evaluation enterprise to obtain different target evaluation subsets; Determine a subset processing strategy according to the shard execution status of each target evaluation subset, wherein the subset processing strategy is to analyze the target evaluation subset using a first confidence analysis method or a second confidence analysis method; In the first confidence analysis method, the shard quality parameters of a type of evaluation subset are determined according to the subset execution efficiency and the reference correlation index, the efficiency adjustment method is determined according to the shard quality parameters, and the confidence reference coefficient of each related analysis text is determined. The efficiency adjustment method is to perform subset task scheduling for a type of evaluation subset, or to adjust the number of concurrent requests according to the subset execution efficiency; In the second confidence analysis method, the subset execution coefficient of the second type of evaluation subset is determined according to the reference association index and the topic association ratio, and the set setting method and the effective evaluation strategy are determined according to the subset execution coefficient. The effective evaluation strategy is to determine the confidence reference coefficient based on the reference related matching coefficient and the key evaluation parameter, or to determine the confidence reference coefficient based on the access matching coefficient and the reference influence coefficient. Under the subset analysis conditions, enterprise evaluation is carried out on the target evaluation enterprises. In the enterprise evaluation, the final evaluation score of each target evaluation data is determined based on the data value of the target evaluation data and the evaluation weight coefficient corresponding to the relevant analysis text.

[0006] Further, for a single target evaluation subset, if the target evaluation subset is in a shard execution state where the extended effective coefficient is less than or equal to the preset extended effective coefficient or the execution complete coefficient is less than or equal to the preset execution complete coefficient, the target evaluation subset is analyzed using a first confidence analysis method, including: Determine a sharding quality parameter of a class of evaluation subsets according to the subset execution efficiency and the reference correlation index; Determine whether to perform subset task scheduling for a type of evaluation subset according to the shard quality parameter; Under the subset confirmation condition, the confidence reference coefficient of each relevant analysis text is determined according to the topic enrichment parameter; The subset confirmation condition is that a type of evaluation subset does not need to perform subset task scheduling or has completed the subset task; The type of evaluation subset is a target evaluation subset in a type of shard execution state.

[0007] Further, for a single type of evaluation subset, if the slice quality parameter of the type of evaluation subset is less than the preset slice quality parameter, subset task scheduling is performed for the type of evaluation subset; Determine the URLs to be segmented of the evaluation subset based on the extended correlation coefficient and the topic-independent parameter; The target allocation subset is determined based on the key words corresponding to the URL to be segmented and its extended URL and the subset processing efficiency.

[0008] Furthermore, for a single type-one evaluation subset, if the shard quality parameter of the type-one evaluation subset is greater than the preset shard quality parameter, the number of concurrent requests is increased and adjusted according to the subset execution efficiency; Determine whether to perform secondary adjustment on the number of concurrent requests based on the efficiency optimization parameters; The increase in the number of concurrent requests is negatively correlated with the subset execution efficiency.

[0009] Further, for a single target evaluation subset, if the target evaluation subset is in a second-class shard execution state where the expansion validity coefficient is greater than the preset expansion validity coefficient and the execution complete coefficient is greater than the preset execution complete coefficient, the target evaluation subset is analyzed using a second confidence analysis method, including: Determine the subset execution coefficient of the second category evaluation subset according to the reference relevance index and the topic relevance ratio; Determine the set setting method and effective evaluation strategy according to the subset execution coefficient; The set setting method is to determine the relevant matching set according to the subject association parameter and the set association index or to determine the access matching set according to the execution correlation coefficient and the access correlation coefficient; The second type of evaluation subset is a target evaluation subset in a second type of sharding execution state.

[0010] Further, for a single second-category evaluation subset, if the subset execution coefficient of the second-category evaluation subset is greater than the preset subset execution coefficient, a relevant matching set is determined according to the subject association parameter and the set association index, and a confidence reference coefficient of the relevant analysis text obtained by the second-category evaluation subset in the current subset analysis cycle is determined based on the reference relevant matching coefficient of each evaluation matching set and the key evaluation parameter; The correlation matching coefficient of each key subject word in any correlation matching set is greater than the preset correlation matching coefficient.

[0011] Further, for a single second-category evaluation subset, if the subset execution coefficient of the second-category evaluation subset is less than or equal to the preset subset execution coefficient, an access matching set is determined according to the execution correlation coefficient and the access correlation coefficient, and a confidence reference coefficient of the relevant analysis text obtained by the second-category evaluation subset in the current subset analysis cycle is determined based on the access matching coefficient of each access matching set and the corresponding reference influence coefficient; The access matching coefficient in any access matching set is greater than the preset access matching coefficient.

[0012] Furthermore, under the subset analysis condition, the information acquisition quality of each target evaluation set is determined based on the effective reference proportion and information overlap parameters; The information acquisition quality is positively correlated with the effective reference ratio and the information overlap parameter respectively; The subset analysis condition is that each target evaluation subset completes the task effective analysis or performs effective analysis.

[0013] Further, the final evaluation score of each target evaluation data of the target evaluation enterprise is determined based on each data value corresponding to the target evaluation data in the obtained relevant analysis text and the evaluation weight coefficient corresponding to the relevant analysis text; For a single relevant analysis text, its corresponding evaluation weight coefficient is positively correlated with the information acquisition quality of the target evaluation subset to which the relevant analysis text belongs.

[0014] The present invention also provides a system for applying the enterprise evaluation based on big data analysis, comprising: A subset evaluation module for expanding effective coefficients and executing complete coefficients in response to subset evaluation conditions to determine a subset processing strategy; A first confidence analysis module, which is connected to the subset evaluation module, is used to respond to the shard quality parameter of the adjustment judgment condition to determine the efficiency adjustment method and complete the determination of the confidence reference coefficient of each relevant analysis text. The efficiency adjustment method is to perform subset task scheduling for a type of evaluation subset, or to adjust the number of concurrent requests according to the subset execution efficiency; A second confidence analysis module, which is connected to the subset evaluation module, is used to respond to the subset execution coefficient of the setting judgment condition to determine the set setting mode and the effective evaluation strategy, the effective evaluation strategy is to determine the confidence reference coefficient based on the reference related matching coefficient and the key evaluation parameter, or to determine the confidence reference coefficient based on the access matching coefficient and the reference influence coefficient; An evaluation execution module, which is connected to the first confidence analysis module and the second confidence analysis module, is used to determine the final evaluation score of each target evaluation data based on the data value of the target evaluation data and the evaluation weight coefficient corresponding to the relevant analysis text.

[0015] Compared with the prior art, the beneficial effect of the present invention lies in that the technical scheme of the present invention periodically judges the shard execution status of each target evaluation subset according to the extended effective coefficient and the execution complete coefficient, and determines the subset processing strategy according to the shard execution status, so that the subsequent analysis process of the subset retrieval results is more in line with the actual information situation. While ensuring the accuracy of the judgment on the effectiveness of the acquired information, the processing efficiency of the judgment process is guaranteed. The present invention improves the data analysis efficiency of the subsequent enterprise evaluation process.

[0016] Furthermore, the present invention determines the slice execution status of each target evaluation subset according to the extended validity coefficient and the execution completeness coefficient, which is used to characterize the execution status of each target evaluation subset for the assigned information capture task, and also characterizes the data richness of the acquired web page information, so that the subsequent targeted subset processing strategy has a stronger match. The present invention improves the accuracy of the effectiveness evaluation of the acquired web page information.

[0017] Furthermore, the present invention determines an optimization method for targeted subset allocation based on fragmentation quality parameters for target evaluation subsets with poor execution of assigned information capture tasks. If the fragmentation quality parameters of one type of evaluation subsets are small, it means that the association and mutual compensation of URLs constituting the current subset are poor, and targeted URL scheduling is performed for this. For a type of evaluation subsets with larger fragmentation quality parameters, the subset execution efficiency is monitored in real time to optimize the number of concurrent requests and improve data acquisition efficiency. The present invention takes into account the efficiency of the information acquisition process while ensuring the accuracy of the effectiveness evaluation of the acquired web page information.

[0018] Furthermore, the present invention targets target evaluation subsets that have good performance in executing the assigned information capture tasks and have obtained good quality web page information, and determines targeted set setting methods and effective evaluation strategies for subject keywords based on the subset execution coefficients of such target evaluation subsets. For key subject words with poor relevance, sets are divided based on access conditions, so that the settings of different matching sets are more in line with actual information conditions. The present invention improves the accuracy of the effectiveness evaluation of the obtained web page information. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a schematic diagram of the enterprise evaluation method based on big data analysis of the present invention; Figure 2 A flow chart of a subset processing strategy for determining a target evaluation subset according to a slice execution state of the present invention; Figure 3 A flow chart of a method for determining a set setting according to a subset execution coefficient of the present invention; Figure 4 This is a module connection diagram of the enterprise evaluation system based on big data analysis of the present invention. DETAILED DESCRIPTION

[0020] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0021] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0022] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0023] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0024] See also Figures 1 to 3 As shown, the present invention provides an enterprise evaluation method based on big data analysis, comprising: Obtain target enterprise data of target assessment enterprises; Dividing the target enterprise data of the target evaluation enterprise to obtain different target evaluation subsets; Determine a subset processing strategy according to the shard execution status of each target evaluation subset, wherein the subset processing strategy is to analyze the target evaluation subset using a first confidence analysis method or a second confidence analysis method; In the first confidence analysis method, the shard quality parameters of a type of evaluation subset are determined according to the subset execution efficiency and the reference correlation index, the efficiency adjustment method is determined according to the shard quality parameters, and the confidence reference coefficient of each related analysis text is determined. The efficiency adjustment method is to perform subset task scheduling for a type of evaluation subset, or to adjust the number of concurrent requests according to the subset execution efficiency; In the second confidence analysis method, the subset execution coefficient of the second type of evaluation subset is determined according to the reference association index and the topic association ratio, and the set setting method and the effective evaluation strategy are determined according to the subset execution coefficient. The effective evaluation strategy is to determine the confidence reference coefficient based on the reference related matching coefficient and the key evaluation parameter, or to determine the confidence reference coefficient based on the access matching coefficient and the reference influence coefficient. Under the subset analysis conditions, enterprise evaluation is carried out on the target evaluation enterprises. In the enterprise evaluation, the final evaluation score of each target evaluation data is determined based on the data value of the target evaluation data and the evaluation weight coefficient corresponding to the relevant analysis text.

[0025] The present invention is applied to the process of conducting enterprise evaluation on target evaluation enterprises. The target evaluation enterprises are enterprises that need to be evaluated. The target enterprise data are several initial URLs. For a single target evaluation enterprise, the present invention determines several initial URLs based on the evaluation direction of the target evaluation enterprise and the business fields involved, and divides the initial URLs of the target evaluation enterprise to obtain several target evaluation subsets. In each subset analysis cycle, the processing node corresponding to the target evaluation subset can determine a new URL based on the initial URL in the target evaluation subset and the acquired text content, and record the newly determined URL as an extended URL in the corresponding target evaluation subset. Any target evaluation subset is a collection of several initial URLs and extended URLs. Before the new URL is determined, there are only initial URLs in the target evaluation subset. The initial URL and the extended URL contained in each target evaluation subset are recorded as the relevant URLs of the corresponding target evaluation subset. How to determine the initial URL based on the evaluation direction of the target evaluation enterprise and the business field involved, and how to determine the new URL based on the initial URL and the text content obtained each time is easy for technical personnel in this field to understand, and will not be elaborated here. The subject keywords contained in the relevant analysis text in the present invention can be set by the user according to the actual evaluation enterprise. For example, the main business of the target evaluation enterprise is green petrochemical and new materials, and the subject keywords include but are not limited to: anti-corrosion coating preparation, ink production, natural gas, coating stirring, printing ink, petroleum products, mixing devices, water-based coatings, ink preparation, coating processing, coating production, preparation process, coating combination, waterproof coating preparation and positive electrode materials.

[0026] The present invention applies a cyclic subset analysis cycle, and the duration of the subset analysis cycle can be determined by the user. The higher the user's requirements for data analysis efficiency in the enterprise evaluation process, the shorter the duration of the subset analysis cycle. A subset analysis cycle duration is provided, and the subset analysis cycle is 5 minutes. At the end of each subset analysis cycle, the shard execution status of each target evaluation subset is determined according to the extended effective coefficient and the execution complete coefficient, and the subset processing strategy is determined according to the shard execution status; The present invention uses several historical evaluation records, and any one of the historical evaluation records records at least one extended effectiveness coefficient, execution completeness coefficient, sharding quality parameter, segmentation priority coefficient, correlation index, correlation matching coefficient, access matching coefficient, and confidence reference coefficient in the enterprise evaluation process for the target enterprise. Each historical evaluation record corresponds to a qualified mark, which records whether the data analysis efficiency in the enterprise evaluation process meets user requirements. It can be understood that the user can determine whether the data analysis efficiency in the enterprise evaluation process meets the requirements based on self-set indicators. For example, the self-set indicators can be but are not limited to evaluation analysis efficiency. The evaluation analysis efficiency is the time spent determining the enterprise evaluation results after completing the acquisition of enterprise information.

[0027] Specifically, for a single target evaluation subset, if the target evaluation subset is in a shard execution state where the extended effective coefficient is less than or equal to the preset extended effective coefficient or the execution complete coefficient is less than or equal to the preset execution complete coefficient, the target evaluation subset is analyzed using the first confidence analysis method, including: Determine a sharding quality parameter of a class of evaluation subsets according to the subset execution efficiency and the reference correlation index; Determine whether to perform subset task scheduling for a type of evaluation subset according to the shard quality parameter; Under the subset confirmation condition, the confidence reference coefficient of each relevant analysis text is determined according to the topic enrichment parameter; The subset confirmation condition is that a type of evaluation subset does not need to perform subset task scheduling or has completed the subset task; The type of evaluation subset is a target evaluation subset in a type of shard execution state.

[0028] Among them, for a single target evaluation subset, the extension validity coefficient = ln (subset extension parameter × extension validity parameter), the subset extension parameter is the number of extended URLs obtained in the current subset analysis cycle, the extension validity parameter is the average number of key subject words of each extended URL obtained in the current subset analysis cycle, the execution completeness coefficient = (the number of extended URLs obtained in the previous subset analysis cycle - the number of extended URLs obtained in the current subset analysis cycle) / the number of extended URLs obtained in the previous subset analysis cycle, the text content corresponding to the web page information determined based on each related URL included in the target evaluation subset is recorded as the related analysis text, key subject words are extracted for each related information text, and the correlation index between the key subject words of the two types of evaluation subsets is detected. For any two key subject words, the correlation index is the number of times the above two key subject words exist in the same trusted reference text at the same time in each historical evaluation record, and the reference correlation index , n is the number of key subject words in the second category evaluation subset, gi is the correlation index between the key subject words in the ith group, and for a single related analysis text, the confidence reference coefficient is positively correlated with the topic enrichment parameter, which is the number of different key subject words in the related analysis text; The values ​​of the preset extended effective coefficient and the preset execution complete coefficient can be determined by the user according to the actual work scenario. For example, the user can set them according to the historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the smaller the value of the preset extended effective coefficient and the smaller the value of the preset execution complete coefficient. A method for determining the value of the preset extended effective coefficient is provided, and the average value of the extended effective coefficient of the target evaluation subset in the historical evaluation records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset extended effective coefficient. A method for determining the value of the preset execution complete coefficient is provided, and the average value of the execution complete coefficient of the target evaluation subset in the historical evaluation records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset execution complete coefficient.

[0029] Specifically, for a single type of evaluation subset, if the slice quality parameter of the type of evaluation subset is less than or equal to the preset slice quality parameter, subset task scheduling is performed for the type of evaluation subset; Determine the URLs to be segmented of the evaluation subset based on the extended correlation coefficient and the topic-independent parameter; The target allocation subset is determined based on the key words corresponding to the URL to be segmented and its extended URL and the subset processing efficiency.

[0030] Among them, for a single first-class evaluation subset, the shard quality parameter is the product of the subset execution efficiency and the reference correlation index, and the subset execution efficiency is the product of the extended effective coefficient and the execution complete coefficient. The value of the preset shard quality parameter can be determined by the user according to the actual work scenario. For example, the user can set it according to the historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the smaller the value of the preset shard quality parameter. A method for setting the value of the preset shard quality parameter is provided, and the historical evaluation records for subset task scheduling for a first-class evaluation subset are recorded as quality reference records, and the average value of the shard quality parameters of each first-class evaluation subset in the quality reference records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset shard quality parameter; If any evaluation subset needs to be scheduled for subset tasks, for a single related URL in the evaluation subset, the segmentation priority coefficient = ln (topic independent parameter / extended correlation coefficient), the extended correlation coefficient is the number of extended URLs determined by the related URL, the topic independent parameter = 1 / the number of composite topics of the related URL, for the key topic word corresponding to a single related URL, if the key topic word exists in other related URLs in the evaluation subset, the key topic word is determined to be the composite topic of the related URL, and if the segmentation priority coefficient of the related URL is greater than the preset segmentation priority coefficient, the related URL is scheduled to other target evaluation subsets, and The relevant URL is recorded as the URL to be split. For a single URL to be split, the allocation priority coefficient of each target evaluation subset is determined according to the key subject words corresponding to the URL to be split and its extended URL and the subset processing efficiency. For a single target evaluation subset, the allocation priority coefficient = ln (topic relevance index × subset processing efficiency of the target evaluation subset), the topic relevance index = the number of key subject words that coexist in the relevant analysis text corresponding to the URL to be split and its extended URL and the target evaluation subset / the number of key subject words in the relevant analysis text corresponding to the URL to be split and its extended URL. The target evaluation subset with the largest allocation priority coefficient is recorded as the target allocation subset; The value of the preset segmentation priority coefficient can be determined by the user according to the actual work scenario. For example, the user can set it according to historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the smaller the value of the preset segmentation priority coefficient. A method for determining the value of the preset segmentation priority coefficient is provided, and the historical evaluation records for subset task scheduling for a type of evaluation subset are recorded as quality reference records, and the average value of the segmentation priority coefficients of each URL to be segmented in the quality reference records that meet the user's requirements for data analysis efficiency in the enterprise evaluation process is recorded as the preset segmentation priority coefficient.

[0031] Specifically, for a single type-one evaluation subset, if the shard quality parameter of the type-one evaluation subset is greater than the preset shard quality parameter, the number of concurrent requests is increased and adjusted according to the subset execution efficiency; Determine whether to perform secondary adjustment on the number of concurrent requests based on the efficiency optimization parameters; The increase in the number of concurrent requests is negatively correlated with the subset execution efficiency.

[0032] Among them, for a type of evaluation subset for which the number of concurrent requests is adjusted individually, the efficiency optimization parameter is the difference between the subset execution efficiency of the next subset evaluation cycle and the subset execution efficiency of the current subset analysis cycle. If the efficiency optimization parameter is less than the preset efficiency optimization parameter, the number of concurrent requests is reduced and adjusted. The reduction value of the number of concurrent requests is negatively correlated with the efficiency optimization parameter. How to adjust the number of concurrent requests is easy to understand for technicians in this field and will not be elaborated here.

[0033] Specifically, for a single target evaluation subset, if the target evaluation subset is in a second-class shard execution state where the expansion validity coefficient is greater than the preset expansion validity coefficient and the execution complete coefficient is greater than the preset execution complete coefficient, the second confidence analysis method is used for the target evaluation subset for analysis, including: Determine the subset execution coefficient of the second category evaluation subset according to the reference relevance index and the topic relevance ratio; Determine the set setting method and effective evaluation strategy according to the subset execution coefficient; The set setting method is to determine the relevant matching set according to the subject association parameter and the set association index or to determine the access matching set according to the execution correlation coefficient and the access correlation coefficient; The second type of evaluation subset is a target evaluation subset in a second type of sharding execution state.

[0034] Among them, for a single second-category evaluation subset, the subset execution coefficient = ln (reference association index × topic association ratio), topic association ratio = the number of key topic words with associated topic words / the number of key topic words in the second-category evaluation subset, for any two key topic words, if the association index between the above two key topic words is greater than the preset association index, it is determined that there is an association relationship between the above group of key topic words, and they are recorded as each other's associated topic words; The value of the preset association index can be determined by the user according to the actual work scenario. For example, the user can set it according to the historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the larger the value of the preset association index. A method for determining the value of the preset association index is provided, and the average value of the association index of the associated keywords in the historical evaluation records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset association index.

[0035] Specifically, for a single second-category evaluation subset, if the subset execution coefficient of the second-category evaluation subset is greater than the preset subset execution coefficient, the relevant matching set is determined according to the subject association parameter and the set association index, and the confidence reference coefficient of the relevant analysis text obtained by the second-category evaluation subset in the current subset analysis cycle is determined based on the reference relevant matching coefficient of each evaluation matching set and the key evaluation parameter; The correlation matching coefficient of each key subject word in any correlation matching set is greater than the preset correlation matching coefficient.

[0036] Among them, for a single second-category evaluation subset, if the relevant matching set is determined according to the subject association parameter and the set association index, for any key subject word in the second-category evaluation subset, the relevant matching coefficient is the product of the subject association parameter and the set association index, the subject association parameter is the number of associated subject words of the key subject word in the second-category evaluation subset, and the set association index is the average value of the association index between the key subject word and other key subject words in the second-category evaluation subset; The values ​​of the preset relevant matching coefficient and the preset subset execution coefficient can be determined by the user according to the actual work scenario. For example, the user can set them according to the historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the larger the value of the preset relevant matching coefficient. A method for determining the value of the preset relevant matching coefficient is provided. The historical evaluation records of the relevant matching set determined according to the subject association parameters and the set association index are recorded as relevant matching reference records. The minimum value of the relevant matching coefficients of each key subject word in the relevant matching set in the relevant matching reference records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset relevant matching coefficient. A method for determining the value of the preset subset execution coefficient is provided. The minimum value of the subset execution coefficient of the second category of evaluation subsets in the relevant matching reference records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset subset execution coefficient. The relevant analysis text is the relevant analysis text of each target evaluation subset within the current subset analysis cycle. For a single relevant analysis text, the confidence reference coefficient is the sum of the products of the reference relevant matching coefficients of each relevant matching set and the corresponding set weight coefficient. The reference relevant matching coefficient is the average value of the relevant matching coefficients of each key subject word in the relevant matching set. For a single relevant matching set, its corresponding set weight coefficient is positively correlated with the overlap evaluation parameter of the relevant matching set. The key evaluation parameter is the product of the overlap topic ratio and the overlap correlation coefficient. The overlap topic ratio = the number of key subject words in the relevant matching set that exist in the relevant analysis text / the number of key subject words in the relevant matching set. The overlap correlation coefficient is the number of combinations of key subject words that have an association relationship among the key subject words in the relevant matching set that exist in the relevant analysis text.

[0037] Specifically, for a single second-category evaluation subset, if the subset execution coefficient of the second-category evaluation subset is less than or equal to the preset subset execution coefficient, an access matching set is determined according to the execution correlation coefficient and the access correlation coefficient, and the confidence reference coefficient of the relevant analysis text obtained by the second-category evaluation subset in the current subset analysis cycle is determined based on the access matching coefficient of each access matching set and the corresponding reference influence coefficient; The access matching coefficient in any access matching set is greater than the preset access matching coefficient.

[0038] Among them, for a single second-category evaluation subset, if the access matching set is determined based on the execution correlation coefficient and the access correlation coefficient, for any access matching set, the access matching coefficient = execution correlation coefficient / access correlation coefficient, the execution correlation coefficient is the average value of the execution related parameters of each key subject word in the access matching set, for a single key subject word, the execution related parameter = the number of execution related URLs / the number of related URLs of the second-category evaluation subset, the execution related URL is the related URL that has an execution relationship with the related URL corresponding to the key subject word in the second-category evaluation subset, if a related URL is determined based on the initial URL or other extended URL in the corresponding target evaluation subset, then it is judged that the related URL has an execution relationship with the initial URL or other extended URL in the corresponding target evaluation subset; the access correlation coefficient , m is the number of related URLs that have an execution relationship with the related URL corresponding to the key theme word, xj is the reference access interval between the jth related URL that has an execution relationship with the related URL corresponding to the key theme word and the related URL corresponding to the key theme word, and for any two related URLs, the reference access interval is the average of the interval durations of the access times of the web pages corresponding to the two related URLs by each user in a single access process; The value of the preset access matching coefficient can be determined by the user according to the actual work scenario. For example, the user can set it according to the historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the larger the value of the preset access matching coefficient. A method for determining the value of the preset access matching coefficient is provided. The historical evaluation records of the access matching set determined according to the execution correlation coefficient and the access correlation coefficient are recorded as access matching reference records. The minimum value of the access matching coefficient of the access matching set in the access matching reference records that meet the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset access matching coefficient. For a single relevant analysis text, the confidence reference coefficient is the sum of the products of the access matching coefficients of each access matching set in the corresponding second-category evaluation subset and the corresponding reference influence coefficient. For a single access matching set, the corresponding reference influence coefficient is positively correlated with the behavior evaluation parameter of the access matching set. The behavior evaluation parameter is the product of topic coverage and key access parameters. The topic coverage = the number of key subject words existing in the relevant analysis text / the number of key subject words in the access matching set. The key access parameter is the average of the regional retention time of each key subject word existing in the relevant analysis text. For a single key subject word, the regional retention time is the average of the time the mouse marker stays in the area where the key subject word exists when the user visits the relevant URL corresponding to the relevant analysis text.

[0039] Specifically, under the subset analysis condition, the information acquisition quality of each target evaluation set is determined based on the effective reference proportion and information overlap parameters; The information acquisition quality is positively correlated with the effective reference ratio and the information overlap parameter respectively; The subset analysis condition is that each target evaluation subset completes the task effective analysis or performs effective analysis.

[0040] Specifically, the final evaluation score of each target evaluation data of the target evaluation enterprise is determined based on each data value corresponding to the target evaluation data in the obtained relevant analysis text and the evaluation weight coefficient corresponding to the relevant analysis text; For a single relevant analysis text, its corresponding evaluation weight coefficient is positively correlated with the information acquisition quality of the target evaluation subset to which the relevant analysis text belongs.

[0041] Among them, for a single target evaluation set, the information acquisition quality is the sum of the effective reference ratio and the information overlap parameter, the effective reference ratio = the number of confident reference texts / the number of related analysis texts acquired by the target evaluation set, the confident reference text is the related analysis text whose confidence reference coefficient is greater than the preset confidence reference coefficient, and the information overlap parameter is the number of key subject words whose number of related analysis texts is greater than the preset number of texts; The user can determine the final evaluation score of each target evaluation data according to the data information in the relevant analysis text and the evaluation weight coefficient corresponding to each relevant analysis text. In addition, the user can determine the method of determining the final evaluation score according to actual needs. For example, for a single target evaluation data, the target evaluation data needs to remain stable, and the data value corresponding to the target evaluation data in the relevant analysis text is obtained, and the final evaluation score is , t is the number of evaluation data of this project in each relevant analysis text obtained, is the data difference value corresponding to the s-th target evaluation data in the project target evaluation data existing in each relevant analysis text obtained, the data difference value is the data value corresponding to the s-th target evaluation data and the data reference value of the project target evaluation data, the data reference value is the average value of the data values ​​corresponding to each project target evaluation data in each relevant analysis text obtained, is the evaluation weight coefficient corresponding to the relevant analysis text corresponding to the s-th target evaluation data in the target evaluation data of the project in each relevant analysis text; For a single target evaluation data, if there are relevant analysis texts for the target evaluation data that only belong to a single target evaluation subset, then the evaluation weight coefficient corresponding to each relevant analysis text is positively correlated with the information acquisition quality of the target evaluation subset. If there are relevant analysis texts for the target evaluation data that belong to multiple target evaluation subsets, for the relevant analysis texts for the target evaluation data in a single target evaluation subset, the corresponding evaluation weight coefficient is positively correlated with the distribution information acquisition quality of the target evaluation subset. The distribution information acquisition quality is the product of the information acquisition quality of the target evaluation subset and the proportion of relevant texts in the target evaluation subset. The proportion of relevant texts = the number of relevant analysis texts for the target evaluation data in the target evaluation subset / the number of relevant analysis texts for the target evaluation data. How to determine the abnormal coefficients of target evaluation data of different categories based on the acquired data information and the evaluation weight coefficient is easy for technicians in this field to understand and will not be elaborated on here. The values ​​of the preset confidence reference coefficient and the preset number of texts can be determined by the user according to the actual work scenario. For example, the user can set them according to historical evaluation records. The higher the user's requirements for the data analysis efficiency in the enterprise evaluation process, the larger the value of the preset confidence reference coefficient and the smaller the value of the preset number of texts. A method for determining the value of the preset confidence reference coefficient is provided, and the minimum value of the confidence reference coefficient of each confidence reference text in the historical evaluation records that meets the user's requirements for the data analysis efficiency in the enterprise evaluation process is recorded as the preset confidence reference coefficient. A value of the preset number of texts is provided, and the value of the preset number of texts is 30% of the number of relevant analysis texts of the target evaluation subset.

[0042] See also Figure 4 As shown, it is a module connection diagram of the enterprise evaluation system based on big data analysis of the present invention. The present invention provides an enterprise evaluation system based on big data analysis, including: A subset evaluation module for expanding effective coefficients and executing complete coefficients in response to subset evaluation conditions to determine a subset processing strategy; A first confidence analysis module, which is connected to the subset evaluation module, is used to respond to the shard quality parameter of the adjustment judgment condition to determine the efficiency adjustment method and complete the determination of the confidence reference coefficient of each relevant analysis text. The efficiency adjustment method is to perform subset task scheduling for a type of evaluation subset, or to adjust the number of concurrent requests according to the subset execution efficiency; A second confidence analysis module, which is connected to the subset evaluation module, is used to respond to the subset execution coefficient of the setting judgment condition to determine the set setting mode and the effective evaluation strategy, the effective evaluation strategy is to determine the confidence reference coefficient based on the reference related matching coefficient and the key evaluation parameter, or to determine the confidence reference coefficient based on the access matching coefficient and the reference influence coefficient; An evaluation execution module, which is connected to the first confidence analysis module and the second confidence analysis module, is used to determine the final evaluation score of each target evaluation data based on the data value of the target evaluation data and the evaluation weight coefficient corresponding to the relevant analysis text.

[0043] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0044] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for enterprise evaluation based on big data analysis, characterized in that: include: Obtain target enterprise data of target assessment enterprises; Dividing the target enterprise data of the target evaluation enterprise to obtain different target evaluation subsets; Determine a subset processing strategy according to the shard execution status of each target evaluation subset, wherein the subset processing strategy is to analyze the target evaluation subset using a first confidence analysis method or a second confidence analysis method; In the first confidence analysis method, the shard quality parameters of a type of evaluation subset are determined according to the subset execution efficiency and the reference correlation index, the efficiency adjustment method is determined according to the shard quality parameters, and the confidence reference coefficient of each related analysis text is determined. The efficiency adjustment method is to perform subset task scheduling for a type of evaluation subset, or to adjust the number of concurrent requests according to the subset execution efficiency; In the second confidence analysis method, the subset execution coefficient of the second type of evaluation subset is determined according to the reference association index and the topic association ratio, and the set setting method and the effective evaluation strategy are determined according to the subset execution coefficient. The effective evaluation strategy is to determine the confidence reference coefficient based on the reference related matching coefficient and the key evaluation parameter, or to determine the confidence reference coefficient based on the access matching coefficient and the reference influence coefficient. Under the subset analysis conditions, enterprise evaluation is carried out on the target evaluation enterprises. In the enterprise evaluation, the final evaluation score of each target evaluation data is determined based on the data value of the target evaluation data and the evaluation weight coefficient corresponding to the relevant analysis text.

2. The enterprise evaluation method based on big data analysis according to claim 1 is characterized in that: For a single target evaluation subset, if the target evaluation subset is in a shard execution state where the extension validity coefficient is less than or equal to the preset extension validity coefficient or the execution complete coefficient is less than or equal to the preset execution complete coefficient, the first confidence analysis method is used to analyze the target evaluation subset, including: Determine a sharding quality parameter of a class of evaluation subsets according to the subset execution efficiency and the reference correlation index; Determine whether to perform subset task scheduling for a type of evaluation subset according to the shard quality parameter; Under the subset confirmation condition, the confidence reference coefficient of each relevant analysis text is determined according to the topic enrichment parameter; The subset confirmation condition is that a type of evaluation subset does not need to perform subset task scheduling or has completed the subset task; The type of evaluation subset is a target evaluation subset in a type of shard execution state.

3. The enterprise evaluation method based on big data analysis according to claim 2 is characterized in that: For a single type of evaluation subset, if the slice quality parameter of the type of evaluation subset is less than the preset slice quality parameter, subset task scheduling is performed for the type of evaluation subset; Determine the URLs to be segmented of the evaluation subset based on the extended correlation coefficient and the topic-independent parameter; The target allocation subset is determined based on the key words corresponding to the URL to be segmented and its extended URL and the subset processing efficiency.

4. The enterprise evaluation method based on big data analysis according to claim 3 is characterized in that: For a single first-class evaluation subset, if the shard quality parameter of the first-class evaluation subset is greater than the preset shard quality parameter, the number of concurrent requests is increased and adjusted according to the subset execution efficiency; Determine whether to perform secondary adjustment on the number of concurrent requests based on the efficiency optimization parameters; The increase in the number of concurrent requests is negatively correlated with the subset execution efficiency.

5. The enterprise evaluation method based on big data analysis according to claim 4 is characterized in that: For a single target evaluation subset, if the target evaluation subset is in a second-class shard execution state where the expansion validity coefficient is greater than the preset expansion validity coefficient and the execution completeness coefficient is greater than the preset execution completeness coefficient, the second confidence analysis method is used for the target evaluation subset for analysis, including: Determine the subset execution coefficient of the second category evaluation subset according to the reference relevance index and the topic relevance ratio; Determine the set setting method and effective evaluation strategy according to the subset execution coefficient; The set setting method is to determine the relevant matching set according to the subject association parameter and the set association index or to determine the access matching set according to the execution correlation coefficient and the access correlation coefficient; The second type of evaluation subset is a target evaluation subset in a second type of sharding execution state.

6. The enterprise evaluation method based on big data analysis according to claim 5 is characterized in that: For a single second-category evaluation subset, if the subset execution coefficient of the second-category evaluation subset is greater than the preset subset execution coefficient, the relevant matching set is determined according to the subject association parameter and the set association index, and the confidence reference coefficient of the relevant analysis text obtained by the second-category evaluation subset in the current subset analysis cycle is determined based on the reference relevant matching coefficient of each evaluation matching set and the key evaluation parameter; The correlation matching coefficient of each key subject word in any correlation matching set is greater than the preset correlation matching coefficient.

7. The enterprise evaluation method based on big data analysis according to claim 6 is characterized in that: For a single second-category evaluation subset, if the subset execution coefficient of the second-category evaluation subset is less than or equal to the preset subset execution coefficient, an access matching set is determined according to the execution correlation coefficient and the access correlation coefficient, and a confidence reference coefficient of the relevant analysis text obtained by the second-category evaluation subset in the current subset analysis cycle is determined based on the access matching coefficient of each access matching set and the corresponding reference influence coefficient; The access matching coefficient in any access matching set is greater than the preset access matching coefficient.

8. The enterprise evaluation method based on big data analysis according to claim 7 is characterized in that: Under the subset analysis condition, the information acquisition quality of each target evaluation set is determined based on the effective reference ratio and information overlap parameters; The information acquisition quality is positively correlated with the effective reference ratio and the information overlap parameter respectively; The subset analysis condition is that each target evaluation subset completes the task effective analysis or performs effective analysis.

9. The enterprise evaluation method based on big data analysis according to claim 8 is characterized in that: Determine the final evaluation score of each target evaluation data of the target evaluation enterprise based on each data value corresponding to the target evaluation data in the obtained relevant analysis text and the evaluation weight coefficient corresponding to the relevant analysis text; For a single relevant analysis text, its corresponding evaluation weight coefficient is positively correlated with the information acquisition quality of the target evaluation subset to which the relevant analysis text belongs.

10. An enterprise evaluation system using the enterprise evaluation method based on big data analysis as claimed in any one of claims 1 to 9, characterized in that: include: A subset evaluation module for expanding effective coefficients and executing complete coefficients in response to subset evaluation conditions to determine a subset processing strategy; A first confidence analysis module, which is connected to the subset evaluation module, is used to respond to the shard quality parameter of the adjustment judgment condition to determine the efficiency adjustment method and complete the determination of the confidence reference coefficient of each relevant analysis text. The efficiency adjustment method is to perform subset task scheduling for a type of evaluation subset, or to adjust the number of concurrent requests according to the subset execution efficiency; A second confidence analysis module, which is connected to the subset evaluation module, is used to respond to the subset execution coefficient of the setting judgment condition to determine the set setting mode and the effective evaluation strategy, the effective evaluation strategy is to determine the confidence reference coefficient based on the reference related matching coefficient and the key evaluation parameter, or to determine the confidence reference coefficient based on the access matching coefficient and the reference influence coefficient; An evaluation execution module, which is connected to the first confidence analysis module and the second confidence analysis module, is used to determine the final evaluation score of each target evaluation data based on the data value of the target evaluation data and the evaluation weight coefficient corresponding to the relevant analysis text.

Images