Method and system for evaluating credential technology

Abstract

The invention discloses a credential and credential technology assessment method and system, and relates to the technical field of credential and credential assessment. Comprising the following steps: performing innovation information input in a network form and a paper questionnaire form; the input information is transmitted to the user opinion classification storage unit through the user opinion collection unit, the user opinion classification storage unit comprises a first storage layer and a second storage layer, and the first storage layer and the second storage layer store innovation information passing through and not passing through the classification table respectively. According to the invention, a set of complete large-scale all-around technical innovation management system is established, innovation information is collected in various modes, innovation information which cannot be realized is filtered out, weights of corresponding innovation information are respectively set, the weights and scores of the innovation information by corresponding experts are combined, the number of the innovation information is updated in real time, and the innovation information is updated in real time. The evaluation accuracy of the innovation information is improved, and the advantages and disadvantages of the innovation information are determined according to the score.

Description

Technical Field

[0001] The present invention relates to the field of credible innovation technology assessment technology, and specifically to a credible innovation technology assessment method and system. Background Art

[0002] Existing information technology service quality evaluation often takes the form of manually obtaining paper documents, that is, manually screening, collecting and extracting the corresponding features that can evaluate the quality of information technology, and then evaluating the quality of information technology services in the form of professional evaluation and scoring, and giving information technology service quality evaluation conclusions with personal biased opinions.

[0003] However, the use of manual evaluation methods not only leads to long evaluation time and low evaluation efficiency, but also requires multiple professionals to score the information during the evaluation process. However, such scoring method is not the most suitable for information technology service quality users who are currently requesting information. Therefore, the evaluation results output by professionals are of low reference value to users and cannot meet the actual needs of users in the current environment. Summary of the invention

[0004] The purpose of the present invention is to provide a method and system for evaluating information technology to solve the problems raised in the above-mentioned background technology.

[0005] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a method and system for evaluating innovation technology, including: front-end input, inputting innovation information in the form of network and in the form of paper documents;

[0006] Information storage, the input information is transmitted to the user opinion classification storage unit through the user opinion collection unit, the user opinion classification storage unit includes a first storage layer and a second storage layer, the first storage layer and the second storage layer respectively store the innovation information that passes and fails the classification table; the total number of innovation information and all text information output by the user opinion classification storage unit are stored;

[0007] Establish an intelligent scoring model to score the innovation information entering the innovation information collection unit. The scoring is based on two indicators: the total number of the same type of information and the feasibility of the solution. If the innovation solution cannot be realized, the final score is 0.

[0008] The intelligent scoring model evaluates the technology maturity and R&D cost of the innovation information evaluated by the innovation information evaluation unit. The technology maturity evaluation is the technology maturity developed for the innovation information in the current market. The lower the technology maturity, the higher the score; the lower the R&D cost, the higher the score;

[0009] The intelligent scoring model inputs innovation information such as staffing, materials, and software purchases into the developed quota software, which automatically evaluates the R&D costs of the system. The lower the R&D costs, the higher the score.

[0010] Evaluation is conducted based on R&D costs through calculation software. The higher the return on investment, the higher the score.

[0011] Set the scoring coefficient, and the sum of the scoring coefficient of the corresponding unit multiplied by the total score of the unit is the total score of the innovation information, so as to realize the evaluation of the information innovation technology.

[0012] Furthermore, the intelligent scoring model establishment method includes:

[0013] S1: Obtain training data and collect various parameters in the implementation process of previous information technology;

[0014] S2: Feature extraction, using training data to extract feature data from the training data:

[0015] S3: Determine the label or target of the score, label the feature data and set the target value;

[0016] S4: Divide the data into training, validation, and test sets to evaluate the performance of the model;

[0017] S5: Use neural network models to perform basic training on data;

[0018] S6: After verification, the model is deployed to achieve automatic scoring.

[0019] Furthermore, the paper questionnaire form for innovation information input is that the information innovation collection personnel distributes the survey form to the undirected personnel, and after the survey personnel fill it out, the information innovation collection personnel manually enters the information into the front-end input unit;

[0020] Innovative information input in the form of network is to install the front-end input unit in the terminal in the form of software, publish it to the mobile phone application store in the form of APP for users to download, and embed it into the company's official website in the form of opinion box or question column for users to fill in and submit. The submitted information is transmitted to the user opinion collection unit.

[0021] Furthermore, the opinion classification storage unit realizes automatic classification and real-time update of user opinions through neural network training, and stores the classified storage of the collected information through the classification table in the first layer. The classification table is selected in the form of a tree table, which is divided into left branches and right branches. The right branches are included in the left branches, and each left branch is a writable field;

[0022] If the questions and suggestions raised by the user do not fall within the scope of the left branch, the collected information is stored in the second storage layer, and an update time is set. If the information flowing into the second storage layer is not manually moved out to the left branch of the first storage layer within the set update time, the information will be deleted.

[0023] Furthermore, the innovation information collection unit is used to store the total number of innovation information and all text information output by the user opinion classification storage unit, but encryption measures are set so that the innovation information collection unit can update the information transmitted by the opinion classification storage unit in real time, but cannot modify the information stored in the innovation information collection unit, protect the integrity of the transmitted information, and ensure that the information will not be modified during the transmission process. At the same time, only the recipient with the correct key or authentication can decrypt and verify the data, which can provide real-time update function and protect the security of the information stored in the unit.

[0024] Furthermore, the R&D cost assessment includes: man-hour assessment, material cost assessment, equipment and facility assessment, outsourced R&D or purchased technology cost assessment and indirect cost assessment.

[0025] Furthermore, the formula for calculating the return on investment is: (income flow - investment amount) / R&D cost×100%. In addition, it is necessary to compare it with the time value of cash during the investment period. The larger the difference, the higher the return on investment evaluation.

[0026] A system for evaluating ICT technology, comprising:

[0027] Collection module: used for front-end input, and inputs innovation information in the form of network and paper documents. The collection module includes: front-end input unit, user opinion collection unit, user opinion classification storage unit, and innovation information collection unit;

[0028] Storage module: used for information storage. The input information is transmitted to the user opinion classification storage unit through the user opinion collection unit. The user opinion classification storage unit includes a first storage layer and a second storage layer. The first storage layer and the second storage layer store the innovation information that passes and fails the classification table respectively; the total number of innovation information and all text information output by the user opinion classification storage unit are stored; and the information in the scoring module is stored;

[0029] Scoring module: The built-in intelligent scoring model evaluates the technology maturity and R&D cost of the innovation information evaluated by the innovation information evaluation unit. The technology maturity evaluation is the technology maturity developed for the innovation information in the current market. The lower the technology maturity, the higher the score; the lower the R&D cost, the higher the score;

[0030] And evaluation based on R&D costs through calculation software, the higher the return on investment evaluation, the higher the score;

[0031] The scoring module also includes: innovation information evaluation unit, technology maturity evaluation unit, R&D cost evaluation unit, investment return rate evaluation unit and calculation unit;

[0032] Allocation module: used to implement the intelligent scoring model to input innovation information such as personnel allocation, materials, and software purchases into the developed quota software. The quota software automatically evaluates the R&D cost of the system. The lower the R&D cost, the higher the score;

[0033] The reading module is used to display the set scoring coefficient. The sum of the scoring coefficient of the corresponding unit multiplied by the total score of the unit is the total score of the innovation information, so as to realize the evaluation of the information innovation technology; including a PC terminal or a mobile terminal, which is used by the manager to retrieve the information stored in the storage module and display the evaluation score of the queried innovation information to facilitate decision-making;

[0034] The distribution module copies the innovative information in the storage module and transmits it to several reading modules through the network in the form of data broadcasting.

[0035] Furthermore, the innovation information evaluation unit is implemented as follows:

[0036] Step 1: Establish an updateable resource library to better configure audit resources;

[0037] Step 2: Classify the resources in the resource library by field, so as to speed up the review process;

[0038] Step 3: Configure security measures to access and verify the authority of the innovative information collection unit, thereby improving system security and preventing leaks;

[0039] Step 4: Information push: the system automatically pushes the innovation information of the innovation information collection unit to experts in the corresponding field;

[0040] Step 5: Innovation information scoring.

[0041] Furthermore, the calculation unit sets scoring coefficients for the innovation information evaluation unit, technology maturity evaluation unit, R&D cost evaluation unit, and return on investment evaluation unit respectively. The sum of the scoring coefficients of the corresponding units multiplied by the total score of the unit is the total score of the innovation information, thereby realizing the evaluation of the information innovation technology.

[0042] Compared with the prior art, the present invention has the following beneficial effects:

[0043] The ICT technology evaluation method and system has established a complete, large-scale, and comprehensive technology innovation management evaluation system. It collects innovation information through various means, filters out innovation information that cannot be realized, sets corresponding weights for innovation information, and uses intelligent models to score innovation information in combination with artificial intelligence technology. It updates the amount of innovation information in real time, improves the accuracy of innovation information evaluation, and determines the quality of innovation information by scoring, thereby providing a reference for the establishment and upgrading of subsequent ICT technology.

[0044] All information is set in a storage module and quickly transmitted to a PC terminal or mobile terminal in the form of data broadcasting through a distribution module, making it convenient for managers to retrieve and make decisions. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 This is a diagram of the credential creation technology evaluation system of the present invention;

[0046] Figure 2 It is the internal connection diagram of the collection module of the present invention;

[0047] Figure 3 This is the internal connection diagram of the scoring module of the present invention. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] like Figure 1-Figure 3 As shown, the present invention provides a technical solution: a method and system for evaluating ICT technology, wherein the ICT technology system includes a collection module, a scoring module, a storage module, an allocation module and a reading module;

[0050] The collection module includes: a front-end input unit, a user opinion collection unit, a user opinion classification storage unit, and an innovation information collection unit.

[0051] The front-end input unit includes the network form to input innovation information and the paper questionnaire form to input innovation information.

[0052] Specifically, the input of innovation information in the form of paper questionnaires is that the information innovation collection personnel distribute survey forms to undirected personnel, and after the survey personnel fill in the forms, the information innovation collection personnel manually enter the information into the front-end input unit;

[0053] Innovative information input in the form of the Internet is to install the front-end input unit in the terminal of each service hall in the form of software, publish it to the mobile phone application store in the form of APP for users to download, and embed it in the company's official website in the form of opinion box or question column for users to fill in and submit. The submitted information is transmitted to the user opinion collection unit.

[0054] The information collected in the above manner is transmitted to the user opinion classification storage unit, which includes a first storage layer and a second storage layer. The first storage layer classifies and stores the collected information through a classification table. The classification table can be selected in a tree table form, divided into a left branch and a right branch. The right branch is included in the left branch. Each left branch is a writable field, such as distance education, telemedicine, remote settlement, communication, smart Internet of Things, smart home and smart transportation. If words related to distance education and telemedicine appear in the same information, then the information will be added to the right branch of distance education and telemedicine at the same time. The opinion classification storage unit realizes automatic classification of user opinions through neural network training. If the questions and suggestions raised by the user do not belong to the field of the left branch, the information is stored in the second storage layer, and the update time is set. For example, the information update time of the second storage layer is three days, that is, the information flowing into the second storage layer is not manually moved out to the left branch of the first storage layer within three days, and the information will be deleted.

[0055] The user opinion classification storage unit automatically classifies the above information and summarizes it in a list in a form such as, but not limited to, an Excel table. The total number of the same type of information is represented in the list in digital form. For example, there are 100,111 telemedicine items and 80,111 distance education items. The total number of the same type of information is accurate to the single digit.

[0056] The number of information in the table is updated in real time as the information is continuously written into the first storage layer, that is, the total number of the same type of information based on the evaluation in the later stage is the real-time number of information.

[0057] The innovation information collection unit is used to store the total number of innovation information and all text information output by the user opinion classification storage unit, but the information in the innovation information collection unit cannot be modified.

[0058] Specifically, encryption measures such as digital signatures, message authentication codes (MACs), secure communication protocols, and tamper-proof hash functions are set in the system, so that the innovative information collection unit can update the information transmitted by the opinion classification storage unit in real time, but cannot modify the information stored in the innovative information collection unit, protect the integrity of the transmitted information, and ensure that the information will not be modified during the transmission process. At the same time, only the recipient with the correct key or authentication can decrypt and verify the data, which can provide real-time update functions and protect the security of the information stored in the unit.

[0059] Among them, the scoring modules include: innovation information evaluation unit, technology maturity evaluation unit, R&D cost evaluation unit, return on investment evaluation unit and calculation unit.

[0060] Specifically, the implementation method of the innovation information evaluation unit is: 1. Establish an updateable resource library (resources can be added or deleted) to better configure audit resources; 2. Classify the resources in the resource library by field, so as to speed up the audit; 3. Configure corresponding security measures to access and verify the authority of the innovation information collection unit, so as to improve the security of the system and prevent leaks; 4. Information push, the system automatically pushes the innovation information of the innovation information collection unit to experts in the corresponding field; 5. Innovation information scoring.

[0061] Innovation information is pushed to multiple experts at the same time, or experts enter the innovation information collection unit within their authority to score the innovation information. In a specific embodiment, the same innovation information needs to be scored by three experts, and the scoring information is blocked for the other two scoring experts. The score of each unit is the total score / 3.

[0062] Establish an intelligent scoring model to score the innovative information entering the innovative information collection unit. The scoring is based on two indicators: the first is the total number of the same type of information. It can be known that the higher the number, the greater the market demand; the second is the feasibility of the solution, for example, some innovative solutions are impossible to achieve;

[0063] In a specific embodiment, the score of the total number of information indicators is automatically scored by the system. The higher the number, the higher the score. For example, when the total number of the same type of information is more than 3 million, the score is 10; when the total number is between 2.8 million and 3 million, the score is 9; when the total number is between 2.6 million and 2.8 million, the score is 8; ..., the score decreases by 1 for every 200,000 people reduction, and the lowest score is 1 (no further derivation).

[0064] When the plan is feasible, the score is 1, and when the plan is not feasible, the score is 0. The feasibility of the plan adopts the principle of minority obeys majority, that is, when the two results obtained by the intelligent scoring model are scored as 1, the plan is passed and the final score is 1. Similarly, when the two results obtained by the intelligent scoring model are scored as 0, the plan is not passed and the final score is 0.

[0065] 3. Technology maturity evaluation unit, the intelligent scoring model evaluates the technology maturity of the innovative information that has passed the evaluation of the innovative information evaluation unit (feasible solution). The method for establishing the intelligent scoring model includes: S1: obtaining training data and collecting various parameters in the previous implementation process of the innovative technology; S2: feature extraction, using the training data to extract the feature data in the training data: S3: determining the scoring label or target, labeling the feature data and setting the target value; S4: dividing the data into training set, validation set and test set to evaluate the performance of the model; S5: using the neural network model to perform basic training of the data; S6: after the verification is completed, the model is deployed to achieve automatic scoring.

[0066] In a specific embodiment, the technology maturity evaluation is the maturity of the technology developed for the innovative information in the current market. The lower the technology maturity, the higher the score.

[0067] In the R&D cost evaluation unit, the intelligent scoring model inputs innovation information such as staffing, materials, and software purchases into the developed quota software, which automatically evaluates the system's R&D costs.

[0068] In a specific embodiment, the lower the R&D cost, the higher the score. The R&D cost evaluation includes:

[0069] Working hours evaluation: Calculate the overall personnel cost by evaluating the working hours of the personnel involved in the R&D project, including but not limited to the salary and benefits of the R&D team, management and support team;

[0070] Material cost assessment: assess the cost of required materials, including but not limited to raw materials, experimental equipment, testing tools, etc.

[0071] Equipment and facilities assessment: The cost of the equipment and facilities required for the assessment, including but not limited to the purchase, maintenance and update costs of laboratory equipment, office equipment and professional software;

[0072] Cost assessment of outsourcing R&D or purchasing technology: When purchasing existing technology or outsourcing certain tasks or technologies during the R&D process, it is necessary to evaluate the cost of outsourcing services, including but not limited to contract fees, salaries of outsourcing teams, software purchase costs, etc.

[0073] Indirect cost assessment: assess the indirect costs associated with the R&D project, including but not limited to office space rental, water and electricity costs, communication costs, etc.

[0074] The return on investment evaluation unit uses calculation software to evaluate based on R&D costs.

[0075] In a specific embodiment, the higher the return on investment evaluation, the higher the score. The return on investment calculation formula is: (income flow-investment amount) / R&D cost*100%. In addition, it is also necessary to compare with the time value of cash during the investment period. The larger the difference, the higher the return on investment evaluation.

[0076] The calculation unit sets scoring coefficients for the innovation information evaluation unit, the technology maturity evaluation unit, the R&D cost evaluation unit, and the return on investment evaluation unit, respectively. The sum of the scoring coefficients of the corresponding units multiplied by the total score of the unit is the total score of the innovation information, so as to realize the evaluation of the information innovation technology. In a specific embodiment of the present scheme, the scoring coefficients in the above units can be set to 40%, 10%, 30% and 20% respectively.

[0077] The storage module is used to store the information in the scoring module.

[0078] The reading module is a PC terminal or a mobile terminal, which is used by managers to retrieve the information stored in the storage module and display the evaluation score of the queried innovation information to facilitate decision-making.

[0079] The distribution module copies the innovation information in the storage module and transmits it to several reading modules through the network by means of data broadcasting, so as to facilitate the management personnel to retrieve and make decisions on the innovation information.

[0080] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for evaluating ICT technology, characterized in that: include: Front-end input, input of innovation information in the form of network and paper documents; Information storage, the input information is transmitted to the user opinion classification storage unit through the user opinion collection unit, the user opinion classification storage unit includes a first storage layer and a second storage layer, the first storage layer and the second storage layer respectively store the innovation information that passes and fails the classification table; The total amount of innovative information and all text information output by the user opinion classification storage unit are stored; Establish an intelligent scoring model to score the innovation information entering the innovation information collection unit. The scoring is based on two indicators: the total number of the same type of information and the feasibility of the solution. If the innovation solution cannot be realized, the final score is 0. The intelligent scoring model evaluates the technology maturity and R&D cost of the innovation information evaluated by the innovation information evaluation unit. The technology maturity evaluation is the technology maturity developed for the innovation information in the current market. The lower the technology maturity, the higher the score; the lower the R&D cost, the higher the score; The intelligent scoring model inputs innovation information such as staffing, materials, and software purchases into the developed quota software, which automatically evaluates the R&D costs of the system. The lower the R&D costs, the higher the score. Evaluation is conducted based on R&D costs through calculation software. The higher the return on investment, the higher the score. Set the scoring coefficient, and the sum of the scoring coefficient of the corresponding unit multiplied by the total score of the unit is the total score of the innovation information, so as to realize the evaluation of the information innovation technology.

2. According to claim 1, a method for evaluating ICT technology, characterized in that: The intelligent scoring model establishment method comprises: S1: Obtain training data and collect various parameters in the implementation process of previous information technology; S2: Feature extraction, using training data to extract feature data from the training data: S3: Determine the label or target of the score, label the feature data and set the target value; S4: Divide the data into training, validation, and test sets to evaluate the performance of the model; S5: Use neural network models to perform basic training on data; S6: After verification, the model is deployed to achieve automatic scoring.

3. According to claim 1, a method for evaluating ICT technology, characterized in that: The paper questionnaire form for innovation information input is that the information innovation collection personnel distributes the survey form to random personnel, and after the survey personnel fill it out, the information innovation collection personnel manually enter the information into the front-end input unit; Innovative information input in the form of network is to install the front-end input unit in the terminal in the form of software, publish it to the mobile phone application store in the form of APP for users to download, and embed it into the company's official website in the form of opinion box or question column for users to fill in and submit. The submitted information is transmitted to the user opinion collection unit.

4. According to claim 1, a method for evaluating ICT technology, characterized in that: The opinion classification storage unit realizes automatic classification and real-time update of user opinions through neural network training, and stores the classified storage of the collected information through the classification table in the first layer. The classification table is selected in the form of a tree table, which is divided into left branch items and right branch items. The right branch items are included in the left branch items, and each left branch item is a writable field; If the questions and suggestions raised by the user do not fall within the scope of the left branch, the collected information is stored in the second storage layer, and an update time is set. If the information flowing into the second storage layer is not manually moved out to the left branch of the first storage layer within the set update time, the information will be deleted.

5. According to claim 1, a method for evaluating ICT technology, characterized in that: The innovative information collection unit is used to store the total number of innovative information and all text information output by the user opinion classification storage unit, but encryption measures are set so that the innovative information collection unit can update the information transmitted by the opinion classification storage unit in real time, but cannot modify the information stored in the innovative information collection unit, protect the integrity of the transmitted information, and ensure that the information will not be modified during the transmission process. At the same time, only the recipient with the correct key or authentication can decrypt and verify the data, which can provide a real-time update function and protect the security of the information stored in the unit.

6. According to claim 1, a method for evaluating ICT technology is characterized in that: The R&D cost assessment includes: man-hour assessment, material cost assessment, equipment and facility assessment, outsourced R&D or technology purchase cost assessment and indirect cost assessment.

7. According to claim 1, a method for evaluating ICT technology is characterized in that: The formula for calculating the return on investment is: (income flow - investment amount) / R&D cost×100%. In addition, it is also necessary to compare with the time value of cash during the investment period. The larger the difference, the higher the return on investment evaluation.

8. A system for evaluating ICT technology, characterized in that: include: Collection module: used for front-end input, and inputs innovation information in the form of network and paper documents. The collection module includes: front-end input unit, user opinion collection unit, user opinion classification storage unit, and innovation information collection unit; Storage module: used for information storage. The input information is transmitted to the user opinion classification storage unit through the user opinion collection unit. The user opinion classification storage unit includes a first storage layer and a second storage layer. The first storage layer and the second storage layer store the innovation information that passes and fails the classification table respectively; the total number of innovation information and all text information output by the user opinion classification storage unit are stored; and the information in the scoring module is stored; Scoring module: The built-in intelligent scoring model evaluates the technology maturity and R&D cost of the innovation information evaluated by the innovation information evaluation unit. The technology maturity evaluation is the technology maturity developed for the innovation information in the current market. The lower the technology maturity, the higher the score; the lower the R&D cost, the higher the score; And evaluation based on R&D costs through calculation software, the higher the return on investment evaluation, the higher the score; The scoring module also includes: innovation information evaluation unit, technology maturity evaluation unit, R&D cost evaluation unit, investment return rate evaluation unit and calculation unit; Allocation module: used to implement the intelligent scoring model to input innovation information such as personnel allocation, materials, and software purchases into the developed quota software. The quota software automatically evaluates the R&D cost of the system. The lower the R&D cost, the higher the score; The reading module is used to display the set scoring coefficient. The sum of the scoring coefficient of the corresponding unit multiplied by the total score of the unit is the total score of the innovation information, so as to realize the evaluation of the information innovation technology; including a PC terminal or a mobile terminal, which is used by the manager to retrieve the information stored in the storage module and display the evaluation score of the queried innovation information to facilitate decision-making; The distribution module copies the innovative information in the storage module and transmits it to several reading modules through the network in the form of data broadcasting.

9. The system for evaluating the ICT technology according to claim 8, characterized in that: The innovation information evaluation unit is implemented as follows: Step 1: Establish an updateable resource library to better configure audit resources; Step 2: Classify the resources in the resource library by field, so as to speed up the review process; Step 3: Configure security measures to access and verify the authority of the innovative information collection unit, thereby improving system security and preventing leaks; Step 4: Information push: the system automatically pushes the innovation information of the innovation information collection unit to experts in the corresponding field; Step 5: Innovation information scoring.

10. The system for evaluating ICT technology according to claim 8, characterized in that: The calculation unit sets scoring coefficients for the innovation information evaluation unit, technology maturity evaluation unit, R&D cost evaluation unit, and return on investment evaluation unit respectively. The sum of the scoring coefficients of the corresponding units multiplied by the total score of the unit is the total score of the innovation information, thereby realizing the evaluation of the information innovation technology.

Images