Information Processing for Expertise-Weighted Evaluation Confidence
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional evaluation systems are susceptible to variations in evaluation results due to evaluator expertise and conflicts of interest, raising questions about the reliability of the evaluations.
Innovation Solution
An information processing method and system that derive a confidence level of an evaluation by determining the field expertise level and conflict of interest level of an evaluator based on evaluation target and evaluator information, using equations to weight these factors for a more accurate assessment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional evaluation systems are used, then evaluation results can be obtained, but the reliability of evaluation results deteriorates due to evaluator expertise variations and conflicts of interest
Solution Approach 1:
The evaluation system is segmented into multiple independent components: evaluator information acquisition module, evaluation target information acquisition module, field expertise level determination module, conflict of interest level determination module, and confidence level derivation module. Each module handles a specific aspect of the evaluation process, allowing the system to maintain reliability while managing complexity through modular design.
Solution Approach 2:
The patent introduces an intermediary confidence level metric that mediates between the evaluator's characteristics (expertise and conflicts of interest) and the final evaluation result. This intermediary component allows the system to account for evaluator reliability factors without directly complicating the core evaluation process, as the confidence level serves as a buffering layer that quantifies reliability independently.
2Measurement precision
If evaluator expertise and conflict of interest information are incorporated, then confidence level of evaluation improves, but information processing complexity increases
Solution Approach 1:
The patent transforms qualitative evaluator characteristics (expertise and conflicts of interest) into quantitative parameters (field expertise level and conflict of interest level) that can be processed systematically. By changing the parameter representation from subjective attributes to measurable levels, the system achieves precise measurement of evaluation confidence while maintaining manageable information processing complexity through standardized parameter formats.
Solution Approach 2:
The system applies local quality by determining field expertise level and conflict of interest level specifically for each evaluator-evaluation target pair rather than applying uniform criteria to all evaluations. This localized assessment allows precise measurement of confidence levels for specific evaluation contexts without requiring complex global processing of all possible evaluator characteristics.
3Measurement precision
If multiple evaluation factors are analyzed, then accuracy of confidence level derivation improves, but processing time increases
Solution Approach 1:
The patent performs preliminary actions by acquiring and storing evaluator information (including field expertise level and conflict of interest level) and evaluation target information before the actual evaluation process. This pre-processing of information allows the confidence level derivation to proceed efficiently during the evaluation phase, as the foundational data is already prepared and organized, reducing processing time while maintaining accurate multi-factor analysis.
Data Source
AI summary
An information processing method includes: obtaining evaluation target information containing information about an evaluation target; obtaining evaluator information containing information about an evaluator; determining, based on the evaluation target information and the evaluator information, at least one of a field expertise level or a conflict of interest level of the evaluator on the evaluation target; and deriving a confidence level of the evaluation based on the at least one of the field expertise level or the conflict of interest level which have been determined in the determining.