Operator Speech Correlation Analysis for Plant Task Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies lack the ability to effectively evaluate operational skills, including conversations and information transmission, during plant operations, as they do not analyze the correlation between conversation data, action data, and task status.

Innovation Solution

An evaluation system that includes speech data acquisition, speech recognition, task data acquisition, extraction, and analysis units to analyze correlations between conversation data, action data, and task status, providing insights into appropriate conversation and operation performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If speech recording and video recording are performed during plant operations, then operational training data is captured, but the ability to evaluate the correlation between conversation, action, and task status is lost

Engineering Contradiction:
Improveconversation and operation dataVSAvoidevaluation capability
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system merges speech data, video data, and operation data into a unified evaluation framework. The speech recognition unit converts speech to text, which is then integrated with operation data from the power plant control system, allowing comprehensive correlation analysis between conversation content, operational actions, and task status

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system provides feedback by evaluating and displaying the correlation between conversation data, action data, and task status data. This feedback mechanism enables assessment of whether appropriate conversations were performed at appropriate times during plant operations, allowing for continuous improvement of operational skills

Inventive Principle:
Principle #23Feedback

2Measurement precision

If comprehensive data collection is performed, then evaluation accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveevaluation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The evaluation system is segmented into distinct functional units: speech data acquisition, speech recognition, operation data acquisition, and correlation analysis. Each unit handles a specific aspect of data processing, making the overall complex system manageable through modular design while maintaining comprehensive evaluation capabilities

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces intermediate processing components including speech recognition units that convert speech to text, and extraction units that identify relevant conversation data. These intermediaries bridge the gap between raw data collection and meaningful evaluation, reducing complexity by structuring the data flow

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11380318B2Evaluation system, evaluation method, and program
Publication Date: 2022.07.05 MITSUBISHI HEAVY IND LTD
  • US11380318B2 patent drawing
  • US11380318B2 patent drawing
  • US11380318B2 patent drawing

AI summary

An evaluation system includes a speech data acquisition unit configured to acquire speech data from speech of a member engaged in a task, a speech recognition unit configured to recognize content of the speech from the speech data and convert the content into text data, a task data acquisition unit configured to acquire data indicating an action related to the task of the member and data indicating a task status, an extraction unit configured to extract conversation data related to the task from the text data based on the content of the speech recognized by the speech recognition unit, and an analysis unit configured to analyze correlations between the conversation data, the data indicating the action, and the data indicating the task status.