Operation Detection Using Motion Certainty and Sound Confirmation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to accurately detect operator operations when the touch position cannot be detected, leading to inappropriate determination of user interface component operations.
Innovation Solution
An operation detection system that utilizes motion detection, certainty level estimation based on operator motion, and sound detection to determine the performance of predetermined operations, integrating imaging, myoelectric potential measurement, and sound collection devices to enhance detection accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple cameras are arranged in a matrix to increase detection coverage, then detection coverage is improved, but device complexity and processing load increase
Solution Approach 1:
The detection area is divided into multiple regions of interest (ROIs), and only these specific regions are detected by the camera. This segmentation approach maintains comprehensive detection coverage while reducing the amount of data that needs to be processed, thereby lowering device complexity and processing load.
Solution Approach 2:
Different regions of interest are detected with different levels of attention and processing resources. By focusing detection quality locally on critical areas rather than uniformly across the entire field of view, the system achieves high detection coverage while optimizing computational resources and reducing overall device complexity.
2Measurement precision
If image processing is performed at high resolution to improve detection accuracy, then detection accuracy is improved, but processing time increases
Solution Approach 1:
The image processing is segmented into two stages: initial detection at lower resolution to identify regions of interest quickly, followed by detailed analysis at high resolution only for those specific regions. This approach maintains high detection accuracy for critical areas while significantly reducing overall processing time.
Solution Approach 2:
High-resolution processing is applied partially only to regions of interest rather than to the entire image. This partial action approach ensures detection accuracy is improved for critical areas while avoiding the excessive processing time that would result from full-image high-resolution analysis.
3Measurement precision
If detection sensitivity is increased to detect subtle operations, then detection sensitivity is improved, but false positive rate increases
Solution Approach 1:
Different detection sensitivity levels are applied to different regions of interest based on their importance and characteristics. Critical areas use higher sensitivity with additional verification, while less critical areas use lower sensitivity thresholds. This local differentiation maintains high detection sensitivity for important operations while reducing false positives overall.
Solution Approach 2:
The system incorporates feedback mechanisms where detection results are verified and validated before final classification. Multiple detection passes and cross-validation against known patterns help distinguish true positive detections from false positives, maintaining high sensitivity while improving reliability.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention provide a operation detection device and a operation detection method configured to: detect a motion of an operator; estimate, based on the detected motion of the operator, a certainty level that the operator has performed a predetermined operation; detect a predetermined sound generated when the predetermined operation is performed; and when the certainty level is a predetermined value or more and the predetermined sound is detected, determine that the operator has performed the predetermined operation.