Karaoke Scoring Device Facial Expression Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional karaoke scoring systems do not effectively incorporate facial expressions and motions into the scoring process, limiting user engagement and enjoyment, especially for those with confidence issues in singing voice.
Innovation Solution
A scoring device that acquires image data of the singer, detects facial features associated with expressions and motions, and calculates a score based on these features, allowing for a more engaging and personalized scoring experience by considering previously defined target features and expressions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional scoring functions are used that only consider musical interval, swell, and vocal volume, then the scoring system remains simple and easy to implement, but the user engagement and enjoyment are limited
Solution Approach 1:
The patent combines multiple scoring dimensions (facial expression recognition, voice quality analysis, musical accuracy) into a unified scoring system. The facial feature detection unit, voice analysis unit, and musical interval calculation unit all contribute to a comprehensive score, merging diverse data sources to enhance user engagement while maintaining systematic integration
Solution Approach 2:
The scoring device performs multiple functions simultaneously: it recognizes facial expressions, analyzes voice characteristics, calculates musical intervals, and provides real-time feedback. This multi-functional approach allows the system to evaluate singing performance from multiple dimensions without requiring separate systems for each function
2Adaptability or versatility
If facial features are added to scoring criteria to enhance user engagement, then more diverse customer segments can be attracted, but the device complexity increases
Solution Approach 1:
The patent segments the facial recognition process into distinct components: feature point detection on the face image, expression classification based on feature point movements, and integration with voice analysis. This segmentation allows complex facial analysis to be broken down into manageable processing stages, reducing overall system complexity while maintaining comprehensive evaluation capability
Solution Approach 2:
The patent introduces a control unit that acts as an intermediary, coordinating between the facial feature detection unit, voice analysis unit, and score calculation unit. This central control mechanism manages the flow of information between different modules, simplifying the integration of multiple complex functions through a unified control architecture
Data Source
AI summary
A scoring device has an acquisition unit that acquires image data in which a singer is photographed, a detector that detects a feature associated with an expression or a facial motion during singing as a facial feature of the singer from the image data acquired by the acquisition unit, a calculator that calculates a score for singing action of the singer based on the feature detected by the detector, and an output unit that outputs the score.