Facial Expression Operation System for Intuitive Electronic Device Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Operating electronic devices, such as mobile phones, using touch panels can be dull and require manual clicks or slides, lacking intuitive interaction methods.

Innovation Solution

An electronic device equipped with a facial expression operation system that uses a camera to capture and analyze facial expressions, allowing users to control device functions through recognized facial movements, such as eye winking or mouth changes, by correlating detected features with predefined operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch panel operation is used, then device control function is achieved, but operation intuitiveness deteriorates

Engineering Contradiction:
Improveoperation intuitivenessVSAvoidoperation method complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical touch panel operation system with a facial expression recognition system. Instead of requiring physical contact with the device through clicks or slides, the system captures facial images via camera, detects facial features and expressions through image processing algorithms, and translates these into device control commands. This substitution of mechanical interaction with optical and computational methods directly improves operation intuitiveness while reducing the complexity of the interaction paradigm.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces facial expression recognition as an intermediary between the user and the device control system. The facial expression detection module acts as a mediator that captures the user's intended action through facial movements and translates it into device commands. This intermediary layer enables more natural and intuitive interaction by bridging the gap between human expression and machine response, eliminating the need for direct manual input on the touch panel.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If manual input is required, then precise control is achieved, but user experience deteriorates

Engineering Contradiction:
Improveuser experienceVSAvoidautomatic operation level
Core Design Contradiction:
Ease of operationVSExtent of automation

Solution Approach 1:

The patent implements self-service automation where the system automatically captures facial images, detects expressions, and executes corresponding device operations without requiring manual input from the user. The facial expression recognition system continuously monitors facial movements and automatically translates them into control commands, enabling the device to respond to user intent autonomously. This self-service approach significantly enhances user experience by eliminating repetitive manual operations while maintaining precise control through automated expression-to-command translation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent incorporates feedback mechanisms where the system continuously monitors facial expressions and provides real-time device responses. The facial expression detection module captures user intent through facial movements, and the system immediately executes corresponding operations, creating a closed-loop feedback system. This continuous feedback between facial expression detection and device response enables highly automated operation while maintaining precise control, as the system constantly adjusts its responses based on real-time facial input without requiring manual confirmation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9904361B2Electronic device and facial expression operation method
Publication Date: 2018.02.27 MOBILE DRIVE NETHERLANDS BV
  • US9904361B2 patent drawing
  • US9904361B2 patent drawing
  • US9904361B2 patent drawing

AI summary

A facial expression operation method includes capturing images using a camera device of an electronic device. A face area of the user exists in the images is determined by comparing the images with face image samples stored in a storage device. Feature values of the face area are calculated when the face area exists in the images. A facial expression is determined by comparing the feature values of the face area and the feature values of the face image samples. The electronic device is operated automatically to perform a corresponding function according to the facial expression.