Tactile Feedback Device for Facial Expression Level Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Individuals with impaired vision cannot recognize facial expressions or the level of smiling, as existing vision assist devices do not provide information on the level of facial expressions made by subjects nearby.

Innovation Solution

A device comprising an imaging device, a tactile feedback device, and a controller that processes facial images to determine expression parameters, levels of smiling, and corresponding tactile feedback intensities, providing varying tactile feedback to convey the level of facial expressions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If vision assist devices are used to help individuals with impaired vision, then they can detect the presence of a subject, but they cannot recognize the level of facial expression (e.g., level of smiling) of the subject

Engineering Contradiction:
Improvefacial expression level informationVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the facial expression analysis into multiple independent components: detecting facial landmarks (eyes, nose, mouth), calculating geometric relationships between landmarks, determining expression type, and measuring expression level. This segmentation allows the system to process complex facial expression data through manageable steps without requiring a single complex recognition system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer that converts visual facial expression data into tactile feedback signals. The controller acts as an intermediary that receives image data, processes facial expression parameters, and translates them into tactile feedback intensity levels, bridging the gap between visual input and tactile output for visually impaired users.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If tactile feedback is provided to convey facial expression information, then users can recognize facial expression levels, but the feedback intensity must be precisely controlled to accurately represent different expression levels

Engineering Contradiction:
Improvefacial expression level detection precisionVSAvoidtactile feedback control complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent changes the parameter of tactile feedback intensity to correspond directly to the facial expression level parameter. By establishing a direct mapping where feedback intensity varies proportionally with expression level (e.g., 0% smiling = no feedback, 100% smiling = maximum feedback), the system achieves precise measurement representation without complex control mechanisms.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses tactile feedback intensity variations as an analogous 'color change' system, where different intensities of tactile feedback represent different levels of facial expression, similar to how different colors represent different states. This intuitive mapping makes the system easy to operate and interpret.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS11482132B2Devices and methods for providing tactile feedback
Publication Date: 2022.10.25 TOYOTA MOTOR ENG & MFG NORTH AMERICA INC
  • US11482132B2 patent drawing
  • US11482132B2 patent drawing
  • US11482132B2 patent drawing

AI summary

A device for providing a tactile feedback includes an imaging device configured to capture an image of a face of a subject, a tactile feedback device, and a controller communicatively coupled to the imaging device and the tactile feedback device. The controller comprising at least one processor and at least one memory storing computer readable and executable instructions that, when executed by the processor, causes the controller to: process the image, determine a type of a facial expression based on the processed image, determine a level of a facial expression of the type based on the processed image, determine a tactile feedback intensity of the tactile feedback device based on the level of the facial expression, and control the tactile feedback device to provide a tactile feedback having the tactile feedback intensity.