Tactile Image Processing for Visually Impaired via Object Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing tactile displays for visually impaired individuals are inadequate for presenting complex images like photographs, requiring significant time and labor to create tactile representations, and often result in noise that interferes with appreciation.
Innovation Solution
An image processing apparatus that detects object types and areas within input images and determines a tactile presentation form for each object type and area, using either a pin display or a temperature sensation display to present the image in a recognizable tactile manner.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If direct tactile representation of photograph information is created, then complete image information is presented, but the unevenness forms noise and interferes with photograph appreciation
Solution Approach 1:
The photograph is segmented into multiple regions of interest based on visual importance. Only these significant regions are converted into tactile unevenness, while other areas remain flat. This segmentation allows complete image information to be presented through selective tactile representation without creating noise from converting all photograph details.
Solution Approach 2:
The invention extracts only the essential and visually important portions of the photograph to create tactile unevenness. By taking out and emphasizing only the key regions that contribute to photograph appreciation, the system avoids converting all image information into tactile form, thereby preventing noise while maintaining complete information presentation.
2Ease of operation
If tactile unevenness is generated for photograph appreciation, then tactile recognition is improved, but time and labor are required to determine locations for unevenness formation
Solution Approach 1:
The system automatically determines the locations and regions for tactile unevenness formation by analyzing the photograph's visual importance distribution. This self-service approach eliminates the need for manual discussion and determination of unevenness locations with visually handicapped persons, thereby improving tactile recognition while reducing time and labor requirements.
Solution Approach 2:
The invention performs preliminary analysis of the photograph to identify visually important regions before generating tactile unevenness. This preliminary action of automatically determining optimal locations for tactile representation eliminates the need for subsequent manual adjustments and discussions, thereby improving ease of operation while minimizing time and labor loss.
3Loss of information
If all image data is converted to tactile form, then complete information is presented, but the amount of information is large and creates noise
Solution Approach 1:
The photograph information is segmented into visually important regions and other areas. Only the important regions are converted into tactile unevenness, while other areas remain flat. This segmentation maintains complete information presentation by preserving all regions in the image data while reducing tactile complexity by only activating tactile elements where necessary.
Solution Approach 2:
The invention applies different tactile qualities to different regions of the photograph. Visually important regions are given tactile unevenness for enhanced recognition, while other regions remain flat. This local differentiation allows complete information to be presented while reducing overall information complexity by applying tactile complexity only where needed.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables visually impaired individuals to effectively grasp the contents of images through tactile sensation, improving the appreciation of complex images like photographs by reducing noise and increasing efficiency in tactile representation.
Implementation Method 1
A presentation device that presents tactile sensation with respect to e.g. text, a figure, and unevenness of a pattern, by independently moving up and down each of a plurality of pins, which are two-dimensionally arranged
Implementation Method 2
a presentation device that presents warm and cold sensation with respect to e.g. the text, figure, and unevenness of a pattern, by electrically controlling semiconductor thermoelectric elements referred to as the Peltier elements, which are two-dimensionally arranged, to generate heat
Data Source
AI summary
An image processing apparatus that presents contents of an input image, such as a photograph, such that a visually handicapped person can grasp the input image through tactile sensation. The image processing apparatus includes an image input section configured to input image data, a detection section configured to detect object types of objects and object areas of the objects based on the image data input by the image input section, and a presentation form determination section configured to determine a presentation form of presenting a tactile presentation area corresponding to each object area detected by the detection section, on an object type-by-object type basis.