Picture-Based Communication System Using Hierarchical Ontology
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current picture-based communication systems for individuals with motor or verbal disabilities are either slow due to reliance on alphabetical representations or cognitively complex, requiring large numbers of images and complex combinations, which can be difficult for those with limited cognitive functions to use effectively.
Innovation Solution
The use of Disambiguated Word (DW) data structures and dictionaries that associate unique images with meanings, allowing for language-independent representation of words and phrases, enabling efficient construction of sentences through a hierarchical ontology and questioning mechanism, facilitating easier navigation and customization for users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a system uses a large number of pictures to represent a large vocabulary, then the vocabulary capacity is improved, but the device complexity and cognitive load increase
Solution Approach 1:
The patent applies multi-functionality by enabling a single picture to represent multiple words through contextual relationships. The picture of a 'hand' can represent different words depending on the sentence context, allowing one image to serve multiple linguistic functions and reducing the total number of pictures needed while maintaining large vocabulary capacity
Solution Approach 2:
The patent implements nesting through hierarchical organization of pictures into categories and subcategories. Pictures are arranged in nested structures where selecting a category picture reveals subcategory pictures, and selecting a subcategory picture reveals specific word pictures. This nested arrangement allows the system to represent a large vocabulary through a manageable hierarchy of pictures rather than displaying all pictures at once
2Device complexity
If a system uses polysemy to reduce the number of pictures, then the device complexity is reduced, but the cognitive complexity of the system increases
Solution Approach 1:
The patent applies segmentation by dividing the vocabulary into distinct categories and subcategories, with each category represented by a separate picture. This segmentation organizes the polysemous pictures into manageable groups, making it easier for users to navigate and select the correct picture for a given word without having to remember all possible polysemous representations and their contexts
Solution Approach 2:
The patent implements preliminary action by pre-organizing pictures into hierarchical categories and subcategories before the user needs to use the system. This pre-organization establishes clear visual groupings and relationships between pictures, reducing the cognitive load during actual use by providing a structured framework for selecting pictures rather than requiring the user to remember complex polysemous relationships
3Ease of operation
If a system displays all pictures on a single screen, then the accessibility is improved, but the area required increases
Solution Approach 1:
The patent applies segmentation by dividing the picture set into multiple categories and subcategories, with each category displayed on a separate screen or screen section. This segmentation allows the system to maintain accessibility by organizing pictures into logical groups that can be navigated through category selection, while reducing the total screen area required by not displaying all pictures simultaneously
Solution Approach 2:
The patent implements dimensionality change by transitioning from a two-dimensional grid of pictures to a hierarchical structure with multiple levels. Users navigate through categories and subcategories in a sequential manner, with each level revealing a subset of pictures. This hierarchical dimension allows the system to present pictures in an organized manner that reduces the effective screen area needed while maintaining accessibility
Data Source
AI summary
A picture based communication system and mechanisms of implementation thereof allowing for rapid translation of picture based input into words or sentences of a previously chosen output language. Communication systems may be incorporated on PCs, mobile devices or may be a software running on a remote system which allows for language-independent messages to be constructed, which can be de-constructed into any language on the receiver's side. Mechanisms of implementation would also be of assistance in allowing people with language difficulties, dyslexia or illiteracy to communicate effectively.