Sensory Substitution Apparatus for Multi-Sense Signal Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing sensory substitution technologies are limited in converting multiple sensory signals into different sensory information and efficiently transmitting them to corresponding sensory organs, due to bandwidth limitations and varying user preferences.

Innovation Solution

A sensory substitution apparatus and method that combines multiple sensory inputs (visual, auditory, tactile, olfactory, and taste) by classifying, calculating importance, and converting them into new sensory signals suitable for transmission to different sensory organs, using a sensory information combiner with an individual sensory classifier, importance calculator, and sensory information converter.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If existing sensory substitution technologies convert single sensory signals into another sensory signal, then the substitution process is simple, but the technology cannot effectively transmit multi-sense sensory information due to bandwidth limitations and varying user preferences

Engineering Contradiction:
Improveability to convert multi-sense sensory informationVSAvoidcomplexity of sensory information processing system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the sensory information processing into separate functional modules: sensory information collector, sensory information combiner, and sensory information converter. Each module handles specific tasks independently, allowing multi-sense sensory information to be processed through segmented functions rather than a monolithic complex system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The sensory information combiner is designed to receive and process multiple types of sensory information (visual, auditory, tactile, olfactory, taste) and convert them into appropriate sensory signals for different sensory organs, making the system universally applicable to various sensory substitution needs without requiring separate specialized systems for each sense

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If sensory organs are used as transmission paths to transmit single sensory signal, then the transmission path is simple, but the system cannot adapt to different degrees of stimulus preference and bandwidth limits of users

Engineering Contradiction:
Improveadaptation to user-specific bandwidths and preferencesVSAvoidease of sensory information transmission
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the conversion and transmission of sensory information based on user-specific bandwidth limitations and stimulus preferences. The sensory information converter can adaptively modulate the output signals to match the capabilities and preferences of the target sensory organ, making the transmission process flexible rather than static

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters such as signal frequency, amplitude, and encoding methods based on the detected sensory organ characteristics and user preferences. By adjusting these parameters dynamically, the system optimizes transmission effectiveness for each user's specific sensory capabilities without requiring manual intervention

Inventive Principle:
Principle #35Parameter changes

3Productivity

If multi-sense sensory information is combined and converted into different sensory information, then the transmission effectiveness is improved, but the processing complexity and time required increase

Engineering Contradiction:
Improveefficiency of sensory substitutionVSAvoidtime for sensory information processing
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary classification and organization of sensory information before conversion. By pre-processing and structuring the multi-sense sensory data into appropriate categories, the subsequent conversion process becomes more efficient and requires less time, as the information is already prepared in the correct format for transformation

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11980527B2Sensory substitution apparatus and method
Publication Date: 2024.05.14 ELECTRONICS & TELECOMM RES INST
  • US11980527B2 patent drawing
  • US11980527B2 patent drawing
  • US11980527B2 patent drawing

AI summary

Provided is a sensory substitution apparatus and method that combines two or more pieces of multi-sense sensory information to be converted into different multi-sense sensory information, in which received pieces of multiple information are combined to suit sensory characteristics of the user's body and efficiently transmitted to a different sensory organ. According to the present invention includes: receiving input sensory information; classifying the input sensory information; calculating an importance of each of individual sensory information; determining a target sense for which part or all of the individual sensory information, of which an importance is calculated, is to be converted into a new sensory signal incongruent with the corresponding individual sense; and converting the input sensory information into target sensory information to be transmitted to the determined target sense which is an organ.