Information Processing System for Hearing-Impaired Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Individuals with hearing difficulties face challenges in communicating effectively, especially when technical terms are involved, such as during medication-related conversations at pharmacies, where existing systems like sign language recognition and voice-based searches are not fully effective in preventing communication stagnation.

Innovation Solution

An information processing system comprising a first information acquisition unit, a second information adding unit, a presentation unit, and a conversion unit that acquires and presents information about medicine names, adds associated information, and converts user operations on this information for seamless communication between users and pharmacists, utilizing a camera for image data and text recognition to facilitate communication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If sign language recognition is used to facilitate communication, then communication accessibility is improved, but communication completeness deteriorates when technical terms are involved

Engineering Contradiction:
Improvecommunication accessibilityVSAvoidcommunication completeness
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces an information processing system that acts as an intermediary between the hearing-impaired user and the pharmacist. The system captures images of the user's gestures, recognizes them as operations on displayed medicine information, and transmits the corresponding data to the pharmacist's terminal, thereby mediating the communication gap without losing technical information

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the manual sign language communication system with an automated image recognition and data transmission system. Instead of relying on the pharmacist to interpret sign language gestures, the system automatically captures images, recognizes gestures, extracts medicine information, and transmits it digitally, eliminating the need for human interpretation and ensuring complete information transfer

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If voice-based search is used for medicine information, then search efficiency is improved, but communication effectiveness deteriorates for hearing-impaired users

Engineering Contradiction:
Improvesearch efficiencyVSAvoidcommunication effectiveness
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent creates a universal communication system that serves multiple functions: it displays medicine information, captures user gestures through imaging, recognizes operations automatically, and transmits data. This multi-functional system replaces the need for voice-based search with a gesture-based interface that works equally well for hearing-impaired users while maintaining search efficiency

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If technical medicine names are used in communication, then information accuracy is improved, but communication difficulty increases for hearing-impaired users

Engineering Contradiction:
Improveinformation accuracyVSAvoidcommunication difficulty
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent creates a visual copy of the medicine information display that is captured by the imaging device. Instead of relying on the user to verbally or manually convey technical medicine names, the system captures an image of the displayed information, recognizes the user's gesture in relation to the display, and transmits the exact data shown on the screen, ensuring accuracy without requiring the user to handle complex technical terminology

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240290450A1Information processing system, information processing method, and computer readable medium
Publication Date: 2024.08.29 NEC CORP
  • US20240290450A1 patent drawing
  • US20240290450A1 patent drawing
  • US20240290450A1 patent drawing

AI summary

In an information processing system, a first information acquisition unit acquires first information including a name of a medicine. A second information adding unit adds second information about the medicine associated with the first information to the first information. A presentation unit presents, to a user, the first and second information in association with each other. A conversion unit shows, upon receiving an operation indicating the second information performed by the user, the first information associated with the second information to a communication destination.