Information Processing Apparatus Routing Multi-Modal User Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interactive automatic response services based solely on text messages often require multiple conversations to specify the user's inquiry, especially when the user is unsure of terms like names, parts, or symptoms, and may fail to accurately identify the intended item.

Innovation Solution

An information processing apparatus and medium that utilize a reception unit to receive user input in natural language, image, or sound, and a selection unit to determine the appropriate service for analysis, such as natural language processing or image analysis, to efficiently identify and respond to user queries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If text-based interactive automatic response service is used, then implementation complexity is low, but the number of conversations required to specify user inquiries increases and identification accuracy decreases

Engineering Contradiction:
Improveimplementation complexityVSAvoidnumber of conversations required
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent combines multiple input modalities (text, image, sound) into a unified interaction system. The reception unit accepts information from users through any of these three channels, and the selection unit integrates them into a single analysis process, reducing the need for multiple sequential conversations to specify inquiries.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system is designed to handle diverse user input types through a single interface. The reception unit can process text messages, images, and sounds, making the system universally applicable to various user expression methods without requiring separate specialized systems for each modality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If text-based interactive automatic response service is used, then implementation complexity is low, but the accuracy of identifying user inquiries decreases

Engineering Contradiction:
Improveimplementation complexityVSAvoididentification accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent merges multiple analysis services (natural language processing, image analysis, sound analysis) into a unified processing architecture. The selection unit determines which analysis service to use based on the input type, and the results are integrated to provide comprehensive and accurate identification of user inquiries.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The selection unit acts as an intermediary that routes different types of input (text, image, sound) to the appropriate analysis service. This mediator ensures that each input type is processed by the most suitable service, improving overall identification accuracy while maintaining system coherence.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If multiple analysis services are integrated, then identification accuracy improves, but device complexity increases

Engineering Contradiction:
Improveidentification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the analysis function into separate, specialized services (natural language processing service, image analysis service, sound analysis service). Each service handles a specific input type independently, and the selection unit coordinates them. This segmentation allows for improved accuracy through specialization while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects which analysis service to activate based on the type of input received from the user. The selection unit determines the appropriate service at runtime, allowing the system to adapt its complexity based on the actual task requirements rather than always running all services simultaneously.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11531815B2Information processing apparatus and non-transitory computer readable medium storing program
Publication Date: 2022.12.20 FUJIFILM BUSINESS INNOVATION CORP
  • US11531815B2 patent drawing
  • US11531815B2 patent drawing
  • US11531815B2 patent drawing

AI summary

An information processing apparatus includes a reception unit that receives information from a user in an interactive form and a selection unit that selects a first service for analyzing contents of natural language as a transmission destination of the information in a case where information from the user is input in natural language and selects a second service as an analysis destination of the received information in a case where information from the user is input as an image or a sound.