Remote Terminal IME for Accurate Soft Keyboard Text Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote operation technologies face issues with accurate text input, particularly in languages like Japanese, where the conversion of key events from soft keyboards to host computers can result in errors due to the failure to transmit the correct text string, as seen in the case of inputting 'ai' being displayed as 'affection' instead of the intended key information.

Innovation Solution

Incorporating an Input Method Editor (IME) within the remote terminal, which processes key symbol inputs from a soft keyboard, converts them, and transmits the correct text string to the host computer, enabling reliable text input by displaying an input field and soft keyboard on the remote terminal, triggered by specific user operations, such as double touches on the desktop screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If text input is enabled through soft keyboard on remote terminal, then text input functionality is provided, but text input accuracy deteriorates due to incorrect key event transmission

Engineering Contradiction:
Improvetext input functionalityVSAvoidtext input accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an IME (Input Method Editor) as an intermediary component between the soft keyboard and the host computer. The IME intercepts key events from the soft keyboard, performs proper conversion and processing, and then transmits the correct text string to the host computer. This mediator resolves the inaccurate text input problem by ensuring proper event handling and conversion before transmission.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms where the IME monitors and processes key events in real-time, converting soft keyboard inputs into proper text strings based on the selected input method. The converted text is then fed back to the application layer for display and further processing, ensuring accuracy in text input operations.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If IME is integrated in remote terminal, then text input accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvetext input accuracyVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The IME component integrates multiple functions within a single module: it handles key event interception, performs text conversion based on different input methods (roman, kana, etc.), manages candidate word selection, and controls transmission to the host computer. This multi-functional design improves text input accuracy while minimizing the increase in overall system complexity by consolidating functions rather than adding separate components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10359931B2Remote operation apparatus, remote operation system, and non-transitory computer readable medium storing program
Publication Date: 2019.07.23 FUJIFILM BUSINESS INNOVATION CORP
  • US10359931B2 patent drawing
  • US10359931B2 patent drawing
  • US10359931B2 patent drawing

AI summary

A remote operation apparatus includes: a display that displays a desktop screen of an apparatus to be remotely operated; and a controller that displays an input field and displays a soft keyboard in a case in which a specific operation is performed on a displayed desktop screen, and enables text input to the input field with the soft keyboard.