Aerial Image Document Association via Ultrasonic Tactile Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies for forming and interacting with aerial images as input interfaces lack the ability to effectively present and manage information in a user-friendly and intuitive manner, particularly in terms of associating documents with specific positions within these images based on their characteristics.

Innovation Solution

An information processing apparatus that generates three-dimensional aerial images and associates documents with specific positions within these images based on their characteristics, using a processor to manage and manipulate the images through gestures, and providing tactile feedback to users through an ultrasonic tactile interface device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If an aerial image is used as an input interface, then the user can interact with three-dimensional spatial information, but the ability to effectively present and manage documents based on their characteristics is lacking

Engineering Contradiction:
Improveability to present and manage informationVSAvoiduser-friendly and intuitive interaction
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent extends the traditional two-dimensional display interface into three-dimensional aerial space. Documents are positioned at specific coordinates (x, y, z) within the aerial image space, allowing users to interact with information in a volumetric environment. This dimensional transformation enables simultaneous presentation of multiple documents at different spatial locations while maintaining intuitive gesture-based control operations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If multiple documents are associated with specific positions in the aerial image, then information presentation capability is enhanced, but the complexity of managing and manipulating these documents increases

Engineering Contradiction:
Improveinformation presentation capabilityVSAvoidcomplexity of managing and manipulating documents
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system provides tactile feedback through an ultrasonic tactile interface device when users interact with documents in the aerial image. This haptic feedback mechanism gives users sensory confirmation of document selection, manipulation, and association operations, reducing the cognitive load required to manage multiple documents in three-dimensional space. The feedback loop helps users understand system state without visual confirmation alone.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an information processing apparatus as an intermediary between the user and the documents in aerial space. This apparatus handles the complex operations of associating documents with positions, retrieving documents based on spatial coordinates, and managing document metadata. By offloading these management tasks to the intermediary system, the user interface remains simple while the backend handles sophisticated document organization.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to intuitively interact with and manage information by transforming aerial images based on gestures, allowing for efficient presentation and selection of documents, enhancing user experience and information retrieval.

Implementation Method 1

an ultrasonic tactile interface device that generates ultrasonic waves in accordance with a detection result and provides tactile feedback to a user

Methodology Applied
Scientific EffectUltrasonic vibration: Ultrasonic Vibration

Implementation Method 2

generates ultrasonic waves in accordance with a detection result and provides tactile feedback to a user

Methodology Applied
Scientific EffectAcoustic radiation pressure: Acoustic Radiation Pressure

Data Source

PatentUS11867929B2Information processing apparatus and non-transitory computer readable medium
Publication Date: 2024.01.09 FUJIFILM BUSINESS INNOVATION CORP
  • US11867929B2 patent drawing
  • US11867929B2 patent drawing
  • US11867929B2 patent drawing

AI summary

An information processing apparatus includes a processor. The processor is configured to generate data concerning a three-dimensional image to be formed in air and to associate a document with a specific position within the three-dimensional image, based on a characteristic of the document.