Touch Screen Sensing Tags for Multi-Sensory Digital Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital picture display technologies only appeal to a single human sense, sight, failing to engage multiple senses such as sound, taste, touch, and smell.

Innovation Solution

A method and apparatus that acquire digital pictures, assign sensing tags to sections, and use a touch screen to deliver corresponding sensory experiences, including tactile, auditory, and olfactory responses, by integrating a processor, touch screen, and sensory elements like heating/cooling wires and an olfactory system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If digital pictures are displayed on a screen using traditional display technology, then the display is simple and easy to implement, but only one human sense (sight) is appealed

Engineering Contradiction:
Improvesensory engagementVSAvoiddisplay system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display screen is divided into multiple tactile zones corresponding to different sections of the digital picture. Each zone can be independently controlled to provide different tactile sensations (rough, smooth, soft, hard) matching the visual content, thereby enabling multi-sensory engagement without requiring a completely new display system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display screen serves multiple functions: visual display, tactile feedback, and sensory stimulation. By integrating tactile elements into the existing screen structure, the system appeals to multiple senses (sight, touch) simultaneously, increasing adaptability without replacing the entire display infrastructure

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If sensing tags are assigned to various sections of the picture and tactile feedback is provided, then multi-sensory engagement is achieved, but the device complexity increases

Engineering Contradiction:
Improvesensory stimulationVSAvoidsystem integration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The tactile feedback system is nested within the display screen structure. Heating elements, cooling wires, and tactile actuators are embedded within the screen layers, allowing multi-sensory functionality to be integrated into the existing display hardware without adding external complexity

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

A processor acts as an intermediary between the digital picture data and the tactile feedback system. The processor assigns sensing tags to picture sections and translates them into appropriate tactile responses, simplifying the control logic and enabling flexible multi-sensory engagement without direct complex wiring between all components

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables digital pictures to be displayed in a multi-sensory manner, stimulating sight, sound, touch, and smell, enhancing user engagement and experience.

Implementation Method 1

heating wires

Methodology Applied
Scientific EffectJoule heating: Joule Heating

Implementation Method 2

cooling wires

Methodology Applied
Scientific EffectJoule heating: Joule Heating

Implementation Method 3

olfactory system

Methodology Applied
Scientific EffectOlfaction:

Data Source

PatentUS8072432B2Image sense tags for digital images
Publication Date: 2011.12.06 SONY GROUP CORP
  • US8072432B2 patent drawing
  • US8072432B2 patent drawing
  • US8072432B2 patent drawing

AI summary

A method and apparatus for presenting the sense of an image is disclosed. First, a digital image is acquired and then various sensing tags are assigned to various sections of the digital image. The digital image is displayed on a screen. It is determined when and where a user touches the screen which corresponds to a section of the digital image. If a sensing tag has been assigned to the touched section of the digital image, the tagged sense is provided to the user.