Interactive Image Projection Accessory for Multi-Touch Surface Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional displays, especially touch displays, face limitations in providing intuitive and interactive control over computing systems, particularly in mobile devices with small display areas, where user input is restricted and color fidelity is compromised due to surface variations.

Innovation Solution

An image generation device accessory that projects a derived version of an input image onto a surface, capturing user interactions and communicating them back to the device, while performing color compensation to enhance image fidelity, using a camera system and processing module to handle input events and adjust image projections accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch displays are incorporated into mobile devices to enable intuitive user interaction, then ease of operation is improved, but the display area and device footprint are reduced

Engineering Contradiction:
Improveuser interactionVSAvoiddisplay area
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent projects the display from a two-dimensional screen onto a three-dimensional surface (tabletop), allowing users to interact with a larger area while the device remains compact. The projection transforms the limited mobile device display area into an extended interactive surface, resolving the contradiction between ease of operation and display area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If the display area is made small to reduce device footprint, then device portability is improved, but user input capability and control precision are reduced

Engineering Contradiction:
Improvedevice footprintVSAvoiduser input precision
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

By projecting the display onto a larger surface, the system increases the effective input area while maintaining a small device footprint. The camera system tracks user inputs on this expanded projection with high precision, overcoming the limitation of small physical display area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The camera system acts as an intermediary between the small device and the large projection surface. It captures and tracks user inputs on the projected image, providing precise measurement and input detection that would be impossible with the small device screen alone.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If color compensation is applied to correct surface variations in projected images, then color fidelity is improved, but processing complexity and time are increased

Engineering Contradiction:
Improvecolor fidelityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs self-calibration by capturing an image of a color chart, automatically analyzing the surface color variations, and generating compensation values without requiring manual intervention. This self-service approach improves color fidelity while minimizing processing complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The color compensation values are calculated and stored in advance during an initial calibration phase. This preliminary action allows the system to quickly apply pre-computed compensation during normal operation, reducing real-time processing complexity while maintaining high color fidelity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9946333B2Interactive image projection
Publication Date: 2018.04.17 ULYTE INC
  • US9946333B2 patent drawing
  • US9946333B2 patent drawing
  • US9946333B2 patent drawing

AI summary

An accessory facilitating interaction with a projected image at least partially sourced by the image generation device. The accessory receives an input image from a device, and projects at least a derived image of the input image onto a surface on which the accessory sits. For instance, the accessory might project the input image itself, or perhaps some post-processed version of the input image. A camera system captures data representing user interaction with the projected image. Based on this data, an image input event is detected, and then communicated to the device. For instance, if the image generation device were a touch-sensitive device, the device may respond to the user contacting the projected image the same as it would if the user touched the image generation device at the same corresponding location. Embodiments described herein also relate color compensation of a displayed image.