Object Interaction Display Using Camera-Based Code Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object recognition systems on touch screens require expensive hardware with embedded cameras or optical sensors to detect patterns on objects, and users must often enter passwords or use visible codes for establishing communication links between mobile devices and large format displays, which can be inconvenient and less secure.

Innovation Solution

A system that uses a camera on the object to establish a dedicated link with a host computer without visible codes, employing Direct Contact Camera Codes (DCCC) or wireless transmitters for precise location and orientation detection, allowing for secure and automatic communication between mobile devices and large format displays without the need for passwords or optical sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Difficulty of detecting and measuring

If a camera or optical sensor is embedded in the touch screen for object recognition, then object detection capability is improved, but hardware cost increases

Engineering Contradiction:
Improveobject detection capabilityVSAvoidhardware cost
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary code (barcode, QR code, or other machine-readable pattern) as a mediator between the object and the camera system. Instead of embedding expensive optical sensors in the touchscreen, the system uses a standard camera to capture images of these codes, which are then decoded to identify and locate objects. This intermediary approach enables object recognition using conventional, low-cost camera hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent uses visual codes (barcodes, QR codes, or custom patterns) as information carriers that can be captured by standard cameras. These codes serve as copies or representations of object identity and location information, allowing the system to recognize objects without needing complex optical sensing hardware embedded in the display.

Inventive Principle:
Principle #26Copying

2Loss of information

If a visible code is placed on the object for recognition, then object identification is improved, but security and convenience deteriorate due to password entry requirements

Engineering Contradiction:
Improveobject identification accuracyVSAvoiduser convenience and security
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system enables automatic object identification and link establishment through camera-based code recognition. The mobile device automatically captures the code, decodes it, and establishes communication with the display without requiring manual password entry or user intervention. This self-service approach improves both convenience and security by eliminating password transmission requirements.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual password entry mechanisms with automated camera-based code recognition. Instead of requiring users to physically type passwords or interact with authentication interfaces, the system uses the camera to automatically capture and process identification codes, substituting mechanical user interaction with automated optical recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If PCT (Project Capacitive Technology) is used for touch detection, then touch sensitivity is improved, but optical pattern detection capability is lost

Engineering Contradiction:
Improvetouch sensitivityVSAvoidoptical pattern detection capability
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent merges two separate functional systems: a standard capacitive touchscreen for touch detection and a camera system for optical code recognition. By combining these independent subsystems, the display maintains excellent touch sensitivity through PCT while simultaneously gaining object recognition capability through the camera-based code detection, avoiding the need to choose one technology over the other.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11797133B2Display capable of interacting with an object
Publication Date: 2023.10.24 KARL STORZ SE & CO KG
  • US11797133B2 patent drawing
  • US11797133B2 patent drawing
  • US11797133B2 patent drawing

AI summary

A system includes a screen and a computer that detects an object near the screen and allows interaction between the object and the computer.