Camera-Based Gesture Interaction via Hotspot Attributes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera-based systems face challenges in creating interactive content due to limited adoption and the inefficiency of recreating existing content for presentation, as they require learning new markup languages with limited utility.

Innovation Solution

A method is introduced where electronic documents are enhanced with hotspot attributes that allow users to interact using predefined physical gestures captured by a camera system, enabling interaction with the document without the need for new markup languages, by injecting hotspot attributes into document elements, allowing users to perform actions on the displayed document through gesture recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If new markup languages are developed for camera-based systems, then camera-based interaction functionality is improved, but system complexity and learning curve increase

Engineering Contradiction:
Improvecamera-based interaction functionalityVSAvoidmarkup language complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies universality by enabling standard web markup languages (HTML, XML, etc.) to serve dual purposes: traditional display purposes and camera-based interaction purposes. The hotspot attributes injected into standard document elements allow existing web content to be enhanced with camera-based gesture recognition capabilities without requiring separate markup languages, thus making the system universal across different interaction paradigms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces hotspot attributes as an intermediary layer between standard document elements and camera-based interaction functionality. These attributes act as mediators that bridge the gap between existing web technologies and new camera-based gestures, allowing interaction without directly modifying the core markup language structure.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If existing content is recreated for camera-based systems, then camera-based interaction capability is improved, but productivity and efficiency deteriorate

Engineering Contradiction:
Improvecamera-based interaction capabilityVSAvoidcontent creation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-defining hotspot attributes and gesture mappings that can be automatically injected into existing document elements. This preparation work is done in advance through attribute injection mechanisms, allowing existing content to be rapidly adapted to camera-based systems without manual recreation, thus maintaining high productivity while enabling new interaction capabilities.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by replicating the functionality of traditional interactive elements (buttons, links, etc.) through hotspot attributes on existing document elements. Instead of recreating content in a new format, the system copies the interaction capability onto existing elements via attribute injection, preserving the original content structure while adding camera-based interaction support.

Inventive Principle:
Principle #26Copying

3Ease of operation

If camera-based systems are widely adopted, then ease of operation is improved, but the need for specialized markup languages increases complexity

Engineering Contradiction:
Improveuser interaction easeVSAvoidmarkup language requirement
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the system universal by allowing standard web documents to function with both traditional and camera-based interfaces through hotspot attributes. This eliminates the need for users to learn specialized markup languages while maintaining ease of operation, as the same standard documents work across different interaction modes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system applies self-service by automatically injecting hotspot attributes into document elements based on predefined rules and gesture mappings. This automated process eliminates the need for manual configuration or specialized knowledge, allowing the system to configure itself and maintain simplicity while providing advanced camera-based interaction capabilities.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10691217B2Methods and systems for providing a camera-based graphical user interface
Publication Date: 2020.06.23 FUJIFILM BUSINESS INNOVATION CORP
  • US10691217B2 patent drawing
  • US10691217B2 patent drawing
  • US10691217B2 patent drawing

AI summary

A method at a computer system includes obtaining an electronic document comprising document elements, and injecting into the document in association with one of the document elements one or more hotspot attributes, the hotspot attributes defining attributes of a hotspot that is displayable in conjunction with the document element when the document is displayed, the hotspot attributes being associated with predefined physical gestures and respective document actions; such that the hotspot, when displayed as part of a displayed document, indicates that a viewer of the displayed document can interact with the displayed document using the predefined physical gestures (i) performed at a position that overlap a displayed version of the document in a field of view of a camera system and (ii) captured by the camera system, wherein a physical gesture results in a respective document action being performed on the displayed document.