Interactive Surface Physical Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Interactive surface technologies face challenges such as cumbersome and imprecise input mechanisms, user confusion, especially in collaborative environments, and difficulties in manipulating out-of-reach digital objects, as well as a lack of efficient information sharing and collaboration tools.

Innovation Solution

The implementation of an interactive management module (IMM) that allows users to engage with interactive surfaces using physical devices, detecting their placement and orientation to display associated digital objects, and enabling collaborative interactions by merging selections from multiple devices, manipulating digital objects using cursor and finger contact points, and generating digital copies of physical objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional input mechanisms (touch-only interaction) are used on interactive surfaces, then the system maintains simplicity, but user precision and responsiveness deteriorate

Engineering Contradiction:
Improveinput precisionVSAvoidinput mechanism complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple input devices (physical keyboard, mouse, touch surface) into a single interactive surface system. The physical keyboard and mouse are placed on the interactive surface, and their inputs are merged with touch interactions to provide precise control while maintaining the simplicity of the surface interface.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The interactive surface serves multiple functions: it detects touch inputs directly, recognizes physical objects placed upon it, and integrates inputs from traditional devices like keyboards and mice. This multi-functionality allows the system to improve input precision without requiring separate specialized systems for each input type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Quantity of substance

If multiple digital objects are displayed on a large interactive surface, then information capacity increases, but user accessibility and ease of operation deteriorate due to out-of-reach objects

Engineering Contradiction:
Improveinformation capacityVSAvoidobject accessibility
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent introduces physical objects as intermediaries between the user and distant digital objects. By placing physical objects on the interactive surface, users can manipulate associated digital objects that may be located anywhere on the large surface, effectively extending their reach without physically moving to different locations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system adds a physical dimension to the interaction space. Physical objects placed on the surface create association zones that link physical location to digital content, allowing users to access digital objects through physical placement rather than direct digital manipulation, thus making distant objects accessible.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Speed

If physical objects are placed on the interactive surface to improve input precision, then input responsiveness improves, but user confusion increases due to multiple objects and associations

Engineering Contradiction:
Improveinput responsivenessVSAvoiduser understanding
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The patent uses visual attributes such as colored borders and highlighting to clearly distinguish between different association zones and their corresponding digital objects. When a physical object is placed on the surface, the system displays visual indicators that show which digital object is associated with that physical location, preventing user confusion.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The system provides immediate visual feedback when physical objects are placed on the interactive surface. The association zones are displayed with clear visual attributes, and the system confirms the linkage between physical and digital objects, helping users understand the current state and avoid confusion.

Inventive Principle:
Principle #23Feedback

4Productivity

If traditional collaborative tools are used in meeting environments, then information sharing is limited, but collaboration efficiency deteriorates

Engineering Contradiction:
Improvecollaboration efficiencyVSAvoidcollaboration system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The interactive surface serves as a universal collaboration platform that integrates multiple functions: displaying digital content, accepting various input types (touch, physical objects, traditional devices), and enabling information sharing. This single system replaces multiple separate collaboration tools while improving efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically manages the complexity of collaborative interactions by detecting physical objects, creating association zones, and linking them to digital content without requiring users to manually configure complex settings. The collaboration environment is self-configuring, reducing the perceived complexity for users.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP2332024B1Using physical objects in conjunction with an interactive surface
Publication Date: 2019.10.30 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2332024B1 patent drawingFigure 1
  • EP2332024B1 patent drawingFigure 2
  • EP2332024B1 patent drawingFigure 3

AI summary

An interaction management module (IMM) is described for allowing users to engage an interactive surface in a collaborative environment using various input devices, such as keyboard-type devices and mouse-type devices. The IMM displays digital objects on the interactive surface that are associated with the devices in various ways. The digital objects can include input display interfaces, cursors, soft-key input mechanisms, and so on. Further, the IMM provides a mechanism for establishing a frame of reference for governing the placement of each cursor on the interactive surface. Further, the IMM provides a mechanism for allowing users to make a digital copy of a physical article placed on the interactive surface. The IMM also provides a mechanism which duplicates actions taken on the digital copy with respect to the physical article, and vice versa.