Stylus Position Detection Using Wide-Field Camera Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Interactive whiteboards are often expensive and dedicated to a single purpose, lacking versatility and efficient sensing technologies to accurately detect stylus positions on their surfaces.

Innovation Solution

A method utilizing a pointing device with a camera having a wider field of view than the tip, processing images to identify unique hashed mapped zones on a display surface, and determining the tip's position based on these zones, allowing for versatile whiteboard functionality on any display device without additional sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional sensing surfaces with specialized sensors are used, then stylus position detection accuracy is improved, but device cost and complexity increase

Engineering Contradiction:
Improvestylus position detection accuracyVSAvoidsensing surface complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a camera to capture an optical image (copy) of the display surface and its markings, replacing the need for specialized physical sensors. The image processing system creates a digital representation of the surface state, which is then used to determine stylus position through image analysis rather than direct physical sensing.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical/specialized sensing systems with an optical system. Instead of using dedicated sensors embedded in the display surface, the invention uses a camera to optically detect the display surface state and stylus position through image capture and processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If dedicated whiteboard systems with specialized hardware are used, then whiteboard functionality is achieved, but adaptability to different display devices is reduced

Engineering Contradiction:
Improvewhiteboard functionalityVSAvoiddisplay device compatibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent makes the whiteboard system universal by using a camera and image processing algorithm that can work with any display device showing visual markings. The system is not tied to specialized hardware but can adapt to different displays, projectors, or surfaces as long as they present visual information that can be captured and processed by the camera system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system creates a digital copy of the display surface through camera imaging, allowing the whiteboard functionality to be replicated across different display devices without requiring specialized hardware. The visual information is captured optically and processed software-based, enabling portability and adaptability.

Inventive Principle:
Principle #26Copying

3Measurement precision

If specialized sensing technologies are implemented, then stylus interaction detection is improved, but cost increases

Engineering Contradiction:
Improvestylus interaction detectionVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent replaces expensive, specialized sensing components with a relatively inexpensive camera and software-based image processing system. The camera is a common, low-cost component compared to specialized whiteboard sensors, and the software algorithms provide the detection functionality without requiring costly hardware infrastructure.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The invention substitutes mechanical sensing systems with optical sensing using a camera. This replacement dramatically reduces cost while maintaining detection capability, as cameras are mass-produced consumer components whereas specialized sensing surfaces require custom manufacturing and integration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Measurement precision

If the camera field of view matches the tip size, then positioning precision is improved, but area coverage is reduced

Engineering Contradiction:
Improvetip position precisionVSAvoiddetectable area on display surface
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent divides the display surface into multiple zones or regions that can be independently identified and tracked. The camera captures a wider area containing multiple zones, and image processing identifies which specific zone contains the stylus tip, allowing both broad coverage and precise localization through regional segmentation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from point-to-point precision matching to area-based detection with computational precision. Instead of requiring the camera field of view to exactly match the tip size in one dimension, the system uses the wider field of view to capture multiple reference points and zones, then computationally determines precise tip position within the broader area through image analysis.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9411433B2Whiteboard display
Publication Date: 2016.08.09 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US9411433B2 patent drawing
  • US9411433B2 patent drawing
  • US9411433B2 patent drawing

AI summary

A method includes receiving an image of a display surface from a pointing device having a camera with a field of view wider than a tip of the pointing device, processing the received image to identify an area on the display surface within the field of view of the camera, and identifying a position of the tip of the pointing device on the display surface as a function of the identified area on the display surface.