Geospatial Display Configuration via Fiducial Mark Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Configuring a virtual workspace or 'desktop' across multiple heterogeneous displays of different sizes, technologies, and locations is challenging for computing devices, as the location and configuration of the displays may be unknown to the operating system or configuration utility.

Innovation Solution

A geospatial display configuration system that uses a camera to capture images of the room, identifies fiducial marks on each display, creates a three-dimensional model of the space, and establishes relationships between displays to determine a proper pointing device path across all displays, allowing for a unified and optimized virtual desktop configuration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple heterogeneous displays are used to create a virtual workspace, then the functionality and versatility of the system is improved, but the complexity of configuring and managing the workspace increases

Engineering Contradiction:
Improvevirtual workspace functionalityVSAvoidconfiguration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically detects display devices, determines their spatial relationships, and configures the virtual workspace without requiring manual user input. The processor autonomously identifies fiducial marks on displays, captures images with a camera, creates three-dimensional models, and establishes geospatial relationships to generate the configuration, eliminating the need for complex manual setup procedures.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical configuration processes with automated computational methods. Instead of physically measuring and manually configuring displays, the system uses image processing, three-dimensional modeling, and automated geospatial relationship calculation to determine display positions and create the virtual workspace configuration automatically.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If displays are arranged in non-uniform locations with different sizes and technologies, then the adaptability of the system is improved, but the difficulty of detecting and measuring display relationships increases

Engineering Contradiction:
Improvedisplay arrangement flexibilityVSAvoiddisplay relationship detection
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system handles diverse display parameters (different sizes, technologies, locations) by capturing images at multiple positions and angles, then processing these varied parameters through three-dimensional modeling. The geospatial relationship calculation automatically adapts to different display configurations by mathematical transformation, converting diverse physical parameters into a unified virtual coordinate system.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces fiducial marks as intermediary reference points on each display device. These standardized markers serve as mediators between the physical display characteristics and the virtual workspace model, enabling reliable detection and measurement of display relationships regardless of the specific display technology or arrangement by providing common reference frames for calculation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If the operating system does not know the location and configuration of displays, then the ease of operation is maintained, but the precision of mouse path identification deteriorates

Engineering Contradiction:
Improvesystem operation simplicityVSAvoidmouse path identification accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs preliminary automated detection and configuration before the user begins working. By pre-identifying display locations, sizes, and spatial relationships through image capture and three-dimensional modeling, the system prepares accurate geospatial data in advance. This preliminary action ensures that when the user operates the system, the mouse path identification is already optimized for precision without requiring manual configuration.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11687309B2Geospatial display configuration
Publication Date: 2023.06.27 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US11687309B2 patent drawing
  • US11687309B2 patent drawing
  • US11687309B2 patent drawing

AI summary

In an example implementation according to aspects of the present disclosure, a system comprising a camera, a plurality of displays and a processor. The processor receives a series of images, from the camera, corresponding to a physical environment, wherein the series of images include the plurality of displays. The processor identifies a fiducial mark within the series of images corresponding to a display. The processor determines a three-dimensional space based on a camera position based on the series of images. The processor determines a location within the three-dimensional space corresponding to the one of the plurality of displays. The processor creates a geospatial relationship between the location and the camera within the three-dimensional space. The processor correlates the geospatial relationship to a display configuration screen. The processor creates a pointing device path in the display configuration screen corresponding to the geospatial relationship.