Image Recognition for Multi-Display Configuration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for configuring multiple display devices connected to a computer device, especially mobile devices, are complex and inconvenient, requiring manual adjustment of display positions and lacking intuitive user interfaces, which can lead to errors and increased processing demands.

Innovation Solution

A method that uses image recognition to identify and associate display devices with their physical locations and orientations, allowing users to configure them through intuitive gestures or symbols without needing complex menu interfaces, utilizing available camera capabilities or graphical inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If menu-based configuration interface is used to configure multiple display devices, then display devices can be connected and configured, but the configuration process becomes complex and difficult for less technically literate users

Engineering Contradiction:
Improvecapability to configure multiple display devicesVSAvoiduser-friendliness of configuration process
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces the manual menu-based configuration process with an automated image recognition system. The computer device captures an image of the display arrangement, automatically detects display devices, identifies their types and positions, and configures them without user interaction with complex menus. This substitutes the mechanical interaction (menu navigation) with an automated optical recognition system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-configuration by automatically detecting and identifying display devices from captured images. The computer device independently determines display device types, positions, and arrangements without requiring user guidance through configuration menus, enabling the system to configure itself autonomously.

Inventive Principle:
Principle #25Self-service

2Loss of information

If manual configuration is required to adjust display device positions, then physical locations can be configured, but the process becomes inconvenient and time-consuming

Engineering Contradiction:
Improveaccuracy of display device position informationVSAvoidtime required for configuration
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary detection and identification of display devices by capturing an image before final configuration is needed. The image recognition process pre-determines display device positions, types, and arrangements, so that when configuration is required, the system already has the necessary information ready, eliminating the need for time-consuming manual adjustment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces manual position adjustment and configuration with automated image recognition. The system captures an image, automatically determines the physical locations and arrangements of display devices, and configures them based on the recognized information, substituting manual mechanical configuration with automated optical detection and processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If the computer device does not automatically detect relative positions of display devices, then detection simplicity is maintained, but manual input is required which increases complexity

Engineering Contradiction:
Improvesimplicity of detection mechanismVSAvoidconvenience of configuration
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The camera device serves multiple functions: it captures images for display device detection, identifies display device types, determines physical positions, and provides information for configuration. This multi-functional approach eliminates the need for separate detection mechanisms and manual input processes, achieving both detection simplicity and configuration convenience through a single universal device.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces manual position input with automated image recognition. The system uses the camera to capture images, processes them to automatically determine display device relative positions, and configures the display arrangement without requiring manual input, substituting mechanical configuration processes with automated optical recognition and processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If application visual interface positioning requires manual configuration, then application display control is achieved, but additional menu interface configuration is needed which reduces productivity

Engineering Contradiction:
Improvecontrol over application display locationVSAvoidefficiency of application deployment
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent replaces manual application positioning and display device configuration with automated image recognition. The system captures an image, automatically identifies display devices and their positions, and enables applications to be deployed to the correct displays without requiring users to navigate menu interfaces for positioning, thereby improving productivity while maintaining display control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10365877B2System for identifying and using multiple display devices
Publication Date: 2019.07.30 DISPLAYLINK (UK) LTD
  • US10365877B2 patent drawing
  • US10365877B2 patent drawing
  • US10365877B2 patent drawing

AI summary

Data, particularly display data, is sent to a particular peripheral device, particularly a display device) from a computer device, such as a mobile device. The method involves determining an identifier of each peripheral device and receiving (35) a user identification identifying a particular peripheral device. The user identification is then associated (36) with the identifier of the particular peripheral device, and data is sent to the particular peripheral device based on the identifier associated with the user identification. The user identification comprises a user gesture which is captured as an input image, which is processed to determine which particular peripheral device the user gesture is gesturing towards and associating the user gesture with the identifier of the particular peripheral device. Alternatively the user identification may be directly input by a user on a display showing either recognised elements that have been associated with identifiers of the peripheral devices, or a listing of available peripheral devices.