Touchscreen Building Control via Device Photography

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display and operating devices for building system technology require users to read and identify menu texts or symbols to control electrical devices, which can be cumbersome and time-consuming.

Innovation Solution

A display and control device with a touchscreen element, integrated camera, memory element, card reader, and processing device that allows users to control electrical devices by directly recognizing and touching the photo imaging surface of the device, eliminating the need for text or symbol identification, and using a bus system to assign actuator addresses to photo display areas of electrical devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If menu text or symbol identification is used to control electrical devices, then the control function is achieved, but the operation complexity and time consumption increase

Engineering Contradiction:
Improveease of device controlVSAvoidtime for identifying and controlling devices
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent creates visual copies (photographs) of the actual electrical devices and displays them on the touchscreen. Users interact with these photographic representations instead of abstract symbols or text menus. The system captures images of devices using an integrated camera or external source, stores them in memory, and allows users to tap on the visual copies to control the corresponding physical devices, eliminating the need to read and interpret text or symbols.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/cognitive process of reading text and interpreting symbols with a direct visual recognition and tapping interaction. Instead of the traditional sequence of reading menu text -> understanding meaning -> selecting option, the system allows direct visual identification of the device in the photograph -> tapping the image -> immediate control, substituting the cognitive processing step with intuitive visual interaction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If symbolic representation is used for device control, then the interface can be standardized, but the user must understand and identify symbols which increases operational difficulty

Engineering Contradiction:
Improveinterface standardizationVSAvoiddevice identification ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system replaces standardized symbols with actual photographic copies of the devices. Instead of using generic icons that require learning and interpretation, the system displays real images of the specific devices in the environment. This maintains interface versatility while dramatically improving ease of operation, as users can immediately recognize the device in the photograph without needing to understand symbolic representations.

Inventive Principle:
Principle #26Copying

3Productivity

If commissioning software with text menus is used, then comprehensive device control is achieved, but the commissioning process becomes time-consuming and complex

Engineering Contradiction:
Improvecommissioning speedVSAvoidcommissioning process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

During commissioning, the system captures photographs of devices and automatically processes them for control assignment. Instead of requiring installers to manually navigate through text-based menus and fill out forms, the system uses the camera to capture device images, stores them in memory, and enables intuitive tapping-based control assignment. This dramatically speeds up the commissioning process while reducing the complexity of interactions required.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs automatic functions during commissioning, such as capturing images, storing them in memory, and preparing the control interface. The commissioning process becomes more self-service oriented, where the system automatically handles image acquisition and preparation, reducing the manual effort and complexity involved in the commissioning workflow.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP1881649B1Display and command console for building technology management
Publication Date: 2019.02.27 ABB (SCHWEIZ) AG
  • EP1881649B1 patent drawingFigure 1~2

AI summary

The device (1) has area of a house or a subarea of area is formed in form of photo on the touch screen element (2), on which the electrically controlled devices (13-20) are identified. The photo imaging surface of a certain electric unit is assigned to an address that is assigned to the actuator (9-12) of this electric unit by the processing device (7). A desired actuator function is transferred during contact of the photo imaging surface by the processing mechanism.