Electronic Relay Panel Light Interpretation via Mobile AR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Interacting with electronic relays in electric power distribution grids is inefficient and time-consuming due to complex user-interface panels with multiple signaling components, requiring skilled personnel and technical manuals, especially in poor lighting conditions or remote locations.

Innovation Solution

A computer-implemented method using a mobile device with a camera to capture and process images of the user-interface panel, applying augmented reality features to identify and interpret light signals, and provide interactive guidance for users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple signaling components are provided on the user-interface panel, then the electronic relay can provide comprehensive operating condition information, but the difficulty of interpreting the light signals increases significantly

Engineering Contradiction:
Improveoperating condition informationVSAvoidlight signal interpretation
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces a mobile device as an intermediary between the electronic relay's multiple signaling components and the user. The mobile device captures images of the LED indicators, processes them through image recognition algorithms, and presents the interpreted information in a user-friendly format, thereby mediating the complex interaction between multiple signaling components and the user

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the manual interpretation process (requiring skilled personnel to read and interpret multiple LED signals) with an automated image recognition and processing system. The mobile device's camera and processing algorithms substitute for human expertise in decoding the signaling components

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If the user-interface panel has a complex layout with multiple components, then the electronic relay provides comprehensive control and monitoring capabilities, but the ease of operation deteriorates

Engineering Contradiction:
Improvecontrol and monitoring capabilitiesVSAvoiduser interaction
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent transitions the interaction from the physical two-dimensional panel space to a digital interface on a mobile device. By capturing an image of the panel and displaying it on a larger mobile device screen with augmented reality overlays, the system adds a digital dimension that makes the complex layout more navigable and understandable

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates a digital copy of the physical user-interface panel through image capture. This copy can be displayed, manipulated, and annotated on the mobile device, allowing users to interact with a replicated version of the complex interface in a more flexible and user-friendly environment

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If electronic relays are installed in remote locations with poor lighting conditions, then the electronic relay can be deployed in more flexible locations, but the ease of operation and component identification deteriorates

Engineering Contradiction:
Improveinstallation location flexibilityVSAvoidcomponent identification
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by capturing an image of the user-interface panel before the user needs to interpret it. The mobile device takes a photograph of the LED indicators and panel layout, then processes this image to identify and interpret the signaling components, preparing the information in advance for user consumption

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes visual inspection under poor lighting conditions with electronic image capture and processing. The mobile device's camera and image recognition algorithms replace the human visual system, enabling accurate component identification regardless of ambient lighting conditions

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates easy and efficient interaction with electronic relays by non-specialist users, enhancing identification of components and procedures, even in challenging environments, without requiring powerful processing resources or internet connectivity.

Implementation Method 1

activating a camera of a mobile computerised device; showing images of a user-interface panel of said electronic relay on a display of said mobile computerised device. Said images are conveniently captured by said camera

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP4033397B1A computer-implemented method for assisting a user in interacting with an electronic relay for electric power distribution grids
Publication Date: 2025.11.26 ABB SPA
  • EP4033397B1 patent drawingFigure 1
  • EP4033397B1 patent drawingFigure 2
  • EP4033397B1 patent drawingFigure 3

AI summary

A computer-implemented method to assist a user in interacting with an electronic relay for electric power distribution grids. The method of the invention provides for identifying light signals emitted by one or more user-interface components of the user-interface panel of the electronic relay by processing images of said user-interface panel, which have been captured by the camera of a mobile computerised device. The method of the invention provides for showing information, which describes the identified light signals emitted by said user-interface components on the display of said mobile computerised device.