Optical Spatial Coordinate Control Using 2D Code Gestures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for controlling machines using spatial coordinates are complex and require bulky hardware, as they often rely on absolute geodetic reference systems or sensors to detect relative movements, limiting intuitive and spontaneous control.

Innovation Solution

A method that uses a two-dimensional code applied to a carrier medium, where the spatial position of a normal vector and its angle of rotation are determined using an image processing system to generate vector space coordinates, allowing for intuitive control of machines without bulky devices, by translating gesture movements into control variables.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If absolute geodetic reference systems are used for controlling machines, then spatial coordinates can be precisely defined, but the complexity of coordinate conversion increases significantly

Engineering Contradiction:
Improvespatial coordinate precisionVSAvoidcoordinate conversion complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a two-dimensional code as an intermediary carrier that encodes spatial coordinate information in a local reference system. This mediator eliminates the need for complex conversions between absolute geodetic systems and local machine coordinates, as the code directly provides coordinates in the machine's operational reference frame.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a simplified copy of spatial coordinate information by encoding it in a two-dimensional code format. Instead of working with complex absolute geodetic coordinates, the system uses a copied representation in a local reference system that is directly usable by the machine control system.

Inventive Principle:
Principle #26Copying

2Device complexity

If relative reference systems with control levers are used, then the hardware can be simplified, but the operator must manually synchronize control movements with machine responses

Engineering Contradiction:
Improvecontrol device hardwareVSAvoidoperator synchronization burden
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system enables self-service control by allowing the machine to automatically interpret and execute commands based on the two-dimensional code position. The operator simply moves the carrier medium to the desired location, and the system automatically determines the corresponding spatial coordinates and control actions without requiring manual synchronization.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces mechanical control levers and sensors with an optical image processing system that reads two-dimensional codes. This substitution eliminates the need for mechanical detection devices while providing more precise and automatic control coordinate determination.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Difficulty of detecting and measuring

If bulky control devices with sensors are used, then control variables can be detected, but the equipment becomes relatively complex and bulky

Engineering Contradiction:
Improvecontrol variable detectionVSAvoidcontrol device bulkiness
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The patent replaces mechanical sensors and detection devices with an optical image processing system. The system uses optical reading of two-dimensional codes to detect spatial position information, eliminating the need for bulky mechanical control devices while maintaining or improving detection accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The two-dimensional code serves multiple functions: it encodes spatial coordinates, defines the local reference system origin, and provides orientation information. This multi-functional approach eliminates the need for separate sensors for each type of information, reducing overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Device complexity

If a two-dimensional code with normal vector determination is used, then spatial coordinates can be generated without bulky devices, but the image processing system must determine the angle of rotation accurately

Engineering Contradiction:
Improvecontrol device sizeVSAvoidrotation angle measurement
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent uses color marks within the two-dimensional code to encode orientation information. By detecting the positions and colors of specific marks, the system can determine the normal vector and rotation angle of the carrier medium, achieving accurate angular measurement through optical color detection rather than mechanical means.

Inventive Principle:
Principle #32Color changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables simple and intuitive control of machines using a small, portable carrier medium, such as a card or smartphone display, allowing for precise control of spatial coordinates and facilitating Internet-based networking of physical and virtual objects, with scalable control processes for both physical and virtual spaces.

Implementation Method 1

read in a first method step by means of an optical image processing system

Methodology Applied
Scientific EffectOptical image processing: Image Processing

Data Source

PatentEP3584764B1Method for controlling a machine by means of at least one spatial coordinate as control variable
Publication Date: 2021.07.28 DEUTSCHE BAHN AG
  • EP3584764B1 patent drawingFigure 1
  • EP3584764B1 patent drawingFigure 2
  • EP3584764B1 patent drawingFigure 3

AI summary

The invention relates to a method for controlling a machine using at least one spatial coordinate as a control variable. The invention further relates to a control system for a machine. Known devices for determining control variables based on spatial coordinates are technically complex and bulky. This disadvantage is to be overcome. Furthermore, the control of machines using spatial coordinates is to be simplified and, in particular, made intuitive. The invention aims to create the possibility of controlling machines without relying on bulky control devices, remote controls, or similar equipment.According to the invention, this is achieved in a process-oriented manner by determining a vectorial spatial coordinate (Z) using a two-dimensional code applied to a carrier plane (HE) and readable by means of an optical image processing system, and transmitting it as a control variable to a control system of the machine, wherein ▪ in a first process step the spatial position of a normal vector (N+) perpendicular to the centroid of the area of ​​the code is determined by means of the image processing system, ▪ and in a second process step the angle of rotation of a rotational movement (R) of the carrier plane (HE) of the code about an axis of rotation perpendicular to the carrier plane (HE) is detected by means of the image processing system, wherein the length of the normal vector (N+) is determined by means of the angle of rotation.