Mapping Graphic Data to 3D Manifold for HMI Precision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing human-machine interfaces face challenges in handling and manipulating graphically represented data, particularly on complex and curved screens, requiring improved precision and adaptability to user requirements while maintaining robustness and reliability, which is complicated by the miniaturization and increasing complexity of devices.

Innovation Solution

A method that maps graphic data onto a two-dimensional manifold using a mapping function, allowing for precise manipulation by an input object in three-dimensional space, with a marker point and area displayed to enhance interaction, and the use of non-linear mapping functions to adjust pixel parameters like resolution and brightness, enabling interaction on non-planar surfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If graphic data are mapped with high resolution onto a two-dimensional manifold for precise manipulation, then manipulation precision is improved, but device complexity increases

Engineering Contradiction:
Improvemanipulation precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a third dimension (depth/distance from the two-dimensional manifold) to enhance manipulation precision. By detecting the distance of the input object from the screen surface and using this depth information, the system achieves more precise control without increasing the complexity of the two-dimensional display manifold itself. The mapping function incorporates this third dimension to adjust graphical parameters dynamically.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the interface adapts to different user requirements and application scenarios, then adaptability is improved, but device complexity increases

Engineering Contradiction:
ImproveadaptabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic adaptation by continuously detecting the distance of the input object from the two-dimensional manifold and adjusting graphical parameters in real-time. The mapping function dynamically modifies resolution, brightness, and other parameters based on the detected distance, allowing the interface to adapt to different user requirements without requiring multiple fixed configurations or complex switching mechanisms.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes graphical parameters (resolution, brightness, size of graphical elements) based on the detected distance of the input object. This allows the interface to adapt to different usage scenarios by adjusting parameters dynamically rather than requiring complex reconfiguration of the entire system.

Inventive Principle:
Principle #35Parameter changes

3Area of stationary object

If the screen size is miniaturized to reduce device size, then device size is reduced, but manipulation precision deteriorates

Engineering Contradiction:
Improvescreen sizeVSAvoidmanipulation precision
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

By introducing depth detection (distance from the screen surface) as a third dimension, the patent enables precise manipulation on miniaturized screens. The distance information provides additional control degrees of freedom, allowing users to precisely manipulate graphical elements even on small screens through varied hand positions and gestures at different distances from the screen.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP2860614B1Method and device for handling graphically displayed data
Publication Date: 2017.09.13 ELMOS SEMICON AG
  • EP2860614B1 patent drawingFigure 1

AI summary

Method for handling graphically represented data, wherein graphical data already exists in a computing unit, is generated, and/or is available as vectors, comprising the following steps: mapping the graphical data with a first resolution onto a two-dimensional manifold of a three-dimensional space using a mapping function (mapping rule); acquiring the spatial position of an input object in three-dimensional space using a measuring device; processing the acquired data using the computing unit; quantifying the position of the input object using a three-dimensional coordinate system that is chosen (designed) such that the two-dimensional manifold lies in one of the coordinate surfaces of the three-dimensional coordinate system;Determining the distance of the input object from the two-dimensional manifold along a trace curve between the input object and an intersection point of the trace curve on the two-dimensional manifold; determining a marker point on the two-dimensional manifold at a predefined distance from the intersection point; displaying the marker point on the two-dimensional manifold, wherein the marker point is part of a marker region or a marker object, and wherein the marker point and/or the marker region and/or the marker object is determined by a marker function.