Touch Message Fusion for Multi-Screen Finger Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Dual-screen terminal devices fail to recognize and track multiple fingers operating simultaneously across screens due to the inability of existing systems to integrate touch event protocols from each screen independently.

Innovation Solution

A fusion method and terminal for touch messages that buffers and integrates touch messages from multiple screens, converting and packaging them into a unified multi-finger touch protocol data, allowing for simultaneous recognition and tracking of finger operations across screens.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If each touch screen works independently and reports its own touch event, then each screen can be operated separately, but the system cannot integrate touch protocols from multiple screens to recognize and track multiple fingers simultaneously

Engineering Contradiction:
Improvemulti-screen touch operation capabilityVSAvoidtouch event integration
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent merges touch event data from multiple independent touch screens into a unified coordinate system. The fusion terminal integrates touch protocols from different screens by converting their coordinates to a common reference frame, enabling the system to recognize and track multiple fingers operating across screens simultaneously, thus resolving the information loss caused by independent screen operation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a coordinate fusion module as an intermediary between independent touch screens and the operating system. This mediator converts and integrates touch event data from multiple screens with different coordinate systems into a unified format, allowing the system to process multi-screen touch operations without losing touch event information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the system processes touch events from multiple screens simultaneously, then multi-finger tracking can be achieved, but the complexity of integrating coordinate systems increases

Engineering Contradiction:
Improvemulti-finger touch recognition speedVSAvoidcoordinate system integration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the coordinate system integration process into distinct modules: individual screen coordinate detection, coordinate transformation to unified system, and fused touch event output. This segmentation allows each module to handle specific tasks independently, reducing overall system complexity while maintaining high-speed multi-finger recognition capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the coordinate system parameters of individual touch screens to match a unified reference coordinate system. By transforming coordinates from various screen systems into a common parameter space, the system simplifies the integration process and enables efficient multi-finger tracking without excessive computational complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3660649B1Touch message fusion method, terminal, and computer-readable storage medium
Publication Date: 2023.11.29 ZTE CORP
  • EP3660649B1 patent drawingFigure 1
  • EP3660649B1 patent drawingFigure 2~3
  • EP3660649B1 patent drawingFigure 4

AI summary

The present invention provides a fusion method and terminal for touch messages and a computer readable storage medium. The method includes: pushing touch messages of all touch fingers from at least two different touch screens into different buffer queues for buffering; intercepting head data of each buffer queue to generate a reported data array; and acquiring states of the touch fingers according to the reported data array and packaging the states into multi-finger touch protocol data.