Gesture Recognition for Location-Based Augmented Reality Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing methods for delivering self-defined information between mobile devices are complex and time-consuming, requiring users to employ picture editing software to add symbols to images before sending them.

Innovation Solution

A method and system that generate and process information by creating gesture information based on a terminal device's movement path and location, allowing users to send summary information containing the gesture path and location, which is then displayed on the receiving device's camera interface when the user arrives at the corresponding location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If users use picture editing software to add self-defined symbols to images, then the information can be delivered between terminals, but the operation becomes complex and time-consuming

Engineering Contradiction:
Improveinformation deliveryVSAvoidoperation complexity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical interaction with picture editing software by using gesture recognition technology. Users create patterns through physical gestures in the air, which are captured by a camera and processed into images with self-defined information, eliminating the need for complex software operations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system automatically captures gestures, processes them into patterns, and generates images with self-defined information without requiring manual intervention. The gesture recognition system and image processing occur automatically, reducing user effort and time investment.

Inventive Principle:
Principle #25Self-service

2Reliability

If users manually edit pictures to add self-defined information, then the pattern can be saved and sent, but the process becomes time-consuming

Engineering Contradiction:
Improvepattern deliveryVSAvoidtime investment
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically capturing and processing gestures in real-time. The gesture recognition and pattern generation happen immediately as the user performs the gesture, eliminating the need for subsequent manual editing and saving steps.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The gesture recognition system continuously captures and processes gestures without interruption. The entire workflow from gesture input to pattern generation and image creation occurs in a continuous automated process, eliminating idle time between manual operations.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP2699027B1Method, device and terminal equipment for message generation and processing
Publication Date: 2021.10.06 HUAWEI DEVICE CO LTD
  • EP2699027B1 patent drawingFigure 1~2
  • EP2699027B1 patent drawingFigure 3~5

AI summary

The present invention relates to a method, an apparatus, and a terminal device for generating and processing information. The information generation method includes: generating gesture information according to an identified gesture path, where the gesture path is formed by a movement track of a terminal; detecting location information of a place where the gesture occurs; and generating summary information according to the gesture information and the location information. The information processing method includes: receiving summary information, and extracting location information and gesture information in the summary information; and when detected current location information of a terminal matches the location information in the summary information, and a camera is in a switched-on state, obtaining a gesture path according to the gesture information in the summary information, and displaying on a viewing interface of the camera. By adopting the technical solutions provided by the present invention, a user can send gesture information when being at a certain geographical location to a contact person, and the gesture information is displayed on a viewing interface of a camera of the contact person that arrives at the geographical location, to make an operation for delivering a pattern with self-defined information between the user and the contact person simple and time-saving.