Virtual Message Positioning on Moving Objects via Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality technologies rely on markers or location-based information, which limit the ability to create and search for virtual messages on moving objects in a user-friendly and dynamic manner, especially when positioning information is unavailable or unreliable.

Innovation Solution

A method and system that allows users to create and search for virtual messages on moving objects using a mobile device, where the system captures and processes image information and positioning data to associate virtual messages with moving objects, enabling their display on the mobile device through a cloud-based server and database, even in indoor environments or without reliable GPS data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional augmented reality technology uses markers or location-based information to initiate image objects, then the system can reliably position virtual content, but the system cannot create and search virtual messages on moving objects in environments where GPS or orientation data is unavailable

Engineering Contradiction:
Improvepositioning reliabilityVSAvoidenvironmental adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces image information as an intermediary to replace traditional GPS and orientation data for positioning virtual messages. Instead of relying on location-based information or markers, the system uses image processing to extract features from captured images of moving objects, thereby enabling virtual message placement and retrieval in environments where conventional positioning methods fail.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/GPS-based positioning system with an image-processing-based system. By substituting the reliance on GPS modules, gyroscopes, and location services with computer vision and image recognition techniques, the system achieves positioning capability in indoor or GPS-denied environments through visual feature extraction and matching.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the system uses GPS modules and gyroscopes to obtain positioning information for displaying image objects, then location-based positioning can be achieved, but the system fails to provide accurate positioning in indoor environments or when GPS data is unavailable

Engineering Contradiction:
Improvepositioning precisionVSAvoidenvironmental coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent makes the positioning system universal by enabling it to function across diverse environments using a common image-processing mechanism. The same image capture and processing pipeline that works for outdoor GPS-based positioning also functions for indoor and GPS-denied environments, eliminating the need for environment-specific positioning subsystems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the fundamental parameter used for positioning from geographic coordinates (latitude, longitude, altitude from GPS) to visual feature parameters (image hashes, color blocks, line data). This parameter transformation allows the system to maintain positioning precision across different environments by relying on visual features that exist universally rather than GPS signals that are environment-dependent.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If conventional augmented reality systems require well-defined correlation between markers and image objects, then the system can accurately place virtual content, but the system lacks user-friendly creation and search capabilities for virtual messages on moving objects

Engineering Contradiction:
Improvecontent placement accuracyVSAvoiduser-friendly operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent enables the system to automatically perform tasks that would otherwise require manual configuration. The system automatically captures images, extracts visual features, generates positioning information, and creates the correlation between moving objects and virtual messages without requiring users to manually define markers or configure complex positioning parameters, thereby maintaining accuracy while improving ease of operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary image processing and feature extraction when the application is launched or when the user intends to create a virtual message. By pre-processing images and extracting visual features in advance, the system establishes the positioning foundation before the user needs to create or search for virtual messages, simplifying the user interaction while ensuring accurate content placement.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3340177B1Method and system for creating virtual message onto a moving object and searching the same
Publication Date: 2020.04.29 LI YU HSIEN
  • EP3340177B1 patent drawingFigure 1A
  • EP3340177B1 patent drawingFigure 1B
  • EP3340177B1 patent drawingFigure 2A

AI summary

The disclosure is related to a system and a method for creating a virtual message (103) on a moving object (101), and for searching the virtual message (103). Under a data-construction mode, a user manipulates a mobile device (10) to select a virtual message (103), and to capture a moving object (101). The mobile device (10) allows the user to position the virtual message (103) on the moving object (101). The system then receives data of the virtual message (103), the image information extracted from the moving object (101), and a viewable range for the virtual message (103) relative to the moving object (101). The image information is employed to be the reference for the position of the virtual message (103). Under a search mode, the system renders a service for searching the virtual message (103) over a specific moving object (101) according to the image information of the moving object (101) and the location of the mobile device (10).