Character recognition based mobile augmented reality reading method and reading system thereof

A text recognition and augmented reality technology, which is applied in character recognition, character and pattern recognition, and other database retrieval, can solve the problems of high storage cost, restrictions on the wide application of augmented reality technology, and cumbersome preparations for image entry, etc., to achieve expansion and application The effect of small range and storage cost

Inactive Publication Date: 2016-06-01
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This way of using images as identification and matching carriers, on the one hand, needs to pre-enter and store a large amount of image data for matching on the server side, the storage cost is high, and the pre-image entry preparation work is cumbersome; on the other hand, because only Preset images can be recognized and produce augmented reality effects, and mobile augmented realization terminals can only function in very limited specific image scenarios, which greatly restricts the wide application of augmented reality technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Character recognition based mobile augmented reality reading method and reading system thereof
  • Character recognition based mobile augmented reality reading method and reading system thereof
  • Character recognition based mobile augmented reality reading method and reading system thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0038] Such as figure 1 As shown, a mobile augmented reality reading method based on text recognition mainly includes the following six steps:

[0039] S1. The mobile device acquires a captured image P containing text.

[0040] S2. The mobile device preprocesses the image P obtained in step S1 to obtain an image P', and then uploads it to the server.

[0041] S3. The server performs character detection and recognition on the received image P', and obtains a character set {W i} and the position information {Loc i}. where W i Indicates the i-th text detected, Loc i Indicates the position where the text appears in the image P'.

[0042] S4. According to the predefined keyword dictionary, the server performs keyword matching in the text in the image P' obtained in step S3, and obtains the keyword set {T j}, and where each keyword appears in the image P'{Pos j}. where T j Indicates the jth keyword detected, Pos j Indicates that the keyword T j appears at the position in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a character recognition based mobile augmented reality reading method.The method includes steps: 1, a mobile device acquires a shot original image containing characters; 2, the mobile device preprocesses the acquired original image and uploads to a server; 3, the server acquires a character set and position information of each character in the image; 4, the server acquires a keyword set and position information of each keyword; 5, the server searches multimedia resources related to each keyword and returns corresponding results to the mobile device; 6, aiming at each group of received results, the mobile terminal precisely overlays the multimedia resources onto the original image.The invention further discloses a reading system for implementation of the character recognition based mobile augmented reality reading method.The reading system comprises a mobile phone terminal and a server terminal, and the mobile phone terminal and the server terminal are in communication through the internet.The character recognition based mobile augmented reality reading method and the reading system have the advantages of low storage cost of the server and the like.

Description

technical field [0001] The invention relates to an augmented reality system technology, in particular to a text recognition-based mobile augmented reality reading method and a reading system thereof. Background technique [0002] In the previous mode of reading books and newspapers, the information people get only comes from the books and newspapers they read, and the amount of information they get is small and limited. Enter keywords in the search engine on the PC or mobile terminal to search. This mode is cumbersome to operate, and the interaction between the reader and the newspaper is poor. [0003] In view of the problems existing in the above-mentioned reading mode, the present invention proposes an Augmented Reality (AR) technology combined with text recognition and knowledge base matching technology to accurately superimpose relevant text, images, and videos on the text content read by readers, Help readers get more information conveniently and quickly in the proce...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F17/27G06K9/00
CPCG06F16/951G06F40/30G06V30/10G06F18/00
Inventor 吕建明石嘉琪代涵宣刘宇阳徐辰沁马芮黄洁晶
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap