Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

AR (Augmented Reality) realizing method, server, terminal and system

An augmented reality and environment technology, applied in the fields of artificial intelligence and computer vision, can solve problems such as poor applicability, reduce the dependence of plane templates, enhance coordination and consistency, and improve accuracy.

Active Publication Date: 2017-08-08
CHENGDU IDEALSEE TECH
View PDF5 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, limited by the planar template, this technical solution is less applicable to non-planar objects and objects with less texture features

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AR (Augmented Reality) realizing method, server, terminal and system
  • AR (Augmented Reality) realizing method, server, terminal and system
  • AR (Augmented Reality) realizing method, server, terminal and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] The method for realizing augmented reality in the embodiment of the present invention, such as figure 1 As shown, it mainly includes the following steps: step S101, real-time acquisition of images of the environmental scene; step S102, extraction of image features in the environmental scene image; step S103, initial positioning of the environmental scene according to the image features, and establishment of a local map of the environmental scene ; Step S104, tracking the image frames in the environment scene image; Step S105, displaying the virtual object in the current frame image of the environment scene image according to the pose of the virtual object to be displayed.

[0042] In this technical solution, through the real-time image acquisition of the environmental scene, the image features in the real-time image of the environmental scene are extracted, such as the ORB (Oriented Brief) feature, and the initial positioning of the environmental scene is performed accor...

Embodiment 2

[0056] The server 200 for implementing augmented reality in the embodiment of the present invention, such as figure 2 As shown, it includes: video acquisition module 201: used to acquire the video image of the environmental scene; scene reconstruction module 202: used for performing three-dimensional scene reconstruction on the environmental scene according to the environmental scene video image acquired by the video acquisition module 201; database construction Module 203: for constructing an image retrieval database of the environmental scene according to the video image of the environmental scene acquired by the video acquisition module 201 .

[0057] In this technical solution, the video acquisition module 201 shoots or acquires a pre-shot video image of an environmental scene, and records image details in the environmental scene. The scene reconstruction module 202 performs three-dimensional reconstruction of the environment scene according to the video image of the envi...

Embodiment 3

[0063] The terminal 300 for implementing augmented reality in the embodiment of the present invention, such as Figure 4 As shown, it includes: image acquisition module 301: used to collect images of environmental scenes in real time; feature extraction module 302: used to extract image features in the environmental scene images collected by image acquisition module 301; map creation module 303: used to The image features extracted by the extraction module 302 are used to initialize and locate the environment scene, and set up a local map of the environment scene; image tracking module 304: used to track the image frames in the environment scene image collected by the image acquisition module 301; data acquisition module 305 : for acquiring the pose of the virtual object to be displayed; display module 306: for displaying the virtual object in the current frame image of the environment scene image according to the pose of the virtual object to be displayed acquired by the data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an AR realizing method. The method comprises the following steps that an image of an environment scene is collected in real time; image features are extracted from the image of the environment scene; according to the image features, the image scene is positioned initially, and a local map of the environment scene is established; image frames in the image of the environment scene are tracked; and according to a pose of a virtual object to be displayed, the virtual object is displayed in a present frame of the image of the environment scene. The invention provides an AR realizing server, terminal and system. Via the AR realizing method, server, terminal and system, images of the virtual object of the environment scene or target object can be displayed in an overlapped way under the template free condition, rely on a planar template of a present AR technology is reduced effectively, the real-time registering accuracy between the virtual object and the real environment scene is improved, and the virtual object is much more coordinated and consistent with the overlapped image of the environment scene.

Description

technical field [0001] The present invention relates to the technical fields of artificial intelligence and computer vision, in particular to a method, server, terminal and system for realizing augmented reality. Background technique [0002] Simultaneous Localization and Mapping (SLAM) is a technology applied to the combination of autonomous map creation and self-positioning in an unknown environment. It is a research hotspot in the field of autonomous navigation. Finally, how to perceive the surrounding environment and construct an incremental map, while positioning itself, is currently mainly used in technical directions such as unmanned driving, robots, and three-dimensional reconstruction of scenes. [0003] Augmented reality technology (Augmented Reality, AR) uses computer graphics technology and visualization technology to generate virtual objects that do not exist in the real environment, and accurately integrates virtual objects into the real environment through ima...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/33G06T19/00
CPCG06T7/00
Inventor 柳寅秋
Owner CHENGDU IDEALSEE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products