Method and device for implementing augmented reality (AR) and terminal device

An augmented reality and implementation method technology, applied in the field of information processing, can solve problems such as inaccurate location, inaccurate AR information, and unreal AR information display, and achieve the effect of real AR information and accurate location.

Active Publication Date: 2015-11-04
ALIBABA (CHINA) CO LTD
View PDF6 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this method, due to the accumulation of errors in the sensor, the position of the user determined when shooting for a period of time or when there is violent movement is not accurate, resulting in the displayed AR information being inaccurate
At the same ti

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for implementing augmented reality (AR) and terminal device
  • Method and device for implementing augmented reality (AR) and terminal device
  • Method and device for implementing augmented reality (AR) and terminal device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] like figure 2 As shown, a schematic diagram of an implementation process of implementing an augmented reality implementation method for a terminal-side device may include the following steps:

[0039] S21. Acquiring an image sequence of a shooting object.

[0040] During specific implementation, the user can take pictures of the surrounding environment through a camera built in a terminal device such as a mobile phone, and obtain an image sequence of the object being photographed. In the embodiment of the present invention, the user can obtain image sequences representing different regions of the object by moving.

[0041] S22. Select at least one key frame image from the acquired image sequence.

[0042] Wherein, the key frame image is an image capable of recovering the local three-dimensional point cloud data of the shooting object, and the determined, adjacent key frame images satisfy a preset image interval distance.

[0043] better, such as image 3 As shown, ...

Embodiment 2

[0116] like Figure 5 As shown, it is a schematic structural diagram of an augmented reality implementing device provided by an embodiment of the present invention, including:

[0117] An acquisition unit 51, configured to acquire an image sequence of the subject;

[0118] The selection unit 52 is configured to select at least one key frame image from the image sequence acquired by the acquisition unit 51 .

[0119] Wherein, the key frame image is an image capable of recovering the local three-dimensional point cloud data of the photographed object, and adjacent key frame images satisfy a preset distance between images.

[0120] The first determining unit 53 is configured to determine that the key frame image with the latest shooting time is the current key frame image;

[0121] The second determination unit 54 is configured to determine the complete 3D point cloud data of the subject according to the current key frame image determined by the first determination unit 53 or t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for implementing augmented reality (AR) and a terminal device, which is used for displaying corresponding AR information in real time on an image photographed by a user and improving the accuracy and the authenticity of AR information display. The method for implementing augmented reality comprises the steps of acquiring an image sequence of a photographed object; selecting at least one key-frame image from the image sequence, wherein the key-frame image can restore an image of local three-dimensional point cloud data of the photographed object, and the adjacent key-frame images meet a preset image spacing distance; determining a key-frame image with the photographing time being the latest as the current key-frame image; determining complete three-dimensional point cloud data of the photographed object according to the current key-frame image or the selected at least one key-frame image; acquiring AR information to be displayed; determining a display direction of the AR information on the current frame image according to the complete three-dimensional point cloud data and the current key-frame image; and displaying the AR information on the current frame image according to the display direction.

Description

technical field [0001] The present invention relates to the technical field of information processing, in particular to an augmented reality realization method, device and terminal equipment. Background technique [0002] Augmented reality (AR, Augmented Reality) is a technology that uses virtual objects to enhance the reality of real scenes. Augmented reality retains the user's actual environment as the user's main perception and interaction environment, and marks the virtual generated information such as text, two-dimensional graphics, and three-dimensional models on the objects displayed on the display screen in the user's actual environment. , so as to realize the annotation and description of the user's environment, or the effect of augmenting the reality environment. like figure 1 As shown, the user turns on the camera of the mobile terminal and points the camera at the real environment. At this time, the screen of the user's mobile terminal will display the existing...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00
Inventor 郑杰段思九
Owner ALIBABA (CHINA) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap