Unlock instant, AI-driven research and patent intelligence for your innovation.

A 3D registration method for augmented reality based on orb operator

An augmented reality, three-dimensional registration technology, applied in image enhancement, computing, image analysis and other directions, can solve problems such as inconvenient use, inability to track, affecting scene consistency, etc., to reduce computational pressure, reduce transmission pressure, and be more reliable. awesome effect

Active Publication Date: 2020-07-17
BEIJING UNION UNIVERSITY
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method is a method based on marker points, which has the following disadvantages: 1. It is necessary to add artificial markers in the real scene. In some specific occasions, such as museums, it is not easy to add such artificial markers, and it will greatly affect the scene. Consistency, and artificial markers must always appear in the camera's field of view, once out of the range, they cannot be tracked; 2. Using projection technology to project markers into the scene, there may be light intensity exposure to the camera, reflective Affects, so markers registered to the scene cannot be tracked
Additional head-mounted display equipment is required, which is inconvenient to use

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D registration method for augmented reality based on orb operator
  • A 3D registration method for augmented reality based on orb operator
  • A 3D registration method for augmented reality based on orb operator

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] Such as figure 1 As shown, step 100 is executed to acquire images of cultural relics using a camera. Execute step 110, adjust the image obtained from the device into an image in RGBA format with a resolution of 640x480, first convert the image into an 8-bit (256-level) grayscale image, and then construct an image pyramid, which is divided into 4 levels, each Each layer is half the image of the previous layer. We check the ORB will levy points on each layer. Step 120 is executed to describe the extracted feature points, obtain a descriptor and perform feature matching. Before the feature tracking of each frame starts, we need to make a pre-estimation of the camera motion, based on the pose of the camera in the previous frame and the image information of the current detection, pre-estimate the pose of the camera in the current frame. Here we choose a fuzzy small image of the original image after downsampling, the size is 40x30, that is, the length and width are one-tho...

Embodiment 2

[0057] Such as figure 2 , 2a As shown in , 2b, and 2c, the image is converted into an 8-bit (256-level) grayscale image, and then an image pyramid is constructed. Pyramid is the main form of multi-scale image representation, and image pyramid is an effective but conceptually simple structure to explain images at multiple resolutions. An image pyramid is a collection of progressively lower resolution images arranged in a pyramid shape. In this system, we use interlaced sampling to extract the pyramid model. It is divided into 4 levels. The resolution of the first level is 640x480, the resolution of the second level is 320x240, the resolution of the third level is 160x120, and the resolution of the fourth level is 80x60. Half of the layer image. Such as image 3 The image shown is for the figure 2 Detect ORB feature points (dots with white edges in the figure) on the level shown in , to obtain the required features; as Figure 3a The image shown is for the Figure 2a D...

Embodiment 3

[0059] Such as Figure 4 , 4a As shown, through the algorithm proposed in this paper, the Figure 4 Objects in the scene can be detected, and feature points (gray points in the figure) that can be used as markers in the scene can be detected. These feature points are very robust to illumination, scale, and rotation. Using these feature points to generate Figure 4a Image of virtual information shown.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides an augmented reality 3-D registration method based on ORB operators, comprising the following steps: using an acquiring device to acquire the images of the objects in a specific scene; extracting characteristics points of images of objects and describing the characteristics points; obtaining the descriptors and performing the characteristics matching; calculating the altitude and the position of the acquiring device; reducing the error and generating point clouds; performing information transmission; and displaying the virtual information on devices. The devices allowing the use of the method include a mobile phone and a tablet personal computer. These devices are more popular and can be portably carried. The method does not need to place artificial markers in a scene, and it can be conveniently used. Through the use of the ORB algorithm to extract and match the characteristics, not only the computation amount is reduced, but also good robustness exists for different illumination intensities. The system is faster and more accurate for object identification in a real scene.

Description

technical field [0001] The invention relates to the technical field of augmented reality of a computer system, in particular to an augmented reality three-dimensional registration method based on an ORB operator. Background technique [0002] Augmented reality is a new field that studies the fusion of real world and computer-generated data, and it is becoming more and more popular recently. With the popularity of home mobile devices, people's demand for mobile performance is increasing, and mobile AR is becoming a field with full potential. The increasingly powerful processors of mobile devices, coupled with the inherent hardware sensing of new devices, make it attractive to build AR systems on mobile devices. [0003] Most of the existing mobile AR systems still cannot be separated from the assistance of prominent signs, or have to use special hardware sensing to solve the problem of real-time tracking. This brings great resistance to the development of AR technology, and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T19/00G06T7/246G06T7/73
CPCG06T19/006G06T2207/20016G06T2207/30244
Inventor 刘宏哲袁家政张雪鉴
Owner BEIJING UNION UNIVERSITY
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More