Reality augmenting method with real environment estimation and reality augmenting system

An augmented reality and environment technology, applied in computing, computer parts, 3D image processing, etc., can solve problems such as affecting the recognition effect, and achieve the effect of adding vividness and improving the user's real experience.

Inactive Publication Date: 2009-09-02
上海水晶石视觉展示有限公司
View PDF0 Cites 49 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] The disadvantage is that the requirements for markers are relatively high, and the shape of markers is required to be simple. The contrast between the edge of the shape and the b

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reality augmenting method with real environment estimation and reality augmenting system
  • Reality augmenting method with real environment estimation and reality augmenting system
  • Reality augmenting method with real environment estimation and reality augmenting system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0076] Such as figure 1 As shown, an augmented reality system with realistic environment estimation includes:

[0077] The video frame training module is used to select or extract a front view of a marker, train the marker, and obtain training data;

[0078] The video frame correction module is connected to the video frame training module, and is used to calculate and correct the camera internal parameters of the marker image;

[0079] The video frame capture module is connected to the video frame training module and the video frame correction module, and is used to correct each frame in the real environment captured by the camera using the data in the video frame correction module, Then identify the marker based on the training data in the video frame training module. If it contains a marker, calculate the relative position matrix of the marker in the camera coordinate system, and calculate the brightness of the recognized marker and the front view of the marker. Perform compari...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a reality augmenting method with real environment estimation and a reality augmenting system. The method comprises the following steps: initializing a system environment and configuring system parameters; selecting or extracting one marker front view and training a marker to obtain training data; calculating and correcting camera inner parameters of a marker image; correcting each frame of a real environment shot by a camera, and based on the training data, identifying the marker and calculating a relative position matrix of the marker in a camera coordinate system; and searching a corresponding virtual model by the identified marker, determining the position of the model by utilizing the position matrix of the extracted marker, drawing the virtual model, estimating illumination information of the environment in which the marker is positioned by comparing the brightness of the identified marker and brightness of the marker front view, performing real environment light source estimation to estimate the position of the real light source and generate shadow. The method and the system greatly reduce the limitation on the marker and can be used for marking maps and complex two-dimensional images.

Description

technical field [0001] The invention belongs to the field of augmented reality technology, in particular to a method and system of augmented reality, which is applied to the fields of virtual reality and computer vision, and uses pattern recognition and virtual reality technology to add content and enhance effects to the real image frames collected by video . Background technique [0002] Augmented reality (AR, Augmented Reality) is a technology that uses virtual objects to enhance the reality of real scenes. Augmented reality is based on the real physical environment collected by acquisition devices such as cameras, by annotating virtual generated information such as text, two-dimensional images, and three-dimensional models on objects in the real physical environment displayed on the display screen, so as to realize the user's physical environment Notes, descriptions, or enhancements and emphasis on certain effects of the real-world environment. For example, when a user ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T15/60G06K9/62
Inventor 季斐翀陆涛周暖云潘晋
Owner 上海水晶石视觉展示有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap