Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A 3D digital modeling method based on dome video stream

A modeling method and video streaming technology, applied in the field of 3D digital modeling based on dome video streaming, can solve the problems of incomplete feature points, poor customer experience, poor stability, etc., and achieve smooth and reliable visual effects. Wide range of expansion areas and stable model establishment

Active Publication Date: 2020-09-15
CHINA GERMANYZHUHAIARTIFICIAL INTELLIGENCE INST CO LTD +2
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This leads to incomplete feature points, which can only be tracked for the previously extracted 500 feature points, so the tracking stability will be very poor
On the other hand, since the effect presentation of the traditional method is transitioned through point-to-point, there will be a stuck situation; and the scene roaming method of establishing a model through the existing method can only present a guided or structured The effect, not many details, not refined enough
So the customer experience is not good

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D digital modeling method based on dome video stream
  • A 3D digital modeling method based on dome video stream
  • A 3D digital modeling method based on dome video stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0107] The three-dimensional modeling of the present invention is further described through the accompanying drawings. The main implementation method of the present invention is: S1 handheld dome camera performs video shooting according to the route required by the user;

[0108] S2 obtains the video stream of the handheld dome camera;

[0109] S3 automatically extracts key frames from the video stream;

[0110] S4 uses super-resolution algorithms to improve the image quality of key frame images;

[0111] S5 tracks the pixels on the key frame image to obtain a dense point cloud;

[0112] S6 selects stable and representative pixels for tracking and uses the PnP algorithm to estimate the trajectory of the camera to determine the camera position and orientation;

[0113] S7 performs three-dimensional modeling according to the dense point cloud obtained in step S5 and the camera position and orientation obtained in step S6.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a three-dimensional digital modeling method based on dome video streams. It includes the following steps: S handheld dome camera shoots video according to the route required by the user; S2 obtains the handheld dome camera video stream; S3 automatically extracts key frames from the video stream; S4 uses a super-resolution algorithm to improve the image quality of key frame images. ;S5 tracks the pixels on the key frame image to obtain a dense point cloud; S6 selects and tracks stable pixels and uses the PnP algorithm to estimate the camera motion trajectory, thereby determining the camera position and orientation; the stable pixels are located in the middle area of ​​the key frame image points and the number of continuous tracking frames is greater than 10 frames; S7 performs three-dimensional modeling based on the dense point cloud obtained in step S5 and the camera position and orientation obtained in step S6. The invention provides a three-dimensional digital modeling method that does not require fixed-point shooting, has high stability in establishing a three-dimensional model, and has high visual effect fluency.

Description

Technical field [0001] The invention relates to the technical field of three-dimensional imaging modeling, and relates to a three-dimensional digital modeling method, in particular to a three-dimensional digital modeling method based on a spherical screen video stream. Background technique [0002] In the field of 3D digital modeling technology, the positioning of the camera is an important basic technical indicator. The traditional camera positioning is to take a picture at a certain point by taking a picture, then change to another point to take the picture, and then use two or more points. The position of the photos taken at each point is compared to establish a three-dimensional model. The video frames obtained in this way are discontinuous, so data offset or errors will occur, which will lead to the introduction of major errors in the modeling process, which becomes A big problem in the field of 3D digital modeling. [0003] In order to solve the above problems, technicians g...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00G06T7/70G06T3/00
CPCG06T7/70G06T17/00G06T2207/10028G06T3/02
Inventor 崔岩
Owner CHINA GERMANYZHUHAIARTIFICIAL INTELLIGENCE INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products