Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A 3D digital modeling method based on dome video stream

A modeling method and video streaming technology, applied in the field of 3D digital modeling based on dome video streaming, can solve the problems of incomplete feature points, poor customer experience, poor stability, etc., and achieve smooth and reliable visual effects. Wide range of expansion areas and stable model establishment

Active Publication Date: 2020-09-15
CHINA GERMANYZHUHAIARTIFICIAL INTELLIGENCE INST CO LTD +2
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This leads to incomplete feature points, which can only be tracked for the previously extracted 500 feature points, so the tracking stability will be very poor
On the other hand, since the effect presentation of the traditional method is transitioned through point-to-point, there will be a stuck situation; and the scene roaming method of establishing a model through the existing method can only present a guided or structured The effect, not many details, not refined enough
So the customer experience is not good

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D digital modeling method based on dome video stream
  • A 3D digital modeling method based on dome video stream
  • A 3D digital modeling method based on dome video stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0107] The three-dimensional modeling of the present invention is further described through the accompanying drawings. The main implementation method of the present invention is: S1 handheld dome camera performs video shooting according to the route required by the user;

[0108] S2 obtains the video stream of the handheld dome camera;

[0109] S3 automatically extracts key frames from the video stream;

[0110] S4 uses super-resolution algorithms to improve the image quality of key frame images;

[0111] S5 tracks the pixels on the key frame image to obtain a dense point cloud;

[0112] S6 selects stable and representative pixels for tracking and uses the PnP algorithm to estimate the trajectory of the camera to determine the camera position and orientation;

[0113] S7 performs three-dimensional modeling according to the dense point cloud obtained in step S5 and the camera position and orientation obtained in step S6.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a three-dimensional digital modeling method based on a ball screen video stream. The method comprises the following steps of S1, holding a ball screen camera to carry out video shooting according to a route required by a user; S2, acquiring a hand-held ball screen camera video stream; S3, automatically extracting a key frame from the video stream; S4, using super-resolution algorithm to increase the image quality of a key frame image; S5, tracking pixel points on the key frame image to obtain dense point cloud; S6, selecting a tracked stable pixel point and using a PnPalgorithm to estimate a camera motion track so as to determine a camera position and an orientation, wherein the stable pixel point is the point in the middle area of the key frame image and the continuous tracking frame number of the stable pixel point is greater than 10 frames; and S7, carrying out three-dimensional modeling according to the dense point cloud obtained in the step S5 and the camera position and the orientation obtained in the step S6. By using the three-dimensional digital modeling method provided in the invention, fixed point shooting is not needed, three-dimensional modelestablishing stability is high and the fluency of a visual effect is high.

Description

Technical field [0001] The invention relates to the technical field of three-dimensional imaging modeling, and relates to a three-dimensional digital modeling method, in particular to a three-dimensional digital modeling method based on a spherical screen video stream. Background technique [0002] In the field of 3D digital modeling technology, the positioning of the camera is an important basic technical indicator. The traditional camera positioning is to take a picture at a certain point by taking a picture, then change to another point to take the picture, and then use two or more points. The position of the photos taken at each point is compared to establish a three-dimensional model. The video frames obtained in this way are discontinuous, so data offset or errors will occur, which will lead to the introduction of major errors in the modeling process, which becomes A big problem in the field of 3D digital modeling. [0003] In order to solve the above problems, technicians g...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00G06T7/70G06T3/00
CPCG06T3/0006G06T7/70G06T17/00G06T2207/10028
Inventor 崔岩
Owner CHINA GERMANYZHUHAIARTIFICIAL INTELLIGENCE INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products