View angle image generation method and device, electronic equipment and storage medium
A viewing angle and image technology, applied in the fields of graphics, image processing, computer vision and artificial intelligence, can solve problems such as high-definition rendering and reconstruction, and achieve the effect of solving high-definition rendering reconstruction, reducing computing load and rendering delay.
Active Publication Date: 2022-05-27
TSINGHUA UNIV
View PDF4 Cites 8 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] This application provides a method, device, electronic device, and storage medium for generating perspective images, so as to solve problems such as high-definition rendering and reconstruction in scenes with limited camera resolution
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0030] The following describes in detail the embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to be used to explain the present application, but should not be construed as a limitation to the present application.
[0031] The NeRf rendering technology specifically includes: obtaining the position and direction of each pixel point according to the two-dimensional image, simulating a ray from each pixel point, and sampling multiple discrete points on the ray. Each point has two properties, color and direction, and the final value of that pixel is a linear superposition of the color and transparency of multiple points on the ray. The sampling points of multiple rays in differe...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the technical field of image processing, in particular to a visual angle image generation method and device, electronic equipment and a storage medium, and the method comprises the steps: building a first nerve radiation field of a target three-dimensional scene, obtaining a color value and a transparency value of each discrete point in each preset sampling direction in the first nerve radiation field, and obtaining a visual angle image; performing bilinear interpolation sampling to obtain color values and transparency values in a plurality of new sampling directions, and inputting the color value and transparency value of each discrete point in a preset sampling direction and the new sampling direction into a preset three-dimensional convolutional neural network for discrete point reconstruction to obtain a second neural radiation field; and performing linear superposition on the color values and the transparency values of the discrete points in the second neural radiation field along each pixel direction under the target view angle to obtain a final color of each pixel, and generating an image under the target view angle based on the final color of each pixel. Therefore, the problems of high-definition rendering reconstruction and the like in a scene with limited camera resolution are solved.
Description
technical field [0001] The present application relates to the technical fields of image processing, graphics, computer vision and artificial intelligence, and in particular, to a method, apparatus, electronic device and storage medium for generating a perspective image. Background technique [0002] NeRf (Neuralradiancefield, neural radiation field) rendering technology proposes a neural radiation field function that optimizes the scene through the sparse sampling set of the input view and its sampling pose, and then obtains a new perspective by projecting the neural radiation field to different angles. render method. [0003] Compared with traditional rendering methods, NeRf does not need to consider the geometric structure of the scene, and can achieve fine rendering of a single point, synthesize the view from the coordinates and angles queried by the camera rays, and use the classic volume rendering technology to project the output color and density. into the image. [...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06T15/20G06T7/90G06T3/40G06N3/04G06K9/62G06V10/774G06V10/82
CPCG06T15/205G06T3/4007G06T7/90G06T3/4076G06T2207/20081G06N3/045G06F18/214
Inventor 于涛韩雨琪
Owner TSINGHUA UNIV