Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Viewpoint image processing method and related equipment

A viewpoint image and processing method technology, applied in the field of image processing, can solve problems such as low synthesis efficiency

Pending Publication Date: 2021-03-23
HUAWEI TECH CO LTD
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this scheme can only generate an intermediate viewpoint image of one-dimensional two-viewpoint images. For multiple viewpoint images, CNN needs to be run repeatedly, and the synthesis efficiency is low.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Viewpoint image processing method and related equipment
  • Viewpoint image processing method and related equipment
  • Viewpoint image processing method and related equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0191] Figure 10 A training method 1000 for a virtual view synthesis network provided in Embodiment 1 of the present invention, the structural diagram of the virtual view synthesis network can be found in Figure 11 ,exist Figure 11 In , the virtual view synthesis network consists of three parts, which are representation network, generation network and correction network. Among them, the characterization network is used to obtain the features of the input existing viewpoint images, and calculate a feature matrix representing the relationship information of the geometric positions between the input existing viewpoint images according to these features; the generation network is used to generate The virtual synthetic pixel matrix of the preliminary synthetic view; the correction network is used to generate the final synthetic view output from the virtual synthetic pixel matrix of the preliminary synthetic view.

[0192] The method for training the virtual view synthesis netw...

Embodiment 2

[0211] Figure 12 It is a viewpoint image processing method 1200 provided by the embodiment of the present invention, the method 1200 includes but not limited to the following steps:

[0212] Step 1201. Acquire a preset number of first viewpoint images.

[0213] Specifically, the first viewpoint image is an existing viewpoint image.

[0214] In a specific embodiment, if it is on the server side (including cloud server, it can be for Figure 7 described in the description of the server or cloud) to complete the synthesis of virtual viewpoint images, then the server can be connected to the network with a preset number of video or image acquisition devices, and the preset number of acquisition devices are in the preset number of spaces After the location collects the preset number of images, the preset number of images is sent to the server. If in terminal (can be for Figure 7 The terminal described in the description) completes the synthesis of virtual viewpoint images, the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a viewpoint image processing method and related equipment, and relates to the field of artificial intelligence / computer vision. The method comprises the steps:obtaining a preset number of first viewpoint images; obtaining a geometrical characteristic matrix among the preset number of first viewpoint images; generating an adaptive convolution kernel of eachpixel in the preset number of first viewpoint images according to the geometrical characteristic matrix and the position information of the second viewpoint images to be synthesized; wherein the position information represents the viewpoint position of the second viewpoint image; generating the preset number of virtual synthetic pixel matrixes to be processed according to the adaptive convolutionkernel and the pixels of the preset number of first viewpoint images; and synthesizing the preset number of to-be-processed virtual synthetic pixel matrixes into the second viewpoint image. By adopting the embodiment of the invention, the efficiency and quality of synthesizing the second viewpoint image can be improved.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a viewpoint image processing method and related equipment. Background technique [0002] Multi-viewpoint image data is a kind of image or video data with multiple viewing angles obtained by multiple video or image acquisition devices. For example, in the shooting of virtual reality video content, multiple cameras can be used to shoot video at different positions to obtain multi-viewpoint image data, and then image processing by computer is performed to obtain virtual viewpoint images to create a virtual reality video experience for users. [0003] Due to the limitations of existing image sensor pixels or hardware cost, existing shooting devices cannot obtain high spatial resolution (single viewpoint image resolution) and angular resolution (number of viewpoint images) at the same time. Therefore, it is an effective way to solve this problem by shooting multi-vie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06N3/04
CPCG06T19/006G06N3/045G06T15/205G06N3/084G06N3/048G06V10/40G06V10/82G06T15/20
Inventor 宋翼邸佩云向维韩康王冰
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com