Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for joint segmentation and 3D reconstruction of a scene

A joint segmentation, 3D technology, applied in the field of signal processing

Inactive Publication Date: 2019-08-13
INTERDIGITAL CE PATENT HLDG
View PDF10 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, 3D reconstruction is not accurate enough for finer interaction in some applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for joint segmentation and 3D reconstruction of a scene
  • Method and device for joint segmentation and 3D reconstruction of a scene
  • Method and device for joint segmentation and 3D reconstruction of a scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0101]It is to be understood that the drawings and descriptions of the present disclosure have been simplified to illustrate elements relevant to a clear understanding of the present disclosure, while for the sake of clarity, many other elements found in typical operating devices, like mobile devices (e.g., mobile phones, tablets, head-mounted displays, etc.) or automated devices (e.g., robots, self-driving devices, smart home devices, etc.).

[0102] The general principles of the present disclosure rely on determining a refined 3D reconstruction and enhanced segmentation of the scene from an initial 3D reconstruction of the scene and from initial 2D features determined from at least one of a set of images of the scene, as corresponding to the scene The initial 3D reconstruction of is associated with the initial 3D features.

[0103] Scenes can obviously be objects. Therefore, a scene can consist of one or more objects.

[0104] Specifically, a refined 3D reconstruction of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for joint segmentation and 3D reconstruction of a scene, from a set of at least one image of the scene, comprises: - obtaining (11) an initial 3D reconstruction of the scene; - obtaining (12)initial 3D features associated with the initial 3D reconstruction; - obtaining (13) an initial segmentation of the initial 3D reconstruction; - determining (14) enhanced 3D features, from the initial3D features and from initial 2D features determined in at least one image of the set, as corresponding to the initial 3D features associated with the initial 3D reconstruction of the scene, the enhanced 3D features corresponding at least partly to the initial segmentation; and - determining (15) an enhanced segmentation and a refined 3D reconstruction, from the initial segmentation and the enhanced 3D features. The method is applied to augmented reality.

Description

technical field [0001] The present disclosure relates to the field of signal processing, and more particularly to the processing of images or video. [0002] More specifically, the present disclosure relates to a method for joint segmentation and 3D reconstruction of scenes, with the aim of improving segmentation and reconstruction of scenes compared to some prior art. [0003] This disclosure is particularly applicable to any application where 3D reconstruction is of interest. This may be the case, for example, in fields like navigation, autonomous robots, virtual reality, augmented and / or mixed reality, smart home devices, etc. Background technique [0004] This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present disclosure that are described and / or claimed below. It is believed that this discussion helps to provide the reader with background information to facilitate a better understanding of vari...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/50G06T7/12
CPCG06T2207/10028G06T7/55G06T7/11G06T2207/10016G06T7/12G06T7/50G06T2207/10012G06T5/00G06T7/507G06T7/344G06T7/60G06T17/10
Inventor T.罗
Owner INTERDIGITAL CE PATENT HLDG