Data-driven mapping function for visual effects applications using mesh segmentation

Abstract

A volumetric based three-dimensional (3D) object is segmented. A training dataset of 3D training objects is acquired. A neural network is defined by multiple layers including a linear layer and a graph layer. The linear layer operates on 2D objects and provides inputs to the graph layer that performs convolution operations on vertices of the 3D objects. A model, that approximates a shape diameter function (SDF) determines neighborhood diameters including a distance from a vertex of the 3D objects to an antipodal vertex. The model is generated by iterating through the 3D objects using the neural network to converge on weights of SDF features. An input mesh is acquired and the converged weights are used to approximate SDF values. The SDF values are input to a graph cut algorithm that generates vertex clusters defining a segmented part of the input mesh. The segmented part is visually displayed or provided.