Check patentability & draft patents in minutes with Patsnap Eureka AI!

Shape-refinement of triangular three-dimensional mesh using a modified shape from shading (SFS) scheme

A technology of triangles and grids, applied to the details of processing steps, graphics and image conversion, 3D image processing, etc., can solve problems such as low efficiency and time consumption

Pending Publication Date: 2021-12-21
SONY CORP
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This causes unnecessary time consumption and can be computationally inefficient, especially for memory / processing constrained systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Shape-refinement of triangular three-dimensional mesh using a modified shape from shading (SFS) scheme
  • Shape-refinement of triangular three-dimensional mesh using a modified shape from shading (SFS) scheme
  • Shape-refinement of triangular three-dimensional mesh using a modified shape from shading (SFS) scheme

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] Embodiments described below can be found in the disclosed apparatus and method for shape refinement of triangular three-dimensional (3D) meshes using a modified shape from shading (SFS) scheme. An exemplary aspect of the present disclosure provides an electronic device for shape refinement of a triangular 3D mesh of an object part, such as a human face part. The disclosed electronic device is configured to model details (eg, facial details) of an initial triangular 3D mesh by using a modified SFS scheme. The initial triangular 3D mesh together with corresponding texture maps and color images of object parts can be used to estimate a final 3D triangular mesh from the initial triangular 3D mesh as a shape-refined 3D triangular mesh. An orthographic projection is employed to project the initial triangular 3D mesh onto a 2D image plane with a square grid. A modified shape from shadow recovery (SFS) scheme is further applied to re-estimate the z-coordinate value of each ver...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An electronic apparatus and method is provided for shape-refinement of a triangular 3D mesh using a modified Shape from Shading (SFS) scheme. The electronic apparatus generates a flat two-dimensional (2D) mesh based on an orthographic projection of an initial three-dimensional (3D) triangular mesh on an image plane that includes a plurality of square grid vertices. The electronic apparatus estimates a final grid depth value for each square grid vertex of the flat 2D mesh based on a modified SFS scheme. The modified SFS scheme corresponds to an objective relationship among a reference grid image intensity value, an initial grid depth value, and a grid albedo value for each square grid vertex of the plurality of square grid vertices. The electronic apparatus estimates a final 3D triangular mesh based on the initial 3D triangular mesh and the estimated final grid depth value.

Description

[0001] Cross Reference / Incorporation by Reference to Related Applications [0002] none. technical field [0003] Various embodiments of the present disclosure relate to three-dimensional (3D) modeling, virtual human technology, and virtual reality. More specifically, various embodiments of the present disclosure relate to electronic devices and methods for shape refinement of triangular 3D meshes using a modified shape from shading (SFS) scheme. Background technique [0004] Advances in the fields of three-dimensional (3D) computer graphics and 3D modeling have paved the way for the development and visualization of realistic 3D models of different types of objects (e.g., human faces) in 3D environments such as computer-generated imagery (CGI) environments . Typically, a 3D model of an object of interest can be rendered from a 3D mesh that uses polygonal surfaces to define the shape and geometry of the object of interest. In order to generate a realistic 3D model of an ob...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/20G06T7/507G06T15/50
CPCG06T17/20G06T7/507G06T15/50G06T19/20G06T2219/2021G06T2207/10016G06T2207/10024G06T2200/08G06T2207/30201G06T15/80G06T3/067
Inventor 胡捷M·格哈拉维-阿尔克汉萨利
Owner SONY CORP
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More