Mobile face capture and image processing system and method

a face capture and image processing technology, applied in the field of computer-based teleconferencing, can solve the problems of reducing local interaction, affecting the physical world of the site in which the user is located, and affecting the effect of the user's face captur

Inactive Publication Date: 2005-04-21
BOARD OF TRUSTEES OPERATING MICHIGAN STATE UNIV +1
View PDF54 Cites 184 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

[0014] The projection augmented-reality display projects stereo images towards a screen which is covered by a fine grain retro-reflective fabric. The projection augmented-reality display uses an optics system that preferably includes two miniature source displays, and projection-optics, such as a double Gauss form lens combined with a beam splitter, to project an image via light towards the surface covered with the retro-reflective fabric. The retro-reflective fabric retro-reflects the projected light brightly and directly back to the eyes of the user. Because of the properties of the retro-reflective screen and the optics system, each eye receives the image from only one of the source

Problems solved by technology

However, wide screen displays are disadvantageous because virtual 3D objects presented on the screen are not blended into the environment of the room of the users.
This problem applies to representation of remote users as well.
Because these systems only display 3D virtual environments, the user cannot see both the physical world of the site in which they are located and the virtual world which is displayed.
Furthermore, people in the same room cannot see each others' full face and eyes, s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile face capture and image processing system and method
  • Mobile face capture and image processing system and method
  • Mobile face capture and image processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The following description of the preferred embodiment(s) is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.

[0049]FIG. 1 depicts a teleportal system 100 using two display sites 101 and 102. Teleportal system 100 includes a first teleportal site or local site 101 and a second teleportal site or remote site 102. It should be appreciated that additional teleportal sites can be included in teleportal system 100. Although first teleportal site 101 is described in detail below, it should further be appreciated that the second teleportal site 102 can be identical to the first teleportal site 101. It should also be noted that the number of users and types of screens can vary at each site.

[0050] Teleportal sites 101 and 102 preferably include a screen 103. Screen 103 is made of a retro-reflective material such as beads-based or corner-cube based materials manufactured by 3M® and Reflexite Corporation. The retro-reflective materia...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Image processing procedures include receiving at least two side view images of a face of a user. In other aspects, side view images are warped and blended into an output image of a face of a user as if viewed from a virtual point of view. In further aspects, a virtual video is produced in real time of output images from a video feed of side view images.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application is a continuation-in-part of U.S. patent application Ser. No. 09 / 748,761 filed on Dec. 22, 2000. The disclosure of the above application is incorporated herein by reference in its entirety for any purpose.FIELD OF THE INVENTION [0002] The present invention generally relates to computer-based teleconferencing in a networked virtual reality environment, and more particularly to mobile face capture and image processing. BACKGROUND OF THE INVENTION [0003] Networked virtual environments allow users at remote locations to use a telecommunication link to coordinate work and social interaction. Teleconferencing systems and virtual environments that use 3D computer graphics displays and digital video recording systems allow remote users to interact with each other, to view virtual work objects such as text, engineering models, medical models, play environments and other forms of digital data, and to view each other's physical en...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): A41D31/00G02B27/00G02B27/01H04N13/00
CPCA41D31/0088G02B27/017G02B27/0172G02B2027/0134G02B2027/0138H04N13/0497G02B2027/0187H04N13/0059H04N13/0285H04N13/044H04N13/0468G02B2027/0178A41D31/32H04N13/194H04N13/286H04N13/344H04N13/366H04N13/398
Inventor BIOCCA, FRANKROLLAND, JANNICK P.STOCKMAN, GEORGE C.REDDY, CHANDAN K.FIGUEROA, MIGUEL VILLANEUVA
Owner BOARD OF TRUSTEES OPERATING MICHIGAN STATE UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products