Mobile device human body scanning and 3D model creation and analysis

[0069]Example 1. A 3D image of a subject/user is obtained via the following steps:

[0070]Step 1. The subject uses a mobile device (e.g., smartphone) to make a self-scan in uncontrolled conditions using an application on the mobile device.

[0071]Step 2. The mobile device is placed on any plane surface, preferably a flat surface.

[0072]Step 3. The subject stands between 2 and 2.5 meters away from the mobile device and facing the front of the camera located on the mobile device. If the surface on which the mobile device is placed is not exactly flat, the interface of application located on the mobile device may assist the user to stand approximately parallel to the mobile device's surface. The interface may also assist the subject to be centered for an optimal view and image capture. The camera captures a first 2D image of the subject facing the camera.

[0073]Step 4. The subject turns clockwise or counter-clockwise until standing in profile view relative to the camera. The camera then captures a second 2D image of either the left or right profile image of the subject.

[0074]Step 5. The subject exits the scene captured by the camera, and the camera captures a background image without the subject in the image.

[0075]Step 6. The mobile device application runs one or more image segmentation algorithms, which extract(s) extremity feature points 60 from the front and side images of the subject (top, bottom). See FIG. 14. The image segmentation algorithms further obtain the camera's angular positions using an accelerometer of the mobile device. Using the algorithmic data, the camera's optical data, the photo sensor parameters, and a reported height of the subject, the application runs another set of algorithms/functions which allow for the computation of a sensed camera position and a map between image coordinates corresponding to the extremity points (x, y, z) 60 in a world coordinate system.

[0076]Step 7. Further image segmentation allows for segmentation of the front and side silhouettes of the subject, and a map between image coordinates can be constructed as described in Step 6 above, wherein the image coordinates now correspond to boundary points 70 of both silhouettes. See FIG. 15. More points 70 can be included in the set of images (both along the boundary of as well as within the silhouettes), using machine learning on the data base of information from a user's models, wherein relative spatial positions for such points 70 are continuously being analyzed and determined.

[0077]Step 8. A model body (test model) with an explicit surface boundary is used. The model body is represented by a polygon mesh for both genders. X1, y1, and z1 coordinate values are obtained for all topological corresponding points using the information from Step 6 and Step 7.

[0078]Step 9. A mapping function, Fm, is introduced. The mapping function, Fm, maps the surface of the test model (the model body) to the subject's body model as a linear combination of the 3D shape functions obtained in Steps 6-8.

[0079]Step 10. The subject's 3D model is represented by a final function, Ff, which transforms the test model surface polygon mesh into a subject's body model surface polygon mesh. The latter can be created on demand and based on multiple purposes. Among these are: 3D rendering, body metric analysis, product fit computations, etc.

[0080]It is noted that all 3D body models created via the process described in Example 1 above have a unique mapping function F corresponding to a particular general test model. This relationship will further allow for the creation of a 3D image containing all possible mutual mappings inside the data base pertaining to that particular test model.

[0081]The description of a preferred embodiment of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in this art. It is intended that the scope of the invention be defined by the following claims and their equivalents.

[0082]Moreover, the words “example” or “exemplary” are used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the words “example” or “exemplary” is intended to present concepts in a concrete fashion. As used in this application, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise, or clear from context, “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, if X employs A; X employs B; or X employs both A and B, then “X employs A or B” is satisfied under any of the foregoing instances. In addition, the articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or clear from context to be directed to a singular form.