3D Shape Recovery Using Texture
Purpose
The purpose of this study was to implement an existing shape-from-texture algorithm and test the efficiency of the algorithm in the context of custom-made abstract textures. I investigated whether the 3D surface generated by the algorithm looks logically correct or similar to the texture given as input. The algorithm is based on Loh’s method of recovery of 3D-structure using visual texture patterns (Loh, 2006).
Solution
Given a digital image of a textured surface, this program does the following:
•Calculate the orientation parameters p and q
•Calculate surface normal
•Generate 3D Mesh surface
Input = digital image composed of texels
Output = orientation parameters / 3D mesh
Algorithm ( Images below)
-
Input a texture image to the system
-
Extract frontal patch from input image
-
Apply gaussian window on patch
-
Take fourier transform of frontal patch
-
Take spectral inertia of fourier transform
-
Repeat the process with each local patch in original image
-
Scale to eliminate blur/illumination. Intersection of two graphs gives tilt angle.
-
Find k at the angle orthogonal to the tilt angle, and use that to find slant
-
Use Peter Kovesi’s shapelet method to reconstruct mesh using slant and tilt angles
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
Results
Example 1
Example 2
