MICRO 3D VISUALIZATION AND SHAPE RECONSTRUCTION COMPOSITIONS AND METHODS THEREOF

Abstract

The present disclosure provides a microscale three-dimensional modeling system comprising a lighting condition, a camera, a microscope, and a mobile photographic platform. Methods of utilizing the system are also included in the present disclosure, including a method of generating a three-dimensional surface model of an object as well as a method of generating a three-dimensional CAD model of an object.

Claims

1. A microscale three-dimensional modeling system comprising i) a lighting condition, ii) a camera, iii) a microscope, and iv) a mobile photographic platform.

2. The system of claim 1, wherein the lighting condition comprises absolute lightening, relative lightening, or a combination thereof.

3. The system of claim 1, wherein the lighting condition comprises absolute lightening.

4. The system of claim 1, wherein the lighting condition comprises relative lightening.

5. The system of claim 1, wherein the system further comprises a Surface from Motion (SfM)-based software.

6. The system of claim 1, wherein the camera comprises a focal length that is greater than a depth of measurement.

7. The system of claim 1, wherein the camera comprises a zoom magnification power between 7× and 45×.

8. The system of claim 1, wherein the camera is connected to the microscope.

9. The system of claim 1, wherein the microscope comprises a magnification power between 2× and 45×.

10. The system of claim 1, wherein the mobile photographic platform is configured under the microscope.

11. The system of claim 1, wherein the system further comprises a computer aided design (CAD) component.

12. A method of generating a three-dimensional surface model of an object, said method comprising the step of using the microscale three-dimensional modeling system of claim 1 to provide the three dimensional surface model of the object.

13. The method of claim 12, wherein the method comprises a 3D photo stitching process.

14. The method of claim 13, wherein the 3D photo stitching process comprises an overlap between photos between 60% and 80%.

15. The method of claim 12, wherein the method comprises obtaining one or more photos of the object at a 45° angle around the vertical axis of the object.

16. The method of claim 12, wherein the object is between 1 μm and 1000 μm in size.

17. The method of claim 12, wherein the object is between 100 μm and 1000 μm in size.

18. The method of claim 12, wherein the object is between 500 μm and 1000 μm in size.

19. The method of claim 12, wherein the object is selected from the group consisting of a micro part assembly automation, a biomedical device, a biomedical device fabrication, a biological specimen, a microchemical specimen, and a physical specimen.

20. A method of generating a three-dimensional CAD model of an object, said method comprising the step of using the microscale three-dimensional modeling system of claim 1 to provide a three dimensional surface model of the object, and further comprising performing a CAD operation to provide the three dimensional CAD model of the object.

Description

BRIEF DESCRIPTIONS OF THE DRAWINGS

[0015] The detailed description particularly refers to the accompanying figures in which:

[0016] FIG. 1 shows the concept of Structure from Motion (SfM) technique.

[0017] FIG. 2 shows a diagram for Phong's illumination model and the associated formula.

[0018] FIG. 3 shows an experimental setup for microscale SfM comprising a gantry type microscope with a mobile platform underneath the microscope.

[0019] FIG. 4 shows a capturing sequence for an exemplary microscale SfM technique.

[0020] FIG. 5A shows absolute light conditions. FIG. 5B shows relative light conditions.

[0021] FIG. 6 shows the microscale gear comprising a length of 300 micrometers and a diameter of 70 micrometers as used for testing.

[0022] FIG. 7 shows that 5 of the 22 photos were identified with significant matching points using the absolute light condition.

[0023] FIG. 8A shows the reconstructed surface of the microscale gear object using the absolute light condition. FIG. 8B shows a sectional view of the object at the A-A distance shown in FIG. 8A.

[0024] FIGS. 9A and 9B show that all of the 22 photos were identified with significant matching points using the relative light condition.

[0025] FIG. 10A shows the reconstructed surface of the microscale gear object using the relative light condition. FIG. 10B shows a sectional view of the object at the A-A distance shown in FIG. 10A.

[0026] FIG. 11 shows a comparison of the number of recognized photos using the absolute light condition and the relative light condition.

[0027] FIG. 12A shows the micro-fluidic channel in comparison to a penny. FIG. 12B shows the original CAD design of the micro-fluidic channel.

[0028] FIG. 13A shows the first model created by the magnification factor of 30.

[0029] FIG. 13B shows that 17 point cloud data were captured from the model.

[0030] FIG. 14A shows the Euclidean distance of each point cloud data to the measured and plotted surface and FIG. 14B shows the surface fitting results.

[0031] FIG. 15 shows that 15 point cloud data were captured for surface flatness accuracy test.

[0032] FIG. 16A shows the collected data points by scatter 3D representation and FIG. 16B shows the surface fitting results.

[0033] FIGS. 17A-17B show a microscale 3D pyramid comprising a 450 μm.sup.2 base and a 2,100 μm height (300 μm/step; 7 steps).

[0034] FIG. 18 shows construction of the microscale 3D pyramid using a magnitude factor of 70× zoom.

[0035] FIG. 19A shows a total of 12-point cloud data depicted in 3D scatter plot.

[0036] FIG. 19B shows the depth of the first two steps from the top were measured to be 287 μm and 295 μm, respectively, using the calibration factor (145.73).

DETAILED DESCRIPTION

[0037] In an illustrative aspect, a microscale three-dimensional modeling system is provided. The system comprises i) a lighting condition, ii) a camera, iii) a microscope, and iv) a mobile photographic platform.

[0038] In an embodiment, the lighting condition comprises absolute lightening, relative lightening, or a combination thereof. In an embodiment, the lighting condition comprises absolute lightening. In an embodiment, the lighting condition comprises relative lightening. In an embodiment, the lighting condition comprises a Gouraud lighting condition.

[0039] In an embodiment, the camera is a digital camera. In an embodiment, the camera comprises a fisheye lens. In an embodiment, the camera comprises a focal length that is greater than a depth of measurement.

[0040] In an embodiment, the camera comprises a lens comprising 50 mm focal length (35 mm film equivalent). In an embodiment, the camera comprises a lens comprising a focal length between 20 mm and 80 mm (35 mm film equivalent). In an embodiment, the camera comprises a zoom magnification power between 7× and 45×. In an embodiment, the camera comprises a widefield of view of 1.25 inches. In an embodiment, the camera comprises a working distance of 4 inches. In an embodiment, the camera is connected to the microscope.

[0041] In an embodiment, the microscope comprises a fixed lens. In an embodiment, the microscope comprises an adjustable depth of focus (DOF). In an embodiment, the microscope comprises a magnification power between 2× and 45×. In an embodiment, the microscope is a gantry-type microscope.

[0042] In an embodiment, the mobile photographic platform is configured under the microscope. In an embodiment, the mobile photographic platform comprises a piezo-electric mobile platform. In an embodiment, the mobile photographic platform comprises a rotational axis. In an embodiment, the mobile photographic platform comprises two degrees of freedom axes of rotational mobility. In an embodiment, the mobile photographic platform comprises a three Degree of Freedom X-Y-Z motion control system.

[0043] In an embodiment, the system further comprises a three-dimensional (3D) photography software. In an embodiment, the 3D photography software is a Surface from Motion (SfM)-based software. Software configured to provide SfM capabilities is known to the person of ordinary skill in the art and can be utilized with the system.

[0044] In an embodiment, the system further comprises a computer aided design (CAD) component. Components configured to provide CAD capabilities, such as CAD software, are known to the person of ordinary skill in the art and can be utilized with the system.

[0045] In an embodiment, the system is configured for surface modeling of a microscale object. In an embodiment, the microscale object is between 1 μm and 1000 μm in size. In an embodiment, the microscale object is between 100 μm and 1000 μm in size. In an embodiment, the microscale object is between 500 μm and 1000 μm in size.

[0046] It is contemplated that objects on a microscale can be observed according to the present disclosure. In an embodiment, the system is configured for surface modeling of a micro part assembly automation. In an embodiment, the system is configured for surface modeling of a biomedical device. In an embodiment, the system is configured for surface modeling of a biomedical device fabrication. In an embodiment, the system is configured for surface modeling of a biological specimen. In an embodiment, the system is configured for surface modeling of a microchemical specimen. In an embodiment, the system is configured for surface modeling of a physical specimen.

[0047] In an illustrative aspect, method of generating a three-dimensional surface model of an object is provided. The method comprises the step of using a microscale three-dimensional modeling system to provide the three dimensional surface model of the object a microscale three-dimensional modeling system. The microscale three-dimensional modeling system of any of the above embodiments can be utilized with the method of generating a three-dimensional surface model of an object.

[0048] In an embodiment, the method comprises a 3D photo stitching process. In an embodiment, the 3D photo stitching process comprises an overlap between photos between 60% and 80%. In an embodiment, the method comprises obtaining one or more photos of the object at a 45° angle around the vertical axis of the object.

[0049] In an embodiment, the object is between 1 μm and 1000 μm in size. In an embodiment, the object is between 100 μm and 1000 μm in size. In an embodiment, the object is between 500 μm and 1000 μm in size.

[0050] In an embodiment, the object comprises a micro part assembly automation. In an embodiment, the object comprises a composition comprising one or more microchannels. In an embodiment, the object comprises a biomedical device. In an embodiment, the object comprises a biomedical device fabrication. In an embodiment, the object comprises a biological specimen. In an embodiment, the object comprises a microchemical specimen. In an embodiment, the object comprises a physical specimen.

[0051] In an illustrative aspect, method of generating a three-dimensional CAD model of an object is provided. The method comprises the step of using a microscale three-dimensional modeling system to provide a three dimensional surface model of the object, and further comprising performing a CAD operation to provide the three dimensional CAD model of the object. The micro scale three-dimensional modeling system of any of the above embodiments can be utilized with the method of generating a three-dimensional CAD model of an object.

[0052] In an embodiment, the CAD operation comprises dimensioning of the object. In an embodiment, the CAD operation comprises volume measuring of the object. In an embodiment, the CAD operation comprises surface texturing of the object.

[0053] In an embodiment, the method comprises a 3D photo stitching process. In an embodiment, the 3D photo stitching process comprises an overlap between photos between 60% and 80%. In an embodiment, the method comprises obtaining one or more photos of the object at a 45° angle around the vertical axis of the object.

[0054] In an embodiment, the object is between 1 μm and 1000 μm in size. In an embodiment, the object is between 100 μm and 1000 μm in size. In an embodiment, the object is between 500 μm and 1000 μm in size.

[0055] In an embodiment, the object comprises a micro part assembly automation. In an embodiment, the object comprises a composition comprising one or more microchannels. In an embodiment, the object comprises a biomedical device. In an embodiment, the object comprises a biomedical device fabrication. In an embodiment, the object comprises a biological specimen. In an embodiment, the object comprises a microchemical specimen. In an embodiment, the object comprises a physical specimen.

[0056] The following numbered embodiments are contemplated and are non-limiting:

1. A microscale three-dimensional modeling system comprising i) a lighting condition, ii) a camera, iii) a microscope, and iv) a mobile photographic platform.
2. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the lighting condition comprises absolute lightening, relative lightening, or a combination thereof.
3. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the lighting condition comprises absolute lightening.
4. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the lighting condition comprises relative lightening.
5. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the lighting condition comprises a Gouraud lighting condition.
6. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera is a digital camera.
7. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a fisheye lens.
8. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a focal length that is greater than a depth of measurement.
9. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a lens comprising 50 mm focal length (35 mm film equivalent).
10. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a lens comprising a focal length between 20 mm and 80 mm (35 mm film equivalent).
11. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a zoom magnification power between 7× and 45×.
12. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a widefield of view of 1.25 inches.
13. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera comprises a working distance of 4 inches.
14. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the camera is connected to the microscope.
15. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the microscope comprises a fixed lens.
16. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the microscope comprises an adjustable depth of focus (DOF).
17. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the microscope comprises a magnification power between 2× and 45×.
18. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the microscope is a gantry-type microscope.
19. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the mobile photographic platform is configured under the microscope.
20. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the mobile photographic platform comprises a piezo-electric mobile platform.
21. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the mobile photographic platform comprises a rotational axis.
22. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the mobile photographic platform comprises two degrees of freedom axes of rotational mobility.
23. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the mobile photographic platform comprises a three Degree of Freedom X-Y-Z motion control system.
24. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system further comprises a three-dimensional (3D) photography software.
25. The system of clause 24, any other suitable clause, or any combination of suitable clauses, wherein the 3D photography software is a Surface from Motion (SfM)-based software.
26. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system further comprises a computer aided design (CAD) component.
27. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a microscale object.
28. The system of clause 27, any other suitable clause, or any combination of suitable clauses, wherein the microscale object is between 1 μm and 1000 μm in size.
29. The system of clause 27, any other suitable clause, or any combination of suitable clauses, wherein the microscale object is between 100 μm and 1000 μm in size.
30. The system of clause 27, any other suitable clause, or any combination of suitable clauses, wherein the microscale object is between 500 μm and 1000 μm in size.
31. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a micro part assembly automation.
32. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a composition comprising one or more microchannels.
33. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a biomedical device.
34. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a biomedical device fabrication.
35. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a biological specimen.
36. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a microchemical specimen.
37. The system of clause 1, any other suitable clause, or any combination of suitable clauses, wherein the system is configured for surface modeling of a physical specimen.
38. A method of generating a three-dimensional surface model of an object, said method comprising the step of using the microscale three-dimensional modeling system comprising i) a lighting condition, ii) a camera, iii) a microscope, and iv) a mobile photographic platform to provide the three dimensional surface model of the object.
39. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the microscale three-dimensional modeling system is the system of any one of clauses 1-37.
40. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the method comprises a 3D photo stitching process.
41. The method of clause 40, any other suitable clause, or any combination of suitable clauses, wherein the 3D photo stitching process comprises an overlap between photos between 60% and 80%.
42. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the method comprises obtaining one or more photos of the object at a 45° angle around the vertical axis of the object.
43. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object is between 1 μm and 1000 μm in size.
44. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object is between 100 μm and 1000 μm in size.
45. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object is between 500 μm and 1000 μm in size.
46. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a micro part assembly automation.
47. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a composition comprising one or more microchannels.
48. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a biomedical device.
49. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a biomedical device fabrication.
50. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a biological specimen.
51. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a microchemical specimen.
52. The method of clause 38, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a physical specimen.
53. A method of generating a three-dimensional CAD model of an object, said method comprising the step of using the microscale three-dimensional modeling system comprising i) a lighting condition, ii) a camera, iii) a microscope, and iv) a mobile photographic platform to provide a three dimensional surface model of the object, and further comprising performing a CAD operation to provide the three dimensional CAD model of the object.
54. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the microscale three-dimensional modeling system is the system of any one of clauses 1-37.
55. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the CAD operation comprises dimensioning of the object.
56. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the CAD operation comprises volume measuring of the object.
57. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the CAD operation comprises surface texturing of the object.
58. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the method comprises a 3D photo stitching process.
59. The method of clause 58, any other suitable clause, or any combination of suitable clauses, wherein the 3D photo stitching process comprises an overlap between photos between 60% and 80%.
60. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the method comprises obtaining one or more photos of the object at a 45° angle around the vertical axis of the object.
61. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object is between 1 μm and 1000 μm in size.
62. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object is between 100 μm and 1000 μm in size.
63. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object is between 500 μm and 1000 μm in size.
64. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a micro part assembly automation.
65. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a composition comprising one or more microchannels.
66. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a biomedical device.
67. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a biomedical device fabrication.
68. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a biological specimen.
69. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a microchemical specimen.
70. The method of clause 53, any other suitable clause, or any combination of suitable clauses, wherein the object comprises a physical specimen.

EXAMPLES

Example 1

Photograph Capturing Sequence

[0057] An important consideration in taking photographs of an object are the overlap and degree orientation of the photography. For instance, the photographs can be captured with 60% to 80% overlap for to provide for a desirable digital stitching process with 45 degree around the rotational axis, pointing the viewing angle toward the center of rotation. The sequence should be repeated with changing angles at a different latitude for the overlap in upper and lower parts of the photos as well.

[0058] However, the proposed sequence cannot be easily achieved in a microscale technique since the microscope and the camera assembly cannot move to generate a macroscale scanning pattern. Thus, in order to generate an optimal scanning pattern in microscale, a gantry type microscope was assembled comprising a mobile platform underneath the microscope (see FIG. 3).

[0059] The microscope of the instant example can support an adjustable DOF (Depth of Focus) and has a magnification capability of up to 45 times (45×). The microscope and the photo-sequencing aperture were assembled on a vibration isolated table for precision photography in microscale. A piezo-electric mobile platform with a rotational axis was assembled and placed underneath the gantry-type microscope (0.02 mm position accuracy). A digital camera was attached on the microscope to enable digital shuttling so that no vibration was observed during the photography. The proposed configuration provides solid rigidity during the stationary photography and enables testing various capturing sequences for the microscale SfM.

[0060] In order to obtain a complete set of scanning photography of a microscale object for the SfM process, an exemplary capturing scenario is shown in Error! Reference source not found. The mobile platform underneath the microscope has two degrees of freedom axes of rotational mobility for varying latitude and longitude scanning. In addition, a three Degree of Freedom X-Y-Z motion control system enables precision focus of the microscale object for the microscope. The exemplary capturing sequence provides movement of the camera in order not to generate a blind-spot or to better understand concave shapes on the surface, thus to minimize visual occlusion.

[0061] In addition, compared to the confocal micro imaging technology (e.g., from Leica Microsystems), the scanning speed by the exemplary microscale SfM technique operates at much faster speeds. The scanning of an object with total of 30 photos by the exemplary microscale SfM technique takes only 30 seconds, while the point scanning by confocal imaging with a x-y-z table for multiple images takes up to 30 minutes or more. Without being held to any theory, it is believed that the fast scanning speed of the exemplary microscale SfM technique is because of the simple scanning procedure with two rotational axes of the scanning platform.

Example 2

Ambient Light Control

[0062] Unlike the macroscale SfM, ambient light control is an important factor for realizing a microscale SfM technique. Two different ambient light conditions can be taken into consideration: absolute light and relative light.

[0063] In absolute light condition, the light fixture is assembled on the microscope so that a fixed ambient light condition is achieved for the photo-sequencing process. In the relative light condition, the light fixture is installed on the mobile platform where the target sample is in place. The concept of the absolute and relative light conditions is shown in FIG. 5. It is contemplated that less disturbance in ambient light will be observed in the absolute light condition for the object, while a plain diffuse light condition for the camera may be achieved by the relative light condition.

[0064] Generally, it is believed that the enabling technique for surface reconstruction by multiple 2D images is the perspective projection. Given a set of m projective image spaces, there is a 3D subspace of the space of combined image coordinates called the joint images, P.sup.1, 2, . . . n. These images in scaled coordinates compose a complete projective replica of the 3D world. A fundamental image in the joint image allows the reconstruction process through a matching constraint by which a set of image points, X.sup.1, 2, . . . m, are classified to be the projection of a single world point, X. The matching process, then, produces a single compact geometric object using the antisymmetric 4 index joint Grassmannian tensor.

[0065] The essential mechanism of the projective reconstruction is matching point identification in multiple scaled images, or image points, X.sup.1, 2, . . . m. A feature matching method can be used to form the fundamental matrix for the projective reconstruction. The same features in multiple images, therefore, should be easily identifiable by image transformation.

[0066] In addition to edge or point detection, an important aspect of the image transformation between photos are color-making attributes such as hue, intensity, luminance, brightness, chroma, and saturation, since the same feature in different photos may not be identified due to dissimilar chromaticity. While the absolute light condition provides a stable and consistent chromaticity with respect to the microscope, thus to the camera, the relative light condition is anticipated to provide consistency in chromaticity between pictures. Nevertheless, two different lightning conditions were examined to study the light effect on the microscale SfM technique.

Example 3

Evaluation of Absolute Light Condition and Relative Light Condition

[0067] In the instant example, the exemplary system included a gantry-type microscope to provide ample space below the microscopic lens in order to merit the flexibility of testing different light conditions and scanning sequences. A high definition digital camera was mounted on the microscope via an adapter for minimum disturbance in ambient light control. All experiments were performed in a light controlled cleanroom so that no external light influenced the photo-sequencing process other than the light fixture proposed for each configuration.

[0068] As shown in FIG. 6, the target object selected for testing was a microscale gear comprising a length of 300 micrometers and a diameter of 70 micrometers. This object is a common industrial element and was selected for a comparison of two different ambient light control settings (i.e. absolute light condition and relative light condition).

[0069] Absolute Light Condition: The number of identifiable photos is an important consideration for 3D modeling accuracy because a 3D model using SfM techniques is provided through stitching the photos identified during the image matching process. For a comparison between the absolute and the relative light conditions, the same number of photos (22) were taken for the projective reconstruction process.

[0070] Using the absolute light condition, 5 of the 22 photos were identified with significant matching points in the first test (see FIG. 7). As a result, the reconstructed surface of the microscale gear object did not represent its original cylinder shape but, instead, was in a crushed cylinder form (see FIG. 8A). Further, FIG. 8B shows a sectional view of the object in FIG. 8A (i.e., at the A-A distance shown in FIG. 8A).

[0071] Upon examination of the photos taken in the absolute light condition, slightly different chromaticity between neighboring photos was evidenced for the same features. Different chromaticity of the same features may cause the variability in feature matching, thus leading to a distorted geometry of the original shape.

[0072] Relative Light Condition: In comparison, all of the 22 photos taken using relative light condition were identified due to the identical chromaticity of matching features in the first test (see FIGS. 9A and 9B). The localization errors of the camera viewpoints as shown in FIG. 8 may be due to the magnification adjustment during the photography process to obtain finer and crisp photos. The same technique is applied for the absolute light condition.

[0073] As a result, the completely reconstructed 3D model of the microscale gear object was observed to have an intact original shape (see FIG. 10A). The cross section of the gear (see FIG. 10B, which shows cross section at the A-A distance shown in FIG. 10A) demonstrates a complete circle of the microscale gear object shape with minimal distortion. Moreover, the reconstructed shape conforms to the original shape in scale ratio, thus virtual measurements of any part of the microscale object is made possible. For instance, the screw pitch was measured to be 9.49 micrometers by using the reconstructed 3D model.

[0074] It is believed that the advantage using the relative light condition could be due to the fixed natural ambient light for the sample object, which can be similar to fixing the ambient light in macroscale with the camera rotating around an object. In comparison, the absolute lightning condition was akin to using a flashlight for each photograph in macroscale, thus disturbing the feature matching process. The discrepancy in the color attributes between potentially matching features can lead to an incomplete model using SfM techniques. Approximately 30 repetitions for testing each condition revealed that the relative light condition maintains an average of 20.3 photos recognized, in comparison to an average of 4.5 photos recognized using the absolute light condition (see FIG. 11).

Example 4

Modeling Accuracy

[0075] In order to evaluate the construction capabilities of the exemplary microscale SfM system, a micro-fluidic channel was analyzed to show the accuracy of 3D surface reconstruction. The micro-fluidic channel was manufactured by using a Micro-Milling Machine (363-S 3-Axis Horizontal Machining Center) powered by 50,000 RPM Electric Motor Driven High-Precision Bearing Spindle. The micro milling machine can carve a micro shape in the scale of 50 to 100 micrometer with 2-micron accuracy. The width of the micro-fluidic channel created for the 3D reconstruction test is 235 micrometers for Lab-On-Chip applications.

[0076] FIG. 12A shows the micro-fluidic channel in comparison to a penny. Each channel is spaced by 901 micrometers and the total micro-fluidic channel is bit smaller than the size of a penny. The original CAD design of the micro-fluidic channel is illustrated in FIG. 12B.

[0077] The first model was created by the magnification factor of 30 (see FIG. 13A). The metric used for the 3D modeling accuracy was the flatness of the top surface of the micro-fluidic channel. To that end, 17 point cloud data were captured from the model (FIG. 13B) and processed to create a 3D scatter plot (FIGS. 14A-14B).

[0078] In order to measure the flatness, a plane surface fit was used to measure the deviation of each point from the fit surface. FIG. 14A shows the Euclidean distance of each point cloud data to the measured and plotted surface and FIG. 14B shows the surface fitting results. Most of the data points fall within the range of +0.2 to −0.2 mm. The standard deviation and the RMS value were measured to be 116 micrometers and 113 micrometers respectively.

[0079] In order to measure the limit of the 3D modeling accuracy of the proposed system, another model of the micro-fluidic channel was created by using the magnification factor of 70 (including the digital zoom factor). FIG. 15 shows that 15 point cloud data were captured for surface flatness accuracy test. FIG. 16A shows the collected data points by scatter 3D representation and FIG. 16B shows the surface fitting results. As shown in FIGS. 16A-16B, all point cloud data were within +/−0.05 mm after surface fitting, representing 35 micrometers of standard deviation and 29 micrometers in RMS value.

Example 5

Depth Sensing Accuracy

[0080] In order to evaluate the depth sensing capability of the exemplary microscale SfM system, a microscale 3D pyramid was designed and carved using the Micro-Milling Machine. As shown in FIGS. 17A-17B, a microscale 3D pyramid comprising a 450 μm.sup.2 base and a 2,100 μm height (300 μm/step; 7 steps) was created. Using the same magnitude factor (70× zoom), a 3D model of the microscale 3D pyramid was constructed (see FIG. 18). Four point cloud data were sampled from each level to create a plane fitting to each level. As shown in FIG. 19A, a total of 12-point cloud data were depicted in 3D scatter plot along with numbers corresponding to FIG. 18.

[0081] In order to measure the height of each step, sampled point cloud data are imported to a CAD tool to evaluate depth measurement accuracy. For precision measurement, the fourth step of the microscale 3D pyramid (450 μm.sup.2) was used for original and virtual pyramid calibrations. The Euclidean distance of two point-cloud data sampled at the outside corner of the 4th layer (1.441) was compared to the original design size of 210 μm. As shown in FIG. 19B, using the calibration factor (145.73), the depth of the first two steps from the top were measured to be 287 μm and 295 μm, respectively. Therefore, the error in measurement from the original microscale 3D pyramid dimension was 13 μm for the first step and 5 μm for the second step, demonstrating superior depth measurement capability of the microscale SfM system.