OPTICAL MEASUREMENT DEVICE FOR INSPECTION OF DISCONTINUITIES IN AEROSTRUCTURES
20230280280 · 2023-09-07
Inventors
Cpc classification
G01N21/8851
PHYSICS
G01N2021/8893
PHYSICS
G01N21/9515
PHYSICS
G06F3/14
PHYSICS
International classification
G06F3/14
PHYSICS
Abstract
A handheld device for making 3D topography measurements of surface discontinuities in high performance structures, such as aerostructures (e.g., aluminum fuselages). Lights illuminate the discontinuity from multiple angles, and a camera captures images of the discontinuity. A thickness sensor generates thickness data regarding a thickness of the base material and the top protective coating. A position sensor generates position data regarding a location of the discontinuity on the structure. A processor generates geometry data regarding a geometry of the discontinuity based on the images, performs an analysis of the geometry, thickness, and position data, and communicates a result of the analysis on a display. A conforming membrane and/or a gel and an opaque lubricant may be applied over and conform to the discontinuity in order to make more uniform a reflectivity difference and a color difference between the discontinuity and an adjacent portion of the structure.
Claims
1-20. (canceled)
21. A device for calculating a surface discontinuity of a structure, said structure having an outer surface and a thickness, said surface discontinuity extending from said outer surface into said thickness of said structure or above said outer surface, the device comprising: a plurality of spaced-apart light sources for illuminating said surface discontinuity, each of said plurality of light sources providing illumination toward said surface from a different angle; a digital camera for capturing a plurality of images of said surface discontinuity illuminated by the plurality of light sources; and a processing component for receiving said captured images from said digital camera and calculating geometry data of said surface discontinuity using said captured images.
22. The device of claim 21, wherein said geometry data includes a true size of said surface discontinuity.
23. The device of claim 22, wherein said true size of said surface discontinuity includes at least one of a true height, depth, or volume measured from said outer surface of said structure.
24. The device of claim 23, wherein said true height is a calculated height of said surface discontinuity above said outer surface, said true depth is a calculated depth of said surface discontinuity from said outer surface into said thickness, and said true volume is a calculated volume of said discontinuity above or below said outer surface.
25. The device of claim 23, wherein said processor subtracts said calculated true depth of said surface discontinuity from said thickness of said structure to determine a criticality of said surface discontinuity.
26. The device of claim 21, wherein said processor generates a 3D point cloud of said surface discontinuity based upon said captured images, said 3D point cloud being used to calculate said true size of said surface discontinuity.
27. The device of claim 21 further comprising a display operatively connected to said processing component for receiving and displaying said geometry data.
28. The device of claim 21 further comprising a position sensor for determining a location of said surface discontinuity on said outer surface, said position sensor operatively connected to said processing component.
29. The device of claim 28, wherein said position sensor is a wireless 3D positional tracker for determining said location based on signals received from local transmitters.
30. The device of claim 21, wherein said captured images used to calculate said geometry data includes images captured through a coating applied to said outer surface.
31. A device for calculating a surface discontinuity of a structure, said structure having an outer surface and a thickness, said surface discontinuity extending from said outer surface into said thickness of said structure or above said outer surface, the device comprising: a plurality of spaced-apart light sources for illuminating said surface discontinuity, each of said plurality of light sources providing illumination toward said surface from a different angle; a digital camera for capturing a plurality of images of said surface discontinuity illuminated by the plurality of light sources; a processing component for receiving said captured images from said digital camera and calculating a true size of said surface discontinuity using said captured images; and a display operatively connected to said processing component for receiving and displaying said calculated true size of said surface discontinuity.
32. The device of claim 31, wherein said calculated true size includes at least one of: a true height that is a calculated height of said surface discontinuity above said outer surface, a true depth is a calculated depth of said surface discontinuity from said outer surface into said thickness, and a true volume is a calculated volume of said discontinuity above or below said outer surface.
33. The device of claim 32, wherein said processor subtracts said calculated true depth of said surface discontinuity from said thickness of said structure to determine a criticality of said surface discontinuity.
34. The device of claim 31, wherein said processor generates a 3D point cloud of said surface discontinuity based upon said captured images, said 3D point cloud being used to calculate said true size of said surface discontinuity.
35. A method for calculating a surface discontinuity of a structure, said structure having an outer surface and a thickness, said surface discontinuity extending from said outer surface into said thickness of said structure or above said outer surface, the method comprising: providing a plurality of spaced-apart light sources; illuminating said surface discontinuity from different angles from said plurality of spaced-apart light sources; providing a digital camera; capturing a plurality of images of said surface discontinuity using said digital camera, said surface discontinuity being illuminated by at least one of said plurality of light sources; transferring said plurality of captured images to a processing component; calculating geometry data of said surface discontinuity calculated from said captured images, wherein said geometry data includes a true size of said surface discontinuity; and displaying said calculated data on a display.
36. The method of claim 35, wherein said true size of said surface discontinuity is a true height, a true depth, or a true volume calculated from said outer surface of said structure.
37. The method of claim 36, wherein said true height is a calculated height of said surface discontinuity between said outer surface and a distance said surface discontinuity extends above said outer surface, said true depth is a calculated depth of said surface discontinuity between said outer surface and a distance said surface discontinuity extends into said thickness, and said true volume is a calculated volume of said discontinuity above or below said outer surface.
38. The method of claim 35, wherein said processor subtracts said true depth of said surface discontinuity from said thickness of said structure to determine a criticality of said surface discontinuity.
39. The method of claim 38, wherein said criticality is determined by said processing component by comparing true size of said surface discontinuity to a pre-determined maximum size of said surface discontinuity.
40. The method of claim 38, wherein said determination of said criticality of said surface discontinuity includes utilizes machine learning.
Description
DRAWINGS
[0013] Embodiments of the present invention are described in detail below with reference to the attached drawing figures, wherein:
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033] The figures are not intended to limit the present invention to the specific embodiments they depict. The drawings are not necessarily to scale.
DETAILED DESCRIPTION
[0034] The following detailed description of embodiments of the invention references the accompanying figures. The embodiments are intended to describe aspects of the invention in sufficient detail to enable those with ordinary skill in the art to practice the invention. Other embodiments may be utilized and changes may be made without departing from the scope of the claims. The following description is, therefore, not limiting. The scope of the present invention is defined only by the appended claims, along with the full scope of equivalents to which such claims are entitled.
[0035] In this description, references to “one embodiment”, “an embodiment”, or “embodiments” mean that the feature or features referred to are included in at least one embodiment of the invention. Separate references to “one embodiment”, “an embodiment”, or “embodiments” in this description do not necessarily refer to the same embodiment and are not mutually exclusive unless so stated. Specifically, a feature, structure, act, etc. described in one embodiment may also be included in other embodiments, but is not necessarily included. Thus, particular implementations of the present invention can include a variety of combinations and/or integrations of the embodiments described herein.
[0036] Broadly characterized, the present invention provides a handheld device for making three-dimensional (3D) topography measurements and facilitating inspection and evaluation of surface discontinuities in high performance structures, such as aerostructures (e.g., aluminum fuselages), with higher resolution, greater accuracy, and increased repeatability, and which is suitable for use in production and/or maintenance environments. Further, the device advantageously allows for quickly and easily measuring the true depth of a discontinuity from the bottom of the discontinuity to the top of the metal surface without requiring that the TPC overlaying the metal surface be removed and reapplied. The device may be configured to measure substantially any type of discontinuity, such as scratches, drill runs, gouges, drill marks, dents, layovers, pits, and/or drill starts, having depths of between one-thousandths and thirty-thousandths of an inch. In one implementation, the device may be further configured to measure the height of a discontinuity, such as the head height of a rivet or other fastener, which if too high, could interfere with laminar flow across the surface of the structure.
[0037] Broadly characterized, embodiments of the device may function as follows. Lights may illuminate the discontinuity from multiple angles, and a camera may capture images of the discontinuity. A thickness sensor may generate thickness data regarding a thickness of the base material and the top protective coating. A processor may generate geometry data regarding a geometry of the discontinuity based on the images, perform an analysis of the geometry, thickness, and position data, and communicate a result of the analysis on a display. Further, a conforming element (e.g., a membrane and/or a gel and an opaque lubricant and/or a transparent gel having an opaque surface layer) may be applied over and conform to the discontinuity in order to make more uniform a reflectivity difference and a color difference between the discontinuity and an adjacent portion of the structure.
[0038] Referring to
[0039] The processing component 22 may be substantially any suitable combination of electronic memory and electronic processor configured to receive, store, and analyze data from the images and the TPC and/or base material sensors 32, and provide a report for presentation on the display 24. The display 24 may be substantially any suitable visual display device configured to present the output generated by the processing component 22. In one implementation, the processing component 22 and the display 24 may be provided in the form of a tablet computer or a single board computer (SBC) integrated into or attached to the handheld unit. The trigger 26 may be substantially any suitable trigger or other switching mechanism configured to allow the user to initiate operation of the device 20. The power source 28 may be substantially any suitable power source configured to power operation of the device 20. In one implementation, the power source may be a rechargeable battery integrated into the handheld unit.
[0040] One or more light sources (described below) may illuminate the discontinuity from multiple angles, and a digital camera (described below) may generate digital images of the illuminated discontinuity, and the images may be analyzed to determine the geometry of the discontinuity. The conforming element 46 may be configured to improve these images, including allow for determining the depths (and/or heights) and/or volumes of the discontinuity with submicron accuracy, of the structure regardless of its optical properties, thereby ensuring accuracy, repeatability, and consistent performance, even for optically complex surfaces. In particular, the conforming element 46 may make reflectivity and color more uniform and reduce glare. Further, the conforming element 46 may provide fast acquisition, thereby avoiding measurement drift, reducing sensitivity to vibration, and eliminating sensitivity to environmental changes (e.g., temperature). The conforming element 46 may be, for example, an elastomeric or other membrane and/or a gel and/or an opaque lubricant. A suitable conforming element for use with the present invention may be the transparent gel with opaque surface layer forming part of the GelSight sensor product available from GelSight, Inc. The GelSight technology is the subject of several patents and published patent applications, including U.S. Pat. No. 8,411,140, titled “Tactile sensor using elastomeric imaging,” U.S. Pat. Nos. 9,127,938 and 9,538,056, both titled “High-Resolution Surface Measurement Systems and Methods,” U.S. Pat. App. Pub. No. 2014/0104395, titled “Methods of and Systems for Three-Dimensional Digital Impression and Visualization of Objects Through an Elastomer,” and U.S. Pat. App. Pub. No. 2014/0253717, titled “Continuous Contact-Based Three-Dimensional Measurement,” as well as other published papers, including webpages. Various implementations of the conforming element 46 may include an elastomeric membrane but not a gel, a gel and possibly an opaque lubricant but not an elastomeric membrane, both an elastomeric membrane and a gel, or neither an elastomeric membrane nor a gel but rather some other conforming technology (such as any of the several thin layer technologies which may be used in the eighth alternative implementation described below and shown in
[0041] The TPC and/or base material sensor 32 may be substantially any suitable sensor configured to measure the thickness of the TPC coating and/or the thickness of the underlying metal or other base material. In one implementation, the TPC and/or base material sensor may be an ultrasonic transducer configured to measure an average thickness over a relatively large area, which can minimize the effects of any local deviations in TPC and/or base material thicknesses. If the TPC and/or base material sensor 32 is used in conjunction with a transparent gel or elastomeric based conforming element such as the GelSight gel, the conforming element 46 may be used to propagate ultrasonic waves between the sensor and the TPC coating and/or base material. In such cases, it may be beneficial to introduce a couplant 48 between the conforming element and the TPC and/or base material to facilitate transmission of ultrasonic waves. In another implementation, the TPC and/or base material sensor may be an eddy current sensor configured to measure electromagnetic flux. Some embodiments may not measure the TPC but measure the base material, while other embodiments may measure the TPC but not measure the base material, and still other embodiments may employ separate sensors for measuring the TPC and the base material.
[0042] The position sensor 34 may be substantially any suitable sensor configured to determine a location of the discontinuity on the piece or on a larger structure (e.g., an aircraft) of which the piece is a part. In one implementation, the position sensor 34 may be a wireless 3D positional tracker configured to determine its location based on signals received from local transmitters, and the location of the discontinuity may be equated with or easily determined based on the location of the position sensor 34. The location of the discontinuity may be saved in electronic memory for later retrieval and consideration. In particular, the location of the discontinuity on the piece may be useful for determining the criticality of the discontinuity (and whether it should be repaired it), and for tracking the discontinuity and any changes to it over time. Some embodiments may not include the position sensor 34.
[0043] Referring also to
[0044] In more detail, the processing component 22 may determine a criticality of the discontinuity by subtracting the true depth of the discontinuity from the thickness of the base material to produce a criticality result. Determining the criticality may include comparing the criticality result to a pre-established maximum criticality value, and/or considering a nature of the base material, a nature of the structure, and a force that the structure may experience during use.
[0045] Additionally, the processing component 22 may automatically determine whether the discontinuity should be repaired, and communicate the determination to a user of the device 20 or other responsible party. Evaluating the discontinuity to make the determination may involve the use of machine learning. More specifically, the processing component 22 may, through conventional machine learning techniques, learn how to validly and reliably determine whether the discontinuity should be repaired. The resulting determinations by the processing component 22 may be more objective and reliable than determinations by some human users.
[0046] Air between the conforming element 46 and the piece 36 can adversely impact the accuracy of measurements. One solution is for the user to forcibly push the element 46 onto the piece 36. However, eliminating air from deep discontinuities could require twenty or more pounds of force, and applying that much force could quickly tire the user and cause the user's hands to shake, which could adversely impact the accuracy of measurements. Embodiments of the device 20 may include any one or more of the following solutions to this problem.
[0047] Referring to
[0048] Embodiments of the device 20 may achieve “objective tactility,” wherein tactility (T) is a binary decision based on width (W), height (H), and depth (D). The equation T(W,H,D) is determinant and can be found through multivariate regression analysis given a sample set of discontinuities. Through statistical analysis it can be determined with a known confidence interval that the device 20 evaluates a discontinuity as being tactile.
[0049] The minimum repeatability and reproducibility of the device 20 may depend on the critical threshold for the depth of the discontinuity 42. For example, if the critical threshold is one-thousandths of an inch, and assuming a tolerance consumption allowance of four-to-one, then the minimum repeatability and reproducibility of the device 20 may be no greater than twenty-five microinches, but may be closer to one hundred microinches. The cycle time of the device 20, which is the period from the start of the measurement process to the presentation of the results to the user on the display 24, may be one minute or less, or fifteen seconds or less, or between five and fifteen seconds.
[0050] Referring also to
[0051] Referring also to
[0052] Referring also to
[0053] Table 1, below, shows exemplary data fields that may be populated. Some of the fields may be entered by the user in the Input Required Fields step 526 of the workflow 520. Other fields may be automatically populated by the device 20. Some or all of these data fields may be included in the logged results.
TABLE-US-00001 Data fields Field Example Value Provided by Operator ID 2618693 Operator Badge/RFID Operator Name John doe Operator ID Measurement Type Scratch Operator Measured Part/Assembly 114A12345-01 Operator Work Order 1111111 Operator Station Location Station 245 Operator Buttock Line BL 120 Operator Water Line WL 0 Operator Discontinuity Depth 0.0012″ Device Discontinuity Length 0.304″ Device Discontinuity Width 0.013″ Device Comments Text Box Operators Operator Qualitative Analysis Aircraft Coordinate X 245.34 Indoor Positioning System Aircraft Coordinate Y 128.5 Indoor Positioning System Aircraft Coordinate Z 0.123 Indoor Positioning System
[0054] Referring also to
[0055] Referring also to
[0056]
[0057] Referring to
[0058] Referring to
[0059] Referring to
[0060] Referring to
[0061] Referring to
[0062] Referring to
[0063] Referring to
[0064] Referring to
[0065] Referring to
[0066] Although the invention has been described with reference to the one or more embodiments illustrated in the figures, it is understood that equivalents may be employed and substitutions made herein without departing from the scope of the invention as recited in the claims.
[0067] Having thus described one or more embodiments of the invention, what is claimed as new and desired to be protected by Letters Patent includes the following: