SYSTEM AND METHOD FOR CLASSIFYING SENSOR READINGS
20230057972 · 2023-02-23
Inventors
Cpc classification
G06F18/217
PHYSICS
International classification
Abstract
A system and method to evaluate and/or classify non-destructive testing sensor data, the system and method including: a transmitter configured to provide energy to a material; one or more sensors configured to convert the energy returned from the material into sensor data; a receiver configured to receive sensor data; an attenuation inversion module configured to apply a mathematical transformation to the sensor data to provide transformed sensor data; an analysis module configured to process the transformed sensor data to provided processed sensor date, by: determining values from the transformed sensor data; applying mathematical transformations to the values to produce a set of single values that represent the sensor data; a classification module configured to classify the processed sensor data; and an output module configured to output the results of the classification.
Claims
1. A system to evaluate or classify non-destructive testing sensor data, the system comprising: a transmitter configured to provide energy to a material; one or more sensors configured to convert the energy returned from the material into sensor data; a receiver configured to receive sensor data; an attenuation inversion module configured to apply a mathematical transformation to the sensor data to provide transformed sensor data; an analysis module configured to process the transformed sensor data to provided processed sensor date, by: determining values from the transformed sensor data; applying mathematical transformations to the values to produce a set of single values that represent the sensor data; a classification module configured to classify the processed sensor data; and an output module configured to output the results of the classification.
2. A system according to claim 1, further comprising a memory component configured to store the parameters to be used in the mathematical transformations used in the attenuation inversion module.
3. A system according to claim 1, further comprising a data storage module configured to store: a distribution of known classes for the sensor data the values determined from the processing module; the results of classification; and specific values for limits and boundaries on values determined from signal.
4. A system according to claim 1, further comprising a calculation component that determines parameters and transformations to define new classes.
5. A system according to claim 1, wherein data associated with the energy transmitter, the at least one sensor, and the receiver is included with the sensor data.
6. A system according to claim 3, wherein starting and ending coordinates is be applied to the sensor data to be evaluated as a value for the boundaries determined from the sensor.
7. A system according to claim 1, wherein the classification module is configured to determine the most probable class related to sensor data.
8. A system according to claim 1, wherein the classification module is configured to provide data relating to the transformation of values calculated from the sensor data.
9. A system according to claim 1, wherein the output module is configured to provide data related to whether sensor data is within a stated confidence interval for its classification.
10. A method to evaluate and classify sensor data, the method including: applying energy to a material; receiving transformed energy at sensors as signal data; amplifying the signal data, in an attenuation inversion module; processing the amplified signal data, at a signal processing module; classifying processed signal data; storing processed signal data related to the sensor signals in a data storage module together with the results of classification; displaying the classification results, at an output module; transferring stored data to a classifier module, wherein the data is used to calculate and update transformations and distributions to be applied to future data and; storing the updated transformations and distributions in a data storage module.
11. A method according to claim 10, further comprising storing a plurality of possible classifications of the sensor data.
12. A method according to claim 10, wherein attenuation inversion calculations are applied to the sensor data.
13. A method according to claim 10, wherein the sensor data includes estimated physical dimensions of the material.
14. A method according to claim 10, further comprising applying limits and boundaries on values determined from the signal data and provided by the data storage module.
15. A method according to claim 15, further comprising using stored values for limits and boundaries on values determined from signal data and using starting and ending coordinates in the data set for the signal data to be evaluated.
16. A method according to claim 10, further comprising transforming the signal data into characteristic values using specific data provided by the data storage module.
17. A method according to claim 16, further comprising comparing characteristic values from transformation of the signal data to a known distribution.
18. A method according to claim 10, further comprising providing output related to the most probable class related to the sensor data.
19. A method according to claim 10, wherein the sensor data from materials that are confirmed to be reference samples are used to develop new transformations to be used in classification.
20. A method according to claim 19, wherein a new distribution of results is calculated based on the new transformations.
Description
BRIEF DESCRIPTION OF FIGURES
[0042] Embodiments will now be described, by way of example only, with reference to the attached drawings, in which:
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
DETAILED DESCRIPTION
[0053] Generally, there is provided a system and method for classification/evaluation (sometimes referred to as categorization or sorting) of sensor data, generally non-destructive sensor data, taken from materials for the purpose of determining various features and properties of the materials being tested. An embodiment of the system may generally include: an energy source such as a transducer configured to apply energy to a material, sensors configured to detect and convert energy related to the applied energy in various locations into sensor signals/data, a receiver configured to collect and store the sensor data, a filter module configured to filter the sensor data, a signal processing module configured to process the filtered sensor data, an analysis module configured to analyze the processed sensor data by: calculating a number of characteristic values from the sensor data; comparing the calculated characteristic values with reference values; correlation of characteristic values to a known distribution; classification of the signal data; determining if the signal data can provide a valid solution to evaluation; and an output module configured to output the results of the determining as a signal evaluation.
[0054] In this application, the following general definitions will be used: [0055] Data: A set of numerical values that represent a sensor signal. [0056] Class: A description or template of data that describes certain patterns or attributes. As most non-destructive testing results tend to be displayed graphically, typical classes for this would include items such as the appearance of results with no defects, the appearance of particular defects, and the like. [0057] Transformation: A mathematical operation that can be used to convert data into a single value or a set of values. Transformations could take several forms and in this description they generally convert several data values into a smaller number of values. [0058] Parameter: A numerical value that is calculated from data using transformations or mathematical operations. In the context of this system and method, parameters are intended to reflect the reduction of data to determine if the data produces a parameter result that is similar to a class. [0059] Definition values: Values that are used to define the values of parameters for use in classification. Parameters calculated from data are often compared to these definition values in the screening process.
[0060] It will be understood that when the signal data contains very clear features or patterns, identification and classification may be more direct/basic. These situations may be more common in quality control situations, for example in a controlled manufacturing environment or the like.
[0061] In other circumstances, the materials or components may not immediately yield signal data that provides for a direct/basic interpretation of the required features or patterns at the time of inspection such that there is a barrier to classification. There may be several circumstances that exist to create this barrier. Some examples of barriers include: when the signal data also includes a large amount of noise, such as other signals, reflected signals, environmental effects, and the like the nature of the material or the component obscures the energy transformation, thereby obscuring the features and patterns within the signal data; energy transfer into the material or component may be flawed or impaired; operator error by the personnel gathering the signal data; or the like.
[0062] In these circumstances where interpretation of the transformed energy/signal data may be more complex, it may be desirable to determine if the signal data obtained is useful in evaluation. Data that can be usable in evaluation may include, for example; patterns and values that are clearly different from the applied signal, thus providing evidence that the signal was transformed by the material or component; data that includes patterns or values that are known to be relevant to the material or component being tested; or other information related to the signal data.
[0063] In some cases, data obtained might not be usable and this determination by the system will allow other attempts to obtain usable data in a timely manner. This determination may also allow some immediate decisions regarding disposition of a material or component.
[0064] Examples where data is not useable may include: situations where no signal is detected at the receiver that could have been transmitted from the transmitter; situations where the signal received has not been transformed by the material or component thereby showing that the transmitted signal did not enter the material or component; situations where the signal provided by the receiver only contains values of zero (0); situations where the data in the signals received does not comply with specifications for instrumentation configuration; situations where the signals received are known to not include the data that may be of interest for evaluation; and other reasons.
[0065] Experience with testing and inspection of systems of materials and components has shown that evaluation of certain characteristics of the materials or components is possible using techniques and tools that gather information without damaging the tested material. There are several techniques for non-destructive testing where energy that is applied to the material is transformed and subsequently received by the sensor. Some examples of these techniques include: ultrasonic testing, radiography, eddy current testing, magnetic particle testing, thermography, and others. Some of these tests provide unambiguous, quantitative results that are generally considered to be calibrated measurements.
[0066] Each non-destructive test method may have particular characteristics that make the method better suited for some types and configurations of material. In general, a method is selected and used based on the expertise of the personnel performing the test. Any non-destructive testing method may benefit from embodiments of the system and method described herein, in particular, those that produce a quantitative data output based on measurements.
[0067] Moreover, since non-destructive methods do not affect the usability of the material or component, these techniques and tools can be used to monitor the materials and components both before use and for changes that may occur after use.
[0068] Conventionally, non-destructive testing techniques have been developed to provide a representation that can be related to the physical configuration of the item being tested for interpretation of the results.
[0069]
[0070] In the system shown in
[0071] In some further cases, starting and ending coordinates may be applied to the signal data to be evaluated. As an example, there may be a time delay between initiation of the energy application by the energy source controller 101 and application of the energy to the material 110, and a time delay corresponding to the transmission of the energy through the material.
[0072]
[0073] Returning to
[0074] Attenuation inversion is intended to correspond to the attenuation of energy that normally occurs as, for example, the energy traverses undamaged media. In the case of ultrasonic signals in material, attenuation corresponds to an equation of the form:
where the constant in the equation can be determined from historical values for undamaged materials. In the case of radiation such as light, attenuation corresponds to an equation of the form:
[0075] Attenuation of other types of energy, such as magnetic fields can also be inverted. These inversions are intended to be applied in the attenuation inversion module 125 to provide more robust inverted data.
[0076] The results, sometimes called inversion data, are then conducted to the classification module 130. The classification module 130 can use definition values for parameters supplied by the data storage module 135. In some cases, the parameters may include physical dimensions of the material or component being tested. Examples of other parameters and typical transformations are detailed herein. The classification module may be configured to determine data relating to the transformation of values received from the signal data and may be configured to provide this classification data to, for example, the output module or analysis module.
[0077] The attenuation inversion module 120 may also be used to apply adjustments to the signal data that are related to effects such as: distance from the energy source to the sensor; distance from the energy source to a region of interest; existence of items that may block the energy or place the item or region of interest into, for example, a shadow; absorption of energy within its path; diffusion of energy away from its path; and others as will be understood depending on the application of the technology.
[0078] In some cases, the system may further include an analysis module 150, an output module 140 and a memory module 145. The analysis module 150 may be configured to perform calculations on the signal, inverted or classification data retrieved from the memory module 145. The analysis module 150 may apply transformations to the data to produce a set of parameters that may be used to represent the collected sensor data.
[0079] The memory module 145 is configured to store processed data from the analysis module 150. In some cases, the memory module 145 may be further configured to store the parameters used by the attenuation inversion module 125 and the transformations used in the analysis module 150. In some cases, the data storage module 135 or the memory module 145 may be further configured to store the distribution of known classes for sensor data.
[0080] The data storage module 135 may be configured to include specific definition values for limits and boundaries or to define the distribution of the values using mean, standard deviation, distribution type, and the like for parameters determined from the signal data. The data storage module 135 may also be configured to include data and parameters that can be used to modify the transformation to improve the results of values determined from the signal data to form a single characteristic value. Examples include retaining parameters determined from sensor results that are shown to fit a certain class so they can be used to modify existing transformations and defining values, which is intended to improve future accuracy. Further description of the overall method is provided herein with example parameters. For example, one example indicates how parameters A.sub.B, t.sub.c, and I2Disp are transformed into parameter D.sub.Reference. When particular data is identified as a good example of a class of data, the relevant parameters will be stored in data storage module 135 so they can be used to improve the transformations and defining values used.
[0081] In some cases, the system may be located in one physical location. In other cases, the system may be distributed and, for example, the analysis module 150 may be located separately and may be operatively connected to the data storage module and the classification module. The memory module may be configured to provide a shorter term memory component to the system for data to be transferred to the analysis module or may be remote such as in the cloud or the like. The output module 140 can be configured to provide the output of the classifications of the data to a user of the system or the like. In some cases the classification may provide a probable class related to the sensor data which may be the output provided by the output module 140. In some cases, the classification module 130 and analysis module 150 may determine a confidence interval with respect to the classification and the output module 140 may provide the confidence interval for the classification as part of the output. The output provided by the output module 140 is intended to be in a format readable by a computer program that is configured to receive the results and use them or report on them.
[0082]
[0083] In this example, it may be determined that three quantities can serve to represent the graphical data. These quantities represent characteristics that may be directly related to the transformation of the applied energy by the material 110. These quantities are labeled as characteristics. The first is the area of cross-hatching (430) that corresponds to the areas bounded by the bold locus (410) and line at y=0, in this case, the value is the sum of fourteen sub-areas shown in the image.
[0084] When a plurality of reference specimens or samples are used, some variation may be expected in the appearance of the data output 400 from materials or components 110, with corresponding variation of the values for: A.sub.B; tc; and I2Disp. Values from several examples of the data output 400 for these reference specimens of material or components may be assembled to produce a model of the distribution of inter-relationships of the values that should be expected. It will be understood that there may be more or fewer values and there may be more or fewer samples.
[0085] From the data provided by the available samples of desired data outputs 400, values are calculated as follows by the analysis module for this example with three values. For all of the reference or ideal samples used, the average value of each value A.sub.B, tc, and I2Disp is calculated as A.sub.B, Atc, and AI2Disp. In this example, there are six possible ways that the three values can be combined into pairs that can be compared: A.sub.B with A.sub.B; A.sub.B with tc; A.sub.B with I2Disp; tc with tc; tc with I2Disp; and I2Disp with I2Disp. For each of these combinations, equation 1 is calculated by the analysis module 150:
Where:
[0086] N=total number of samples used; and
a and b correspond to the values compared.
[0087] The values calculated from equation 1 form a symmetric matrix of the form of equation 2.
[0088] The values determined for the quantities of A.sub.B, tc and I2Disp for all of the reference samples may be combined into vectors as shown in equation 3:
[0089] Each sample of the desired data set will provide one vector, x.sub.Sample. Each vector will then be used in the calculation of equation 4 to produce one scalar, shown in equation 4 as D.sub.Reference, for each data set used to create the matrix S.
D.sub.Reference=x.sub.Sample.sup.TS.sup.−1x.sub.Sample (4)
[0090] All of the values of D.sub.Reference provide a distribution of the expected values of D.sub.Reference for classification of future data sets obtained from the configuration of energy source controller 101; energy source 105; tested material 110; sensor 115; and receiver module 120.
[0091] The properties of the distribution; such as mean, standard deviation and the form of the distribution: the values in the matrix S.sup.−1; and other definition values as may be relevant; are then stored by the analysis module 150 in the data storage module 135.
[0092] Consider a specific example where the quantities identified above are used. In this example, the energy source 105 is co-located with the sensor 115 to apply and receive ultrasonic energy from a specimen 110. For the reference samples, outputs from the attenuation inversion module 125 appear similar, but not identical, to
[0093] When the D.sub.Reference values were calculated for all the reference samples, the distribution of the values can be represented by the chart shown in
[0094] Other information may be placed in the data storage module 135. This includes parameters that may be used for various functions, including: determine what actions are to be taken with certain findings from the data sets; definitions for acceptance or rejection of data sets; equations and mathematical operations to be completed that may not be in the existing classification module; equations and algorithms that may be used to identify anomalies in data as knowledge of these develops with experience; and other data.
[0095] When the data as described above has been provided to the data storage module 135, the system in
[0096]
[0097] As detailed herein, the attenuation inversion module 125 will perform various programmed calculations and transformations to invert or cancel out the natural attenuation of energy that is expected by the material 110. For ultrasonic energy, it is well known that the attenuation can be reversed by applying a transformation of the form given in equation 5:
y=me.sup.At (5)
Where:
[0098] m=the magnitude value corresponding to t from the receiver module 120; and
A=a constant value; and
t=the value along the horizontal axis.
[0099] This transformation has been applied to the data set 605 and is shown in the graph in
[0100] The result of this is shown graphically in
[0101] The result of the attenuation inversion module is transmitted to the classification module 130 which: forms the vector x as in equation 3; calculates the scalar D using equation 4; determines the probability value associated with D using the distribution in
[0102] For this example, the calculations provided for by the classification module 130 are: [0103] a. The values for A.sub.B, tc, and I2Disp are calculated and the vector is formed;
D.sub.example=320.8 [0105] c. And
Probability=0
[0106] These results show that the data provided for the chart in
[0107] The output module 140 will provide various outputs following instructions from classification module 130 and other instructions as may be provided by, for example, instructions previously stored in the data storage module 135. The outputs will identify acceptance or rejection of the data set. Other outputs may be: instruction to test the next material; instructions or direct transmission of the data set to another system; instructions to dispose of the tested material; identification of error conditions or faults in the evaluation; or other signals.
[0108] In some cases, the classification module 130 may be configured to calculate values for data patterns from each signal, assemble the values into a vector and calculate the likelihood that the features correspond to a known classification of sensor data. The classification module is configured to extract relevant data, as identified by programming and data storage module 135, from the sensor signal data/inverted signal data.
[0109] The matrix S.sup.−1 is intended to provide benefit in determining how similar a reading was to the set of readings, by, for example, using equation 4 and the graph illustrated in
[0110]
[0111] Table 1 shows the results of the classification calculations using S.sup.−1, equation 4 and
TABLE-US-00001 TABLE 1 Description Reading in FIG. 8A Reading in FIG. 8B A.sub.B 1.830 2.00 tc 16.570 4.484 I2Disp 169.9 55.04 D 2.892 80.9 Probability 0.37 0
These calculations show that the reading in
[0112] The variation that occurs within a data set can be calculated as variance or standard deviation. When 30 or more values are used to calculate these, the addition of a lone value can alter the calculated variance by less than 3% and thus, a data set containing at least 30 values can be used to characterize the variation within the data set with a predetermined level of confidence. The number of values in the data set can be increased to a higher value if a greater level of confidence is desired.
[0113] Now consider that at least thirty (30) readings that are known to belong to the same class as
Note that the elements in this matrix are different from the values shown above for S.sup.−1.
[0114] Table 2 shows the results for evaluation of the readings in
TABLE-US-00002 TABLE 2 Description Reading in FIG. 8A Reading in FIG. 8B A.sub.B 1.830 2.00 tc 16.570 4.484 I2Disp 169.9 55.04 D 293.662 2.381 Probability 0 0.52
The results show that the reading for 8B is similar to the class and
[0115] Referring back to
[0116]
[0117]
[0118] For this image, the location of the centroid of the image area based on the data received from the sensor is marked as 930. The location of the centroid is an example of a characteristic that may be of interest.
[0119]
[0120] In this manner, embodiments of the system and method may be extended to data sets of any number of dimensions and sensors.
[0121] In some cases, the system may further include a memory component configured to store sensor signal data and classification data. The sensor signal data and classification data may be used to determine trends or historic information if desired; provide updated or alternate calculations of the S matrix; provide a record of material tests; provide data for identification of other values that may be used for classification; and other purposes.
[0122] In some cases, the system may use the sensor data in its raw form as-received directly by the receiver. In other cases, the system may use the sensor data in a form that has been altered by transformations applied by elements of the system, such as inversion or the like. Selection of the use and acquisition of sensor data lies with the analysis of the underlying data by one sufficiently skilled in the art.
[0123] In a specific example, the at least one sensor may detect a series of readings. In this case, the classification module can be configured to use values calculated from the series of readings to classify the sensor signal data. This situation may occur where data is to be acquired from discrete locations that are sufficiently separated to allow data to be obtained as a series of readings. This method might also be used to reduce the number and cost of sensors,
[0124] The method and system described herein may be applied to data from a single sensor, or data from a plurality of sensors, or a series of data from a single sensor or a series of data from a plurality of sensors.
[0125] The method and system described herein may also apply to evaluation of data for a plurality of classifications from the same set of sensor data. For example, one set of sensor data could be evaluated within the same system to determine different classifications of data such as: material or component shape; and material or component thickness; and material or component position; and other characteristics that may be detectable in the same set of data.
[0126]
[0127] At 1020, the classification module 130 may then determine each matrix after retrieving further data from the data storage module 135. The classification may determine from the distribution retrieved from the data storage module, if the data meets the acceptance criteria. If the data is not from a new reference specimen, at 1025, the classification module may provide output to the output module, at 1030 and these results may be provided to the user or action associated with the material or component may be taken based on the output.
[0128] If the reference specimen is new, the system is configured to further define reference data quantities, at 1035. In a particular example, the analysis module 150 may require a predetermined number of sets of data prior to determining a classification model. In this case, the analysis module 150 may determine if there is a sufficient number of new quantities in the memory module 145, at 1040, or if further samples may be needed or useful (in this case 30 sets of new quantities is the threshold but this number can be configured depending on the application and the like). If there are sufficient samples, data from new reference specimens may be combined with previously determined specimens, at 1045.
[0129] At 1050, the entries of the matrix S may be calculated and the matrix may then be inverted, at 1055. D.sub.reference may be determined from the matrix S.sup.−1 using equation 4, at 1060. At 1065, the distribution of D.sub.reference may be determined by the analysis module 150. At 1070, the data of the matrix S.sup.−1 may be stored in the data storage module 135 as may be the distribution. At 1075, the data storage module is intended to be accessible at the inspection location of the material and may be fed to the classification module 130.
[0130] In the preceding description, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the embodiments. However, it will be apparent to one skilled in the art that these specific details may not be required. It will also be understood that aspects of each embodiment may be used with other embodiments even if not specifically described therein. Further, some embodiments may include aspects that are not required for their operation but may be preferred in certain applications. In other instances, well-known structures may be shown in block diagram form in order not to obscure the understanding. For example, specific details are not provided as to whether the embodiments described herein are implemented as a software routine, hardware circuit, firmware, or a combination thereof.
[0131] Embodiments of the disclosure or elements thereof can be represented as a computer program product stored in a machine-readable medium (also referred to as a computer-readable medium, a processor-readable medium, or a computer usable medium having a computer-readable program code embodied therein). The machine-readable medium can be any suitable tangible, non-transitory medium, including magnetic, optical, or electrical storage medium including a diskette, compact disk read only memory (CD-ROM), memory device (volatile or non-volatile), or similar storage mechanism. The machine-readable medium can contain various sets of instructions, code sequences, configuration information, or other data, which, when executed, cause a processor to perform steps in a method according to an embodiment of the disclosure. Those of ordinary skill in the art will appreciate that other instructions and operations necessary to implement the described implementations can also be stored on the machine-readable medium. The instructions stored on the machine-readable medium can be executed by a processor or other suitable processing device, and can interface with other modules and elements, including circuitry or the like, to perform the described tasks.
[0132] The above-described embodiments are intended to be examples only. Alterations, modifications and variations can be effected to the particular embodiments by those of skill in the art without departing from the scope, which is defined solely by the claim appended hereto.