Pattern Recognition for Part Manufacturing Processes

20220373999 · 2022-11-24

    Inventors

    Cpc classification

    International classification

    Abstract

    A method and system for identifying parts manufactured by a workstation by measuring signals generated by machines in the workstation, extracting features from the signals, clustering the features into clusters, associating clusters with manufactured parts and recognizing the parts through the clusters.

    Claims

    1. A method for automatically recognizing a manufactured part, the method comprising: a. measuring at least one signal from at least one machine used in manufacturing the part; b. extracting features from the signals; and c. applying pattern recognition to the extracted feature using features previously associated with the manufacturing of the part.

    2. A system for automatically recognizing a manufactured part, the system comprising: a. at least one signal generating sensor associated with at least one machine used in manufacturing the part; and b. one or more processors configured to extract features from the signals generated by the sensor; wherein the one or more processors are configured to apply pattern recognition to the extracted features using features previously associated with the manufacturing of the part.

    3. The method of claim 1, wherein the at least one machine includes a plurality of motors for driving a tool along a toolpath, the method further comprising: for each of selected motors of the plurality of motors; a. measuring an alternating current powering the motor; b. according to the measured alternating current: i. detecting breakpoints, and ii. counting alternating current cycles between consecutive breakpoints; and c. recording a sequence of the counted alternating current cycles as a feature of the part.

    4. The method of claim 3, wherein the selected motors are two selected motors, one selected motor providing the breakpoints that are detected, and the other selected motor providing its number of alternating current cycles between the detected breakpoints.

    5. The method of claim 3, wherein the one or more selected motors includes at least two selected motors, and the features extracted from the log are at least two sequences of counted alternating current cycles associated with the at least two selected motors.

    6. The method of claim 3, wherein the one or more selected motors includes the plurality of motors, and the features extracted from the log are the plurality of sequences of counted alternating current cycles associated with the plurality of motors.

    7. The method of claim 3, wherein the measuring of an alternating current is executed by measuring a single phase of the alternating current.

    8.-15. (canceled)

    16. A method for identifying parts manufactured by a machine, the machine having a plurality of motors for driving a tool along a toolpath, the method comprising: a. manufacturing a plurality of parts, wherein, for each part: for each of selected motors of the plurality of motors: (i) measuring an alternating current that powers the motor, and (ii) extracting features of the part according to the measured alternating current that powers the motor; and b. clustering the logs of the plurality of parts according to the extracted features of each part.

    17. The method of claim 16, wherein the extracting features of the part is executed by detecting breakpoints in the measured alternating current and counting alternating current cycles between consecutive breakpoints.

    18. The method of claim 17, wherein the breakpoints are toolpath turning points.

    19. The method of claim 17, wherein the breakpoints are toolpath start-stop points.

    20. The method of claim 16, wherein the selected motors comprise at least two motors, and the features are derived using data from one motor indicating breakpoints and using data from the other motor indicating the number of its cycles measured during the time between the breakpoints.

    21. The method of claim 16, wherein the measuring of an alternating current is executed by measuring a single phase of the alternating current.

    22. The method of claim 16, wherein the measuring of an alternating current is executed by measuring at least two phases of the alternating current.

    23. The system of claim 2 further comprising: a. the at least one signal generating sensor configured to sense a signal indicative of the activation of the at least one machine; and b. the one or more processors configured: i. to record signals collected from sensors during a manufacturing session; ii. to extract features from a log of signals recorded during machine activation in a manufacturing session; iii. to cluster logs into recognizable patterns; and iv. to identify a manufactured part by comparing its log to logs known to correspond to the part.

    24. The system as in of claim 23, wherein the sensors sense a signal representing at least one of current, voltage, power, temperature, vibration, sound, electromagnetic radiation and light.

    25. The system of claim 23, wherein the sensors' data transmissions are wired.

    26. The system of claim 23, wherein the sensors' data transmissions are wireless.

    27. The system of claim 23, configured to calculate a managerial property of a log.

    28. The system of claim 27, wherein the managerial property is selected from a list comprising power consumption, time of completion, machine amortization and consumption of expendables.

    Description

    BRIEF DESCRIPTION OF THE DRAWINGS

    [0075] The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings, in which:

    [0076] FIG. 1A is a simplified block diagram describing a general system that supplies electrical power to a CNC machine according to embodiments of the present invention;

    [0077] FIG. 1B is a simplified block diagram describing an exemplary system that supplies electrical power to a CNC machine according to embodiments of the present invention;

    [0078] FIGS. 2A-2C, 3A-3C and 4A-4C are graphs illustrating exemplary waveforms of current measured according to exemplary embodiments of the present invention;

    [0079] FIG. 5 is a flowchart describing a process for identifying manufactured parts according to an embodiment of the present invention;

    [0080] FIGS. 6A-6B are flowcharts describing exemplary processes of feature extraction;

    [0081] FIGS. 7A-7C are exemplary number sequences representing part features according to embodiments of the present invention;

    [0082] FIGS. 8A-8B show a simplified block diagram of an embodiment of the invention for general workstations;

    [0083] FIGS. 9A-13C show exemplary signals recorded from sensors;

    [0084] FIG. 14 shows examples of conventional wireless sensors;

    [0085] FIG. 15 show a simplified flowchart of clustering parts; and

    [0086] FIG. 16 show a simplified flowchart of recognizing parts.

    DETAILED DESCRIPTION

    [0087] Counting Alternating Current Cycles Between Breakpoints

    [0088] Reference is made to FIG. 1A, which depicts a system 100 of supplying power to a CNC machine's motors for energizing and controlling a tool for moving along a toolpath in order to create a part. Machine control unit 110 is a computerized unit that receives G-code 106 that describes the part's manufacturing process according to a well-known standard. Machine control unit 110 sends motion instructions 118 to motor control units 120. Motor control units 120 are connected to motors 140 with wires 130 to supply alternating current for individually powering and controlling each of motors 140 so that the tool moves along the toolpath according to the G-code 106. Part identification system 150 includes AC current probes 160, which measure current flow or voltage to be recorded by data acquisition system 170. The recorded data is analyzed by processor 180 for feature extraction and clustering toward part identification as described in the following drawings and accompanying description.

    [0089] FIG. 1B describes an embodiment that uses motors 140A that include three 3-phase motors 140X, 140Y and 140S that are energized and controlled by their respective control units 120X, 120Y and 120S. X-motor control unit 120X and Y-motor control unit 120Y control the tool moving along the X and Y axes, respectively, while spindle motor control unit 120S controls the rotation of the part around the Z axis. The exemplary part identification system 150A measures voltage or current flow of two out of the three alternating current phases powering the motors, as demonstrated by AC probes 160X-1, 160X-2, 160Y-1 and 160Y-2 that may be current flow or voltage probes, which are recorded by data acquisition system 170A and analyzed by processor 180A, for feature extraction and clustering toward part identification.

    [0090] FIGS. 2A-2C illustrate an exemplary signal segment measured by AC probe 160X-1 and AC probe 160X-2, recorded by data acquisition system 170A and analyzed by processor 180A of FIG. 1B, in the course of manufacturing an exemplary part. In the exemplary 3-phase X motor of FIG. 1B, the phases are spaced 120 degrees from each other. In this example, if phase 1 is leading, the X motor is rotating in one direction while if the phase 2 is leading, the motor is rotating in the opposite direction. FIG. 2A shows in points 204 and 208 phase 2 leading. Point 212 is a breakpoint, after which phase 1 is leading, until another breakpoint 216 where phase 2 starts leading again. The corresponding physical phenomenon causing these waveforms is that the motor direction changes at times corresponding to points 212 and 216. Processor 180A receives the signal shown in FIG. 2A from data acquisition system 170A, and analyzes the signal to identify breakpoints 212 and 216 and then counts the number of alternating current cycles therebetween. FIGS. 2B and 2C show magnified views of breakpoints 212 and 216, respectively.

    [0091] The number of alternating current cycles between consecutive breakpoints such as 212 and 216 along the entire part manufacturing accumulate into a sequence of counted cycles, or simply “counts,” such as the sequence of counts 700 in FIG. 7A including counts X1, X2, X3, X4 . . . . As the counted number of cycles between consecutive breakpoints represent the distance travelled by the tool, the count represents some measurement to associate with the manufactured part, and it is therefore indicative of the part and suitable for use as a feature.

    [0092] Sometimes, especially with different parts that are similar in one dimension yet different in another dimension, it may be advantageous to identify breakpoints, count the number of alternating current cycles between consecutive breakpoints and form a sequence of counts for each motor of a plurality of motors, where each sequence serves as a feature of the manufactured part. FIG. 7B demonstrates features 710 that include a sequence X1, X2, X3, X4 . . . and a sequence Y1, Y2, Y3, Y4 . . . derived by data acquisition system 170A and processor 180A with respect to the currents that energize and control X-motor 140X and Y-motor 140Y, respectively.

    [0093] It will be noted that the breakpoints of FIGS. 2A-2C are turning points, where the toolpath changes direction in a specific degree of freedom, e.g., in the X and/or Y direction. For detecting such turning points, measuring the current flow or voltage of two phases, as shown in FIG. 1B, is helpful by detecting the leading phase, as explained above with reference to FIG. 2A.

    [0094] FIGS. 3A-3C pertain to detecting breakpoints that are start-stop points, in which case measuring a single phase of the alternating current powering the motor(s) may be sufficient, and AC probe 160X-2 and AC probe 160Y-2 become redundant. Start-stop point 310 of FIG. 3A, magnified in FIG. 3B, shows a flat segment of zero alternating current where the tool momentarily stops moving in a certain degree of freedom, such as the X axis. Start-stop point 320 of FIG. 3A, magnified in FIG. 3C, shows the next start-stop point. Counting the alternating current cycles between points 310 and 320, and accumulating such counts into sequences of counts between consecutive breakpoints, may be used as a feature of the manufactured part, similar to using breakpoints that are tuning points as in FIGS. 2A-2C and FIGS. 7A-7B described above.

    [0095] It will be noted that when recording two or more count sequences that pertain to different motors and degrees of freedom, as demonstrated by the two sequences of FIG. 7B, each sequence may be treated as a feature of the manufactured part independently of other sequences. However, since the manufacturing process involves strict synchronization of the tool motion along the different degrees of freedom, correlation between breakpoints detected in one motor and counts alternating current cycles in another motor may also be used as a feature of the manufactured part.

    [0096] FIGS. 4A-4C show feature extraction of a part manufactured by the motors 140A of FIG. 1B, wherein start-stop points of spindle motor 140S are used as breakpoints, and alternating current cycles powering X-motor 140X are counted between the spindle motor breakpoints. The measured single-phase currents of the X and spindle motors are shown in FIGS. 4A-4C, with the X and spindle currents shown in the top and bottom parts of each figure, respectively. FIG. 4A shows two breakpoints 404 and 408 that are start-stop points of the spindle motor. In the embodiment of FIGS. 4A-4C, the X-current cycles between consecutive spindle-current breakpoints are counted and accumulate into a sequence of counts, demonstrated by feature 720 of FIG. 7C. FIGS. 4B and 4C are magnified views of the X and spindle currents next to breakpoints 404 and 408, respectively.

    [0097] Process of Feature Extraction and Clustering

    [0098] FIG. 5 describes a process of identifying manufactured parts by measuring alternating currents that power and control motors of a CNC machine (provided by the sensors in real time, or read from a recording of the log off-line). In step 501 a CNC machine having a plurality of motors starts manufacturing a part. In step 503, voltage or current probes, as demonstrated in FIG. 1B, measure the alternating current(s) that power and control one or more selected motors. In some cases, measuring the current powering a single selected motor may be sufficient for the feature extraction described below, while in other cases, especially with different parts that are similar in a certain dimension, two or more selected motors may be needed for effectively distinguishing between similar yet different parts. In step 505 the current(s) measured in step 503 are analyzed to extract feature(s) of the manufactured part. Step 509 checks whether the last part of a plurality of parts has been manufactured, and if not, the next part of the plurality of parts starts being manufactured and feature extraction is performed again in steps 503-505. When the end of manufacturing of the plurality of parts is determined by step 509, step 513 clusters the signals of all manufactured parts according to similarities among the feature(s) extracted for each part in step 505. In step 517 each cluster of similar features is associated with a part number, which may involve data entry by a human operator or may be determined automatically. One way for automatically determining a part is to associate the number of identical or similar clusters with the known number of identical parts made for each of the various different part types made according to the manufacturing plan, and in step 521 each manufactured part is marked according to its cluster, for example by engraving or labeling the part with the part number.

    [0099] FIG. 6A depicts a process of feature extraction based on counting cycles of alternating current. In step 601 the process of feature extraction starts for one or more selected motors out of the plurality of motors powering and controlling a CNC machine. The number of motors may be selected according to the similarity of the different parts to be manufactured, as explained above with reference to FIG. 5. Step 605 starts the manufacturing of a part. Step 609 starts a concurrent process for each motor of the one or more selected motors. In step 613, the alternating current powering the motor is measured using current flow or indirectly by voltage probes over a known or constant resistance. Step 617 identifies toolpath breakpoints in the waveform formed by the measured alternating current, such as turning points demonstrated in FIGS. 2A-2C or start-stop points demonstrated in FIGS. 3A-3C, while step 621 counts alternating current cycles between consecutive breakpoints. Step 625 records the accumulated sequence of alternating current cycles counts as a feature of the manufactured part, as demonstrated by FIGS. 7A and 7B. The process then repeats through step 627 for all selected motors and through step 629 for all manufactured parts, ending feature extraction for all manufactured parts in step 633, optionally ready for further clustering and part identification such as in steps 513-521 of FIG. 5.

    [0100] FIG. 6B shows feature extraction based on identifying breakpoints in a first motor while synchronously counting alternating current cycles in a second motor, as also demonstrated by FIGS. 4A-4C and FIG. 7C. Step 641 starts the manufacturing of a part, followed by concurrent and synchronous steps for two different motors. In step 645 a first process starts for a first motor, so that in step 649 the alternating current powering the first motor is measured, for identifying, in step 653, breakpoints in the alternating current powering the first motor. Concurrently and synchronously with steps 645-653, step 657 starts, for a second motor that is different than the first motor, measuring the alternating current powering the second motor in step 661, followed by counting in step 665 alternating current cycles of the second motor that occur between consecutive breakpoints of the first motor. In step 669 the accumulated sequence of alternating current cycles counts of step 665, as demonstrated, for example, by FIG. 7C, is recorded as a feature of manufactured part.

    [0101] FIGS. 7A-7C demonstrate sequences of alternating current cycles counts between consecutive breakpoints used as features of manufactured parts, and were referenced throughout the description above.

    [0102] The above specification describes embodiments where manufacturing is done according to pre-defined G-code. These embodiments are essentially deterministic (operate, not only repetitively, but essentially identically on like parts) and use a repetitive log of manufacturing. However, some manufacturing is done in manned workstations where a human worker activates and inactivates motors and machines. While such operation is essentially repetitive, it is not necessarily identically-repetitive, because there will probably be slight deviations from one part to another due to the randomness of the human operation based on individual work habits, and the following embodiments accommodate such randomness and still enable the identification of the manufactured part.

    [0103] Attention is now called to FIG. 8A. A workstation 800, such as a mechanical workshop bench or a mechanically operated milling machine, has an electric power line 802 with one or more phases of power, feeding three electric machines 810, 812, 814 via one-phase or 3-phase power cables 804, 806, 806. Each power cable is equipped with a clip-on wireless current sensor 816, 818, 820 and two of the machines, 810, 814 are also equipped with attachable wireless vibration sensors 813, 815.

    [0104] As the workstation performs an automatic or manual work of manufacturing a part, the machines are turned on and off and are applied to the part—cutting, pressing, welding, polishing etc. the part. The sensors transmit analog or digital signals representing their activity.

    [0105] Attention is now called to FIG. 8B. The signals from the sensors are input to a processing unit 830. Wireless sensors are input via antenna 832 and wired sensors are input via wires 833. A digitizing and preprocessing unit 834 converts the signals into digital data, such as those indicating start time and stop time of operation of each machine, and determines parameters representing the pattern of the sensor signal along the time of operation, such as coefficients of a polynomial estimation of the sensor signal during time of activity.

    [0106] The data is input to a processor 836 that receives the parameters representing the work session, uses the parameters to generate a parametric description of the session, and then sends the parametric descriptions to a processing and storage unit 837. A clustering processor 838 clusters the accumulated logs into clusters of similar sessions, that describe repetitive manufacturing of identical parts.

    [0107] Attention is now called to FIG. 9A-9C, representing a sensed signal from 3 machines such as 810, 812, 814 of FIG. 8A respectively.

    [0108] FIG. 9A indicates that machine 810 starts working at time 910 at a high intensity then stops abruptly at time 912 then starts again at time 914 and then stops again at time 916.

    [0109] FIG. 9B indicates that machine 812 starts at a later time 918, works for longer time, and then stops abruptly at time 920.

    [0110] FIG. 9C indicates that machine 814 starts at time 922, increases its intensity gradually then peaks at time 925, then falls down gradually and stops at time 926.

    [0111] The time scale for all three machines in FIGS. 9A-9C is the same time scale. FIGS. 10A-10C show the signals collected from another session, from the same three machines working on another part that is identical to the part corresponding to FIGS. 9A-9C.

    [0112] It is clearly observed that the patterns of FIG. 10 are essentially an accelerated version of the patterns of FIG. 9. This may indicate that the same manufacturing log was carried out at a higher speed.

    [0113] FIG. 11A-11C show the signals collected from the same sensors of the same machines, when manufacturing another part that is different than the first part.

    [0114] In FIG. 11A, it is shown that machine 810 was activated twice, the first period significantly longer than the second period, and its intensity in the first period was increasing and then decreasing gradually. FIG. 11B shows that machine 812 was activated for a longer time, gradually-changing and with lower intensity than in log 9B. FIG. 11C indicates that machine 814 was not activated at all in this log.

    [0115] It is clearly observed that FIGS. 11A-11C represent a different part than FIGS. 10 and 9.

    [0116] FIGS. 12A-12C represent a log that is a deviation of the log of FIGS. 11A-11C, but it is still similar in essence: machine 810 activated twice and not abruptly, machine 812 activated once, and machine 814 not involved. This log clearly represents the same part as FIGS. 11A-11C.

    [0117] FIG. 13 shows a log that is significantly different than all previous logs. Machine 812 is not used and machines 810 and 814 are activated only once. This clearly represents a third manufactured part.

    [0118] In a preferred embodiment of the invention, the logs are parametrized so that they can be clustered and recognized using conventional pattern recognition methods. Features that can be used for parametrizing the logs may include, for each of the machines, starting times, ending times, average intensity (amplitude), standard deviation of intensity, number of activations, overlapping of operation of machines, coefficients of polynomial approximation of the intensity during activation.

    [0119] Conventional pattern recognition methods are used for feature extraction, clustering and recognition of manufactured parts. Non-limiting example pattern recognition methods are discussed at https://en.wikipedia.org/wiki/Pattern_recognition.

    [0120] Attention is now directed to FIG. 15 showing a simplified flow chart of the preparation process of the present embodiment of the invention.

    [0121] After installing sensors on the machines of a given workstation involved in the process of manufacturing, the workstation is operated normally during a work shift, and signals are sampled 1500. At the end of the shift, the record of the logs of the workstation taken during the shift is segmented 1502 into segments of signals sampled representing the manufacturing of individual parts. The segmentation may be executed manually, for example, by a human operator pressing a button to indicate “end of part manufacture”, or may be executed automatically, for example, by detecting relatively long periods of time with negligible, if any, change in the signals sensed by the sensors on the machines (not necessarily inactivity of all machines, as some machines may be left to run while parts are changed).

    [0122] The system then calculates 1504 a large number of pre-determined parameters of the session, as described above, including times of activating each machine and coefficients of polynomial approximation of the signals sensed by the sensors, if the signals change over time.

    [0123] The system then applies 1506 conventional feature extraction procedures to extract features of the individual part-sessions to perform clustering of the sessions into clusters of corresponding to individual parts.

    [0124] Finally, the system labels 1508 each cluster of part-sessions to obtain a legend for recognizing additional logs as representing specific manufactured parts.

    [0125] Attention is now called to FIG. 16, showing a simplified flowchart of the process of recognizing parts. A new log of manufacturing, segmented from a new record of a shift of work of the workstation is input 1600 into the processing system. The segmentation divides the data into groups, each of which corresponds to the manufacture of a single separate part. Parameters of the log are calculated 1602 and features of the session are extracted 1604 according the results of the feature extraction process done in the clustering process, and the part is recognized 1606 by the distance between the features of the session to the features in the clusters using pattern recognition, such as KNN pattern recognition, as a non-limiting example.

    [0126] After the part is recognized, the system can compare the log of the part to the average log of the cluster, and extract managerial properties of the session 1608 such as session duration, relative power consumption of the session, relative amortization of the cutting tools of machines (estimated based on the time the tool was active and the current that the motor guiding the tool consumed. The time that a cutting tool is used and the force that it applies to the workpiece determine the amortization), consumption of expendables, etc. Such properties may help management improve efficiency and reduce the costs of manufacturing.

    [0127] Having thus described exemplary embodiments of the invention, it will be apparent that various alterations, modifications, and improvements will readily occur to those skilled in the art. Alternations, modifications, and improvements of the disclosed invention, although not expressly described above, are nonetheless intended and implied to be within spirit and scope of the invention. Accordingly, the foregoing discussion is intended to be illustrative only; the invention is limited and defined only by the following claims and equivalents thereto.