SORTING SUPPORT METHODS, SORTING SYSTEMS, AND FLATBED MACHINE TOOLS

Abstract

A method for assisting a user with sorting workpieces disposed on a sorting table uses a positioning system for determining a spatial position of a user's hand. The position can be determined by a sorting assistance unit worn near a hand of the user and the position of which is detected by the positioning system, or by image-based positioning using one or more cameras. The method comprises providing a position data set that includes the positions of the workpieces produced of the machining plan on the sorting table; by the positioning system, detecting a position of the user's hand and comparing it with the positions of the position data set; identifying at least one workpiece that is paired with the position of the user's hand; and outputting a sorting signal which comprises information about the at least one workpiece paired with the position of the user's hand.

Claims

1. A method for supporting an operator at a sorting operation of workpieces arranged on a sorting table and that have been produced according to a processing plan using a flatbed machine tool with the use of a localizing system, the method comprising: providing a position data set that includes positions of the workpieces on the sorting table; detecting a position of a hand of the operator with the localizing system; comparing the position of the hand of the operator with the positions of the workpieces in the position data set; identifying at least one workpiece associated with the position of the hand of the operator; and outputting a sorting signal that includes information about the at least one workpiece associated with the position of the hand of the operator.

2. The method of claim 1, wherein one or more workpieces closest to the hand of the operator is identified as the at least one workpiece associated with the position of the hand of the operator.

3. The method of claim 1, wherein the workpiece closest in a direction of movement of the hand of the operator is identified as the at least one workpiece associated with the position of the hand of the operator.

4. The method of claim 1, further comprising displaying information about the at least one workpiece associated with the position of the hand of the operator on a sorting support specific display unit that is associated with the hand of the operator.

5. The method of claim 1, further comprising providing location context sensitive information based on the sorting signal that includes workpiece specific information for the at least one workpiece associated with the position of the hand of the operator.

6. The method of claim 5, further comprising projecting the location context sensitive information onto the at least one workpiece associated with the position of the hand of the operator.

7. The method of claim 5, wherein information about the at least one workpiece associated with the position of the hand of the operator is optically superimposed on the at least one workpiece as text and/or is displayed on display.

8. The method of claim 1, further comprising detecting and registering a removal operation by evaluating the position data of the hand of the operator and detecting a removal movement in a section of a movement trajectory and/or by detecting a gesture movement with the movement trajectory of the hand of the operator.

9. The method of claim 8, further comprising outputting a placing signal for system-supported placing of the removed workpiece at a workpiece collecting point unit provided for the removed workpiece.

10. The method of claim 1, further comprising recognizing and registering a placing operation of the removed workpiece performed by an operator, by evaluating the position data of the hand of the operator and detecting a placing movement in a section of a movement trajectory.

11. The method of claim 10, further comprising: providing an association of gestures and processes; determining a motion trajectory of the hand of the operator by evaluating the position data of the hand of the operator; recognizing a gesture in a section of the motion trajectory; and performing a process assigned to the gesture.

12. The method of claim 1, further comprising outputting a sorting completion signal when the placing operation corresponds to a placing operation associated with the removed workpiece.

13. The method of claim 12, further comprising updating a workpiece collecting point specific display with regard to the placement of the removed workpiece.

14. The method of claim 1, wherein the sorting signal includes sub-signals each associated with a removed workpiece when a plurality of workpieces are associated with the position of the hand of the operator.

15. The method of claim 1, further comprising outputting an error signal when the placing operation is different from a placing operation associated with the removed workpiece.

16. The method of claim 15, further comprising displaying information regarding the placing operation assigned to the removed part.

17. The method of claim 1, further comprising: monitoring a placing operation of at least one removed workpiece in a reject collecting point; and associating the at least one removed workpiece as a reject.

18. The method of claim 17, further comprising: outputting a supplementary production signal to a production control system; comparing production parameters of the removed workpiece with a subsequent processing plan; and if the production parameters correspond with the subsequent processing plan and there is availability with respect to the removed workpiece, supplementing the subsequent processing plan with a generation step for generating a replacement workpiece for the rejected workpiece.

19. The method of claim 1, wherein the sorting signal is generated in less than 0.5 s after the detection of the position of the hand of the operator.

20. The method of claim 1, wherein the workpieces arranged on the sorting table are formed from one or more of sheet metal, glass, semiconductor substrate structures, printed circuit board structures, and plastic.

21. The method of claim 1, wherein the information on the workpiece associated with the position of the hand of the operator includes one or more of a type, position, shape, a placement position of the workpiece, and information on the subsequent process.

22. The method of claim 1, wherein the operator carries a sorting support unit near his hand, and the position of the hand is determined by locating the position of the sorting support unit, and wherein the position of the hand is equated with the position of the sorting support unit.

23. The method of claim 22, wherein the sorting support unit includes a transmitter whose position is detected by the localizing system.

24. The method of claim 1, wherein the position of the hand is determined by image-assisted localizing of the hand with the localizing system and wherein the localizing system evaluates image data of one or more cameras.

25. A flatbed machine tool, comprising: a processing unit; a control unit, in which a processing plan is stored for controlling the processing unit to generate workpieces arranged next to one another in accordance with a processing image data set; a sorting table for supporting the arranged workpieces for sorting after manufacture; and a localizing system for determining the position of a hand of an operator in space, wherein the control unit is adapted to perform a method, comprising: providing a position data set that includes positions of the workpieces on the sorting table; detecting a position of a hand of the operator with the localizing system; comparing the position of the hand of the operator with the positions of the workpieces in the position data set; identifying at least one workpiece associated with the position of the hand of the operator; and outputting a sorting signal that includes information about the at least one workpiece associated with the position of the hand of the operator.

26. The flatbed machine tool of claim 25, further comprising: at least one movable workpiece collecting point unit, wherein the localizing system is a system for detecting and monitoring at least a part of a movement trajectory that is associated with a removed workpiece or with an object effecting the movement; and the control unit is adapted to evaluate the position data set, to integrate location context sensitive information about the environment of the hand of the operator in the sorting process, and to control parameters of the placing process via gestures.

27. The flatbed machine tool of claim 25, further comprising a sorting support unit carried near the hand of the operator adapted to be locatable in position of the sorting support unit with the localizing system, wherein the sorting support unit has a passive transmitter, the position of which is detected by the localizing system.

28. The flatbed machine tool of claim 25, wherein the localizing system includes at least one antenna for receiving signals from the sorting support unit.

29. The flatbed machine tool of claim 25, wherein the localizing system includes one or more cameras for image acquisition of the position of the hand of the operator.

30. The flatbed machine tool of claim 25, wherein the localizing system includes an evaluation unit for determining the position of the hand of the operator for evaluating gestures associated with movement trajectories.

31. The flatbed machine tool of claim 25, wherein the sorting table is part of a pallet exchanger of a flatbed machine tool.

32. The flatbed machine tool of claim 25, further comprising a projection unit for projecting workpiece-specific information onto the at least one workpiece associated with the position of the hand of the operator.

33. The flatbed machine tool of claim 32, wherein the workpiece-specific information includes customer data, information about the subsequent process step, number of further identical parts, assigned workpiece collecting point, or order number for the at least one workpiece associated with the position of the hand of the operator.

Description

DESCRIPTION OF DRAWINGS

[0039] FIG. 1 shows an illustration of a portion of an intelligent factory with a laser cutting or punching flatbed machine tool.

[0040] FIG. 2 shows an illustration of an exemplary arrangement of workpieces on a sorting table.

[0041] FIG. 3 shows illustrations of a position data set and the identification of a workpiece.

[0042] FIG. 4 shows an illustration of an exemplary monitoring of a placement procedure of a removed workpiece.

[0043] FIG. 5 shows a flow chart for illustration of an exemplary process flow during the support of a sorting process.

DETAILED DESCRIPTION

[0044] The aspects described herein are partly based on the realization that for laser cutting (or punching) flatbed machine tools, a precise cutting plan (punching plan) is given that in combination with a detection of the position of the hand with respect to the sorting table on which the produced cut material is arranged can be used to support a manual sorting process and to obtain information suitable for further processing procedures. Thereby, it is proposed to detect the position of the hand with a sorting support device carried close to the hand, and the sorting support device includes sensors for position detection.

[0045] By extending flatbed systems with an indoor localization and interfaces to a control unit, the position of the workpiece collecting point units can be determined and/or the movement of the hand of the operator can be recorded. Such a localization can be done, e.g., via an ultra-wide-band-system of four or more so-called anchors and one or more tags. The anchors serve as receivers and can be positioned stationary around the working area. The tags can be attached to the hand of the operator and optionally to all workpiece collecting point units; the tags can serve to detect their position. Other indoor localization systems include Bluetooth, Wi-Fi, infrared and RFID, for example.

[0046] This type of near-field localization can also be used, for example, in sorting when, e.g., the position of a hand (e.g., of an intelligent glove that interacts with the localizing system) is localized from the workpiece collection unit, for example. If the hand of an operator removes a component from the residual grid, the location of the component in the MES is booked from the residual grid to the hand. If the hand moves near a workpiece collecting point unit (e.g., near a localizing system of the workpiece collecting point unit), the MES books that this part has been placed at the associated workpiece collecting point unit. On the one hand, the localizing system can detect that the hand with the workpiece approached the workpiece collecting point unit. On the other hand, a higher-level system (e.g., the MES) can link the workpiece collecting point unit and the position of the hand.

[0047] The concepts described herein are accordingly based on a localizing system for position detection of a position sensor on an operator when sorting cut material. The implementation can, for example, be done with a data glove worn by the operator or another medium carried by the operator such as a ring, a wristband, a watch (Smartwatch), or a thimble (also commonly referred to as wearables).

[0048] In addition to permanently installed cameras, the image data can also be acquired with supplementary or alternative data glasses worn by the operator. For example, the data glasses can be used to track the hand in space by a camera integrated in the glasses using image processing.

[0049] Such position sensors have one or more transmitters and possibly sensors. Data gloves include such sensors at the wrist or finger, for example. The position sensors make it possible to integrate location context sensitive information on the environment into the sorting process and, for example, to selectively output associated information, e.g., on a display on the glove or generally in the visible area of the sorter.

[0050] Furthermore, the concepts described herein allow the system to be controlled by gestures. For example, the gripping process can be detected or accompanied by a specific movement of a gesture such as lowering the hand or pointing a finger. Alternatively or in addition to the gesture control, a connection to a foot switch or similar is possible. Voice control or a switch sensor on the finger/hand/arm is also conceivable.

[0051] Via the transmitter attached to the operator, the localizing system detects the position of the sorting process by the operator and can evaluate this position with the known positions of the parts. Accordingly, at least one workpiece associated with the position of the hand of the operator, e.g., of the sorting support unit, can be identified and information about the workpiece associated with the position of the hand of the operator, e.g., of the sorting support unit, can then be output via a correspondingly generated sorting signal. This makes it possible, for example, to assign the workpiece removed with the data glove and, based on the position of the transmitter in the localizing field, to display location context sensitive information on the environment. The assignment, possibly supplemented by motion detection, e.g., by gesture detection, allows a removed workpiece to be booked out at the removal point and assigned and booked to a placement point.

[0052] The concepts described herein relate to flat sheet metal installations that use punching or laser cutting to produce workpieces for subsequent processing steps from so-called sheets (starting sheets of predetermined thickness and predetermined size). A workpiece can be converted into a freely selectable shape, for flatbed machines a flat shape, by very flexible sheet metal processing using laser technology. Subsequent bending and welding processes then generate a product. With such laser cutting or punching flatbed machine tools, a processing plan (e.g., cutting plan) is stored as an input parameter in the machine control, wherein the processing plan contains the exact position of the produced workpieces with respect to the sorting table.

[0053] When providing a position data set that includes the position of the workpieces generated with the processing plan on the sorting table, in addition to the original (cutting) processing plan, one can also use additional information obtained during the processing procedure. The information includes, e.g., a coordinate transformation for adapting the (cutting) processing plan to the actual position of the raw sheet or displacements performed after the (cutting) processing. Such information is, for example, stored in the control unit linked to the (cutting) processing plan and, if necessary, is also communicated to the MES.

[0054] Shrinking batch sizes, i.e., the need to be able to produce small quantities in short time windows, and individualized products are current challenges for punching or laser cutting; these challenges have a particular impact on the automation of production processes in sheet metal manufacturing companies. The concepts described herein can coordinate and integrate IT-supported processes, especially for smaller batch sizes, assign these to individual machines, and play a role in an adaptable creation of the production plan.

[0055] There are high demands of a wide variety of products in so-called intelligent factories (smart factories). The e potential for more efficient design of manufacturing processes lies in indirect processes, e.g., the steps taking place before and after the separation process. For example, by enabling more efficient and error-free sorting and compensating for rejected workpieces, one can shorten the throughput time of an order across all manufacturing processes and one can achieve a more efficient utilization of the intelligent factory.

[0056] Transparent manufacturing planning, in which indirect processes are interlinked, provides an overview of production processes and allows their optimization. The operator becomes a process manager who controls the material flow with his oversight, especially for orders with small batch sizes.

[0057] FIG. 1 shows an overview of an intelligent factory 1 (smart factory) that includes self-adapting production resources, such as a laser cutting or punching flatbed machine 3 shown as an example, and an associated MES 5. Usually, several such flatbed machine tool installations and post-processing stations form the intelligent factory 1. Via a network 7, the virtual and physical production elements and production steps, especially the information about workpieces 9 (required number, shape, material, type . . . ) come together in the MES 5. A control unit 8, such as a PC, computing node or similar suitable hardware, is used to control, the flatbed machine 3 and other components assigned to it. The control unit 8 is especially configured to support sorting the workpieces 9 by an operator 11 to workpiece collecting point units 13 during real-time operation of the intelligent factory 1. The underlying computing system includes, for example, digital processor systems with microprocessor circuits having data inputs and control outputs, the processor systems being operated according to computer-readable instructions stored on a computer-readable medium. Typically, the control unit 8 includes high computing power for real-time support and a long-term (non-volatile) memory for storing program instructions as well as a very fast short-term (volatile) memory for storing captured data and evaluation results of the memory for supporting the operator. The operator 11 sorts the workpieces 9 taken from a sheet 17 output by the flatbed machine 3 to the workpiece collecting point units 13. Using the sorting support unit described below, the removal decisions regarding the workpiece to be removed next and the subsequent placing operation at the respective workpiece collecting unit are thereby supported.

[0058] For example, while the operator is making the decision as to which of the workpieces to remove, information about the workpieces that are close to his hand and thus within his gripping range can be displayed. Furthermore, after removing the workpieces 9, a display 19 of an associated workpiece collecting point unit 13 can indicate, for example, that the workpiece 9 is to be stored in this unit. Display 19 can also show the status (general workpiece information), e.g., the number of placed workpieces 9, how many are still missing, or whether an error has been detected.

[0059] In this way, the operator 11, who as an augmented operator is provided with comprehensive information in as real a time as possible, can control the system and efficiently design and monitor manufacturing. As an expert and decision-maker, the operator 11 retains the final decision-maker function in all relevant processes of the production network. Thus, the operator can influence targets situationally and contextually, supported by IT-based assistance systems, such as the method for supporting a sorting process.

[0060] The flatbed machine 3 is a social machine that is in contact with other components with regard to production planning and is intelligently interlinked with the order control and the MES 5. Thus, for example, it can react to possible deviations in the cutting process independently and depending on the situation.

[0061] In traditional manufacturing, an operator would repeatedly pick up work papers relating to orders, manually start orders, sort parts, and associate these to work progress slips and setup plans. This means that the machine can often stand still for longer periods of time.

[0062] In contrast thereto, interlinked production in the intelligent factory 1 optimizes its indirect processes and provides an overview of the production processes to be carried out. The operator 11 becomes the process manager who keeps track and controls the material flow.

[0063] As exemplary sorting devices 38, FIG. 1 further shows a carriage 39 and a bridge 40 that is movable over the sorting table 21. On each of the sorting devices 38, there are one or more workpiece collecting point units 13. At each workpiece collecting point unit 13, there is a display unit 43 with the display 19 and a signal output device 47. Alternatively or in addition to the optical display, acoustic and haptic signals are possible. Furthermore, a combined signal/display unit 44 can be used that can, for example, be placed close to the placing location of larger workpieces.

[0064] In general, picking up and sorting parts, for example, cut parts, is time-consuming, error-prone, and a great challenge (with several orders produced from one blank). With the concepts proposed herein, manufacturing orders for small quantities per batch, for example, can be efficiently sorted for nested parts.

[0065] As will be explained in more detail below, one can monitor with the automated localizing of the hand of the operator 11 provided for support which workpiece 9 was removed from a sheet 17 output by the flatbed machine 3. At one of the intelligent and interlinked workpiece collecting point units 13, a display 19 can then give a sign and show the operator 11 the sorting location assigned, for example, by the MES 5. Localizing the hand can also enable the placing operation to be booked in the MES 5. In addition, the workpiece collecting point units that are designed as intelligent crates, for example, can output current order information received from the MES 5 on, e.g., an E-Ink display. They enable, e.g., an (possibly spatially rough) localization and can enable an intuitive fine search for the operator, for example, by flashing. For example, the workpiece collecting point units 13 are connected to their own data supply system 14 that is connected to the MES 5 and the control unit 8 for data exchange.

[0066] After a number of required workpieces have been sorted into a workpiece collecting point unit 13, an operator 11 (or automated robot system) takes the workpiece collecting point unit 13 to a subsequent processing step.

[0067] An electronic assistant supports the operator 11 on the information side by providing situational information. This allows the operator 11 to continue implementing individual preferences (such as where do I start, do I create small hand buffers or not . . . ) in the sorting process. Steps include monitoring, evaluating, and providing the information required for the situation.

[0068] To detect the required position of the removing hand, a localizing system 51 is provided in the area of the workstation that permits the localization of one hand of the operator, e.g., of a sorting support unit 53. The sorting support unit 53 is located close to the hand/arm of the operator 11. In FIG. 1, the sorting support unit 53 is at a glove of the operator 11. The sorting support unit 53, for example, is a transmitter (Radio Frequency Identification, RFID) whose actual position can be detected in real time. Bearing transponder systems operate, e.g., in the range of 2.45 GHz with a spatial resolution of a few centimeters.

[0069] As shown in FIG. 1, the localizing system 51 has, for example, four antennas 55, whereby at least three antennas (preferably more to increase accuracy) are provided close to the sorting table 21 and optionally at workpiece collecting units (for example, the mobile carriage 39). Radio waves detected via the antennas 55 are transmitted as data to a positioning calculation section 57 of the localizing system 51, the section determining the position of the sorting support unit 53 and optionally its movement trajectory from the different signal propagation times. The positioning calculation section 57 of the localizing system 51 can, for example, also be formed as part of the MES 5.

[0070] Using the data stored in the position data set for workpiece generation from the flatbed machine 3, the position of the parts to be removed is also known in the same coordinate system. If the position and preferred shape and size are known for a workpiece collecting point unit (load carrier) located in the measuring range of the localizing system, the placing operation of the sorting can also be supported. For example, for the carriage 39 or the bridge 40, the individual placement areas (or compartments) each assigned to a display unit can be stored in their geometry and/or position in the MES. The positions of the workpiece collecting point units (e.g., the mobile carriage 39) and the workpiece collecting point units are generally available in the system. The MES database, which is configured as a cloud, for example, also provides basic data on the manufactured workpieces and serves as a memory for the various location information.

[0071] One or more sensors of the sorting support unit 53 carried by the operator also allow the detection of gestures that trigger specific actions in the MES. The detection of specific gestures can also be supported alternatively or additionally by an environment camera.

[0072] The following applications are possible with the setup described above: information can be displayed about parts in the environment of the operator's hand (paper-based sorting is not required). The removal of a workpiece can be booked by gesture control when gripping a workpiece. Furthermore, the workpiece can be added to a workpiece collecting point by gesture control when it is deposited. The booking includes, for example, the assignment to a load carrier and thus the notation, which and how many workpieces are placed as well as where certain workpieces were moved to, e.g., the location at defined compartments.

[0073] In an embodiment of the sorting support unit 53, a work glove is equipped with an attachable transmitter kit. In case of wear, the work glove can be replaced and the existing transmitter kit can be attached to the new work glove. The glove can be used to supply the operator with the necessary information, e.g., by controlling a projector in location context sensitive manner via the glove, which projects the necessary information onto the sheet metal (workpieces) at the appropriate point in the area of the hand. In FIG. 1, for example, a projector 15 is mounted above the sorting table 21, which is adapted to provide information in an area close to the activity of the operator (its hand), e.g., by scanning text or highlighting areas/workpieces. Alternatively or additionally, the necessary information can be provided via a display unit on the glove.

[0074] The localizing system 51 knows from the position of the sorting support unit 53 above which workpiece 9 the hand is located, which e.g., wears the glove or to which another medium is attached for position determination. In addition, a display of the currently detected part on the display unit with further information on the workpiece is conceivable. Such information includes, for example, customer data, information on the subsequent process step, display of the corresponding load carrier and the number of other identical workpieces.

[0075] In some embodiments, the workpiece is registered as removed by the gripping movement and automatically assigned to the load carrier/workpiece collecting point unit (boxes, pallets, boxes with several compartments, etc.), which is also equipped with a transmitter, by releasing it. The load carriers can be equipped with a transmitter regardless of their characteristics. There is therefore no dependence on specific load carriers.

[0076] As a result, the location system/MES knows on which workpiece collecting point unit, e.g., in which compartment of a load carrier, each workpiece is in which quantity. Accordingly, the system can be controlled in the material flow and/or specific workpieces can be located quickly and easily.

[0077] A projector can display the information for the remover on the sheet metal. This is practically difficult to implement, because the radiation behavior of sheet metal (mirrors) requires a high light power. Consequently, only laser projectors with scanners can be used appropriately. However, these cannot cover the entire sorting table at once. For this reason, the location-sensitive projection approach mentioned herein offers a solution: the information is only projected onto the parts in the vicinity of the operator/of the operator's hand. This location context sensitive projection is easier to implement and economically feasible with currently available technical systems.

[0078] FIG. 2 shows an example of an arrangement of workpieces 9 of a machined sheet as it can be present on a sorting table after production with a flatbed machine. To detect the removal of workpieces, the localizing system 51 detects the position of the sorting support unit 53 in the monitored working area 23 that extends over the processed and to be sorted sheet. The sorting is carried out by an operator 11, shown in the example of FIG. 1 as a human being, (not a robot). To determine the position of the sorting support unit 53 and thus the hand over the cut sheet metal on the pallet, the localizing system 51 is calibrated to the machine coordinates.

[0079] On the control unit 8 with interface to the localizing system 51 and to the flatbed machine 3, it is recognized with suitable methods of position comparison (e.g., a difference formation with respect to the surface center of gravity of a workpiece), which workpiece 9 is in the vicinity of the hand and is removed from the sorting table 21. The positions of the workpieces 9 to be sorted result from the underlying processing plan.

[0080] FIG. 3 shows schematically a processing plan 16 with an exemplary visualization of a position data set 16 that was the basis for the arrangement of the workpieces 9 on the sorting table 21. Exemplarily planned parts shaped in three types a, b, c are on a schematically reproduced sheet 17, and the shaped parts are assigned to three orders A, B, C. It can also be seen that the shaped parts produced are to be sorted into three stacks of the types a, b, c on a carriage symbol 25 as workpiece collecting point units.

[0081] FIG. 3 also schematically shows a sorting operation 29 and an exemplary displaying of information for the operator on a display 67.

[0082] The schematically illustrated sorting operation 29 shows a hand 61 wearing a glove 63 to which the sorting support unit 53 having a transmitter is attached. The position of the sorting support unit 53 above the sheet 17 with the cut workpieces 9 is determined and compared with the center of gravity 65 of the workpieces 9. For example, a distance is determined by the geometric mean. FIG. 3 shows a workpiece 9 hatched that represents the workpiece associated with the position of the sorting support unit 53, which in this case is closest to the hand 61 of the operator.

[0083] In FIG. 3, order information (here text order A) for this workpiece 9 is shown on the display 67. For example, the shape of the workpiece 9 can also be displayed for visual inspection by the operator. It is also possible, for example, to display an associated workpiece collecting point unit or information on the placing operation. As indicated in FIG. 3, for example, information on the exact placement point of the workpiece on an associated carriage can be displayed using a carriage symbol 25.

[0084] By constantly updating the display, the operator can be assisted in his selection of the next workpiece to be sorted and in the placing operation.

[0085] The display 67 can, for example, be in the vicinity of the pallet changer of the flatbed machine. Alternatively, information can be projected using projector 15 (e.g., laser projector). Furthermore, the display can be realized on data glasses. Such augmented reality glasses can be used to display not only the fixed and correct placement location, but also its target height. For example, Hololens data glasses can be used to display 3D holographic objects fixed in location. The operator 11 can easily check whether a stack of workpieces is complete.

[0086] In FIG. 3, the double arrows represent the processing of the information from the processing image data set 16 and the position information of the sorting support unit 53 in the MES 5.

[0087] It should be noted that, once the removal process has been recorded, the MES 5 can also cause the display unit of the responsible workpiece collection unit to output signals which simplify the placement process. To inform the operator 11 about what is to happen next with the removed part (it is classically placed in a crate that is used as workpiece collecting point unit 13 for further transport), the control unit 8 has access to the MES 5. Not only the next placing location (in which crate the part must be placed), but also other information such as material, order number, customer, etc., is stored therein.

[0088] The workpiece collecting point units 13 also have a communication interface to the control unit 8 and can output information on the order, e.g., via an E-Ink display. Via the interface, the workpiece collecting point units 13 are thus also in a position to indicate to the operator 11, who is picking up a workpiece 9, in which crate he has to place it. A built-in scale or another suitable sensor unit can be used to determine whether the operator 11 has placed the workpiece 9 in the correct crate. Accordingly, feedback can be sent, e.g., via a counter on the E-Ink display. Thus, in control unit 8, a determination can be made as to whether all parts have been sorted correctly or whether parts of the order are missing that, for example, have fallen through the rest grid.

[0089] It is also conceivable that the operator 11 recognizes a faulty part during sorting and places it in a collecting point provided for rejects. In another case, the flatbed machine 3 automatically records faulty cuts, manual operator interventions or even collisions during sheet processing and records the affected parts as rejects via the interface to the control unit 8. This allows the operator to be notified before picking up the damaged workpiece that it should not be sorted or placed as reject. For such cases, an order for the post-production of the identified rejects can automatically be created in the MES 5 and planned. As shown in FIG. 4, the localizing system 51 also allows to analyze the movement of the hand, e.g., to recognize gestures or to evaluate movement trajectories in general. Thus, by tracking of the hand of the operator 11 it can be determined whether the workpieces were placed in the correct crates. As an example, movement trajectories 33 of the hand when removing a workpiece 9 are shown in FIG. 4. Furthermore, the tracking information can be used to improve the procedure for detecting a part that has been removed. By localizing the hand (e.g., positions 35), its motion trajectory or a part of the motion trajectory, a region of interest 37 is defined in the image area. The above mentioned projection of information can be limited to that area. The projection does not have to cover the entire workspace 23, but only the region of interest 37 around the hand of the operator 11. If several operators 11 work during the sorting process, a region of interest can be defined simultaneously for each operator 11 at the sorting table 21. Each operator 11 can thus be provided with individual information on the correct placing location of the workpiece.

[0090] In addition to the previously mentioned approach of executing the logic and computing power in a central computing node (control unit), other known topologies can be used for linking flatbed machine 3, localizing systems, projector, optionally an imaging system, crates with workpiece collecting points 13, and MES 5.

[0091] One can also suggest to the operator 11 an optimal sorting strategy via the projection screen, e.g., at the data glove or at the data glasses, by the available information even if he can still sort of a self-chosen strategy. With many small parts, for example, one can suggest to the operator to remove several identical parts at the same time. Using an algorithm, it is possible to calculate and display in real time how many parts can be removed at a time, depending on the size and weight of the individual parts, for example. This can also be individually adjustable depending on the operator. Furthermore, if the operator 11 has picked up a shaped part of type a, the position of other parts of the same type, for example along a favorable movement trajectory, can be displayed to the operator 11. This can be done with the projector 15, for example. This can, for example, avoid unnecessary paths.

[0092] After a removed part has been successfully read in, the control unit 8 as a control system outputs the correct placing location to the operator 11, e.g., via the projection screen at the data glove or at the data glasses. This could be, for example, a numbered storage compartment. If the storage compartment is at a more distant location, the projection surface of the data glasses can be used to refer via a map to the storage area. The supporting camera of the data glasses can also recognize the storage compartment as soon as it is within the visible area and mark it on the projection surface.

[0093] The control system also monitors by the localizing system whether the part was placed in the correct compartment during the placing procedure and provides feedback to the operator 11.

[0094] FIG. 5 shows a flow chart to illustrate an example of method procedures in the support of a sorting process as described herein. It is assumed that workpieces that are arranged on a sorting table have been produced with a flatbed machine tool, e.g., a laser cutting or punching flatbed machine tool as described above, based on a processing plan.

[0095] In the control unit 8, a position data set of the processing plan (see, e.g., the position data set 16 in FIG. 3) is provided (step 71) that formed the basis for the arrangement of the generated workpieces. Furthermore, in the area of the sorting table, the movement of a sorting support unit carried close to a hand of the operator is monitored with a localizing system. Thereby, a position of the sorting support unit is continuously detected with the localizing system (step 73). Furthermore, the position of the sorting support unit is compared with the positions of the position data set (step 75). The comparison can, for example, be carried out with respect to an area center of gravity of the cut sheet metal pieces. At least one workpiece associated with the position of the sorting support unit is thus identified (step 77). For example, the workpiece or the workpieces closest to the sorting support unit are identified. For further use in supporting the sorting operation, a sorting signal is then generated (step 79) which includes information about the workpiece associated with the position of the sorting support unit.

[0096] The sorting signal can be transmitted to the control unit 8 and/or the MES 5 and can trigger downstream processes. In this way, the sorting signal can fulfil various tasks and trigger actions. In this way, the MES can cause the information to be displayed to the operator (step 81). For example, the type, the position, and/or the shape of the workpiece and/or information on the associated processing order such as order number, placing location or next processing step can be displayed. It can also indicate whether and how to proceed with the at least one workpiece removed.

[0097] Furthermore, a light projection can be directed onto one or more identified workpieces (step 83) that, for example, identifies a preferred workpiece or maps respective information onto the workpiece(s).

[0098] Furthermore, a workpiece collecting point that is associated with the identified workpiece(s) can be identified (step 85). For example, a flashing signal can be initiated or respective information can be displayed on a display of the workpiece collecting point unit. Thereby, a placing signal can be output as a function of the sorting signal to support the assignment of the removed workpiece by an operator to a subsequent processing step. For example, a placing of the removed workpiece according to an order is stimulated at a workpiece collecting point corresponding to the order. This can include, for example, a flashing of an associated crate, a special signal/special information on a display associated with the crate, and/or the blending in of a marking of the associated crate into a display of data glasses.

[0099] This step is followed by removal of at least one workpiece from the sorting table (step 87), wherein the associated movement of the sorting support unit can be detected by the localizing system (step 89A) and booked as a removal operation (step 91A). Alternatively, the operator can cause the removal to be booked by additional gesture movements (step 91A) that in turn are detected by the localizing system (step 89B), or by using external input means (e.g., a foot switch) (step 89C).

[0100] Furthermore, information for placing a removed workpiece can be provided to the MES (step 93), e.g., by motion detection (step 89A), gesture detection (step 89B), or by using external input means (step 89C), so that after completion of the placing operation, the same can be booked as a completed placing operation (step 91B). The detection of the placing operation can additionally include a monitoring of the weight of a specific workpiece collecting point and/or a monitoring of a motion trajectory or a part of a motion trajectory of the removed workpiece or an object (hand) causing the movement (see, e.g., FIG. 4).

[0101] If the placing operation corresponds to a placing operation associated with the sorting signal, a sorting completion signal can be output (step 95), e.g., again by a flashing signal, special outputs on a display of, e.g., the workpiece collecting point unit, and/or a marking in the display of the data glasses. For example, a workpiece collecting point-specific display can be updated with regard to the placing of the removed workpiece.

[0102] If the placing operation deviates from a placing operation associated with the sorting signal, an error signal can be output (step 97), for example again by a flashing signal at the workpiece collecting point unit, special outputs on a display at the workpiece collecting point unit, and/or a marking in the display of the data glasses. Information regarding the correct placing operation assigned to the sorting signal can also be displayed repeatedly at the same time.

[0103] In addition, it can be monitored, for example, whether at least one removed workpiece was placed by an operator at a reject collecting point during a placing operation (step 99). The removed workpiece can be noted by the MES 5 as a rejected part, e.g., optionally entered in a list of missing parts.

[0104] A supplementary production signal can be output to a production control system for detected rejected parts. Here, for example, the production parameters of the removed workpiece are compared with a subsequent processing plan. If the production parameters correspond to the following processing plan and if a new production of the removed workpiece is available, the following processing plan can be supplemented with a production step for the production of a replacement workpiece for the rejected part. The generation of a replacement workpiece can also be provided for in later subsequent processing plans.

[0105] As indicated by dashed paths in FIG. 5, the steps of the method can be repeated to ensure continuous real-time monitoring and support of the sorting operation. With reference to FIG. 1, in the steps described above, communication can be based on a data link between the localizing system, the workpiece collecting units (e.g., their display units and their signal devices), and the control unit 8 of the machine tool 3 and thus the MES 5. Data can generally be exchanged via data cable with standard data connections, e.g., CAN, Profibus, RS232, RS485, USB, LAN, etc. However, it can also be done via infrared or radio (WLAN, Wi-Fi, etc.). As exemplarily shown in FIG. 1, the workpiece collecting point units 13 with their own data supply system 14 are wirelessly connected to the MES 5 and the control unit 8 for data exchange.

[0106] The communication also allows an operator to be provided with information directly at the glove, on local monitors, and/or at the workpiece collecting point units; e.g., information available to the MES 5. On the one hand, the information that can be made available includes workpiece-specific information (herein also referred to as workpiece information) that refers to the manufacturing process and the associated data of the workpieces that are placed at the workpiece collecting point unit. On the other hand, the information that can be made available includes the workpiece collecting point unit itself, its load, position, etc. that can, for example, be communicated optically and/or acoustically via the signal device.

[0107] If, for example, a specific workpiece cannot be associated with the position of the operator's hand in the case of small workpieces produced due to a lack of spatial resolution, several workpieces can be associated. If a workpiece is to be resolved, i.e., information on a workpiece is to be provided, the required resolution can be supported by other acquisition types such as cameras or scales. Furthermore, one can show to the operator (e.g., reduced) information for the plurality of workpieces and one can optionally allow him to select from the plurality of workpieces by an input.

[0108] The disclosed flatbed machine tool 3, the sorting system, and/or the method can also be used for workpieces 9 and/or shaped parts a, b, c with more than four corners and/or more than four edges.

[0109] It is explicitly stated that all features disclosed in the description and/or the claims are intended to be disclosed separately and independently from each other for the purpose of original disclosure as well as for the purpose of restricting the claimed invention independent of the composition of the features in the embodiments and/or the claims. It is explicitly stated that all value ranges or indications of groups of entities disclose every possible intermediate value or intermediate entity for the purpose of original disclosure as well as for the purpose of restricting the claimed invention, as limits of value ranges.

Other Embodiments

[0110] A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of the following claims.