Method of process monitoring in a machine
11755000 · 2023-09-12
Assignee
Inventors
Cpc classification
G05B2219/31479
PHYSICS
Y02P90/02
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
International classification
Abstract
A method is disclosed comprising retrieving captured process data comprising video and/or audio data capturing at least part of the execution of events in a machine, retrieving at least a first signal representing a measurable machine condition responsive to the events executed, wherein a first sequence of said machine control instructions is configured to trigger a respective first set of said events for execution thereof, determining first time stamps of the machine control instructions, aligning the first time stamps with second time stamps determined for at least one of; i) times of execution of said first set of events determined from the captured process data; ii) the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, displaying a representation of the first sequence of machine control instructions, associated with the first time stamps, together with an output representation said second time stamps.
Claims
1. A method of process monitoring in a food packaging machine being configured to execute a plurality of events, the events being associated with respective machine control instructions, the method comprising: retrieving captured process data comprising at least one of video or audio data capturing at least part of the execution of the events, retrieving at least a first signal representing operation of one or more components of the food packaging machine during production of one or more packaged food containers responsive to the events executed in a process being monitored, determining a first sequence of said machine control instructions configured to trigger a respective first set of said events, said machine control instructions, when executed by a controller of the food packaging machine, causing the one or more components of the food packaging machine to execute the events to produce the one or more packaged food containers, determining first time stamps of the machine control instructions in said first sequence in response to triggering respective events in said first set, with reference to a master clock, determining a chronological sequence of the first time stamps indicating times of execution of the first sequence of said machine control instructions and second time stamps determined with reference to said master clock for at least one of: times of execution of said first set of events determined from the captured process data, or the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, and displaying the chronological sequence for a synchronous monitoring of the first sequence of said machine control instructions and operation of the one or more components of the food packaging machine according to at least one of the master clock of the execution of said first set of events, determined from the captured process data, or of the first signal, wherein alignment of the first and second time stamps indicates correct operation of the one or more components of the food packaging machine to produce the one or more packaged food containers and misalignment of the first and second time stamps indicates an erroneous operation of the one or more components of the food packaging machine due to one or more errors in the first sequence of said machine control instructions, wherein detection of the erroneous operation of the one or more components of the food packaging machine due to one or more errors in the first sequence of said machine control instructions results in troubleshooting the machine control instructions and optimizing a control process of the food packaging machine.
2. The method according to claim 1, wherein the second time stamps are determined with reference to said master clock for: times of execution of said first set of events determined from the captured process data, and the first signal and associated measurable machine condition retrieved in response to execution of said first set of events.
3. The method according to claim 1, wherein the method comprises: receiving a user input to select a first machine control instruction, whereby an associated first time stamp determined for the execution of the first machine control instruction is aligned with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, and displaying an output representation of the captured process data of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
4. The method according to claim 1, wherein the method comprises: receiving a user input to select a first machine control instruction, whereby an associated first time stamp determined for the execution of the first machine control instruction is aligned with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, and displaying an output representation of the first signal as retrieved in response to execution of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
5. The method according to claim 3, comprising: receiving a sequence of said user input for a scrolling selection amongst the first sequence of machine control instructions, and displaying at least one of an output representation of said captured process data, or an output representation of said first signal, having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock.
6. A non-transitory storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the method according to claim 1.
7. A system for process monitoring in a food packaging machine being configured to execute a plurality of events, the events being associated with respective machine control instructions in a controller, the system comprising: a recorder configured to: retrieve captured process data comprising at least one of video or audio data capturing at least part of the execution of the events, and retrieve at least a first signal transmitted by a sensor and representing operation of one or more components of the food packaging machine during production of one or more packaged food containers responsive to the events executed in a process being monitored, a processor configured to communicate with the controller and further configured to: determine a first sequence of machine control instructions configured to trigger a respective first set of said events, said machine control instructions, when executed by the controller of the food packaging machine, causing the one or more components of the food packaging machine to execute the events to produce the one or more packaged food containers, determine first time stamps of the machine control instructions in said first sequence in response to triggering respective events in said first set, with reference to a master clock, and determine a chronological sequence of the first time stamps indicating times of execution of the first sequence of machine control instructions and second time stamps determined with reference to said master clock for at least one of: times of execution of said first set of events determined from the captured process data, or the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, and a display configured to display the chronological sequence for a synchronous monitoring of the first sequence of said machine control instructions and operation of the one or more components of the food packaging machine according to at least one of the master clock of the execution of said first set of events, determined from the captured process data, or of the first signal, wherein alignment of the first and second time stamps indicates correct operation of the one or more components of the food packaging machine to produce the one or more packaged food containers and misalignment of the first and second time stamps indicates an erroneous operation of the one or more components of the food packaging machine due to one or more errors in the first sequence of said machine control instructions, wherein detection of the erroneous operation of the one or more components of the food packaging machine due to one or more errors in the first sequence of said machine control instructions results in troubleshooting the machine control instructions and optimizing a control process of the food packaging machine.
8. The system according to claim 7, wherein the second time stamps are determined with reference to said master clock for: times of execution of said first set of events determined from the captured process data, and the first signal and associated measurable machine condition retrieved in response to execution of said first set of events.
9. The system according to claim 7, wherein the system further comprises: a user input device configured to receive a user input to select a first machine control instruction, wherein the processor is configured to align an associated first time stamp, determined for the execution of the first machine control instruction, with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, and wherein the display is configured to display an output representation of the captured process data of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
10. The system according to claim 9, wherein the user input device is configured to receive a sequence of said user input for a scrolling selection amongst the first sequence of machine control instructions, and wherein the display is configured to display an output representation of said captured process data, or an output representation of said first signal, having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock.
11. The system according to claim 7, wherein time separation between at least one of the first or second time stamps is in the range of 10 to 100 ms.
12. The system according to claim 7, wherein the measurable machine condition comprises at least one of a mechanical characteristic of the food packaging machine or an electrical characteristic of the food packaging machine.
13. The system according to claim 7, wherein the captured process data comprises video data of a movement of the one or more components of the food packaging machine in response to executing the plurality of the events.
14. A food packaging machine for packaging or filling comprising the system according to claim 7.
15. A food packaging machine for packaging or filling being configured to execute a plurality of events, the events being associated with respective machine control instructions in a controller, the food packaging machine comprising: a recorder configured to: retrieve captured process data comprising at least one of video or audio data capturing at least part of the execution of the events, and retrieve at least a first signal transmitted by a sensor and representing operation of one or more components of the food packaging machine during production of one or more packaged food containers responsive to the events executed in a process being monitored, a processor configured to communicate with the controller and being configured to: determine a first sequence of machine control instructions configured to trigger a respective first set of said events, said machine control instructions, when executed by the controller, causing the one or more components of the food packaging machine to execute the events to produce the one or more packaged food containers, determine first time stamps of the machine control instructions in said first sequence when triggering respective events in said first set, with reference to a master clock, and determine a chronological sequence of the first time stamps indicating times of execution of the first sequence of machine control instructions and second time stamps determined with reference to said master clock for at least one of: times of execution of said first set of events determined from the captured process data, or the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, and a display configured to display the chronological sequence for a synchronous monitoring of the first sequence of said machine control instructions and operation of the one or more components of the food packaging machine according to at least one of the master clock of the execution of said first set of events, determined from the captured process data, or of the first signal, wherein alignment of the first and second time stamps indicates correct operation of the one or more components of the food packaging machine to produce the one or more packaged food containers and misalignment of the first and second time stamps indicates an erroneous operation of the one or more components of the food packaging machine due to one or more errors in the first sequence of said machine control instructions, wherein detection of the erroneous operation of the one or more components of the food packaging machine due to one or more errors in the first sequence of said machine control instructions results in troubleshooting the machine control instructions and optimizing a control process of the food packaging machine.
16. The food packaging machine according to claim 15, wherein the second time stamps are determined with reference to said master clock for: times of execution of said first set of events determined from the captured process data, and the first signal and associated measurable machine condition retrieved in response to execution of said first set of events.
17. The food packaging machine according to claim 15, further comprising: a user input device configured to receive a user input to select a first machine control instruction, wherein the processor is configured to align an associated first time stamp, determined for the execution of the first machine control instruction, with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, and wherein the display is configured to display an output representation of the captured process data of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
18. The food packaging machine according to claim 17, wherein the user input device is configured to receive a sequence of said user input for a scrolling selection amongst the first sequence of machine control instructions, and wherein the display is configured to display an output representation of said captured process data, or an output representation of said first signal, having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock.
19. The food packaging machine according to claim 17, wherein the measurable machine condition comprises at least one of a mechanical characteristic of the food packaging machine or an electrical characteristic of the food packaging machine.
20. The food packaging machine according to claim 17, wherein the captured process data comprises video data of a movement of the one or more components of the food packaging machine in response to executing the plurality of the events.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) These and other aspects, features and advantages of which examples of the invention are capable of will be apparent and elucidated from the following description of examples of the present invention, reference being made to the accompanying drawings, in which;
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) Specific examples of the invention will now be described with reference to the accompanying drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these examples are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. The terminology used in the detailed description of the examples illustrated in the accompanying drawings is not intended to be limiting of the invention. In the drawings, like numbers refer to like elements.
(8)
(9) It is thus possible to accurately trace any erroneous behavior in the machine resulting from the control algorithm sequence. This facilitates and improves the trouble shooting of the machine control algorithm to an extent which has not been possible with previous techniques. I.e. taking into account the control instructions, i.e. the input to the machine as explained above, and not only output sensor data, provides for a significantly improvement in terms of optimizing the control process. The accuracy and timing of the set of events (E) executed in the machine can accordingly be accurately evaluated for the input sequence (C) of machine control instructions due to the synchronous tracing of the aligned first (T.sub.C1, T.sub.C2, . . . , T.sub.Cx) and second time stamps (T.sub.e1, T.sub.e2, . . . , T.sub.ex), as explained above. This facilitates monitoring of filling and packaging machines 300 operating at high speeds, where accurate timing of a multitude of interrelated machine functions is of outmost importance.
(10) Alternatively, or in addition, the first signal (s.sub.1) may be synchronously traced as the user moves incrementally through the sequence (C) of machine control instructions. E.g. selecting the second control instruction c.sub.2, and associated first time stamp T.sub.c2, as highlighted in
(11)
(12)
(13) The representation, displayed in step 105, may hence comprise a visual control representation (VC) of the set (C) of machine control instructions. The method 100 may comprise receiving 106 a user input to select a first machine control instruction c.sub.1 in the visual control representation (VC), whereby an associated first time stamp T.sub.C1 determined for the execution of the first machine control instruction c.sub.1 is aligned with a second time stamp T.sub.e1 determined with reference to the master clock (T) for a first event e.sub.1 triggered by the first machine control instruction c.sub.1. The method 100 may comprise displaying 107 an output representation of the captured process data (p) of the first event e.sub.1 at a time defined by the second time stamp T.sub.e1 as the user input to select the first machine control instruction c.sub.1 is received. This has been exemplified above, with reference to the highlighted part 206 in
(14) Thus, when e.g. c2 is chosen in the sequence (C), the video (p) moves to a point in time defined by Te2, showing the related position of the cart 302 as the associated second event e2 is executed.
(15) The method 100 may comprise receiving 106′ a user input to select a first machine control instruction c.sub.1 in the visual control representation, whereby an associated first time stamp T.sub.C1 determined for the execution of the first machine control instruction c.sub.1 is aligned with a second time stamp T.sub.e1 determined with reference to the master clock (T) for a first event e.sub.1 triggered by the first machine control instruction c.sub.1. The method 100 may comprise displaying 107′ an output representation of the first signal (s.sub.1) as retrieved in response to execution of the first event e.sub.1 at a time defined by the second time stamp T.sub.e1 as the user input to select the first machine control instruction c.sub.1 is received. I.e. as also indicated by highlighted part 206 in
(16) The method 100 may comprise receiving 106″ a sequence of the user input for a scrolling selection amongst the first sequence (C) of machine control instructions in the visual control representation (VC). For each selection of a machine control instruction and an associated first time stamp, the method 100 may comprise displaying 107″ an output representation of the captured process data (p), and/or of said first signal (s.sub.1), having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock (T). Thus, the user may move backward and forward in time, amongst the time stamps (T.sub.C1, T.sub.C2, . . . , T.sub.Cx) determined for the sequence (C), while simultaneously monitoring the corresponding or resulting status of the machine 300 in the captured video data (p) or in the first signal (s.sub.1). A facilitated monitoring in rapid events executed in the machine 300 is thus provided as well as improved evaluation of control instructions in the machine 300 for facilitating optimization of the executed process.
(17) A computer program product is provided comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method 100 as described above in relation to
(18) The system 200 may be configured to execute the method 100 as described above with reference to
(19) The mentioned representation may comprise a visual control representation (VC) of the set (C) of machine control instructions. The system 200 may comprise a user input device 205 configured to receive a user input to select a first machine control instruction (c.sub.1) in the visual control representation (VC). The processing unit 203 may be configured to align an associated first time stamp T.sub.C1, determined for the execution of the first machine control instruction c.sub.1, with a second time stamp T.sub.e1 determined with reference to the master clock (T) for a first event e.sub.1 triggered by the first machine control instruction c.sub.1. The display 204 may be configured to display an output representation of the captured process data (p) of the first event at a time defined by the second time stamp T.sub.e1 as the user input to select the first machine control instruction c.sub.1 is received.
(20) The user input device 205 may be configured to receive a sequence of the user input for a scrolling selection amongst the first sequence (C) of machine control instructions in the visual control representation (VC). For each selection of a machine control instruction and an associated first time stamp. The display 204 may be configured to display an output representation of the captured process data (p), and/or of the first signal (s.sub.1), having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock (T).
(21) The time separation between the time stamps may be in the range of 10-100 ms. Thus, high-speed processes in the machine 300 may be resolved with sufficient accuracy. The short time separation of the time stamps (T.sub.C1, T.sub.C2, . . . , T.sub.Cx), (T.sub.e1, T.sub.e2, . . . , T.sub.ex), together with the synchronous monitoring realized by the method 100 and system 200 as described above provides for a facilitated optimization of such processes at significantly shorter time scales than what have been possible before.
(22) The measurable machine condition, represented by the first signal s.sub.1 in the examples above, may comprise a mechanical characteristic of the machine 300 and/or an electrical characteristic of the machine 300. The captured process data (p) may comprise video data of a movement of the machine 300 when executing the plurality of the events.
(23) A packaging- or filling machine 300 is provided comprising a system 200 as described above in relation to
(24) Thus, a packaging- or filling machine 300 is provided, being configured to execute a plurality of events (e.sub.1, e.sub.2, . . . , e.sub.x), where the events are associated with respective machine control instructions (c.sub.1, c.sub.2, . . . , c.sub.x) in a controller 301. The packaging- or filling machine 300 comprises a system 200 for process monitoring thereof. The system 200 comprises a recording device 201 configured to retrieve 101 captured process data (p) comprising video and/or audio data capturing at least part of the execution of the events, and configured to retrieve 102 at least a first signal (s.sub.1) transmitted by a sensor 202 and representing a measurable machine condition responsive to the events executed in the process being monitored. A first sequence (C) of the machine control instructions is configured to trigger a respective first set (E) of said events for execution thereof. The system 200 comprises a processing unit 203 configured to communicate with the controller 301 and being configured to determine 103 first time stamps (T.sub.C1, T.sub.C2, . . . , T.sub.Cx) of the machine control instructions in the sequence (C) when triggering respective events in the first set (E), with reference to a master clock. The processing unit 203 is configured to align 104 the first time stamps with second time stamps (T.sub.e1, T.sub.e2, . . . , T.sub.ex) determined with reference to the master clock (T) for at least one of; i) times of execution of the first set (E) of events determined from the captured process data (p); ii) the first signal (s.sub.1) and associated measurable machine condition retrieved in response to execution of the first set (E) of events. The system 200 comprises a display 204 configured to display 105 a representation of the first sequence (C) of machine control instructions, associated with the first time stamps, together with an output representation of the second time stamps for a synchronous monitoring according to the master clock of the execution of the first set (E) of events, determined from the captured process data (p), and/or of the first signal (s.sub.1).
(25) The present invention has been described above with reference to specific examples. However, other examples than the above described are equally possible within the scope of the invention. The different features and steps of the invention may be combined in other combinations than those described. The scope of the invention is only limited by the appended patent claims.
(26) More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the teachings of the present invention is/are used.