METHOD OF PROCESS MONITORING IN A MACHINE
20210191370 · 2021-06-24
Inventors
Cpc classification
G05B2219/31479
PHYSICS
Y02P90/02
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
International classification
Abstract
A method is disclosed comprising retrieving captured process data comprising video and/or audio data capturing at least part of the execution of events in a machine, retrieving at least a first signal representing a measurable machine condition responsive to the events executed, wherein a first sequence of said machine control instructions is configured to trigger a respective first set of said events for execution thereof, determining first time stamps of the machine control instructions, aligning the first time stamps with second time stamps determined for at least one of; i) times of execution of said first set of events determined from the captured process data; ii) the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, displaying a representation of the first sequence of machine control instructions, associated with the first time stamps, together with an output representation said second time stamps.
Claims
1. A method of process monitoring in a machine being configured to execute a plurality of events, the events being associated with respective machine control instructions, the method comprising: retrieving captured process data comprising at least one of video or audio data capturing at least part of the execution of the events, retrieving at least a first signal representing a measurable machine condition responsive to the events executed in the process being monitored, wherein a first sequence of said machine control instructions is configured to trigger a respective first set of said events for execution thereof, determining first time stamps of the machine control instructions in said sequence in response to triggering respective events in said first set, with reference to a master clock, aligning the first time stamps with second time stamps determined with reference to said master clock for at least one of: times of execution of said first set of events determined from the captured process data, or the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, and displaying a representation of the first sequence of machine control instructions, associated with the first time stamps, together with an output representation of said second time stamps for a synchronous monitoring according to at least one of the master clock of the execution of said first set of events, determined from the captured process data, or of the first signal.
2. The method according to claim 1, further comprising: aligning the first time stamps with the second time stamps determined with reference to said master clock for: times of execution of said first set of events determined from the captured process data, and the first signal and associated measurable machine condition retrieved in response to execution of said first set of events.
3. The method according to claim 1, wherein said representation comprises a visual control representation of the set of machine control instructions, wherein the method comprises: receiving a user input to select a first machine control instruction in the visual control representation, whereby an associated first time stamp determined for the execution of the first machine control instruction is aligned with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, and displaying an output representation of the captured process data of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
4. The method according to claim 1, wherein said representation comprises a visual control representation of the set of machine control instructions, wherein the method comprises: receiving a user input to select a first machine control instruction in the visual control representation, whereby an associated first time stamp determined for the execution of the first machine control instruction is aligned with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, and displaying an output representation of the first signal as retrieved in response to execution of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
5. The method according to claim 3, comprising: receiving a sequence of said user input for a scrolling selection amongst the first sequence of machine control instructions in the visual control representation, whereby for each selection of a machine control instruction and an associated first time stamp, and displaying at least one of an output representation of said captured process data, or an output representation of said first signal, having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock.
6. A non-transitory storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the method according to claim 1.
7. A system for process monitoring in a machine being configured to execute a plurality of events, the events being associated with respective machine control instructions in a controller, the system comprising: a recorder configured to: retrieve captured process data comprising at least one of video or audio data capturing at least part of the execution of the events, and retrieve at least a first signal transmitted by a sensor and representing a measurable machine condition responsive to the events executed in the process being monitored, wherein a first sequence of said machine control instructions is configured to trigger a respective first set of said events for execution thereof, a processor configured to communicate with the controller and further configured to: determine first time stamps of the machine control instructions in said sequence in response to triggering respective events in said first set, with reference to a master clock, and align the first time stamps with second time stamps determined with reference to said master clock for at least one of: times of execution of said first set of events determined from the captured process data, or the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, and a display configured to display a representation of the first sequence of machine control instructions, associated with the first time stamps, together with an output representation of said second time stamps for a synchronous monitoring according to at least one of the master clock of the execution of said first set of events, determined from the captured process data, or of the first signal.
8. The system according to claim 7, wherein the processor is configured to align the first time stamps with the second time stamps determined with reference to said master clock for: times of execution of said first set of events determined from the captured process data, and the first signal and associated measurable machine condition retrieved in response to execution of said first set of events.
9. The system according to claim 7, wherein said representation comprises a visual control representation of the set of machine control instructions, the system further comprising: a user input device configured to receive a user input to select a first machine control instruction in the visual control representation, wherein the processor is configured to align an associated first time stamp, determined for the execution of the first machine control instruction, with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, wherein the display is configured to display an output representation of the captured process data of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
10. The system according to claim 9, wherein the user input device is configured to receive a sequence of said user input for a scrolling selection amongst the first sequence of machine control instructions in the visual control representation, whereby for each selection of a machine control instruction and an associated first time stamp, the display is configured to display an output representation of said captured process data, or an output representation of said first signal, having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock.
11. The system according to claim 7, wherein time separation between at least one of the first or second time stamps is in the range of 10 to 100 ms.
12. The system according to claim 7, wherein the measurable machine condition comprises at least one of a mechanical characteristic of the machine or an electrical characteristic of the machine.
13. The system according to claim 7, wherein the captured process data comprises video data of a movement of the machine in response to executing the plurality of the events.
14. A machine for packaging or filling comprising the system according to claim 7.
15. A machine for packaging or filling being configured to execute a plurality of events, the events being associated with respective machine control instructions in a controller, the machine comprises a system for process monitoring thereof, the system comprising: a recorder configured to: retrieve captured process data comprising at least one of video or audio data capturing at least part of the execution of the events, retrieve at least a first signal transmitted by a sensor and representing a measurable machine condition responsive to the events executed in the process being monitored, wherein a first sequence of said machine control instructions is configured to trigger a respective first set of said events for execution thereof, a processor configured to communicate with the controller and being configured to: determine first time stamps of the machine control instructions in said sequence when triggering respective events in said first set, with reference to a master clock, and align the first time stamps with second time stamps determined with reference to said master clock for at least one of; times of execution of said first set of events determined from the captured process data, or the first signal and associated measurable machine condition retrieved in response to execution of said first set of events, and a display configured to display a representation of the first sequence of machine control instructions, associated with the first time stamps, together with an output representation of said second time stamps for a synchronous monitoring according to at least one of the master clock of the execution of said first set of events, determined from the captured process data, or of the first signal.
16. The machine according to claim 15, wherein the processor is configured to align the first time stamps with the second time stamps determined with reference to said master clock for: times of execution of said first set of events determined from the captured process data, and the first signal and associated measurable machine condition retrieved in response to execution of said first set of events.
17. The machine according to claim 15, wherein said representation comprises a visual control representation of the set of machine control instructions, the system further comprising: a user input device configured to receive a user input to select a first machine control instruction in the visual control representation, wherein the processor is configured to align an associated first time stamp, determined for the execution of the first machine control instruction, with a second time stamp determined with reference to said master clock for a first event triggered by the first machine control instruction, wherein the display is configured to display an output representation of the captured process data of the first event at a time defined by the second time stamp as the user input to select the first machine control instruction is received.
18. The machine according to claim 17, wherein the user input device is configured to receive a sequence of said user input for a scrolling selection amongst the first sequence of machine control instructions in the visual control representation, whereby for each selection of a machine control instruction and an associated first time stamp, the display is configured to display an output representation of said captured process data, or an output representation of said first signal, having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock.
19. The machine according to claim 17, wherein the measurable machine condition comprises at least one of a mechanical characteristic of the machine or an electrical characteristic of the machine.
20. The machine according to claim 17, wherein the captured process data comprises video data of a movement of the machine in response to executing the plurality of the events.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] These and other aspects, features and advantages of which examples of the invention are capable of will be apparent and elucidated from the following description of examples of the present invention, reference being made to the accompanying drawings, in which;
[0020]
[0021]
[0022]
[0023]
[0024]
DETAILED DESCRIPTION
[0025] Specific examples of the invention will now be described with reference to the accompanying drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these examples are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. The terminology used in the detailed description of the examples illustrated in the accompanying drawings is not intended to be limiting of the invention. In the drawings, like numbers refer to like elements.
[0026]
[0027] Alternatively, or in addition, the first signal (s.sub.1) may be synchronously traced as the user moves incrementally through the sequence (C) of machine control instructions. E.g. selecting the second control instruction c.sub.2, and associated first time stamp T.sub.c2, as highlighted in
[0028]
[0029]
[0030] The representation, displayed in step 105, may hence comprise a visual control representation (VC) of the set (C) of machine control instructions. The method 100 may comprise receiving 106 a user input to select a first machine control instruction c.sub.1 in the visual control representation (VC), whereby an associated first time stamp T.sub.C1 determined for the execution of the first machine control instruction c.sub.1 is aligned with a second time stamp T.sub.e1 determined with reference to the master clock (T) for a first event e.sub.1 triggered by the first machine control instruction c.sub.1. The method 100 may comprise displaying 107 an output representation of the captured process data (p) of the first event e.sub.1 at a time defined by the second time stamp T.sub.e1 as the user input to select the first machine control instruction c.sub.1 is received. This has been exemplified above, with reference to the highlighted part 206 in
[0031] The method 100 may comprise receiving 106′ a user input to select a first machine control instruction c.sub.1 in the visual control representation, whereby an associated first time stamp T.sub.C1 determined for the execution of the first machine control instruction c.sub.1 is aligned with a second time stamp T.sub.e1 determined with reference to the master clock (T) for a first event e.sub.1 triggered by the first machine control instruction c.sub.1. The method 100 may comprise displaying 107′ an output representation of the first signal (s.sub.1) as retrieved in response to execution of the first event e.sub.1 at a time defined by the second time stamp T.sub.e1 as the user input to select the first machine control instruction c.sub.1 is received. I.e. as also indicated by highlighted part 206 in
[0032] The method 100 may comprise receiving 106″ a sequence of the user input for a scrolling selection amongst the first sequence (C) of machine control instructions in the visual control representation (VC). For each selection of a machine control instruction and an associated first time stamp, the method 100 may comprise displaying 107″ an output representation of the captured process data (p), and/or of said first signal (s.sub.1), having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock (T). Thus, the user may move backward and forward in time, amongst the time stamps (T.sub.C1, T.sub.C2, . . . , T.sub.Cx) determined for the sequence (C), while simultaneously monitoring the corresponding or resulting status of the machine 300 in the captured video data (p) or in the first signal (s.sub.1). A facilitated monitoring in rapid events executed in the machine 300 is thus provided as well as improved evaluation of control instructions in the machine 300 for facilitating optimization of the executed process.
[0033] A computer program product is provided comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the method 100 as described above in relation to
[0034] The system 200 may be configured to execute the method 100 as described above with reference to
[0035] The mentioned representation may comprise a visual control representation (VC) of the set (C) of machine control instructions. The system 200 may comprise a user input device 205 configured to receive a user input to select a first machine control instruction (c.sub.1) in the visual control representation (VC). The processing unit 203 may be configured to align an associated first time stamp T.sub.C1, determined for the execution of the first machine control instruction c.sub.1, with a second time stamp T.sub.e1 determined with reference to the master clock (T) for a first event e.sub.1 triggered by the first machine control instruction c.sub.1. The display 204 may be configured to display an output representation of the captured process data (p) of the first event at a time defined by the second time stamp T.sub.e1 as the user input to select the first machine control instruction c.sub.1 is received.
[0036] The user input device 205 may be configured to receive a sequence of the user input for a scrolling selection amongst the first sequence (C) of machine control instructions in the visual control representation (VC). For each selection of a machine control instruction and an associated first time stamp. The display 204 may be configured to display an output representation of the captured process data (p), and/or of the first signal (s.sub.1), having an associated second time stamp, synchronously with the scrolling selection with reference to the master clock (T).
[0037] The time separation between the time stamps may be in the range of 10-100 ms. Thus, high-speed processes in the machine 300 may be resolved with sufficient accuracy. The short time separation of the time stamps (T.sub.C1, T.sub.C2, . . . , T.sub.Cx), (T.sub.e1, T.sub.e2, . . . , T.sub.ex), together with the synchronous monitoring realized by the method 100 and system 200 as described above provides for a facilitated optimization of such processes at significantly shorter time scales than what have been possible before.
[0038] The measurable machine condition, represented by the first signal s.sub.1 in the examples above, may comprise a mechanical characteristic of the machine 300 and/or an electrical characteristic of the machine 300. The captured process data (p) may comprise video data of a movement of the machine 300 when executing the plurality of the events.
[0039] A packaging- or filling machine 300 is provided comprising a system 200 as described above in relation to
[0040] Thus, a packaging- or filling machine 300 is provided, being configured to execute a plurality of events (e.sub.1, e.sub.2, . . . , e.sub.x), where the events are associated with respective machine control instructions (c.sub.1, c.sub.2, . . . , c.sub.x) in a controller 301. The packaging- or filling machine 300 comprises a system 200 for process monitoring thereof. The system 200 comprises a recording device 201 configured to retrieve 101 captured process data (p) comprising video and/or audio data capturing at least part of the execution of the events, and configured to retrieve 102 at least a first signal (s.sub.1) transmitted by a sensor 202 and representing a measurable machine condition responsive to the events executed in the process being monitored. A first sequence (C) of the machine control instructions is configured to trigger a respective first set (E) of said events for execution thereof. The system 200 comprises a processing unit 203 configured to communicate with the controller 301 and being configured to determine 103 first time stamps (T.sub.C1, T.sub.C2, . . . , T.sub.Cx) of the machine control instructions in the sequence (C) when triggering respective events in the first set (E), with reference to a master clock. The processing unit 203 is configured to align 104 the first time stamps with second time stamps (T.sub.e1, T.sub.e2, . . . , T.sub.ex) determined with reference to the master clock (T) for at least one of; i) times of execution of the first set (E) of events determined from the captured process data (p); ii) the first signal (s.sub.1) and associated measurable machine condition retrieved in response to execution of the first set (E) of events. The system 200 comprises a display 204 configured to display 105 a representation of the first sequence (C) of machine control instructions, associated with the first time stamps, together with an output representation of the second time stamps for a synchronous monitoring according to the master clock of the execution of the first set (E) of events, determined from the captured process data (p), and/or of the first signal (s.sub.1).
[0041] The present invention has been described above with reference to specific examples. However, other examples than the above described are equally possible within the scope of the invention. The different features and steps of the invention may be combined in other combinations than those described. The scope of the invention is only limited by the appended patent claims.
[0042] More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the teachings of the present invention is/are used.