DEVICE, SYSTEM AND METHOD FOR DETECTION AND MONITORING OF DYSPHAGIA OF A SUBJECT

Abstract

The present invention relates to a device, system and method for automatic detection and progression monitoring of dysphagia of a subject, in particular after stroke. The device comprises a signal input for obtaining a mastication signal indicating mastication of the subject, an audio signal representing sounds generated by the subject and a swallowing signal indicating swallowing of the subject, a signal processor for detecting mastication abnormalities from said mastication signal, mastication-to-swallow abnormalities from said mastication signal and said swallowing signal, and aspiration episodes from said audio signal and said swallowing signal, a dysphagia detector for detecting onset and/or progression of dysphagia from detected mastication abnormalities, mastication-to-swallow abnormalities and aspiration episodes and for generating a dysphagia signal indicating information regarding dysphagia of the subject, and a signal output for outputting said dysphagia signal.

Claims

1. Device for detection and monitoring of dysphagia of a subject, said device comprising: a signal input for obtaining a mastication signal indicating mastication of the subject, an audio signal representing sounds generated by the subject and a swallowing signal indicating swallowing of the subject, a signal processor for detecting mastication abnormalities from said mastication signal, mastication-to-swallow abnormalities from said mastication signal and said swallowing signal, and aspiration episodes from said audio signal and said swallowing signal, a dysphagia detector for detecting onset and/or progression of dysphagia from detected mastication abnormalities, mastication-to-swallow abnormalities and aspiration episodes and for generating a dysphagia signal indicating information regarding dysphagia of the subject, and a signal output for outputting said dysphagia signal.

2. Device as claimed in claim 1, wherein said signal processor is configured to detect an aspiration episode by detecting if a swallow event is followed by one or more cough events.

3. Device as claimed in claim 1, wherein said signal processor is configured to detect mastication abnormalities from said mastication signal and said audio signal in order to distinguish mastication activity from speaking activity.

4. Device as claimed in claim 1, wherein said signal processor is configured to detect abnormalities regarding mastication duration as mastication abnormalities.

5. Device as claimed in claim 3, wherein said signal processor is configured to detect abnormalities regarding mastication duration by comparing a detected mastication duration with a mastication duration threshold.

6. Device as claimed in claim 1, wherein said signal processor is configured to detect abnormalities regarding mastication-to-swallow duration from the beginning of a mastication activity to a swallow event as mastication-to-swallow abnormalities, in particular by comparing a detected mastication-to-swallow duration with a mastication-to-swallow threshold.

7. Device as claimed in claim 2, wherein said signal processor is configured to detect a cough event from said audio signal and/or a movement signal representing movement of the subject's larynx, chest wall or abdominal wall.

8. Device as claimed in claim 2, wherein said signal processor is configured to detect the aspiration episode by detecting a swallow-to-cough duration from a swallow event to a cough event and/or by detecting the number of cough events following a swallow event within a predetermined time period.

9. Device as claimed in claim 8, wherein said signal processor is configured to detect the aspiration episode by comparing the detected swallow-to-cough duration to a swallow-to-cough duration threshold and/or by comparing the detected number of cough events to a cough events threshold.

10. Device as claimed in claim 1, wherein said dysphagia detector is configured to detect onset of dysphagia if a mastication abnormality, a mastication-to-swallow abnormality and/or one or more aspiration episodes are detected and/or to detect as progression of dysphagia the number and/or rate of mastication abnormalities, mastication-to-swallow abnormalities and/or aspiration episodes.

11. System for detection and monitoring of dysphagia of a subject, said system comprising: a mastication signal sensor for acquiring a mastication signal indicating mastication of the subject, an audio signal sensor for acquiring an audio signal representing sounds generated by the subject, a swallowing signal sensor for acquiring a swallowing signal indicating swallowing of the subject, and a device as defined in claim 1, for detection and monitoring of dysphagia of the subject from the acquired mastication signal, swallowing signal and audio signal.

12. System as claimed in claim 11, wherein said mastication signal sensor comprises an electromyography sensor and/or a motion sensor for arrangement at the subject's jaw area, wherein said audio signal sensor comprises a microphone, in particular a contact microphone and/or an acoustic microphone, for arrangement at or a close to the subject, and/or wherein said swallowing signal sensor comprises a laryngeal sensor for arrangement at the subject's throat, in particular in the area of the subject's larynx.

13. System as claimed in claim 11, further comprising a camera for acquiring video data of the subject, wherein said mastication signal sensor is configured to acquire said mastication signal from said video data and/or said swallowing signal sensor is configured to acquire said swallowing signal from said video data.

14. Method for detection and monitoring of dysphagia of a subject, said method comprising: obtaining a mastication signal indicating mastication of the subject, an audio signal representing sounds generated by the subject and a swallowing signal indicating swallowing of the subject, detecting mastication abnormalities from said mastication signal, mastication-to-swallow abnormalities from said mastication signal and said swallowing signal, and aspiration episodes from said audio signal and said swallowing signal, detecting onset and/or progression of dysphagia from detected mastication abnormalities, mastication-to-swallow abnormalities and aspiration episodes, generating a dysphagia signal indicating information regarding dysphagia of the subject, and outputting said dysphagia signal.

15. Method as claimed in claim 14, further comprising detecting an aspiration episode by detecting if a swallow event is followed by one or more cough events.

16. Method as claimed in claim 14, further comprising detecting mastication abnormalities from said mastication signal and said audio signal in order to distinguish mastication activity from speaking activity.

17. Computer program product comprising a computer readable medium having computer readable code embodied therein, the computer readable code being configured such that, on execution by a suitable computer or processor, the computer or processor is caused to perform the steps of the method of claim 14.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0031] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. In the following drawings

[0032] FIG. 1 shows a schematic diagram of a first embodiment of a system and a device according to the present invention,

[0033] FIG. 2 shows an illustration of the mounting of various sensors at the subject's head,

[0034] FIG. 3 shows a schematic diagram of a second embodiment of a system and a device according to the present invention,

[0035] FIG. 4 shows a graph of an exemplary mastication signal,

[0036] FIG. 5 shows a graph of an exemplary swallowing signal, and

[0037] FIG. 6 shows graphs of an exemplary motion signal and exemplary audio signals.

DETAILED DESCRIPTION OF THE INVENTION

[0038] FIG. 1 shows a schematic diagram of a first embodiment of a system 1 and a device 30 according to the present invention for detection and monitoring of dysphagia of a subject, such as a patient in a hospital or in home care. The system 1 comprises various types of sensors including a mastication signal sensor 10 for acquiring a mastication signal 20 indicating mastication of the subject, an audio signal sensor 11 for acquiring an audio signal 21 representing sounds generated by the subject, and a swallowing signal sensor 12 for acquiring a swallowing signal 22 indicating swallowing of the subject. The system 1 further comprises a device 30 for detection and monitoring of dysphagia of the subject from the acquired mastication signal 20, swallowing signal 21 and audio signal 22.

[0039] FIG. 2 shows an illustration of an exemplary mounting of an exemplary set of various types of sensors at the subject's head.

[0040] The mastication signal sensor 10 may e.g. comprise an electromyography (EMG) sensor 50 and/or a motion sensor 51 (e.g. an accelerometer) that is arranged at the subject's jaw area. For instance, the EMG sensor 50 may be placed on the subject's jaw. Alternatively or additionally, the motion sensor 51 can be used, e.g. placed behind the subject's jaw or under the subject's ear.

[0041] The audio signal sensor 11 may comprise a microphone 52, in particular a contact microphone and/or an acoustic microphone, that is arranged at or a close to the subject, e.g. at the subject's throat or cheek.

[0042] The swallowing signal sensor 12 may comprise a laryngeal sensor 53 that is arranged at the subject's larynx, more precisely at the subject's throat in the area of the subject's larynx.

[0043] The device 30 may be implemented in hard- and/or software, e.g. as application program (app) running on a user device, such as a smartphone, tablet, wearable sports activity monitor, laptop, etc., or on a computer or workstation, e.g. in a hospital or care center.

[0044] The device 30 comprises a signal input 31, e.g. a data interface, for obtaining, i.e. retrieving (e.g. downloading) or receiving, the above mentioned various signals from the various sensors 10-12 (50-53 in the embodiment shown in FIG. 2). The signals may be obtained wirelessly, e.g. using a communication network such as Bluetooth or WiFi, or in a wired manner by use of cabling. There may also be a central transmitter (not shown) provided at the subject's body that collects the signals from the various sensors and then sends them to the device or provides them for retrieval by the device 30.

[0045] The device 30 further comprises a signal processor 32 for detecting mastication abnormalities 40 from said mastication signal 20, mastication-to-swallow abnormalities 41 from said mastication signal 20 and said swallowing signal 22, and aspiration episodes 42 from said audio signal 21 and said swallowing signal 22.

[0046] The device 30 further comprises a dysphagia detector 33 for detecting onset and/or progression of dysphagia from detected mastication abnormalities 40, mastication-to-swallow abnormalities 41 and aspiration episodes 42 and for generating a dysphagia signal 43 indicating detected onset and/or progression of dysphagia of the subject. The signal processor 32 and the dysphagia detector 33 may be commonly implemented by a processor or computer.

[0047] The device 30 further comprises a signal output 34 for outputting said dysphagia signal 43 indicating information regarding dysphagia of the subject. The signal output 34 may include a display, such as the display of user device or computer, for issuing the determined dysphagia signal 43 directly for information of and/or use by the user. Alternatively or additionally, the signal output may include a transmission unit, such as a WiFi interface, LAN interface or Bluetooth interface, for transmitting the determined dysphagia signal 43 to a third entity, e.g. a remote user device (e.g. a smartphone or tablet) of a doctor, caregiver or nurse, or a central computer or database of a hospital.

[0048] In a preferred embodiment the system 1 may further comprise a movement sensor 13, such as an accelerometer, for acquiring a movement signal 23 representing movement of the subject's larynx, chest wall or abdominal wall. For this purpose the movement sensor 13 is preferably mounted at the respective body part of the subject. The movement signal 23 is preferably used in the detection of a cough event, optionally together with the audio signal 21, by the signal processor 32.

[0049] FIG. 3 shows a schematic diagram of a second embodiment of a system 2 and a device 30 according to the present invention. In this embodiment a camera 60 is provided for acquiring video data 70 of the subject. Said video data 70 is used by the mastication signal sensor 10 to acquire said mastication signal 20 and/or by the swallowing signal sensor 12 to acquire said swallowing signal 22. For this purpose image processing means are preferably used to identify mastication and/or swallowing, optionally after segmentation of the respective body part used for said identification. Hence, if the video data 70 are used for obtaining the respective signals 10 and/or 12, a corresponding contact sensor (as e.g. illustrated in FIG. 2) for acquiring the respective signals, may be omitted. In another embodiment both sources for the same signal may be used (e.g. combined through averaging) to increase accuracy and reliability.

[0050] Using the above described systems and methods particularly onset of dysphagia can be detected and progression of dysphagia can be monitored. Exemplary implementations and options will be explained in the following:

[0051] For detecting onset of dysphagia (e.g. by an onset detection component), the following may be detected by automatic detection: [0052] if the mastication duration (MD) is higher than commonly known thresholds; said interval expresses patient difficulty to processing food; [0053] if the mastication-to-swallow interval (MSI) higher than predetermined (e.g. commonly known) thresholds; said interval expresses patient difficulty to both processing food and activating swallow reflex leading to prolonged mastication activity followed by a delayed swallow event; [0054] of aspiration episodes, which may be done by detecting coughing events before, during and/or after swallowing events and, optionally, detecting hoarse voice.

[0055] Onset of dysphagia may thus e.g. be determined by one or more of an abnormally high MD over more than one meal, an imbalanced MSI over more than one meal, and more than one aspiration episode.

[0056] For monitoring progression of dysphagia (e.g. by a progression monitoring component), trends over time of MSI index and/or of an incidence rate of aspiration episodes may be monitored. Significant decreases or increases in either or both parameters may be used as indicators for worsening or improvement of the subject's progression of dysphagia.

[0057] The system may further provide recommendations (e.g. by an intervention component or the signal output) on how to manage dysphagia by means of personalized interventions regarding frequency, quantity of meals, consistency of food, and consistency of liquids, posturing during eating, chewing & swallowing exercises, support cutlery for eating, special cup for drinking, etc. Further, a closed loop assessment of interventions' effectiveness based on dysphagia monitoring and assessment after interventions may be implemented. Still further, an automatic alarm may be generated and issued, said alarm triggering a caregiver as soon as an ongoing aspiration episode has been detected.

[0058] The dysphagia onset detection and dysphagia progression monitoring may use the following automatic functionality: [0059] i) MSI automatic detection based on the components [0060] i1) mastication activity detection; [0061] i2) swallow events detection; [0062] i3) detection of abnormal MD; [0063] i4) detection of imbalanced MSI. [0064] ii) Aspiration episodes detection based on the components: [0065] ii1) cough events detection; [0066] ii2) swallow events detection (like i2); and [0067] ii3) detection of correlation of cough events with swallow events.

[0068] Exemplary embodiments for implementing each of the above mentioned functionalities i) and ii) and their components will be explained in the following:

[0069] Mastication activity detection (i1) may use an EMG sensor placed on patient jaw (alternatively a motion sensor can be used, placed behind patient jaw or under ear) and/or a miniature microphone. In the signal from the EMG sensor (or the motion sensor), i.e. a mastication signal 80 as shown as an example in FIG. 4, a mastication pattern is recognized as a sequence of peaks in the signal amplitude significantly higher than during previous inactive periods and similar duration. In the mastication signal 80 shown in FIG. 4 mastication activity patterns 81, 83 (having a duration 84) are interspersed with inactive periods 82 (at which the mastication muscles are at rest). As can be seen, the amplitude of the mastication signal 80 during mastication (periods 81, 83) is significantly higher than during inactive periods 82.

[0070] To ensure robust differentiation from speaking activity, which involves voice activation as well, the audio signal 22, e.g. from a microphone that recognizes patient voice in foreground sound, may be evaluated.

[0071] Swallow events detection (i2; ii2) may use a laryngeal sensor placed on the patient's larynx. A swallowing pattern may be recognized in a swallowing signal 90, as shown as an example in FIG. 5, as succession of high and low peak in the signal amplitude.

[0072] Detection of abnormal MD (i3) may be achieved by detecting when the mastication duration consistently significantly exceeds a mastication duration threshold, such as a common threshold (e.g. 5 seconds, or more generally a value in the range of 1-10 seconds, preferably 5-10 seconds).

[0073] Detection of imbalanced MSI (i4) may be achieved by detecting when the duration from the beginning of the mastication activity pattern followed by a swallow event consistently significantly exceeds a mastication-to-swallow threshold, such as common threshold (e.g. 5 seconds, or more generally a value in the range of 1-10 seconds, preferably 5-10 seconds).

[0074] Cough events detection (ii1) may use one or more of an accelerometer, a contact microphone and an acoustic microphone. An accelerometer signal 100, a contact microphone signal 101 and an acoustic microphone signal 102 are shown in FIG. 6. A coughing event pattern of cough events 104 in periods 103 is clearly present in all three signals 100, 101, 102 as a succession of peaks of significantly higher amplitude than during inactive periods.

[0075] Detection of correlation of cough events with swallow events (ii3) may detect if a swallow event revealed in the laryngeal sensor signal is immediately followed by repeated cough events detected in one of the accelerometer/contact/audio microphone sensor signal. This allows detection if an aspiration event is in progression.

[0076] In summary, the present invention provides a device, system and method that enable the detection of the onset of dysphagia as well as the monitoring of its progression, e.g. in the context of the home. Further, recommendations for personalized interventions tailored according to the subject (e.g. patient) up to date condition may be generated and issued.

[0077] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.

[0078] A processor, such as the signal processor, a processing unit, for instance a controller, implements (part of) the control method. A processor can be implemented in numerous ways, with software and/or hardware, to perform the various functions required. The processor may employs one or more microprocessors that may be programmed using software (e.g., microcode) to perform the required functions. Alternatively, the processor may be implemented as a combination of dedicated hardware to perform some functions and/or be coupled to a further processor (e.g., one or more programmed microprocessors and associated circuitry) for performing other functions.

[0079] Examples of processor components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs).

[0080] In various implementations, the processor be associated with one or more storage media such as volatile and non-volatile computer memory such as RAM, PROM, EPROM, and EEPROM. The storage media may be encoded with one or more programs that, when executed on one or more processors and/or controllers, perform at the required functions. Various storage media may be fixed within the processor or may be transportable, such that the one or more programs stored thereon can be loaded into a processor.

[0081] In the claims, the word comprising does not exclude other elements or steps, and the indefinite article a or an does not exclude a plurality. A single element or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

[0082] A computer program may be stored/distributed on a suitable non-transitory medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.

[0083] Any reference signs in the claims should not be construed as limiting the scope.