System and method for automated monitoring of fetal head descent during labor
10478151 ยท 2019-11-19
Assignee
Inventors
- Nitin Singhal (Bangalore, IN)
- Kajoli Banerjee Krishnan (Bangalore, IN)
- Christian Fritz Perrey (Mondsee, AT)
- Klaus Pintoffl (Mondsee, AT)
- Walter Duda, Jr. (Mondsee, AT)
- Francesca Patruno (Velizy, FR)
Cpc classification
A61B8/5223
HUMAN NECESSITIES
A61B5/055
HUMAN NECESSITIES
A61B2576/00
HUMAN NECESSITIES
A61B5/1075
HUMAN NECESSITIES
G16H50/30
PHYSICS
A61B8/0866
HUMAN NECESSITIES
International classification
A61B5/11
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
Abstract
A method for automatically monitoring fetal head descent in a birth canal is presented. The method includes segmenting each image in one or more images into a plurality of neighborhood components, determining a cost function corresponding to each neighborhood component in the plurality of neighborhood components in each of the one or more images, identifying at least two structures of interest in each image in the one or more images based on the cost function, wherein the at least two structures of interest include a pubic ramus and a fetal head, measuring an angle of progression based on the at least two structures of interest, and determining the fetal head descent in the birth canal based on the angle of progression.
Claims
1. A method for automatically monitoring fetal head descent in a birth canal, comprising: acquiring, via at least one processor, one or more transperineal ultrasound images corresponding to a birth canal of a patient in labor such that the one or more transperineal ultrasound images comprise at least two structures of interest; segmenting, via the at least one processor, each of the one or more transperineal ultrasound images into a plurality of neighborhood components; determining, via the at least one processor, a cost function corresponding to each neighborhood component in the plurality of neighborhood components in each of the one or more transperineal ultrasound images; identifying, via the at least one processor, the at least two structures of interest in each of the one or more transperineal ultrasound images based on the cost function, wherein the at least two structures of interest comprise a pubic ramus and a fetal head; measuring, via the at least one processor, an angle of progression between a first line passing through the pubic ramus and a second line extending from an inferior apex of the pubic ramus and tangentially intersecting a contour of the fetal skull; determining, via the at least one processor, the fetal head descent in the birth canal based on the angle of progression to automatically monitor progression of the fetal head in the birth canal of the patient during labor; and visualizing the one or more transperineal ultrasound images, the pubic ramus, the fetal head, a tangent point on the fetal head, the angle of progression, the fetal head descent, or combinations thereof on a display, wherein at least the angle of progression is overlaid on the one or more transperineal ultrasound images, wherein the steps of acquiring the one or more transperineal ultrasound images, segmenting each of the one or more transperineal ultrasound images, determining the cost function, identifying the at least two structures of interest, measuring the angle of progression, determining the fetal head descent, and visualizing are automated steps.
2. The method of claim 1, wherein the one or more transperineal ultrasound images comprise two-dimensional transperineal ultrasound images.
3. The method of claim 1, wherein segmenting each of the one or more transperineal ultrasound images further comprises enhancing a contrast of each of the one or more transperineal ultrasound images to generate a corresponding contrast enhanced image.
4. The method of claim 3, wherein segmenting each of the one or more transperineal ultrasound images further comprises smoothening spatial discontinuities in tissues in each of the one or more transperineal ultrasound images.
5. The method of claim 4, wherein smoothening spatial discontinuities in the tissues in each of the one or more transperineal ultrasound images comprises processing the corresponding contrast enhanced image via use of a filter to generate a corresponding contrast enhanced smoothened image.
6. The method of claim 5, wherein segmenting each of the one or more transperineal ultrasound images further comprises processing the corresponding contrast enhanced smoothened image via a Frangi mask, a curvature mask, or a combined mask to generate a corresponding filtered image.
7. The method of claim 6, further comprising labeling the plurality of neighborhood components in each of the one or more transperineal ultrasound images.
8. The method of claim 1, wherein determining the cost function comprises computing the cost function corresponding to each neighborhood component in each of the one or more transperineal ultrasound images based on a location of the neighborhood component, a size of the neighborhood component, an anatomical presentation of the neighborhood component, or combinations thereof.
9. The method of claim 1, wherein measuring the angle of progression comprises: identifying end points of the pubic ramus; and drawing the first line to connect the end points of the pubic ramus.
10. The method of claim 9, further comprising determining a tangent point on the fetal head.
11. The method of claim 10, further comprising drawing the second line from one end point of the pubic ramus such that the second line intersects the fetal head tangentially at the tangent point on the fetal head.
12. The method of claim 11, wherein measuring the angle of progression comprises measuring an angle subtended between the first line and the second line.
13. The method of claim 12, wherein determining the fetal head descent in the birth canal based on the angle of progression comprises identifying a fetal station based on a look-up table, and wherein the look-up table provides a correspondence between the angle of progression and the fetal station.
14. A system, comprising: at least one processor configured to automatically: obtain one or more transperineal ultrasound images corresponding to a birth canal of a patient in labor such that the one or more transperineal ultrasound images comprise at least two structures of interest; segment each of the one or more transperineal ultrasound images into a plurality of neighborhood components; determine a cost function corresponding to each neighborhood component in the plurality of neighborhood components in each of the one or more transperineal ultrasound images; identify the least two structures of interest in each of the one or more transperineal ultrasound images based on the cost function, wherein the at least two structures of interest comprise a pubic ramus and a fetal head; measure an angle of progression between a first line passing through the pubic ramus and a second line extending from an inferior apex of the pubic ramus and tangentially intersecting a contour of the fetal skull; determine fetal head descent in the region of interest in the object of interest based on the angle of progression; and visualize the one or more transperineal ultrasound images, the pubic ramus, the fetal head, a tangent point on the fetal head, the angle of progression, the fetal head descent, or combinations thereof on a display, wherein at least the angle of progression is overlaid on the one or more transperineal ultrasound images.
15. A computer-readable non-transitory media storing computer executable code to perform the method of: acquiring one or more transperineal ultrasound images corresponding to a birth canal of a patient in labor such that the one or more transperineal ultrasound images comprise at least two structures of interest; segment each of the one or more transperineal ultrasound images into a plurality of neighborhood components; determine a cost function corresponding to each neighborhood component in the plurality of neighborhood components in each of the one or more transperineal ultrasound images; identify the at least two structures of interest in each of the one or more transperineal ultrasound images based on the cost function, wherein the at least two structures of interest comprise a pubic ramus and a fetal head; measure an angle of progression between a first line passing through the pubic ramus and a second line extending from an inferior apex of the pubic ramus and tangentially intersecting a contour of the fetal skull; determine fetal head descent in the birth canal based on the angle of progression; and visualize the one or more transperineal ultrasound images, the pubic ramus, the fetal head, a tangent point on the fetal head, the angle of progression, the fetal head descent, or combinations thereof on a display, wherein at least the angle of progression is overlaid on the one or more transperineal ultrasound images, wherein the steps of acquiring the one or more transperineal ultrasound images, segmenting each of the one or more transperineal ultrasound images, determining the cost function, identifying the at least two structures of interest, measuring the angle of progression, determining the fetal head descent, and visualizing are automated steps.
16. An imaging system, the system comprising: an ultrasound imaging system configured to obtain one or more transperineal ultrasound images corresponding to a birth canal of a patient in labor such that the one or more transperineal ultrasound images comprise at least two structures of interest; at least one processor in operative association with the ultrasound imaging system, wherein the at least one processor is configured to automatically: segment each of the one or more transperineal ultrasound images into a plurality of neighborhood components; determine a cost function corresponding to each neighborhood component in the plurality of neighborhood components in each of the one or more transperineal ultrasound images; identify the at least two structures of interest in each of the one or more transperineal ultrasound images based on the cost function, wherein the at least two structures of interest comprise a pubic ramus and a fetal head; measure an angle of progression between a first line passing through the pubic ramus and a second line extending from an inferior apex of the pubic ramus and tangentially intersecting a contour of the fetal skull; determine fetal head descent in the birth canal based on the angle of progression; and visualize the one or more transperineal ultrasound images, the pubic ramus, the fetal head, a tangent point on the fetal head, the angle of progression, the fetal head descent, or combinations thereof on a display, wherein at least the angle of progression is overlaid on the one or more transperineal ultrasound images.
17. The imaging system of claim 16, further comprising the display configured to visualize the one or more transperineal ultrasound images, the pubic ramus, the fetal head, the tangent point on the fetal head, the angle of progression, the fetal head descent, or combinations thereof thereon.
Description
DRAWINGS
(1) These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13) As will be appreciated, during the process of childbirth, a clinician, such as a physician or a midwife monitors descent of a fetal head in a birth canal of a patient in labor. In accordance with exemplary aspects of the present specification, systems and methods configured to aid in enhancing clinical workflow are presented. In particular, the methods and systems are configured to facilitate automated monitoring of the fetal head descent during labor. Additionally, the systems and methods provide an objective and reproducible tool for monitoring the fetal head descent, while reducing variability in assisting patients during labor.
(14)
(15) During labor and delivery, the clinician, typically positions an ultrasound probe on or about a region of interest to be imaged. In the present example, the patient in labor 102 may be positioned in a supine position on a patient support 104. Furthermore, an image acquisition device 106 that is operatively coupled to a medical imaging system 108 may be used to acquire image data corresponding to an object of interest in the patient 102. In one embodiment, the image acquisition device 106 may be an ultrasound probe. Additionally, in one example, the medical imaging system 108 may be an ultrasound imaging system. The ultrasound imaging system 108 may be configured to receive ultrasound image data corresponding to the patient 102 and process the ultrasound image data to generate one or more images corresponding to the patient 102. It may be noted that the system 100 may be configured to automatically monitor fetal head descent in the birth canal during labor using a single acquired image. However, in certain other embodiments, more than one image may be employed to automatically monitor fetal head descent in the birth canal during labor.
(16) Moreover, in one example, the one or more images may include transperineal ultrasound images. As will be appreciated, transperineal ultrasound images are representative of images that are acquired using an ultrasound imaging system that is optimized and configured to acquire the images when a probe is placed and roved over the peritoneum of the human anatomy to visualize anatomies of the pelvic region. In this example, the probe 106 may be placed transversely on a suprapubic region of the patient's abdomen. Furthermore, to determine progression of labor, the ultrasound probe 106 may be positioned on the perineum in a mid-sagittal position between the labia below the pubic symphysis. Moreover, a lateral position of the probe 106 may be adjusted until an image showing the sagittal view with one or more anatomical structures of interest or landmarks is obtained. In one example, the anatomical structures of interest may include a pubic ramus and a fetal head. It may be noted that the terms fetal head and fetal skull may be used interchangeably.
(17) Furthermore, in one example, the acquired image may include a two-dimensional (2D) transperineal ultrasound image. Also, in certain embodiments, the images may include B-mode ultrasound images. Additionally, the 2D images may include static 2D images or cine loops that include a series of 2D images or image frames acquired over time. It may be noted that although the present specification is described in terms of 2D ultrasound images, use of the present specification with three-dimensional (3D) ultrasound images and four-dimensional (4D) ultrasound images is also envisaged. Also, the acquired image data may include cine loops, where the cine loops include 2D images acquired over time t.
(18) In the present example, the object of interest may include a fetus in the patient 102. It may be noted that although the present specification is described with reference to a fetus as the object of interest, use of the present specification for imaging anatomical regions of interest in other objects of interest such as an adult patient is also envisaged. In a presently contemplated configuration, the system 100 may be configured to acquire image data representative of the fetus in the patient 102 during labor. In one embodiment, the system 100 may acquire image data corresponding to the fetus via an image acquisition device 106. Also, in one embodiment, the image acquisition device 106 may include a probe, where the probe may include an invasive probe, or a non-invasive or external probe, such as an external ultrasound probe, that is configured to aid in the acquisition of image data. Also, in certain other embodiments, image data may be acquired via one or more sensors (not shown) that may be disposed on the patient 102. By way of example, the sensors may include physiological sensors (not shown) such as positional sensors. In certain embodiments, the positional sensors may include electromagnetic field sensors or inertial sensors. These sensors may be operationally coupled to a data acquisition device, such as an imaging system, via leads (not shown), for example.
(19) The system 100 may also include a medical imaging system 108 that is in operative association with the image acquisition device 106. It should be noted that although the exemplary embodiments illustrated hereinafter are described in the context of a medical imaging system, other imaging systems and applications such as industrial imaging systems and non-destructive evaluation and inspection systems, such as pipeline inspection systems, liquid reactor inspection systems, are also contemplated. Additionally, the exemplary embodiments illustrated and described hereinafter may find application in multi-modality imaging systems that employ ultrasound imaging in conjunction with other imaging modalities, position-tracking systems or other sensor systems. For example, the multi-modality imaging system may include a positron emission tomography (PET) imaging system-ultrasound imaging system. Furthermore, it should be noted that although the exemplary embodiments illustrated hereinafter are described in the context of a medical imaging system, such as an ultrasound imaging system, use of other imaging systems, such as, but not limited to, a computed tomography (CT) imaging system, a contrast enhanced ultrasound imaging system, an X-ray imaging system, an optical imaging system, a positron emission tomography (PET) imaging system, a magnetic resonance (MR) imaging system and other imaging systems is also contemplated in accordance with aspects of the present specification.
(20) As noted hereinabove, in a presently contemplated configuration, the medical imaging system 108 may include an ultrasound imaging system. The medical imaging system 108 may include an acquisition subsystem 110 and a processing subsystem 112, in one embodiment. Further, the acquisition subsystem 110 of the medical imaging system 108 is configured to acquire image data representative of patient in labor 102 via the image acquisition device 106, in one embodiment. For example, the acquired image data may include a plurality of 2D transperineal ultrasound images or slices. It may be noted that the terms images and image frames may be used interchangeably. Additionally, the image data acquired from the fetus may then be processed by the processing subsystem 112.
(21) According to aspects of the present specification, the image data acquired and/or processed by the medical imaging system 108 may be employed to aid a clinician in determining the progression of labor in the patient 102. In certain embodiments, the processing subsystem 112 may be further coupled to a storage system, such as the data repository 116, where the data repository 116 is configured to store the acquired image data. In certain embodiments, the data repository 116 may include a local database.
(22) In addition, the acquisition subsystem 110 may also be configured to acquire images stored in the optical data storage article. It may be noted that the optical data storage article may be an optical storage medium, such as a compact disc (CD), a digital versatile disc (DVD), multi-layer structures, such as DVD-5 or DVD-9, multi-sided structures, such as DVD-10 or DVD-18, a high definition digital versatile disc (HD-DVD), a Blu-ray disc, a near field optical storage disc, a holographic storage medium, or another like volumetric optical storage medium, such as, for example, two-photon or multi-photon absorption storage format. Further, the 2D images so acquired by the acquisition subsystem 110 may be stored locally on the medical imaging system 108.
(23) Furthermore, in accordance with exemplary aspects of the present specification, the processing subsystem 112 may include a fetal head descent monitoring (FHDM) platform 114 that is configured to aid in the automated determination of labor progression by automatically monitoring the fetal head descent in the birth canal of the patient in labor 102. The exemplary system 100 that includes the FHDM platform 114 provides a fully automated framework for determining a fetal head station in the patient in labor aids in simplifying the workflow and enhances the productivity of a skilled and/or less-experienced user. It may be noted that the term fetal head station is used to refer to a position of the head of the fetus in the birth canal of the patient in labor.
(24) Also, in the presently contemplated configuration illustrated in
(25) As noted hereinabove, traditionally, an angle of progression (AOP) is measured as an angle between the line joining the pubic symphysis and the line joining the fetal head. However, the pubic symphysis is a low echogenic structure, and hence difficult to segment especially with an automated technique. In accordance with exemplary aspects of the present specification, highly echogenic structures such as, but not limited to, the pubic ramus and the fetal head are used to determine the AOP in a speedy and accurate manner.
(26) More particularly, the FHDM platform 114 may be configured to determine a position of the fetal head in the birth canal of the patient in labor 102 based on an angle of progression. As used herein, the term angle of progression is used to refer to an angle between two bony landmarks such as the fetal skull and the maternal pubic ramus using the 2D transperineal ultrasound images. In accordance with exemplary aspects of the present specification, the pubic ramus is used instead of the traditionally used pubic symphysis. The pubic ramus is a high echogenic structure in comparison to the low echogenic pubic symphysis. Use of the pubic ramus allows visualization of a clear structure of the landmark and also provides standardization of the measurement of the angle of progression.
(27) The FHDM platform 114 may be configured to process the 2D images to automatically identify the pubic ramus and the fetal skull and to determine the angle of progression. In one example, the FHDM platform 114 may be configured to access the 2D images, from the local database 116. Alternatively, the 2D images may be obtained by the acquisition subsystem 110 from an archival site, a database, or an optical data storage article.
(28) The 2D images may include at least two anatomical structures of interest such as the pubic ramus and the fetal head or fetal head contour. The pubic ramus is a curved structure with two end points. Also, a line passing through those two points may be referred to as a ramus line. Moreover, a line starting from the inferior apex of the pubic ramus (for example, the right end point) and intersecting the fetal skull contour tangentially may be referred to as a tangent line. In accordance with aspects of the present specification, the angle of progression is defined as the angle between the ramus line and the tangent line.
(29) It may therefore be desirable to determine locations of anatomical structures of interest such as the pubic ramus and the fetal head/fetal skull contour in the 2D images. In one embodiment, the FHDM platform 114 may be configured to automatically measure the AOP using the 2D transperineal ultrasound images to provide an objective measure of the progression of labor.
(30) Accordingly, the FHDM platform 114 may be configured to automatically detect two bony landmarks such as the pubic ramus and the fetal skull contour in the 2D images. In one embodiment, the FHDM platform 114 may be configured to segment the input image into neighborhood components using a series of morphological operations such as, but not limited to, vesselness, mean curvature, and neighborhood component labeling. As used herein, the term neighborhood components is used to refer to components that have substantially similar and/or homogeneous intensities.
(31) Furthermore, the FHDM platform 114 may be configured to identify the pubic ramus and the fetal skull in the input images based on an objective function. In one example, the objective function may be based on anatomical presentation, location and size of the two bony landmarks (anatomical structures of interest) in the images. Once the pubic ramus and the fetal skull are identified, the FHDM platform 114 may also be configured to determine a ramus line and a tangent line. Accordingly, the FHDM platform 114 may be configured to determine a tangent point on the fetal skull. In one embodiment, the FHDM platform 114 may be configured to determine the tangent point on the fetal skull using an adaptive fetal skull contour modeling. In one example, the adaptive fetal skull contour model may be based on the nature of disjointedness of fetal skull. Additionally, the FHDM platform 114 may be configured to determine/measure the angle of progression. As previously noted, the angle of progression is defined as the angle between the ramus line and the tangent line. Furthermore, the objective function may also be adapted to determine a quality score corresponding to the 2D transperineal ultrasound images. The quality score may be utilized to assess the consistency of the images with clinical guidelines and appropriateness of use of these images to measure the angle of progression. The working of the FHDM platform 114 will be described in greater detail with reference to
(32) Moreover, as illustrated in
(33) In addition, the user interface 120 of the medical imaging system 108 may include a human interface device (not shown) configured to aid the clinician in manipulating image data displayed on the display 118. The human interface device may include a mouse-type device, a trackball, a joystick, a stylus, or a touch screen configured to facilitate the clinician to identify the one or more regions of interest in the images. However, as will be appreciated, other human interface devices, such as, but not limited to, a touch screen, may also be employed. Furthermore, in accordance with aspects of the present specification, the user interface 120 may be configured to aid the clinician in navigating through the images acquired by the medical imaging system 106. Additionally, the user interface 120 may also be configured to aid in manipulating and/or organizing the displayed images and/or generated indicators displayed on the display 118.
(34)
(35) Traditionally, an angle of progression (AOP) 216 is measured as an angle between a line 212 joining the pubic symphysis 210 and a line 214 joining the fetal head 208. However, the pubic symphysis 210 is a low echogenic structure. Consequently, segmenting the pubic symphysis using an automated technique is challenging. Hence, measuring the AOP using the currently available techniques entails manual intervention.
(36) The shortcomings of the currently available techniques may be circumvented via use of high echogenic structures in a transperineal ultrasound image. In accordance with aspects of the present specification, highly echogenic structures such as, but not limited to, a pubic ramus and a fetal head may be used to determine an AOP.
(37) Reference numeral 304 is representative of a fetal head or fetal head contour. Furthermore, reference numeral 306 may be generally representative of the symphysis capsule, while a pubic symphysis may be generally indicated by reference numeral 308. In accordance with aspects of the present specification, a pubic ramus 310 is employed to measure the AOP as opposed to use of the low echogenic pubic symphysis by the currently available techniques. The pubic ramus 310 is a curved structure with two end points 314, 316. Also, a first line passing through the two end points 314, 316 may be referred to as a ramus line 312. Additionally, a second line starting from the inferior apex of the pubic ramus (for example, the right end point 316) and intersecting the fetal skull contour 304 tangentially may be referred to as a tangent line 318. A point where the tangent line 318 intersects the fetal head 304 may be referred to as a tangent point 320. In accordance with aspects of the present specification, the AOP is defined as the angle 322 between the ramus line 312 and the tangent line 318.
(38) Referring now to
(39) As previously noted with reference to
(40) In accordance with aspects of the present specification, an AOP 412 is measured as an angle subtended between a line 408 that joins the two end points of the pubic ramus 406 and a second line 410 that joins one end point of the pubic ramus 406 to the fetal head 402 tangentially. Accordingly, it is desirable to detect the pubic ramus and the fetal skull contour in the image. Moreover, in accordance with further aspects of the present specification, it is also desirable to identify a point where a line from the one end point of the pubic ramus 406 such as an inferior apex of the pubic ramus 406 intersects the fetal skull contour 402 tangentially.
(41) Turning now to
(42) The method 500 may be described in a general context of computer executable instructions. Generally, computer executable instructions may include routines, programs, objects, components, data structures, procedures, modules, functions, and the like that perform particular functions or implement particular abstract data types. In certain embodiments, the computer executable instructions may be located in computer storage media, such as a memory, local to an imaging system 108 (see
(43) As will be appreciated during a typical scan session, an object of interest such as a patient is positioned for imaging and the clinician attempts to image a desired anatomical region of interest in the patient. Accordingly, the method starts at step 502 where a patient, such as the patient in labor 102 is positioned for imaging. In the present example, the patient may be positioned in a supine position. The image acquisition device 106, such as an ultrasound probe may be placed transversely on the suprapubic region of the patient's abdominal region. A position of the fetal head may be visually identified. Furthermore, for determining progression of labor, the ultrasound probe 106 may be positioned on the perineum of the patient in labor in a mid-sagittal position between the labia and below the pubic symphysis. The position of the ultrasound probe 106 may be adjusted until an image is obtained that shows the sagittal view where the pubic ramus and the fetal skull are clearly visualized.
(44) Once the patient in labor 102 is suitably positioned, one or more images 504 may be acquired, as indicated by step 502. In one embodiment, the acquired images include 2D transperineal ultrasound images 504. The acquired images 504 may be received by the acquisition subsystem 110, for example. It may be noted that the 2D images may include at least two bony landmarks such as the pubic ramus and the fetal head. It may be noted that in accordance with aspects of the present specification, fetal head descent in the birth canal during labor may be automatically monitored using a single acquired image. However, in certain other embodiments, more than one image may be employed to automatically monitor fetal head descent in the birth canal during labor.
(45) Subsequent to the acquisition of the 2D transperineal ultrasound images 504, the images 504 may be processed by the processing subsystem 110 and by the FHDM platform 114 in particular to aid in determining/monitoring the progression of labor, as generally indicated by steps 506-532. The processing of steps 506-532 are described with described with reference to one image from the one or more images 504. The other images in the one or more images 504 may also be processed in a similar manner.
(46) In accordance with aspects of the present specification, the input image 504 may be processed to automatically identify two anatomical structures of interest in the image 504. In one example, the two anatomical structures of interest may include two bony landmarks such as the pubic ramus and the fetal head/fetal head contour. In addition, the pubic ramus and the fetal head may be used to determine an angle of progression (AOP). The AOP may in turn be employed to determine a fetal head position in the birth canal of the patient in labor. It may be noted that the terms fetal head and fetal skull may be used interchangeably. Also, the terms fetal head contour and fetal skull contour may be used interchangeably.
(47) Furthermore, as depicted by step 506, in order to facilitate the automated identification of the anatomical structures of interest such as the pubic ramus and the fetal head and the automated measurement of the AOP, the image 504 may be segmented into a plurality of neighborhood components. Segmenting the image 504 into a plurality of neighborhood components facilitates the identification of the pubic ramus and the fetal head. In one embodiment, a series of morphological operations may be used to segment the input image 504 into the plurality of neighborhood components. Some non-limiting examples of the morphological operations include processing the image 504 via a Frangi mask, a curvature mask, neighborhood component labeling, and the like.
(48) It may be desirable to accurately locate the pubic ramus and the fetal head in the image 504. Typically, in an ideal ultrasound scan, the pubic ramus and the fetal head are characterized by uniform intensity, smooth curvature, and high amplitude. Additionally, the pubic ramus and the fetal head are also manifested as objects in the image 504 that are brighter than other components/objects in the vicinity. However, shadowing from the pubic symphysis affects the uniformity and brightness of the pubic ramus, thereby adversely impeding the delineation of the pubic ramus.
(49) Furthermore, the tissue lining the pubic ramus and the fetal skull is typically continuous and coherent. However, in certain situations, the tissue may appear disjointed in the image 504 due to tissue occlusion, tissue alignment, and the like. It may therefore be desirable to smoothen across any spatial discontinuities in the tissue, while preserving the contrast between the tissue and the surrounding background to enhance the accuracy of identification of the pubic ramus and the fetal head in the image 504. It may also be desirable to remove any speckle in the image 504, while retaining the integrity of edges in the image 504.
(50) Accordingly, the segmenting step 506 may further include enhancing contrast between the tissue and the surrounding background, as indicated by step 508. In addition, the segmenting step 506 may also include smoothening of the spatial discontinuities in the tissue, as depicted by step 510. In accordance with aspects of the present specification, a contrast enhancing and spatial smoothing filter may be employed to facilitate smoothening of the spatial discontinuities in the tissue, while preserving/enhancing the contrast between the tissue and the surrounding background.
(51) In one example, tissue signatures corresponding to the pubic ramus and the fetal skull may be enhanced in the image 504. However, the contrast enhancement of step 508 may also result in other structures and/or noise in the image being highlighted, thereby impeding the selection of desired anatomical structures of interest, such as the pubic ramus and the fetal skull. It may therefore be desirable to enhance the accuracy of detection of the anatomical structures of interest in the image 504. Accordingly, the contrast enhanced image may be processed to transform the contrast enhanced image into a binary representation of image pixels that correspond to the pubic ramus and the fetal head, as indicated by step 512.
(52) It may be noted that the pubic ramus and the fetal skull resemble ridge-like structures. Accordingly, at step 512, in one embodiment, the contrast enhanced image may be processed via use of a filter to enhance the contrast of thick tube-like or ridge-like structures in the image 504. By way of a non-limiting example, a Frangi vesselness filter/mask may be employed to enhance the contrast of the tube-like/ridge-like structures in the image 504. The filtered image may be referred to as a Frangi filtered image.
(53) The contrast enhanced image may be convolved with a series of Gaussian second derivative filters. Furthermore, responses at each image pixel may be stacked in a [22] matrix to obtain the Hessian matrix D.
(54) Furthermore, it may be noted that the ratio of eigenvalues of the matrix D (for example, .sub.1 .sub.2) is a measure of an isotropy of a corresponding structure of interest. The ratio of the eigenvalues having a small value is generally indicative of a ridge-like feature that has a determined orientation and therefore exhibits strong anisotropy. In one embodiment, the anisotropy may be emphasized by embedding the ratio of the eigenvalues into a functional form.
(55) Furthermore, the Frangi filtered image I.sub.f may be binarized by selecting a threshold to generate a binary image I.sub.fm. In one non-limiting example, a threshold value of about 0.5 may be employed to maximize the response of the Frangi mask/filter, while reducing the number of noisy components.
(56) Consequent to the processing of the contrast enhanced image via the Frangi mask/filter, a binary image that includes one or more ridge-like structures is obtained. As previously noted, the pubic ramus and the fetal head resemble ridge-like structures. Consequently, the pubic ramus and the fetal head have a high curvature. Accordingly, it may be desirable to identify the desired anatomical structures of interest such as the pubic ramus and the fetal head from the one or more ridge-like structures in the binary image. In one embodiment, a pixel-wise curvature may be estimated from the contrast enhanced image based on equation (1).
(57)
where I is the contrast enhanced image and I.sub.c is representative of an image obtained after processing the contrast enhanced image via use of a curvature transform.
(58) As previously noted, the pubic ramus and the fetal skull have an intensity that is relatively brighter than the intensities of other structures of interest in the vicinity. Accordingly, a pixel that corresponds to a point on the pubic ramus or the fetal skull exhibits an intensity that is higher than the intensity of a neighboring pixel. In accordance with aspects of the present specification, a determined threshold value T may be employed to aid in selecting/identifying pixels that correspond to the pubic ramus. In one non-limiting example, a threshold value T having a value of about 0.3 may be used to delineate the anatomical structures of interest. Accordingly, the Frangi filtered image may be processed via use of a curvature mask represented by equation (2) to generate a curvature filtered image I.sub.mc.
(59)
(60) In certain situations, the pubic ramus and fetal head/skull may not appear as distinct entities in the Frangi filtered image. However, the pubic ramus and the fetal skull may be connected to neighboring structures or noise. Moreover, in the curvature filtered image, the pubic ramus and the fetal head may have a distinct and a pruned appearance and may be accompanied by many noise artifacts. In order to eliminate or minimize the pruned appearance and to remove the noise artifacts, the Frangi mask and the curvature mask may be combined to generate a combined mask. In one embodiment, the combined mask may be generated by a pixel-to-pixel AND operation of the Frangi filtered image and the curvature filtered image. A combined filtered image I.sub.comb may be generated via use of the combined mask.
(61) Once the contrast enhanced image has been processed via one or more of the Frangi mask, the curvature mask, or the combined mask, an image having segmented neighborhood components may be obtained. Subsequently, at step 514, the neighborhood components in combined filtered image I.sub.comb may be annotated with labels. Each distinct neighborhood component in the combined filtered image I.sub.comb may be assigned a unique identifier or label, while the background is set to zero. An object or neighborhood component is usually defined as a set of connected, non-zero pixels, where two pixels being connected implies that it is possible to construct a path between the two pixels using only non-zero pixels between them. In one example, an 8-connected neighborhood function may be employed to construct the path between the two pixels. Furthermore, noise artifacts may be removed from the image. In one example, neighborhood components that have fewer than 50 pixels may be removed to eliminate the noise.
(62) Following the processing of step 514, a neighborhood component labeled image is obtained. This image includes a plurality of labeled neighborhood components. It may be desirable to automatically select/identify the pubic ramus from the plurality of labeled neighborhood components.
(63) Accordingly, at step 516, an objective cost function corresponding to each neighborhood component may be computed. In one embodiment, the objective function may be based on the pubic ramus anatomy, a size of the pubic ramus, a location of the pubic ramus, and the presentation of the pubic ramus in the image scanning plane. The pubic ramus is generally located in the top left half of the image. Accordingly, the location of the pubic ramus within the symphyseal capsule may be determined by a heuristic approach that is configured to identify objects in the top left half of the image. In addition, the pubic ramus appears as an object of high intensity and is typically brighter than other objects in the vicinity.
(64) In accordance with further aspects of the present specification, a concavity of the component with respect to the lateral resolution may be used in the identification of the pubic ramus from the plurality of labeled neighborhood components. As previously noted, the pubic ramus and fetal skull are typically a continuous and coherent entity. However, in certain situations, the pubic ramus and the fetal head may appear discontinuous even in the contrast enhanced image. In accordance with aspects of the present specification, disjointed components in a local neighborhood may be joined with a candidate component based on similarity of curvature. In particular, disjointed components having similar curvature result in a lower value of fitting error. Hence, disjointed components in the neighborhood may be combined or joined with the candidate component based on a value of the fitting error.
(65) Referring now to
(66) Subsequently, a search may be carried out in the neighborhood of the two end points 608, 610 of the initial candidate component 604 to determine presence of any disjointed components, as depicted by an image 612 of
(67) According to aspects of the present specification, the disjointed components may be combined or joined with the initial candidate component 604 based on a similarity of curvature of the components, as depicted by an image 618 of
(68) Subsequently, the determined fitting errors may be compared with a determined threshold value to identify a best fit of the disjointed components with the initial candidate component 604 based on the similarity of curvature of the components to be joined or combined. In the present example, the first component 614 that has a normalized fitting error within the threshold value may be combined with the initial candidate component 604, as depicted in
(69) Consequently, the first disjointed component 612 may be combined or joined with the initial candidate component 604 to obtain a combined component 624 as depicted in an image 622 of
(70) Referring again to
(71)
where, C.sub.i, mV.sub.i, mI.sub.i, l.sub.i are measures of concavity, mean vesselness, mean intensity, and length of the i.sup.th component, respectively, N.sub.r is the total number of components after combining disjointed components located in the top left half of the imaging scan plane, and R.sub.c is representative of a component that is selected as the pubic ramus.
(72) Additionally, at step 518, once the pubic ramus is identified, it is desirable to select the fetal head/skull from the plurality of labeled neighborhood components. A component from the plurality of labeled neighborhood components that represents a leading edge of the fetal skull may be selected based on a cost function. In one example, the cost function may be computed based on the fetal skull anatomy, a location of the fetal skull anatomy, and a presentation of the fetal skull anatomy in an imaging scan plane. Furthermore, the fetal skull may be assumed to be located below the pubic ramus in the image. Moreover, the fetal skull appears as an object of high intensity in the image and is typically brighter than other objects in the vicinity.
(73) As previously noted with reference to the selection of the pubic ramus, the concavity of the component with respect to the lateral direction may be used to aid in the selection of the fetal skull from the plurality of labeled neighborhood components. Accordingly, disjointed components may be combined to obtain a combined component. Furthermore, a component representative of the fetal skull may be selected from the plurality of labeled neighborhood components based on the cost function. One example of the cost function is provided in equation (4).
(74)
where N.sub.h is the total number of components that lie within the search constraint and H.sub.c is representative of a component selected as the fetal skull.
(75) Consequent to the processing of steps 506-518, the pubic ramus and the fetal skull are identified in the image 504. Subsequently, it is desirable to measure the AOP. In accordance with exemplary aspects of the present specification, the AOP is representative of an angle between the two bony landmarks such as the fetal skull and the maternal pubic ramus that are identified using the 2D transperineal ultrasound images 504. In particular, the angle of progression is defined as the angle between the ramus line and the tangent line.
(76) As previously noted, the ramus line is defined as a line that passes through the two end points of the pubic ramus. Accordingly, at step 520, the ramus line may be determined. To that end, a first end point and a second point of the pubic ramus may be identified. Subsequently, a first line representative of the ramus line may be drawn such that the first line passes through the two end points of the pubic ramus.
(77) Furthermore, the tangent line is defined as a line that starts from the inferior apex of the pubic ramus (for example, the right end point) and intersects the fetal skull contour tangentially. In one embodiment, a second line that is representative of the tangent line may be drawn from the inferior apex, for example, the second end point of the pubic ramus such that the second line intersects the fetal skull contour tangentially. It is therefore desirable to determine a point where the second line intersects the fetal skull tangentially, as depicted by step 522. This point may be referred to as a tangent point.
(78) Turning now to
(79) In on example, the fetal skull contour may be modeled by a polynomial regression equation represented by:
P=p.sub.nx.sup.n+p.sub.n1x.sup.n1+ . . . +p.sub.1x+p.sub.0x(5)
where, n=2, 3, represent quadratic and cubic regression models, respectively.
(80) As depicted in
(81)
where H.sub.c is the fetal skull contour, (x.sub.2,y.sub.2).) is the right end point 710 of the pubic ramus 704, and (x.sub.t, y.sub.t) is the computed tangent point.
(82) With returning reference to
(83) Once the ramus line and the tangent line have been drawn/determined, an AOP may be measured, as indicated by step 526. As previously noted, in accordance with exemplary aspects of the present specification, the AOP is measured as the angle between the ramus line and the tangent line. Reference numeral 528 may be representative of the angle of progression.
(84)
(85) Referring again to
(86) Furthermore, one or more of the input images, the pubic ramus, the fetal skull contour, the tangent point, the tangent line, the ramus line, the AOP, and the fetal head descent may be visualized on a display, such as the display 118 of
(87) Turning now to
(88) In addition, in
(89)
(90) As previously noted with reference to
(91) The processing subsystem 112 includes a control processor 1116, a demodulator 1118, an imaging mode processor 1120, a scan converter 1122 and a display processor 1124. The display processor 1124 is further coupled to a display monitor 1136, such as the display 116 (see
(92) The aforementioned components may be dedicated hardware elements such as circuit boards with digital signal processors or may be software running on a general-purpose computer or processor such as a commercial, off-the-shelf personal computer (PC). The various components may be combined or separated according to various embodiments of the invention. Thus, those skilled in the art will appreciate that the present ultrasound imaging system 1100 is provided by way of example, and the present specifications are in no way limited by the specific system configuration.
(93) In the acquisition subsystem 110, the transducer assembly 1106 is in contact with the patient 102. The transducer assembly 1106 is coupled to the transmit/receive (T/R) switching circuitry 1108. Also, the T/R switching circuitry 1108 is in operative association with an output of transmitter 1110 and an input of the receiver 1112. The output of the receiver 1112 is an input to the beamformer 1114. In addition, the beamformer 1114 is further coupled to the input of the transmitter 1110 and to the input of the demodulator 1118. The beamformer 1114 is also operatively coupled to the control processor 1116 as shown in
(94) In the processing subsystem 112, the output of demodulator 1118 is in operative association with an input of the imaging mode processor 1120. Additionally, the control processor 1116 interfaces with the imaging mode processor 1120, the scan converter 1122 and the display processor 1124. An output of imaging mode processor 1120 is coupled to an input of scan converter 1122. Also, an output of the scan converter 1122 is operatively coupled to an input of the display processor 1124. The output of display processor 1124 is coupled to the monitor 1136.
(95) Furthermore, the foregoing examples, demonstrations, and process steps such as those that may be performed by the system may be implemented by suitable code on a processor-based system, such as a general-purpose or special-purpose computer. It should also be noted that different implementations of the present specification may perform some or all of the steps described herein in different orders or substantially concurrently, that is, in parallel. Furthermore, the functions may be implemented in a variety of programming languages, including but not limited to C++ or Java. Such code may be stored or adapted for storage on one or more tangible, machine readable media, such as on data repository chips, local or remote hard disks, optical disks (that is, CDs or DVDs), memory or other media, which may be accessed by a processor-based system to execute the stored code. Note that the tangible media may include paper or another suitable medium upon which the instructions are printed. For instance, the instructions may be electronically captured via optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in the data repository or memory.
(96) The various systems and methods for automated monitoring of the fetal head descent in the birth canal of the patient during labor described hereinabove provide a framework for robust automated measurement of the angle of progression, thereby simplifying workflow in the labor room especially for less experienced users. Moreover, the systems and method presented herein may also be extended to measure alternate markers for fetal head descent such as the head-perineum distance. The systems and method also allow an independent and objective assessment of image quality in terms of the visualization and presentation of the fetal skull and the pubic ramus.
(97) Additionally, the various systems and methods are automated, thereby circumventing the need for manual intervention. Consequently, dependency on highly trained professionals is reduced. In addition, the scan time may be dramatically minimized when compared to manual image acquisition and measurement, thereby increasing the throughput. By way of example, for rural setups with high volumes of fetal scanning, these systems and methods aid in decreasing the net scan time, thereby enhancing handling of higher volumes.
(98) Furthermore, the systems and methods that are capable of automatically measuring the angle of progression by ultrasound aid in enhancing the accuracy of monitoring of the fetal head descent by reducing the variability in assisting patients during labor. Moreover, the productivity may be increased by avoiding multiple examinations and/or minimizing the need for support of expert clinicians to assess the head station. Also, the systems and method provide an objective and reproducible documentation that is independent of the experience levels of midwives or clinicians assisting in the labor room. The easy and fast workflow derived provided by the methods and systems for the angle of progression measurement may aid in enhancing the skill and utilization of midwives or paramedics across the world and also encourage adoption of ultrasound to assist labor in geographies with fewer experienced sonographers.
(99) While only certain features of the disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the disclosure.