IMAGE-BASED MOTION DETECTION METHOD
20230215022 ยท 2023-07-06
Assignee
- Shanghai Shende Green Medical Era Healthcare Technology Co., Ltd. (Shanghai, CN)
- Shende (Ningbo) Medical Device Technology Co., Ltd (Ningbo, CN)
- Nantong Shende Medical Device Technology Co., Ltd (Nantong, CN)
Inventors
- Bo WEI (Shanghai, CN)
- Junjie Guo (Shanghai, CN)
- Shengfa ZHANG (Shanghai, CN)
- Jiawei GU (Shanghai, CN)
- Zhiqiang SU (Shanghai, CN)
- Bo YANG (Shanghai, CN)
- Hao Wu (Shanghai, CN)
- Lei CUI (Shanghai, CN)
- Zhou TIAN (Shanghai, CN)
Cpc classification
G06T7/246
PHYSICS
G06V10/44
PHYSICS
G06V10/762
PHYSICS
International classification
G06T7/246
PHYSICS
G06V10/44
PHYSICS
G06V10/74
PHYSICS
G06V10/762
PHYSICS
Abstract
Disclosed is an image-based motion detection method. The method specifically includes: acquiring a reference image of a detecting object, determining several first detecting points in the reference image, extracting basic markings centered on the first detecting points in the reference image and classifying all the basic markings into several categories; acquiring a detecting image of the detecting object; matching the basic markings in the detecting image, obtaining an offset vector of each basic marking, and determining whether the basic marking has moved according to a norm of the offset vector of the basic marking; determining whether the number of the basic markings that have moved in each category is greater than a third threshold, if yes, determining that the category has moved; and if no, determining that the category has not moved; and determining a moving state of the detecting object according to a moving state of each category.
Claims
1. An image-based motion detection method, comprising: acquiring a reference image of a detecting object, determining several first detecting points in the reference image, extracting basic markings centered on the first detecting points in the reference image and classifying all the basic markings into several categories, wherein each category comprises at least one basic marking; acquiring a detecting image of the detecting object, wherein the detecting image and the reference image comprise the same image parameters and the image parameters comprise position, direction, size and resolution; matching the basic markings in the detecting image with the basic markings in the reference image, obtaining an offset vector of each basic marking between the reference image and the detecting image, and determining whether a norm of the offset vector of each basic marking is greater than a second threshold, if yes, determining that the basic marking has moved; and if no, determining that the basic marking has not moved; determining whether the number of the basic markings that have moved in each category is greater than a third threshold, if yes, determining that the category has moved; and if no, determining that the category has not moved; and determining a whole moving state and a part moving state of the detecting object according to a moving state of each category.
2. The image-based motion detection method of claim 1, further comprising: clustering all basic markings of each category to obtain several clusters; recording one cluster comprising the largest number of the basic markings as Cmax; in response that the proportion of the number of basic markings in Cmax to the number of basic markings in the category of Cmax is not less than a first threshold, calculating an average value
3. The image-based motion detection method of claim 2, wherein the operation of clustering all basic markings of each category specifically comprises: classifying two basic markings into a cluster if a norm of a difference between offset vectors of the two basic markings is less than a fifth threshold; and classifying unclassified basic markings into the cluster if differences between offset vectors of the unclassified basic markings and an average value of offset vectors in the cluster.
4. The image-based motion detection method of claim 1, wherein the basic markings are image fragments, the operation of extracting image fragments specifically comprises: extracting images within a range of a first preset distance centered on the first detecting points to construct the image fragments.
5. The image-based motion detection method of claim 4, wherein in response that the number of the first detecting points in the reference image is less than a fourth threshold, expanding detecting points, and the operation of expanding the detecting points comprises: determining the fourth threshold; centered on the first detecting points, determining several second detecting points within a range of a second preset distance; determining an entropy threshold; centered on the second detecting points, extracting images in the range of the first preset distance in the reference image; saving images whose entropy is greater than the entropy threshold as expanded image fragments.
6. The image-based motion detection method of claim 1, wherein the basic markings are image feature points, and the operation of extracting the image feature points specifically comprises: centered on the first detecting points, identifying the image feature points within a range of a third preset distance in the reference image.
7. The image-based motion detection method of claim 6, wherein the image feature points are Harris corner points.
8. The image-based motion detection method of claim 1, wherein a density-based clustering algorithm is adopted to classify satisfied basic markings into a category.
9. The image-based motion detection method of claim 8, wherein the clustering algorithm is density-based spatial clustering of applications with noise (DBSCAN).
10. The image-based motion detection method of claim 1, further comprising: dividing the reference image to obtain different image dividing units and classifying the basic markings in a same image dividing unit into a same category.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0034]
[0035]
[0036]
[0037]
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0038] The present disclosure is described in detail below in conjunction with the drawings and specific embodiments. The embodiments are implemented with the technical solution of the present disclosure, which gives detailed implementation and specific operation procedures. But the protection scope of the present disclosure is not limited to the following embodiments.
Embodiment 1
[0039] The present disclosure provides an image-based motion detection method, including:
[0040] Acquiring a reference image of a detecting object, determining several first detecting points in the reference image, extracting basic markings centered on the first detecting points in the reference image and classifying all the basic markings into several categories, wherein each category comprises at least one basic marking;
[0041] Acquiring a detecting image of the detecting object, wherein the detecting image and the reference image include the same image parameters and the image parameters include position, direction, size and resolution;
[0042] Matching the basic markings in the detecting image with the basic markings in the reference image, obtaining an offset vector of each basic marking between the reference image and the detecting image, and determining whether a norm of the offset vector of each basic marking is greater than a second threshold, if yes, determining that the basic marking has moved; and if no, determining that the basic marking has not moved;
[0043] Determining whether the number of the basic markings that have moved in each category is greater than a third threshold, if yes, determining that the category has moved; and if no, determining that the category has not moved;
[0044] Determining a whole moving state and a part moving state of the detecting object according to a moving state of each category.
Embodiment 2
[0045] The present disclosure provides an image-based motion detection method as shown in
[0046] S01: acquiring a reference image of a detecting object and determining several first detecting points in parts of the reference image to determine whether movement occurs;
[0047] S02: extracting basic markings centered on the first detecting points in the reference image, wherein the basic markings are image fragments, extracting images within a range of a first preset distance centered on the first detecting points to construct the image fragments;
[0048] S03: as shown in
[0049] S04: acquiring a detecting image of the detecting object, wherein the detecting image and the reference image include the same image parameters and the image parameters include position, direction, size and resolution;
[0050] S05: matching and comparing the position of the basic markings in the detecting image with the basic markings in the reference image to obtain an offset vector of each basic marking between the reference image and the detecting image;
[0051] S06: clustering all basic markings of each category to obtain several clusters; classifying two basic markings into a cluster if a norm of a difference between offset vectors of the two basic markings is less than a fifth threshold; and classifying unclassified basic markings into the cluster if differences between offset vectors of the unclassified basic markings and an average value of offset vectors in the cluster to obtain several clusters, and recording one cluster including the largest number of the basic markings as Cmax, as shown in
[0052] S07: in response that the proportion of the number of basic markings in Cmax to the number of basic markings in the category of Cmax is not less than a first threshold, calculating an average value
[0053] S08: determining whether a norm of the offset vector of each basic marking is greater than a second threshold, if yes, determining that the basic marking has moved; and if no, determining that the basic marking has not moved;
[0054] S09: determining whether the proportion of the number of the basic markings that have moved in each category is greater than a third threshold, if yes, determining that the category has moved; and if no, determining that the category has not moved;
[0055] S10: determining a whole moving state and a part moving state of the detecting object according to a moving state of each category. The moving states include whole motion, part motion, and no motion.
[0056] The operation of determining the fourth threshold; in response that the number of the first detecting points in the reference image is less than a fourth threshold, expanding detecting points, and the operation of expanding the detecting points includes:
[0057] centered on the first detecting points, determining several second detecting points within a range of a second preset distance; centered on the second detecting points, extracting images in the range of the first preset distance in the reference image to construct the image fragments; determining an entropy threshold; and saving images whose entropy is greater than the entropy threshold as expanded image fragments. The entropy value reflects the amount of information contained in the image segment, which can reflect whether the image segment contains anatomical structures or not. Such that all the image segments obtained by the expansion contain anatomical structures.
[0058] In the motion detection method, the second detecting point is used to make up for the insufficient number of the first detecting point, thereby to expand the detecting range. The second detecting point and the first detecting point are in the same anatomical structure, which may avoid the movement of other parts form disturbing the detection results. The first detection point can be set at a location with good anatomical structures, thereby facilitating the matching of individual image segments in the detecting image.
Embodiment 3
[0059] In some embodiments, the basic markings are image feature points and the image feature points are Harris corner points. The operation of extracting the image feature points specifically includes centered on the first detecting points, identifying the image feature points within a range of a third preset distance in the reference image. Other operations are similar to embodiment 2.
Embodiment 4
[0060] In some embodiments, the method further includes dividing the reference image based on different anatomical structures to obtain different image dividing units and classifying the basic markings in the same image dividing unit into the same category. Other operations are similar to embodiment 2.
[0061] The image-based motion detection methods provided in embodiments 1-4 adopt the way of clustering to process the results of all basic markings, which may correct the basic markings with large deviations. Meanwhile the part motion of the detecting object may be observed according to the motion of the category, and the motion state may be judged by judging the proportion of all basic marking, which may avoid the interference of some wrong basic markings. Since the threshold value may be changed, the method may be flexibly used in different usage scenarios.
[0062] The above describes in detail a preferred specific embodiment of the present disclosure. It should be understood that a person of ordinary skill in the art can make many modifications and changes according to the idea of the present disclosure without creative working. Therefore, any technical solution that can be obtained by logical analysis, reasoning or limited experiments based on the prior art by a person skilled in the art in accordance with the idea of the present disclosure shall fall within the protection scope determined by the claims.