Inspection device for mechanical instruments and uses thereof
09815166 · 2017-11-14
Inventors
Cpc classification
B23Q17/2404
PERFORMING OPERATIONS; TRANSPORTING
G06Q10/087
PHYSICS
B23Q17/2409
PERFORMING OPERATIONS; TRANSPORTING
B23Q17/249
PERFORMING OPERATIONS; TRANSPORTING
International classification
B23Q17/24
PERFORMING OPERATIONS; TRANSPORTING
G06Q10/08
PHYSICS
Abstract
Devices and methods for inspection of various mechanical instruments to determine their level of wear and re-usability, particularly surgical and dental instruments, are provided.
Claims
1. An inspection device for mechanical instruments, the inspection device comprising: (i) one or more cameras configured to acquire an image of a mechanical instrument or a section thereof; (ii) one or more illuminators configured to illuminate the mechanical instrument or a section thereof; (iii) a processor configured to trigger the one or more illuminators, receive the image from the one or more cameras and compute an output signal regarding the type of the inspected mechanical instrument; and (iv) an inventory management system or software for sorting said inspected mechanical instruments based at least on the output signal provided by the processor, wherein computing the output signal further comprises: applying an image edge detection algorithm to detect edges within the image; selecting one or more image edges from the detected image edges, which represent mechanical cutting edges; determining a level of wear of the one or more mechanical cutting edges; and based at least on the detected level of wear, providing an indication regarding re-usability of the mechanical instrument wherein computing the output signal further comprises: applying a texture segmentation algorithm to the image to determine the level of wear of the mechanical instrument or a section thereof; and based at least on the detected level of wear, providing an indication regarding re-usability of the mechanical instrument; measuring color variation along the image to determine an amount of residue contamination of the mechanical instrument or a section thereof; and based at least on the detected amount of residue contamination, providing an indication regarding re-usability of the mechanical instrument.
2. The inspection device of claim 1, wherein computing the output signal comprises detecting and extracting specific mechanical edges of the inspected mechanical instrument or the section thereof.
3. The inspection device of claim 1, wherein determining the level of wear of the one or more active cutting edges comprises: applying contour assessment algorithms to measure parameters selected from continuity, roughness, width, uniformity or combinations thereof of an active cutting edges: and based at least on the measured parameters, providing an indication regarding the level of wear.
4. The inspection device of claim 1, wherein computing the output signal further comprises: detecting a tip of the inspected instrument or the section thereof within the image: extracting a profile of the detected tip: comparing the extracted profile to a reference profile: based at least on the comparison, determining the level of wear of the tip: and based at least on the detected level of wear, providing an indication regarding re-usability of the mechanical instrument.
5. The inspection device of claim 1, wherein computing the output signal comprises: projecting light onto the contour of the inspected device or a section thereof; measuring light-material interaction phenomena to determine the level of wear of the contour; and based at least on the detected level of wear, providing an indication regarding re-usability of the mechanical instrument.
6. The inspection device of claim 1, further comprising a display unit.
7. The inspection device of claim 1, wherein the mechanical instrument is a dental instrument.
8. The inspection device of claim 1, wherein the mechanical instrument is a surgical instrument.
9. The inspection device of claim 1, wherein said processor is further configured to receive by wire or wireless communication a description of new tools being added to an inventory of a clinic and/or of a Sterile Processing Department (SPD) and/or of a Central Sterilized Supply Department (CSSD) and/or of an Operating Room (OR) and/or a surgical case, and to sort said inspected mechanical instruments according to said received description.
10. The inspection device of claim 1, wherein said processor is further configured to output an indication regarding said instrument's designated location within a particular surgical kit and/or in an SPD and/or a CSSD and/or an OR.
11. The inspection device of claim 1, wherein said provided indication is a serial number of said inspected mechanical instrument.
12. The inspection device of claim 1, further comprising an indication unit configured to provide an indication regarding the re-usability of said inspected mechanical instrument.
13. The inspection device of claim 12, wherein the indication provided by the indication unit comprises a score.
14. The inspection device of claim 12, wherein the indication provided by the indication unit is a visual signal.
15. The inspection device of claim 12, wherein the indication provided by the indication unit is an audible signal.
16. A method for inspecting mechanical instruments, the method comprising: (i) acquiring an image of the mechanical instrument or a section thereof using one or more cameras accompanied with one or more illuminators; (ii) automatically setting the combination of cameras and illuminators by using an iterative multiple exposures process; (iii) operating a processor configured to receive the image from the one or more cameras and compute an output signal regarding the type of the inspected mechanical instrument; and (iv) sorting inspected mechanical instruments, using an inventory management system or software, based at least on the signal provided by the processor; wherein computing the output signal further comprises: applying an image edge detection algorithm to detect edges within the image; selecting one or more image edges from the detected image edges, which represent mechanical cutting edges; determining a level of wear of the one or more mechanical cutting edges; and based at least on the detected level of wear, providing an indication regarding re-usability of the mechanical instrument wherein computing the output signal further comprises: applying a texture segmentation algorithm to the image to determine the level of wear of the mechanical instrument or a section thereof; and based at least on the detected level of wear, providing an indication regarding re-usability of the mechanical instrument; measuring color variation along the image to determine an amount of residue contamination of the mechanical instrument or a section thereof; and based at least on the detected amount of residue contamination, providing an indication regarding re-usability of the mechanical instrument.
Description
BRIEF DESCRIPTION OF THE FIGURES
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
DETAILED DESCRIPTION OF THE INVENTION
(16) The present invention is directed, in some embodiments, to methods and devices for the inspection of instruments used during clinical procedures, such as surgical and/or dental instruments. For example, dental burrs, dental drills and optionally other instruments utilized in dental procedures may be inspected.
(17) For example, dentists commonly use handpieces that are adapted to receive dental drill bits, burs or other cutting instruments. In some embodiments, a simply operated detection and inspection device is provided, that can determine the level of wear of dental instruments. Such device may be useful, for example, for determining when a certain tool should be replaced.
(18) According to some exemplary embodiments, by using an inspection device according to embodiments of the present invention, the clinical personnel and/or technicians and/or assistants will be able to evaluate the condition of the instrument and its drilling, polishing, cutting, holding, scraping and/or scaling efficiency, and to measure the level of wear of the instrument prior to or during operation. The clinical personnel may therefore decide in advance or during procedure whether it is possible to continue working with the instrument or whether the instrument should be replaced.
(19) Such devices may be part of a dentist and patient unit, for example, a unit's tray that contains a dental drill. For example, in some embodiments, the device is part of the dental unit as an add-on device. The inspection device may also be a separate entity unit or part of a disinfection facility center or a stand-alone unit accessible by the assistant or the dentist for operation during or between therapy sessions. For example, in some embodiments, the device is part of a case cart unit in a SPD (Sterile Processing Department) and/or CSSD (Central Sterilized Supply Department. For example, in some embodiments, the device is part of OR accessible to technician and/or nurses and/or surgeons to inspect usability of instruments prior or during surgical and/or invasive and/or minimally invasive procedures.
(20) Advantageously, the system according to some embodiments of the present invention provides an objective and repetitive indication or score (e.g. number) that identifies the tool and indicates the overall tool's functionality to perform its task.
(21) In some embodiments, the quantitative result of the inspected tool can be transmitted, by wire or wireless connection, to a system or software that controls and manages a clinic's stock and purchasing, in order to save labor and assist in evaluating which new tools should be ordered as replacement for the damaged ones.
(22) In some embodiments, the inspection device of the present invention has means to receive by wire or wireless communication a description of new tools being added to the inventory of a clinic and/or of the CSSD and/or of the OR and/or a surgical case. New tools may be inspected and sorted by using the inspection device of the present invention. In some embodiments, a display or screen, which may be part of the inspection device, gives an indication whether a tool to be inspected is part of a library of tools recognized by the device, prior to inspecting and displaying the grade of quality. In some embodiments, the inspection device of the present invention has means to receive by wire or wireless communication a description and name of the tools being inspected and following identification of instrument, to output an indication regarding the instrument's designated location, for example, within a particular surgical or in other location as required in SPD and/or CSSD and/or OR.
(23) According to one aspect, the present invention provides an inspection device for mechanical instruments, the device comprising:
(24) one or more cameras configured to acquire one or more images of a mechanical instrument or a section thereof;
(25) a processor configured to receive an image from the one or more cameras and compute an output signal regarding the re-usability of the inspected instrument; and
(26) an indication unit configured to communicate the output signal to a user.
(27) According to another aspect, the present invention provides a method for inspecting a mechanical instrument, the method comprising:
(28) acquiring an image of the mechanical instrument or a section thereof using one or more cameras combined with one or more lenses and optionally one or more illuminators;
(29) operating a processor configured to receive an image from the one or more cameras and compute an output signal regarding the re-usability of the inspected instrument.
(30) In principle, the inspection may be performed using all optic modalities possible, including for example, laser and infrared techniques.
(31) In some embodiments, one or more cameras are used for optically scanning the inspected instrument. Exemplary cameras include CCD, CMOS, line scanners, and photodiode sensors.
(32) In some embodiments, the one or more cameras comprise at least one top view camera and least one side view camera. In some embodiments, a single side view camera is used to acquire multiple images of multiple viewing angels of an inspected instrument, by using, for example, a polygon mirror, which allows to obtain a plurality of viewing angles in a single image, or by using, for example, a step motor, which allows to capture multiple images at different viewing angles with a single camera.
(33) In some embodiments, the cameras are stills. In other embodiments, video cameras are used.
(34) In some embodiments, the processor is connected to a computer. In some embodiments, the processor is connected to a computer via wires. In other embodiments, the processor is connected to a computer via wireless connection
(35) In some embodiments, processing of the data is performed by an external computer. In other embodiments, data processing is performed by the inspection device itself.
(36) In some embodiments, the output signal comprises an indication regarding specific segments of the inspected instrument which are worn. In some exemplary embodiments, an image of the inspected instrument in which the worn segments are marked is displayed by a display unit.
(37) In some embodiments, the signal provided by the display unit is a visual signal. In alternative or additional embodiments, the signal is an audible signal.
(38) In some embodiments, the unit is connected to the clinic management system that can affect stock indications and trigger events for purchasing new stock and providing reports on devices usability and quality
(39) Reference is now made to
(40) Reference is now made to
(41) Reference is now made to
(42) The edge detection algorithm detects many edges within the image, however not all are relevant for inspection, as not all represent mechanical, cutting edges of the drill (the active cutting edges). On step (320), one or more edges from the detected image edges are selected, which represent mechanical cutting edges. On step (330), the level of wear of the one or more mechanical cutting edges is determined. In some embodiments, wear includes abrasion, scratches, scrapes, indentation, cavity or combinations thereof. On step (340), an indication regarding the re-usability is provided based at least on the detected level of wear. Typically, a level of wear above a pre-defined threshold will result in an indication that the drill is not re-usable.
(43) Selection of one or more mechanical cutting edges for analysis of wear may be performed by a two-step process, combining data from top and side view images of the inspected drill.
(44) First, top view images are acquired and analyzed in order to detect mechanical cutting edges, for example as described in
(45) Second, a collection of side view images are acquired and analyzed, from which those conveying best inspection information are selected. For example, side view images where an apex of the mechanical cutting edge is perpendicular to an illuminator may be selected. When a source of illumination is perpendicular to an apex of a worn edge, the reflection from a dull, non sharp edge is the largest.
(46) An exemplary flowchart of steps for detecting one or more mechanical cutting edges out of image edges detected within a top view image of the drill is provided in
(47) An exemplary flowchart of steps for analysis of a side view image is provided in
(48) Upon the identification of mechanical cutting edges, their level of wear is determined In some embodiments, the level of wear comprises the level of sharpness. The level of sharpness may be determined based on the thickness of the identified cutting edges, where dull edges correspond to broad edges or to bright edges or to combinations thereof, and sharp edges correspond to narrow edges or to dark edges or to combinations thereof. In alternative or additional embodiments, the level of sharpness is determined based on intensity and uniformity of the edge. In some embodiments, contour assessment algorithms are applied, that measure continuity, roughness, width and/or uniformity of a mechanical cutting edge. In some embodiments, based at least on the combination of these edge measurements, an indication is provided regarding the level of wear.
(49) In some embodiments, the processor utilizes a scoring system in order to determine the level of wear. In some embodiments, broader and brighter edges receive higher scores. Similarly, non-uniform edges receive a higher score, and identified scratches or other defects also receive higher scores. If the total score exceeds a certain threshold, the drill is identified as being un-reusable. Wherever the processor detects a defect, it labels it and adds it to a counter. If the total counts exceed a certain threshold, which is set by the system and or the user, the system designates the drill as defective and provides a signal to the indication unit.
(50) In some embodiments, one or more of the following algorithms are applied: edge detection, 3D rotations of elements (such as edges or “paths”) detected in 2D images, edge roughness estimation, contour assessment (continuity etc.), curve fitting and curve comparison, texture analysis (including for example uniformity of granularity, edge frequency), profile comparison.
(51) Reference is now made to
(52) Reference is now made to
(53) In some embodiments, the output signal for an inspected bun comprises applying a contour following algorithm to follow the contour of the serrated profile and determine, according to its waviness, how close it is to an ideal sharp bun. In some embodiments, a threshold is assigned, and the processor is configured to provide an alert signal indicating a low level of sharpness.
(54) In some embodiments, the inspected instrument does not contain one or more mechanical cutting edges, but is rather characterized by a rough, granular, external texture. Diamond burrs are a non-limiting example of such instruments.
(55) In some embodiments, determination of the level of wear is performed based at least on analysis of the texture. A Fourier analysis could be applied to examine the frequency components of the profile. According to this analysis, reduction of certain spatial frequencies can provide an indication e on the amount of burr wear.
(56) In some embodiments, the processor is configured to compute an output signal based on the uniformity of the granularity of the inspected instrument. In some embodiments, the uniformity of the granularity of the inspected instrument is measured throughout a segmented area, and lack of uniformity of granularity above a certain threshold is indicative of the inspected instrument being defective. In some embodiments, the uniformity of the granularity of the burr is measured all over the segmented area. Wherever the system detects that the uniformity is lacking, it labels it and adds it to a counter. If the total counts of lack of granularity exceed a certain threshold, which is set by the system and or the operator, the system designates the burr as defective and provides a signal to the indication unit.
(57) In some embodiments, computing an output signal based on the level of granularity of the inspected instrument comprises applying a texture segmentation algorithm. In some exemplary embodiments, texture segmentation is performed using an edge frequency based texture analysis.
(58) A non-limiting example of texture segmentation algorithm that may be used to discern different surfaces is edge frequency based texture analysis (see, for example, Srinivasan and Shobha (2008) Proc. Of World Academy of Science Engineering and Tech., vol. 36, pp. 1264-1269). In this algorithm, the total length of all the edges in a region in the acquired image is used as a measure of the coarseness or complexity of a texture. Edges can be detected either as micro edges using small edge operator masks or as micro edges using large edge convolution masks. Operators like Robert's operator or Sobel's operator can be used for this purpose. The distance dependent texture description function g(d) can be computed for any sub-image f defined in a neighborhood N for a variable distance d is
g(d)=|F0−F1|+|F0−F2|+|F0−F3|+|F0−F4| Where F0=f(i,j), F1=f(i+d, j) F2=f(i−d, j), F3=f(i,j+d) and F4=f(i,j−d)
(59) Different values of g(d) in the various parts of the instrument's image provide a differentiator between existence or none existence of diamonds coating on the burr, or the roughness of the material such as Tungsten or Carbide of the bun. From the function g(d) the granularity of the surface can be deduced.
(60) In alternative or additional embodiments, the processor is configured to compute an output signal based on the amount of residue contamination on the inspected instrument. In some embodiments, the amount of color variation along the inspected instrument is measured, and the processor performs segmentation of foreign material, such as resin, tooth residue and/or acryl. Thus, in some embodiments, the processor is configured to measure the amount of color variation along the inspected instrument and segment foreign material.
(61) Reference is now made to
(62) In some embodiments, evaluation of a scaler comprises evaluation of the length, shape and bend angle of the tip, collectively referred to as the profile of the tip. A worn tip is typically shorter, narrower and/or distorted in comparison to a new tip of the same type. According to embodiments of the present invention, the profile of a tip of an inspected scaler is compared to a predefined, reference profile of an un-used, un-damaged tip of the same type, at an exact orientation. The conformity of the inspected profile to a normal reference profile is evaluated. As shown in
(63) As the scaler is inserted into the inspection device in an unknown orientation within the 3D space, a preliminary step of the analysis includes the determination of orientation and creation of a normalized profile at a standard orientation based on images received from a dual camera setup, such as the setup shown in
(64) Reference is now made to
(65) In some embodiments, inspection of a dental scaler is performed using side view cameras (without a top view camera). According to these embodiments, the cameras should be perpendicular to the plane of the scaler—capturing a silhouette image. In some embodiments, this is accomplished by rotating the scaler and selecting the best image. In alternative embodiments, two side-view cameras at orthogonal positions are used, and the scaler is inspected using at least two side-view images.
(66) In some embodiments, the inspection device comprises one or more illuminators. Illuminators may include a one or more of: (1) illumination at different projection angles, (2) illumination of different spectral responses, (3) illumination of different coherence characteristics, and (4) different radiation pattern. The illuminating sources could be switched on/off at various combinations with a camera to produce one or more images of the same viewing angle that can be later analyzed either in a fused/non-fused manner. This may increase the desired signal from an area of interest within the inspected instrument or section thereof, and decrease reflections from unwanted areas.
(67) In some embodiments, computing the output signal comprises: projecting light onto the contour of the inspected device or a section thereof; measuring light-material interaction phenomena to determine the level of wear of the contour; and based at least on the detected level of wear, providing an indication regarding the re-usability of the mechanical instrument.
(68) In some embodiments, coherent light sources (such as laser) may be projected at the contour of the tool, and speckles and/or other optical phenomena may provide indication regarding tip and edge sharpness. In some embodiments, speckles and/or diffraction pattern reflected from a tip or edge of the knife are analyzed to determine the quality and disparity from ideal tip or edge.
(69) Examples of other illuminators include light-emitting diodes (LED), light bulbs, compact fluorescent lamp (CFL) and diffusive luminescence sheets. The different light sources may be combined with diffusers to achieve more uniform light distribution.
(70) In some embodiments, prior to beginning of processing and computation of an output signal by the processor of the inspection device, the user gives an indication regarding the type of instrument being inspected through a user interface unit. Thus, in some embodiments, the inspection device further comprises a user interface unit configured to receive an indication from a user regarding the type of instrument being inspected. The interface unit may also be configured to receive additional data from the user, or to enable the user to change parameters regarding the computation of output signals and the like. The interface may also indicate size of instrument or serial number and/or the intended use of the instrument. For example: mayo scissors 180 mm which are placed in a cesarean section kit.
(71) In some embodiments, the processor is configured to determine the type of the inspected instrument prior to computing an output signal regarding its re-usability. In some embodiments, determining the type of the inspected instrument comprises determining the contour and/or level of granularity of the instrument or a section thereof. In some embodiments, a texture segmentation algorithm is applied in order to verify the level of granularity of the instrument or a section thereof.
(72) In some embodiments, the processor is further configured to transmit the output signal. In some embodiments, the output signal is transmitted to a software. For example the output signal may be transmitted to an inventory management software.
(73) In some embodiments the output signal indicates the instruments' serial number. The output signal may be transmitted to an inventory list for sorting surgical kits.
(74) Reference is now made to
(75) Optionally, the procedure comprises a further step (1150), which is designated to count the amount of residue contamination. On step (1150), the system checks the amount of color variation and does segmentation of foreign material, such as resin, tooth residue and/or acryl.
(76) On step (1160), the total counts of quality are averaged and compared against a threshold which leads to a decision making. On step (1170), a stock management procedure determines whether to notify the user to replace and order a burr replacement.
(77) The device and method of the present invention may be utilized to evaluate the cutting efficiency of hand instruments, for example dental scalers and/or surgical scissors. The device and method of the present invention may be utilized for checking the sharpness of dental instruments such as scalers, curettes, dental burrs and/or implant drills.
(78) The device and method of the present invention may be utilized to evaluate the degree of serration in saws, dissectors, needle holders and other dental or surgical instruments.
(79) The device and method of the present invention may be utilized to inspect the quality of a variety of dental drills, including diamond, tungsten, carbide, zircon oxide and plastic drills. The device may also be utilized to inspect the quality of dental CAD/CAM (computer-aided design and computer-aided manufacturing) drilling and grinding tools, for example, diamond cutters that constitute the milling machine of crown and bridge work.
(80) In some embodiments, instruments to be inspected include dental burrs, implant drills, scalers, probes and ultrasonic/piezo-electric scalers tips, surgical scissors; mayo scissors, matzenbaum scissors, tenotomy scissors, dissecting forceps, needle holders, wound retractors, hysterectomy clamps, bulldog clamps, bone levers, chisels, hand drills, awls, bone rongeurs, bone cutting forceps, uterine probes, biopsy instruments, trocars, genito-urinary instruments, curettes, haemostatic forceps, and uses thereof.
(81) The device and method of the present invention may be utilized to inspect the quality of ultrasonic scaler tips and dental piezo electric tips.
(82) The device and method of the present invention may be utilized to inspect the quality of dental explorers.
(83) The device and method of the present invention may be utilized to inspect a variety of dental and/or surgical instruments, including but not limited to, dental milling tools, drill instruments, cutters, knives, probes, polishing and trimming discs (including plastic, metal and diamond covered discs) solid carbide dental endmills, tangential milling system, plungers for deep cavity, slitting and slotting cutters, cutters with helical/curved cutting edge, fan blades, compressor blades and vanes, turbine blades and vanes.
(84) Additional examples of reusable surgical tools that may be inspected by the device and method of the present invention include: forceps, scissors, knives, shears, chisels, osteotomes, curettes, gouges, saws, files, rasps, drills, burrs, kuentscher and trocars.
(85) Exemplary dental instruments which are suitable for inspection by the device of the present invention, showing wear sings such as white stain, rust stain, metal ablation, residue contamination (such as tooth contamination) are shown in
(86) A top view of a worn (left) versus new (right) dental diamond bun is shown in
(87) A top view of worn (left) versus new (right) dental drills is shown in
(88) In some embodiments, the processor is configured to compare the scanned data to that of a standard new instrument, and analyze the difference between the standard instrument and the inspected instrument. In some embodiments, software is used, that compares the scanned data to that of a standard new instrument, and analyzes the difference between the standard instrument and a measured instrument.
(89) In some embodiments, the device is capable of identifying the instrument, for example, a certain drill, thus the operator will be able to calculate the time span the drill is in use (if measured).
(90) Data received from the scanning may be utilized by common types of inventory management software and will able to track and order dental burrs. Data received from the scanning may be utilized to identity surgical instruments for assembly of surgical sets. Data received from scanning may be utilized for traceability of surgical instruments (frequency of use, sterilization, repair, storage, event history etc.)
(91) Further features: 1. A scoring system may be used to define the level of wear of tools between 1-10, and/or usable vs. unusable. Scoring may be displayed by LEDs and/or on screen. Scoring may be indicated by a change in the color of the LED. Each score/indication may be represented by a dedicated color. Thresholds to each grade may be calibrated by end user standards or by standards required by regulatory bodies. 2. When an instrument is inserted into the device the screen may indicate name, size and type of the instrument. Dental Diamond Burrs, Dental Carbide Buns, Scalers, Mayo Scissors, Matsenbaum Scissors, Tenotomy Scissors, Rongeurs , Curettes, Osteotomes, Drill bits, Rasps, Trocars, Drills, Dermatomes, Hemostats and more. 3. When the device decides that an instrument is in poor quality and unusable, the device may send an alert to a stock management software requesting a new order of the identified instrument. 4. In the case of dental instruments, the device may be integrated within a dental chair or as a standalone system. Integration may be applicable to all commercial chairs. 5. An update button may be included, which enables to add a new tool that to the instrument library stored within the device. New tool will be added to the inventory list. 6. Manual inspection button may be included, which enables to perform manual inspection if necessary.
(92) The foregoing description of the specific embodiments will so fully reveal the general nature of the invention that others can, by applying current knowledge, readily modify and/or adapt for various applications such specific embodiments without undue experimentation and without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. The means, materials, and steps for carrying out various disclosed functions may take a variety of alternative forms without departing from the invention.