DEVICE FOR PROVIDING TOTAL TRICHOME COUNT AND DENSITY OF CANNABIS INFLORESCENCES
20230314333 · 2023-10-05
Inventors
Cpc classification
International classification
Abstract
A device consisting of a digital camera with a microscope objective lens, a disc where plant material can be mounted and automatically rotated, and two other cameras for determining the plant material's shape and size, that allows images of intact cannabis trichomes to be taken, without destruction or damage to the plant material, and automatically counts and calculates the density of the trichomes on the inflorescence surface. This does not require taking any plant cuttings, does not require the use of a microscope or microscope slides, and allows multiple measurements to be taken of a single inflorescence sample in quick succession, without the need for manual image analysis.
Claims
1. A system for automatically measuring trichomes on plant material without chemically or physically altering the plant material comprising: a movable platform for disposing plant material to be measured; a motor for rotating the movable platform; a first camera for producing digital images of said plant material, wherein said first camera for producing digital images includes at least one microscope objective lens; a second camera disposed to produce digital images of a side view of the plant material; a computing device for controlling said motor and said cameras, for receiving said digital images and for executing an algorithm for analyzing said digital images to produce a trichome count; and a screen for displaying output of said algorithm.
2. The system of claim 1 wherein the computing device is physically external to the system.
3. The system of claim 2, wherein the computing device is connected to the system through a short-range networking technology, or a local or wide area network.
4. The system of claim 1, wherein the first camera is vertically oriented relative to the plant material and the second camera is horizontally oriented relative to the plant material.
5. A system for automatically measuring trichomes on plant material without chemically or physically altering the plant material, comprising: a table for disposing plant material to be measured; a camera for producing digital images of said plant material, wherein said camera includes at least one microscope objective lens; a track on which the camera is disposed; a motor and drive system for changing a relative position between said plant material and said camera; a computing device for controlling said motor and said camera for receiving said digital images and for executing an algorithm for analyzing said digital images to produce a trichome count; and a screen for displaying output of said algorithm.
6. The system of claim 5 wherein the computing device is physically external to the system.
7. The system of claim 6, wherein the computing device is connected to the system through a short-range networking technology or a local or wide area network.
8. The system of claim 1, wherein the first camera is vertically oriented relative to the plant material and the second camera is horizontally oriented relative to the plant material.
9. The system of claim 5, wherein the track remains static, and the motor is mounted onto the camera to allow it to move along the track.
10. A system for automatically measuring trichomes on plant material without chemically or physically altering the plant material comprising: means for disposing plant material to be measured; means for producing digital images of said plant material, wherein said means for producing digital images includes at least one microscope objective lens; means for changing a relative position between said plant material and said means for producing digital images; a computing device for controlling said means for changing a relative position of said plant material and for executing an algorithm for analyzing said digital images to produce a trichome count; and means for displaying output of said algorithm.
11. The system of claim 10, wherein the algorithm includes computer code that recognizes, counts and sizes each trichome present in each digital image and measures intermodal distances within the inflorescence; that calculates an average intermodal distance within the inflorescence, trichome density, average trichome cap diameter, and average trichome stalk height of the trichomes.
12. The system of claim 10, wherein the means for changing position of the plant material comprises means for moving said plant material relative to the means for producing digital images.
13. The system of claim 12, wherein the means for moving plant material comprises a turntable on which the plant material is disposed.
14. The system of claim 12, wherein the means for producing digital images comprises a camera vertically oriented relative to the plant material and a camera horizontally oriented relative to the plant material.
15. The system of claim 10, wherein the means for changing position of plant material comprises means for moving the camera relative to the plant material.
16. The system of claim 15, wherein the means for changing position of the plant material comprises a track encircling the plant material.
17. The system of claim 15, wherein the means for producing digital images comprises a camera with a microscope objective lens.
18. The system of claim 10, wherein the computer is external to the system.
19. The system of claim 18, wherein the computer is connected to the system through a short-range networking technology or a local or wide area network.
20. The system of claim 19, wherein the wide area network is the Internet.
Description
DESCRIPTION OF THE FIGURES
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
DETAILED DESCRIPTION OF THE INVENTION
[0027] The following description is provided to enable any person skilled in the art to make and use the invention and sets forth the best modes contemplated by the inventors of carrying out their invention. Various modifications, however, will remain readily apparent to those skilled in the art; the general principles of the present invention have been defined herein specifically to provide an automated trichome counter particularly well-suited for measurement of glandular trichomes on Cannabis inflorescences.
[0028] The terminology used herein is for the purpose of describing specific embodiments only and is not intended to be limiting of the invention. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well as the singular forms, unless the context dearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising”, when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof.
[0029] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the meaning as commonly understood by one having ordinary skill in the art to which this invention pertains. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure and shall not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
[0030] In describing the invention, it will be understood that a number of techniques and steps are disclosed. Each of these has individual benefit and each can also be used in conjunction with one or more, or in some cases all, of the other disclosed techniques. Accordingly, for the sake of clarity, this description will refrain from repeating every possible combination of the individual steps in an unnecessary fashion. Nevertheless, the specification and claims should be read with the understanding that such combinations are entirely within the scope of the invention and the claims.
[0031] A trichome scanner device that allows automatic counting of trichomes on cannabis inflorescences is discussed herein. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without these specific details.
[0032] The present disclosure is to be considered as an exemplification of the invention and is not intended to limit the invention to the specific embodiments illustrated by the drawings or description. Distances, angles, and other measurements are provided in a range that is practical for the device operation and are not intended to limit the invention to any specific embodiments or dimensions. Unless otherwise noted, all components of the device could be fabricated of resin, plastic, metal, wood, or any other inert material that will not interact with the resinous surface of a cannabis inflorescence.
[0033] The present invention will now be described by referencing the appended drawings representing preferred embodiments.
[0034] As shown in
[0035] The second camera 5 is attached to a horizontal mount 17, which is attached to a column 18. The mount 17 is a rectangular block about 10-15 mm in height, about 15-20 mm long, and about 50-80 mm deep; in a preferred embodiment, the mount 17 is about 15 mm high, 20 mm long, and 80 mm deep. The column 18 is also a rectangular member about 10-15 mm deep, about 15-20 mm long, and about 100-150 mm in height; in a preferred embodiment, the column 18 is about 15 mm high, about 20 mm long, and about 150 mm high.
[0036] A microscope objective lens 6 is positioned opposite the second camera 5, aimed diagonally at the plant sample mounted on the rotating disc 1. The working distance for the microscope lens should be in the range of about 80-100 mm, with a lens diameter of 25-40 mm. At the top of the microscope objective lens 6 a high-quality third camera 7 is installed, with a minimum of 5 MP resolution and ¼″ to ⅔″ sensor size. At the bottom of the microscope objective lens 6, a ring light 8 is mounted, with an interior diameter in the range of about 25-40 mm to match the lens diameter, with an exterior circle diameter about 15-20 mm larger than the interior diameter; in a preferred embodiment the microscope objective lens outer diameter and the ring light interior diameter are both about 40 mm, and the ring light exterior diameter is about 60 mm.
[0037] The high-quality camera 7 is mounted atop a column 20 of height ranging between about 100-150 mm; in a preferred embodiment the column 20 has a height of about 150 mm. In a preferred embodiment, a camera mount 19 has square dimensions of about 22 mm long by about 35 mm high by about 24 mm deep (see
[0038] Four bridging members 21, connect the bottom panel 24 and the top panel 23, via screws. Each member 21 is rectangular, with dimensions ranging from about 70-100 mm in depth, about 50-70 mm in height, and about 10-15 mm length (thickness); in a preferred embodiment, this component is about 100 mm deep, about 70 mm tall, and about 15 mm thick. Two of these bridging members 21 are installed on either side of a stepper motor 10, and at opposite ends of the top panel 23 and the bottom panel24; each member 21 includes an octagonal opening in the center (80 mm wide in a preferred embodiment) to allow adequate airflow for the motor 10 and Single-Board Computer (SBC) 9. The two interior components 21 are connected by two braces 22, to join the two parts of the base panel 24, together.
[0039] Cables (not shown) connect the cameras 4, 5, 7, the ring light 8, and the stepper motor 10 to the SBC 9. In a preferred embodiment the SBC 9 runs the Raspberry Pi OS operating system (OS), or some other similarly configured OS. Short-range and long-range wireless technologies (e.g., Bluetooth and WiFi, respectively) can also be employed. The SBC or similar computing device can be Internet-connected and may be located outside of the enclosure containing the other components of the system.
[0040] The vertical and horizontal cameras 4 and 5 (as well as high-quality camera 7) image the inflorescence using the ring light 8 for illumination. The calibration areas 2 and 3 are visible in the images and the calibration markings are used for automatic calibration of the cameras by removing areas of the image outside of the calibration lines. This allows the system to continue to function properly even if the cameras become slightly misaligned due, for example, to handling and transportation of the machine.
[0041] As shown in
[0042] As shown in
[0043]
[0044] The device then images the inflorescence with the camera 7 connected to the SBC's built-in camera port (not pictured). The horizontal and vertical alignment cameras 4 and 5 are connected to the SBC's built-in USB ports (not pictured). It will be appreciated that various connections can also be made via wireless technologies using short-range networking such as Bluetooth or local networks such as RS 232 or wide area networks such as the Internet. There could also be multiple SBCs to control different components, such as a separate SBC solely for image capturing or motor control. After the image has been captured, the SBC pulses the stepper motor 10 to rotate the inflorescence before capturing another image. After a series of images have been captured across the entire circumference of the plant sample, the trichome density is calculated by the software and the value is then output on the LCD display 11.
[0045] The interior chassis of the device is covered by a protective cover, and in a preferred embodiment this cover is about 270 mm in height, 440 mm in length, and 160 mm in depth at the base. In the preferred embodiment, the top lid 25 of the cover has a curved face that is indented at 240 mm from the base of the cover, with a lip that extends 10 mm beyond the depth of the base (maximum depth of 170 mm front to back). In the preferred embodiment, the entry door 12 is positioned in the center of the lower portion of the top panel, 180 mm from each side, and the center of door 12 is 85 mm from the bottom of the device.
[0046]
[0047] The platform B6 is transparent, which allows the camera B4 to photograph the underside of the flower, which is not possible in the first trichome density scanner embodiment described in
[0048] Referring now to the embodiment of
[0049] The IFA algorithm also notes any positional offset of the inflorescence within the alignment area caused by the user not having placed the inflorescence perfectly in the center of the rotating platform 1. This information is used later to determine the distance of the inflorescence from the lens, which will change upon rotation if the inflorescence is not placed perfectly in the center of the platform 1. Although there will be distance variations due to the non-spherical shape of the inflorescence, these variations will be much more pronounced if the inflorescence is off center, and the IFA therefore corrects as many of these variations as possible.
[0050] A Neural Network Machine Learning Algorithm (NNMLA,
[0051] The IFA and the NNMLA both operate on the same digital image. The IFA determines the alignment of the inflorescence on the platform as it is possible it will not be perfectly centered, and the IFA also determines the overall size of the inflorescence; the NNMLA separately (not using the filtered images from the IFA but instead using the original images) counts trichomes. Then the data from the IFA and NNMLA are both used to calculate trichome density, since one needs to estimate the total surface area of the inflorescence sample in order to accurately estimate trichome density.
[0052] In step B the model detects objects by drawing rectangular boxes around trichome heads, trichome stalks, and nodes, and returns rectangular coordinates within the image where it has detected these objects, along with a percentage indicating the confidence of its prediction. In step D the size of the enclosing box around a trichome head is used to approximate the size of the head by calculating the box's area. The same method is used to approximate the height of the trichome stalk. Since the utility of this instrument is primarily based on comparisons of different inflorescence samples (e.g. a cultivar that was grown under different conditions or two different cultivars grown under the same condition, etc.) it does not matter that these are approximations, because the relative measurements of the head diameter and stalk length will matter more than the absolute values.
[0053] In step C, after discarding predictions with a low confidence value and areas outside the known dimensions of the visible inflorescence, the number of trichomes detected in the image is divided by the area of the sphere visible within the camera's lens to produce a density value in trichomes per square millimeter. In step D, using the same image, the algorithm takes the distances measured for the trichome head diameter and stalk heights for every detected trichome and computes the average trichome head diameter and average stalk height for the trichomes contained within the image.
[0054] In step E, inter-nodal distance is calculated from the image from the side camera 5, instead of the image from the microscope camera 7, and is calculated by determining the distance between two adjacent rectangles tagged as nodes by the machine learning algorithm. These values: trichome density, average trichome diameter, average trichome stalk height, and intermodal distance, are then averaged based on the measurements in the image obtained from microscope camera 7 and the image obtained from the side camera 5. The inflorescence is then automatically rotated on the platform and additional images are captured at different angles and the steps above repeat (step F). Once images at multiple angles have been captured and processed, the results are averaged in step G to produce the final measurements, which are then output to the device's LCD display 11 in step H.
[0055] Dividing the number of trichomes detected in the image by the area of the sphere currently visible in the image produces the measurement for the trichome density. To allow for variations in density on the surface of the flower and to reduce measurement errors, multiple calculations are performed by rotating the platform 1 via the stepper motor 10 (see
[0056] The surface of the inflorescence is treated as a spherical surface (see
SA.sub.cap=2πrh
where r=radius of the sphere, and where h=height of the spherical cap.
[0057] The height of the spherical cap is defined by the FOV of the microscope objective lens, since the cap's diameter is by definition the visible distance across the cap, therefore the FOV=diameter of the spherical cap (see
(r−h).sup.2+a.sup.2=r.sup.2(r−h).sup.2=r.sup.2−a.sup.2r−h=√{square root over (r.sup.2−a.sup.2)}∴h=−√{square root over (r.sup.2−a.sup.2)}+r
For example, if the objective lens for a microscope is 10×/22 and the objective magnification is 40, then FOV=(10*40)/22=0.055 mm. Therefore, if a=0.055 mm/2=0.0275 mm, and if the inflorescence sample has a diameter of 1 cm, the radius r=5 mm. To solve for h:
h=−√{square root over ((5 mm).sup.2−(0.0275 mm).sup.2)}+5 mm h=−√{square root over (25 mm.sup.2−0.000756 mm.sup.2)}+5 mm h=−√{square root over (24.999244 mm.sup.2)}+5 mm h=−4.999244 mm+5 mm ∴h=0.000756 mm
and since:
[0058] Trichome density (TD), defined as number of trichomes per surface area:
TD=number of trichomes÷mm.sup.2
TD would therefore be calculated by counting the number of trichomes in the FOV, and dividing that number by SA.sub.cap. For example, if 10 trichomes were detected in the FOV using the lens in the example above, the trichome density would be:
TD=10 trichomes÷0.002375 mm.sup.2TD=1263 trichomes/mm.sup.2
In this case, 314.15 mm.sup.2 is the SA of a sphere with d=1 cm, therefore an inflorescence with 1 cm diameter with TD=1263 mm.sup.2 would be predicted to have 396,821 total trichomes.
[0059] FOV may also be calculated for a camera lens from its measured angular field of view (AFOV):
[0060] where h=length of the sensor and F=focal length of the lens. For example, if the sensor length is 8.38 mm (⅓″) and the focal length of the lens is 15 mm:
[0061] Field of view is then given by the following equation:
where D is the working distance (distance from object to sensor).
[0062]
[0063] The following claims are thus to be understood to include what is specifically illustrated and described above, what is conceptually equivalent and what can be obviously substituted. Those skilled in the art will appreciate that various adaptations and modifications of the just-described preferred embodiments can be configured without departing from the scope of the invention. The illustrated embodiment has been set forth only for the purposes of example and that should not be taken as limiting the invention. Therefore, it is to be understood that, within the scope of the appended claims, the invention may be practiced other than as specifically described herein.