Apparatus for use in luminescence applications

Abstract

Photoluminescence from a sample detector is detected using an array of photo-sensitive detectors. At least one first photo-sensitive detector of the array is provided with a first type of linear polarization filter and at least one second photo-sensitive detector is provided with a second type of linear polarization filter. The first type of linear polarization filter has a plane of polarization which is at angled with respect to a plane of polarization of said second type of polarization filter.

Claims

1. A detector for detecting photoluminescence from a sample, said detector comprising: an array of photo-sensitive detectors configured to receive photoluminescence, at least one first photo-sensitive detector in said array having a first type of linear polarization filter and at least one second photo-sensitive detector in said array having a second type of linear polarization filter, wherein said first type of linear polarization filter has a plane of polarization which is at angled with respect to a plane of polarization of said second type of polarization filter; each photo-sensitive detector having one of said first and second linear polarization filters is individually provided with a linear polarization filter.

2. The detector as claimed in claim 1, wherein the detector is used to detect fluorescence.

3. The detector as claimed in claim 1, wherein each photo-sensitive detector is a SPAD.

4. The detector as claimed in claim 1, wherein each of the first and second linear polarization filters is provided by a grid of parallel wires, wherein a longitudinal extent of said parallel wires defining a plane of polarization.

5. The detector as claimed in claim 4, wherein a spacing between adjacent wires in the grid of parallel wires is less than a wavelength of light to be detected.

6. The detector as claimed in claim 1, wherein at least one photo-sensitive detector of said array has a wavelength filter.

7. The detector as claimed in claim 6, wherein first ones of the plurality of photo-sensitive detectors in said array are provided with a red wavelength filter, second ones of the plurality of photo-sensitive detectors in said array are provided with a green wavelength filter, and third ones of the plurality of photo-sensitive detectors in said array are provided with a blue wavelength filter.

8. The detector as claimed in claim 7, wherein each of said first, second, and third ones of the plurality of photo-sensitive detectors comprise said first photo-sensitive detector having the first type of linear polarization filter and said second photo-sensitive detector having the second type of linear polarization filter.

9. The detector as claimed in claim 8, wherein at least one third photo-sensitive detector of said array is provided with no linear polarization filter.

10. The detector as claimed in claim 9 wherein each of said first, second, and third ones of the plurality of photo-sensitive detectors further comprise said third photo-sensitive detector of said array with no linear polarization filter.

11. The detector as claimed in claim 7, wherein fourth ones of the plurality of photo-sensitive detectors in said array do not have a wavelength filter.

12. A detector for detecting photoluminescence from a sample, comprising: an array of photo-sensitive detectors configured to receive photoluminescence, at least one first photo-sensitive detector in said array having a first type of linear polarization filter and at least one second photo-sensitive detector in said array having a second type of linear polarization filter, wherein said first type of linear polarization filter has a plane of polarization which is at angled with respect to a plane of polarization of said second type of polarization filter; and a signal processor configured to process outputs from said array to provide both fluorescence anisotropy imaging microscopy (FAIM) information and fluorescence lifetime imaging microscopy (FLIM) information.

13. The detector as claimed in claim 12, wherein said signal processor is configured to correlate outputs from the photo-sensitive detector which have linear polarizers in FAIM techniques with outputs from the photo-sensitive detector which have no linear polarizers.

14. The detector as claimed in claim 12, wherein said signal processor is configured to correlate outputs from the photo-sensitive detector which have no linear polarizers in FLIM techniques with outputs from the photo-sensitive detectors which have linear polarizers.

15. A detector for detecting photoluminescence from a sample, said detector comprising: an array of photo-sensitive detectors configured to receive photoluminescence, said array including a first set of photo-sensitive detectors and a second set of photo-sensitive detectors; a colored filter over the second set of photo-sensitive detectors, wherein there is no colored filter over the first set of photo-sensitive detectors; wherein each of first and second sets of photo-sensitive detectors includes: a first photo-sensitive detector having a first type of linear polarization filter; and a second photo-sensitive detector having a second type of linear polarization filter; wherein the first and second types of linear polarization filters have different planes of polarization.

16. The detector of claim 15, wherein each of first and second sets of photo-sensitive detectors further includes a third photo-sensitive detector having no polarization filter.

17. The detector of claim 16, wherein the colored filter is selected from the group consisting of a red wavelength filter, a blue wavelength filter and a green wavelength filter.

18. The detector of claim 16, further comprising a signal processor configured to process outputs from said array of photo-sensitive detectors to provide both fluorescence anisotropy imaging microscopy (FAIM) information and fluorescence lifetime imaging microscopy (FLIM) information.

19. The detector of claim 18, wherein said signal processor is configured to correlate outputs from the first and second photo-sensitive detectors of said array which have linear polarization filters in FAIM techniques with outputs from the third photo-sensitive detectors of said array which have no polarization filter.

20. The detector of claim 18, wherein said signal processor is configured to correlate outputs from the third photo-sensitive detectors of said array which have no polarization filter in FLIM techniques with outputs from the first and second photo-sensitive detectors of said array which have linear polarization filters.

21. A detector for detecting photoluminescence from a sample, said detector comprising: an array of photo-sensitive detectors configured to receive photoluminescence, at least one first photo-sensitive detector in said array having a first type of linear polarization filter and at least one second photo-sensitive detector in said array having a second type of linear polarization filter, wherein said first type of linear polarization filter has a plane of polarization which is at angled with respect to a plane of polarization of said second type of polarization filter; and wherein each of the first and second linear polarization filters is provided by a grid of parallel wires, a longitudinal extent of said parallel wires defining a plane of polarization.

22. The detector of claim 21, wherein a spacing between adjacent wires in the grid of parallel wires is less than a wavelength of light to be detected.

23. The detector of claim 21, wherein the detector is used to detect fluorescence.

24. The detector of claim 21, wherein each photo-sensitive detector is a SPAD.

25. The detector of claim 21, wherein at least one photo-sensitive detector of said array has a wavelength filter.

26. The detector of claim 25, wherein first ones of the plurality of photo-sensitive detectors in said array are provided with a red wavelength filter, second ones of the plurality of photo-sensitive detectors in said array are provided with a green wavelength filter, and third ones of the plurality of photo-sensitive detectors in said array are provided with a blue wavelength filter.

27. The detector of claim 26, wherein each of said first, second, and third ones of the plurality of photo-sensitive detectors comprise said first photo-sensitive detector having the first type of linear polarization filter and said second photo-sensitive detector having the second type of linear polarization filter.

28. The detector of claim 27, wherein at least one third photo-sensitive detector of said array is provided with no linear polarization filter.

29. The detector of claim 28, wherein each of said first, second, and third ones of the plurality of photo-sensitive detectors further comprise said third photo-sensitive detector of said array with no linear polarization filter.

30. The detector of claim 26, wherein fourth ones of the plurality of photo-sensitive detectors in said array do not have a wavelength filter.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) Some embodiments will now be described by way of example only and with reference to the accompanying Figures in which:

(2) FIG. 1A schematically shows the principles used in some embodiments;

(3) FIG. 1B shows schematically the horizontal and vertical polarization components;

(4) FIG. 2 schematically shows a system;

(5) FIG. 3 schematically shows a second system;

(6) FIG. 4 schematically shows a third system using a single detector;

(7) FIG. 5A shows a cross section of a SPAD device used in some embodiments;

(8) FIG. 5B shows a cross section of a second SPAD device used in some embodiments;

(9) FIG. 6 shows a perspective view of the SPAD device of FIGS. 5A-5B;

(10) FIG. 7 shows schematically an example of an imager with linear polarization filtering;

(11) FIG. 8 shows the imager of FIG. 7 with the addition of color filters and schematically shows the associated processing functions; and

(12) FIG. 9 shows the method of ISP processing when the imager of FIG. 7 is used in the arrangement of FIG. 4.

DETAILED DESCRIPTION

(13) Reference is made to FIG. 1A which shows the principles used in some embodiments. Light from a light source 100 is emitted and passes through a linear polarizer 101. The linear polarizer 101 will cause the unpolarized light emitted by the light source 100 to be linearly polarized (Vertical-polarization in the example shown), V-polarization. The vertically polarized light 102 is then directed onto a sample 104, which for example, may be in a cuvette, or for example, may be on a microscope slide. If, for example, the sample 104 is optically excited at an appropriate wavelength (i.e., with a photon energy higher than the lowest unoccupied molecular orbital, or other similar mechanism) by the vertically polarized light 102, the sample 104 will subsequently emit light 110 which is unpolarized. The light emitted from the sample 110, may for example be, fluorescence.

(14) Reference is made to FIG. 1B, the optical emission (unpolarized light) 110 emitted by sample 104, will have both vertical and horizontal planar components. The intensity of the planar components (for example vertical, or horizontal) of the light emitted 110 by the sample 104, may provide intracellular information of the sample 104.

(15) Reference is now made to FIG. 2 which schematically shows a system. Light from the light source 100 is emitted and passes through a first linear polarizer 101. The linear polarizer 101 will cause the unpolarized light emitted by the light source 100 to be linearly polarized, for example, vertically polarized. The vertically polarized light 102 is then directed via a first beam splitter 111 onto a sample 104, for example through a microscope objective 103. The optical emission 110 from the sample 104, which will be unpolarized, may then be collected by the microscope objective 103. The unpolarized optical emission 110 may then be passed through the first beam-splitter 111. The first beam-splitter 111 may for example have dichroic properties which may filter the wavelength of the optical emission 110, to a desired wavelength range. In some embodiments a monochromator, or other wavelength filtering apparatus may for example be used. The unpolarized optical emission 110 may then be passed through a second beam-splitter 112, which may for example, have a 50:50 transmission to reflection ratio.

(16) The reflected unpolarized optical emission 110 may then be passed through a linear polarizer 113. The linear polarizer 113, for example, may only transmit the vertically polarized components 114 of the optical emission 110 from the sample 104. Accordingly, only the vertically polarized components 114 of the optical emission 110 from the sample 104, will reach the detector 115, and hence be measured.

(17) The transmitted unpolarized optical emission 110 may then be passed through a linear polarizer 116. The linear polarizer 116, for example, may only transmit the horizontally polarized components 117 of the optical emission 110 from the sample 104. Accordingly, only the horizontally polarized components 117 of the optical emission 110 from the sample 104, will reach the detector 118, and hence be measured.

(18) Reference is now made to FIG. 3 which shows a second system. In this example, the light 102 emitted from the light source 100 may be pulsed. If, for example, the sample 104 is excited with a pulsed light source 100, the optical emission 110 from the sample 104 will also be pulsed. If the decay time of the pulsed light source 100 is sufficiently short (for example, less than a nanosecond), and the response time of the detectors 115, and 118 is fast enough, the lifetime of the optical emission 110 may be measured. This, for example, may be accomplished using a Time-Correlated Single Photon Counting (TCSPC) technique, using a TCSPC unit 123. The laser driver 125 may trigger the light source 100 to emit a pulse of light using a trigger signal 126. The laser driver may in turn be controlled by the TCSP unit 123 using a control signal 124. In some embodiments, other techniques may be used to pulse modulate the light emitted from the source, for example an acoustic-optical modulator (AOM) in the beam path, or for example a Q-switched laser system, or similar. The pulse of light may then be directed onto the sample 104, with the respective vertical 114 and horizontal 117 components, of the sample's 104 optical emission 110, being detected at detectors 115 and 118 respectively as discussed above and reporting their respective detection data 121 and 122 to the TCSPC unit 123. Correlating the time at which the light source 100 was triggered by the laser driver 125, with the optical emission 110 detected at detectors 115 and 118 respectively, may allow the lifetime of the optical emission 110 to be measured. It may also be possible, for example, to measure the lifetime of the vertical components 114, and the vertical components 117 of the optical emission 110 separately.

(19) For example, in using the techniques described above it may be possible to measure the lifetime of both homo-Forster Resonance Energy Transfer (FRET) and hetero-Forster Resonance Energy Transfer (FRET) between spectrally different fluorophores. However, these techniques are cumbersome, and measuring the lifetime of the excited states of the fluorophores using FLIM, would require a third detector without polarizers. More equipment would be needed to further separate these signals spectrally, such as a monochromator, or colored filters.

(20) Reference is now made to FIG. 4, which shows a similar arrangement as discussed above but which uses, for example, only a single detector 28, which may be used for FAIM and FLIM. The signal from the detector, may be passed to an image signal processor 74, which may process the information into a desirable output. If only a single detector 28 is used, the complexity of signal processing performed within the processor 74 required to separate the signals is increased.

(21) In some embodiments, the detector 28 may use single photon avalanche diodes (SPAD) to sense the reflected light. In general, an array of SPADs are provided as a sensor in order to detect a reflected light pulse or light. A photon may trigger an avalanche current in one or more of the SPADs in an SPAD array. The avalanche current may signal an event, namely that a photon of light has been detected.

(22) SPADs operate as follows. At an initial time, the diode is reverse-biased to a voltage larger than its breakdown voltage. The reception of a photon in the diode junction area starts an avalanche current in the diode, which creates an electric pulse. The diode is then biased back to a voltage smaller than the breakdown voltage to quench the avalanche current, so that the SPAD may again react to the reception of a photon. However, the diode must again be reverse-biased to a voltage larger than its breakdown voltage in order to react to another photon. SPADs can currently be used in cycles having reactivation periods shorter than 10 ns.

(23) The detector 28 may comprise one or more SPADs. In some embodiments, an array of SPADs will be provided. As will be discussed in more detail later, some or all of the SPADs will have a linear polarizing filter 40.

(24) Reference is made to FIG. 5A which schematically shows a cross section of a SPAD used in some embodiments. The SPAD 54 may be provided in a p-substrate 52. Respective p wells 30 and 42 may be provided in the substrate. Between the two p-wells 30 and 42 is provided an n-well region. The n-well region comprises a deep n-well 34, an n-well 32 and an n+ region 36. The n+ region 36 is adjacent the surface region of the SPAD and has a cathode 38 in contact therewith. Each of the p-wells 30 and 42 is provided with a respective p+ region 46 and 44. A respective anode 48 and 50 is provided in contact with the respective p+ region 46 and 44. It should be appreciated that a multiplication junction is provided between the deep n-well 34 and the p-substrate 52.

(25) Reference is now made to FIG. 5B which schematically shows a cross section of a SPAD used in some embodiments. The SPAD 254 may be provided in a P-substrate 252. Respective P-wells 230, 231 and 232 may be provided in the substrate. Each of the P-wells 230, 231 and 232 comprise a p+ region 234, 235 and 236. A respective anode 238 is provided to the p+ region 235. Each of the p+ regions 234 and 236 are provided with electrical grounding 237 and 239. The N well regions 240 and 241 are provided respectively between the P well regions 230 and 231 and between the P well regions 23, and 232 (i.e. in a P-N-P-N-P arrangement). Each of the N-wells 240 and 241 comprise an n+ region 242 and 243, respectively. The N wells 240 and 241 are provided with cathodes 244 and 245, respectively. The N-P-N wells 240, 231 and 241, respectively, are provided with a deep N-well 246. A multiplication junction 247 is provided between the deep N-well 246 and P well 231. In some embodiments the linear polarizer grid edges 248 should contact from top metal down to Poly, to avoid side illumination.

(26) A closely spaced metal wire grid 40 is provided over the surface of the SPAD and is thus between the SPAD detector and the source of the reflections. The wire grid has a plurality of parallel wires. The closely spaced wire grid acts as a polarization filter for light. The spacing d between the wires may be smaller than the wavelength of light and may for example be: d=/2 (where is wavelength). The width w of the wire may be as small as the process allows: w=minimum (where w is the wire width, where the wire may for example be made of metal), the value of w may for example be 0.14 m.

(27) In some embodiments, a wire grid filter may be provided on each individual SPAD.

(28) It should be appreciated that the orientation of the wires controls the direction of the linear polarization provided by the grid.

(29) In this regard, reference is made to FIG. 6 which schematically shows the grid 40 provided on the SPAD 54. In some embodiments, it is ensured that the grid end edges, in the longitudinal direction parallel to the wires, should contact from the top metal down to the poly layer to avoid side illumination impinging on the SPAD, thus bypassing the polarization function provided by the grid. The edges which are perpendicular to the longitudinal direction of the wires do still provide a polarization function. However, in some embodiments, the grid end edges in the parallel direction to the wires may be such that there is a continuous side edge to prevent any side illumination.

(30) Reference is now made to FIG. 7 which schematically shows an arrangement of filters on the SPAD array. In this example, some of the SPADs 60 are without any wire grid and are thus able to detect all light including polarized light. In other words, these SPADs do not have any filter on them. Some of the SPADs 62 are each provided with a wire grid which is oriented in one direction and some of the SPADs 64 are provided with wire grids which are oriented in a direction perpendicular to that of SPADs 62. In the example shown in FIG. 7 those SPADs referenced 62 may for example only detect vertically polarized light whereas as those which are referenced 64 are able to detect only horizontally polarized light.

(31) Reference is made to FIG. 8 which shows a modification to the arrangement shown in FIG. 7. In this example, color filters are additionally provided to allow spectral discrimination. For example, those pixels referenced 66 may have no color filter. The pixels without a color filter 66 may be used to detect spectrally wide band emission (i.e., detect all of the emitted light without spectral filtering). In some embodiments, these pixels 66 may be in an array together with RGB filtered SPADs. In other embodiments, these pixels 66 may be used exclusively.

(32) Those pixels referenced 68 may have a green filter 69, those pixels referenced 70 may have a red filter 71 and those pixels referenced 72 may have a blue filter 73. It should be appreciated that in different embodiments more or less than the three color filters may be provided. It should be appreciated that alternatively or additionally, different colored filters may be used. In some embodiments, the color filters may be provided on an individual pixel basis. Different patterns and positions for the filters may thus be provided in different embodiments.

(33) In some embodiments, the SPADs which have a linear polarizer in-front of them are used to measure homo-FRET in both steady-state and time-resolved FAIM techniques. In other embodiments, the SPADs which do not have a linear polarizer in-front of them may be used in combination or otherwise with the detected polarized light in FAIM techniques, for example as photon counters.

(34) In some embodiments, the SPADs which do not have a linear polarizer in-front of them are used to measure the fluorescence lifetime (hetero-FRET) in FLIM techniques. In other embodiments, the SPADs which do have a linear polarizer in-front of them may be used in combination or otherwise with the detected unpolarized light in FLIM techniques, for example as photon counters.

(35) In some embodiments, SPADs with color filters in-front of them are used to obtain spectrally distinct fluorescence of both homo-FRET, and hetero-FRET, using FAIM and FLIM techniques respectively. In some embodiments these color filters may be red, green, and blue. In other embodiments other types of wavelength filters may be used, for example, dichroic filters, band pass filters, edge filters, notch filters, or the like. In other embodiments SPADs with no color filters in-front of them are used to obtain spectrally wide band emission for both FAIM and FLIM techniques.

(36) Table 1 below shows an example of some embodiments, where an X indicates how information from the detector may be used. Pol indicates that polarization information has been measured, and none indicates that no polarization information has been measured.

(37) TABLE-US-00001 TABLE 1 Red filter Green filter Blue filter No-color filter Pol none Pol none Pol none Pol none FAIM X X X X (Homo- FRET) FLIM X X X X (Hetero- FRET)

(38) In some embodiments, information from the SPADs which measure polarized emission are used to measure FAIM, and information from the SPADs which do not measure polarized emission are used to measure FLIM.

(39) It should be appreciated that the information from at least one detector, with or without a filter arrangement, may be used to contribute information to the FAIM and FLIM techniques, using data correlation techniques.

(40) The outputs from the SPAD array is provided to an image signal processor (ISP) 74. The image signal processor is thus able to provide outputs for the vertically polarized light, the perpendicularly polarized light and the fluorescence lifetime. In the ISP 74 the fluorescence lifetime is calculated by fitting the time-resolved fluorescence decay, using FLIM, to an exponential function, wherein the lifetime is equal to the exponential decay constant of the exponential fit. This information is provided for each of the three colors, as well as the wide band pixels. As can be seen, information for each of the different colors may be graphically represented for each of the polarizations. For example, graphs may be provided which show intensity plotted against wavelength (). The peaks referenced 80 are for the blue filtered results, those referenced 82 are for the green filtered results and those referenced 84 are for the red filtered results. The first graph shows the results for the vertical polarization, the second graph shows the results for the horizontal polarization and the third graph shows the results where there is no polarization filter.

(41) Reference is now made to FIG. 9, which shows, for example, the processing undertaken by the image signal processor (ISP) 74. The signal generated by the detector depicted in FIG. 8 by references 66, 68, 70 and 72, may then be passed into the ISP 74 as an input from the detector array 91. The timing signal from the laser driver may then also be passed into the ISP 74 as an input from the laser driver 92. The ISP 74, may then separate 93 the spectral, and polarized and un-polarized components of the signal 91 from the detector. This information may then be temporally correlated 94 with the input from the laser driver 92. The ISP 74 may then output the polarized information and lifetime components 76, 77, and 78. The polarized information and lifetime components may then be further separated into their spectral components for example, using the red, green and blue color filters described earlier. For example, the parallel polarized lifetime output 76, may be separated into red 76a, green 76b, and blue 76c. The orthogonal polarized lifetime output may be separated into red 77a, green 77b, and blue 77c. Additionally, the unpolarized lifetime may be separated into red 78a, green 78b, and blue 78c.

(42) It should be appreciated that the information which is captured by the array can be processed in any suitable manner.

(43) It should be appreciated that some embodiments of the invention may allow a compact device to the achieved.

(44) In some embodiments the polarization filters, and/or color filters, may be printed onto one or more transmissive surfaces, for example, silica or quartz, to form an arrayed optical filter. Such an optical filter may then be positioned in-front of an array of SPADs, to achieve a similar effect.

(45) In some embodiments the relationship between filters and photo-sensitive detectors is not one to one. A single filter, for example, a linear polarizer, may cover more than one SPAD, for example four SPADs. Likewise, for example, a single color filter may cover more than one SPAD. It should be appreciated that the number of SPADs, covered or not covered, by at least one of the filters, may vary.

(46) Some embodiments may use other photo-sensitive detectors, instead of SPADs, for example, APDs, photodiodes, or the like. These sensors may be integrating elements generating events on reception of the light information.

(47) It should be appreciated that the above described arrangements may also be used for other photoluminescence applications, for example phosphorescence applications, or Raman spectroscopy. Raman spectroscopy typically being a method of characterizing a substance by reflecting light of a known wavelength from a surface, and measuring small changes in the wavelength of the reflected light.

(48) It should be appreciated that the above described arrangements may be implemented at least partially by an integrated circuit, a chip set, one or more dies packaged together or in different packages, discrete circuitry or any combination of these options.

(49) Various embodiments with different variations have been described here above. It should be noted that those skilled in the art may combine various elements of these various embodiments and variations.

(50) Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the scope of the present invention. Accordingly, the foregoing description is by way of example only and is not intended to be limiting. The present invention is limited only as defined in the following claims and the equivalents thereto.