Imaging device, imaging method, and imaging system
10921266 ยท 2021-02-16
Assignee
Inventors
Cpc classification
H01J37/244
ELECTRICITY
G21K2207/005
PHYSICS
G01N23/20075
PHYSICS
H01J2237/24495
ELECTRICITY
International classification
G01N23/20
PHYSICS
Abstract
The present invention discloses an imaging device, an imaging method, and an imaging system, belonging to the field of sample image data acquisition and imaging technology. The imaging device includes: a charged particle source, a convergence system, a scanning control system, a detection module, and a spectral analysis module disposed below the detection module, where the detection module includes a plurality of pixelated detector units; and the detection module is provided with a hole thereon. The diffraction pattern is obtained by using the detection module, and the spectral analysis module performs spectral analysis on a charged particle beam passing through the hole, so as to obtain the diffraction pattern and spectral signal simultaneously by one scanning. The imaging method of the present invention is based on a hollow ptychography method, which enables toper form imaging on the diffraction pattern obtained through the detection module, with good imaging effects.
Claims
1. An imaging device, comprising: a charged particle source (1), configured to emit a charged particle beam; a convergence system (2), configured to constrain and converge the charged particle beam; a scanning control system (3), configured to control the charged particle beam to scan a sample; the sample (4); a detection module (5), configured to receive the charged particle beam and detect a signal strength of the charged particle beam to acquire at least one diffraction pattern; and a spectral analysis module (6) disposed below the detection module (5), configured to analyze spectroscopic characteristics of the charged particle beam to acquire spectral data, wherein the detection module (5) comprises a plurality of pixelated detector units (7) and the detection module (5) is provided with a hole (8) thereon, wherein the imaging device performs hollow ptychography on the at least one diffraction pattern based on a hollow ptychography algorithm to reconstruct an image, and wherein the reconstructed image is obtained through computer calculation.
2. The imaging device according to claim 1, wherein the hole (8) is of, but not limited to, a circular, square, or annular shape.
3. The imaging device according to claim 1, wherein the detection module (5) is of, but is not limited to, a square shape, a circular shape, and an island shape.
4. The imaging device according to claim 2, wherein the detection module (5) is of, but is not limited to, a square shape, a circular shape, and an island shape.
5. The imaging device according to claim 1, wherein the imaging device acquires the at least one diffraction pattern by performing the following steps: A: converging, onto the sample (4) by the convergence system (2), the charged particle beam emitted by the charged particle source (1); B: controlling, by the scanning control system (3), the charged particle beam to scan the sample (4); C: the charged particle beam penetrating the sample (4) to arrive at the detection module (5), detecting the signal strength of the charged particle beam in a corresponding scanning position by the pixelated detector unit (7) in the detection module (5), and acquiring a diffraction pattern in the corresponding scanning position; and D: the charged particle beam scanning the sample (4), enabling a non-empty set R.sub.overlap to be present between a scanning area R.sub.i corresponding to a scanning beam spot and other scanning areas R.sub.j wherein R.sub.overlap=R.sub.iR.sub.j(iN, jN), and N is the total number of scanning areas of the charged particle beam on the sample (4).
6. The imaging device according to claim 1, wherein the performing the hollow ptychography on the at least one diffraction pattern based on the hollow ptychography algorithm particularly comprises the following steps: a: setting P(r) as a probe function and O(r) as a complex amplitude distribution function of an object, reconstructing O(r) through a plurality of iterative calculations, using O(r), which is reconstructed through a final iterative calculation, as a final complex amplitude distribution function of the object, and reconstructing the image through the hollow ptychography based on the final complex amplitude distribution function of the object; b: setting .sub.n,m as a function of an exit wave penetrating the object, and defining .sub.n,m as a product of the probe function (P)r and the complex amplitude distribution function O(r) of the object, to obtain
.sub.n,m(r)=P(r).Math.O.sub.n(r+R.sub.m)formula (1) wherein n represents the n.sup.th iteration of O(r), m represents the m.sup.th scanning position of the charged particle beam on the sample, R.sub.m represents a relative coordinate vector of the charged particle beam in the M.sup.th scanning position on the sample relative to a first scanning position, and r is a space coordinate; c: obtaining amplitude and phase distributions of the exit wave function .sub.n,m in a far field by performing Fourier transform on the function .sub.n,m of the exit wave penetrating the object, to obtain
.sub.n,m=FFT{.sub.n,m(r)}=|A.sub.n,m|exp(i.sub.n,m)formula (2), wherein |A.sub.n,m| represents an amplitude of the exit wave function .sub.n,m in the far field; and .sub.n,m represents a phase of the exit wave function .sub.n,m, in the far field; d: collecting, by using an experimental device, a far-field light intensity of an exit wave penetrating the sample, and recording the same I.sub.m, wherein I.sub.m represents the far-field light intensity of the exit wave penetrating the sample after the charged particle beam scans the m.sup.th scanning position on the sample; e: setting a constraint function M; f: substituting {square root over (I.sub.m )} for the amplitude |A.sub.n,m| of the exit wave function .sub.n,m in the far field and substituting into the constraint function M so as to obtain formula (3):
.sub.n,m,new(r)={square root over (I.sub.m)}exp(i.sub.n,m)M+|A.sub.n,m)exp(i.sub.n,m)(1M)formula (3) g: obtaining a new exit wave function .sub.n,m,new(r) by performing inverse Fourier transform on .sub.n,m,new(r), which is shown by formula (4):
.sub.n,m,new(r)=FFT.sup.1{.sub.n,m,new(r)}formula (4) h: obtaining, through calculation, a new complex amplitude distribution function of the object according to the new exit wave function .sub.n,m,new(r), which is shown by formula (5):
7. The imaging device according to claim 5, wherein the performing the hollow ptychography on the at least one diffraction pattern based on the hollow ptychography algorithm particularly comprises the following steps: a: setting P(r) as a probe function O(r) and as a complex amplitude distribution function of an object, reconstructing through a plurality of iterative calculations, using O(r), which is reconstructed through a final iterative calculation, as a final complex amplitude distribution function of the object, and reconstructing the image through the hollow ptychography based on the final complex amplitude distribution function of the object; b: setting .sub.n,m as a function of an exit wave penetrating the object, and defining .sub.n,m as a product of the probe function P(r) and the complex amplitude distribution function O(r) of the object, to obtain
.sub.n,m(r)=P(r).Math.O.sub.n(r+R.sub.m)formula (1), wherein n represents the n.sup.th iteration of O(r), m represents the m.sup.th scanning position of the charged particle beam on the sample, R.sub.m represents a relative coordinate vector of the charged particle beam in the m.sup.th scanning position on the sample relative to a first scanning position, and r is a space coordinate; c: obtaining amplitude and phase distributions of the exit wave function .sub.n,m in a far field by performing Fourier transform on the function .sub.n,m of the exit wave penetrating the object, to obtain
.sub.n,m(r)=FFT{.sub.n,m(r)}=|A.sub.n,m|exp(i.sub.n,m)formula (2), wherein |A.sub.n,m| represents an amplitude of the exit wave function in the far field .sub.n,m; and .sub.n,m represents a phase of the exit wave function in the far field .sub.n,m; d: collecting, by using an experimental device, a far-field light intensity of an exit wave penetrating the sample, and recording the same as I.sub.m, wherein I.sub.m represents the far-field light intensity of the exit wave penetrating the sample after the charged particle beam scans the m.sup.th scanning position on the sample; e: setting a constraint function M; f: substituting {square root over (I.sub.m )} for the amplitude |A.sub.n,m| of the exit wave function .sub.n,m in the far field and substituting into the constraint function M so as to obtain formula (3):
.sub.n,m,new(r)={square root over (I.sub.m)}exp(i.sub.n,m)M+|A.sub.n,m|exp(i.sub.n,m)(1M)formula (3) g: obtaining a new exit wave function .sub.n,m,new(r) by performing inverse Fourier transform on .sub.n,m,new(r), which is shown by formula (4):
.sub.n,m,new(r)=FFT.sup.1{.sub.n,m,new(r)}formula (4) h: obtaining, through calculation, a new complex amplitude distribution function of the object according to the new exit wave function .sub.n,m,new(r), which is shown by formula (5):
8. The imaging device according to claim 6, wherein the constraint function M is related to a structure of the detection module (5).
9. The imaging device according to claim 7, wherein the constraint function M is related to a structure of the detection module (5).
10. The imaging device according to claim 8, wherein in the first iteration of O(r), a complex amplitude distribution function O.sub.0(r+R.sub.m) of the object is set as a random distribution function.
11. The imaging device according to claim 9, wherein in the first iteration O(r), of a complex amplitude distribution function O.sub.0(r+R.sub.m) of the object is set as a random distribution function.
12. An imaging system, comprising the imaging device according to claim 1.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
DESCRIPTION OF REFERENCE NUMERALS
(19) 1. Charged particle source; 2. Convergence system; 3. Scanning control system; 4. Sample; 5. Detection module; 6. Spectral analysis module; 7. Pixelated detector unit; 8. Hole.
DETAILED DESCRIPTION
(20) The present invention is further described below with reference to the accompanying drawings and examples.
Example 1
(21) Referring to
(22) The charged particle source 1 is configured to emit a charged particle; the convergence system 2 is configured to constrain and converge a charged particle beam; the scanning control system 3 is configured to control the charged particle beam to scan the sample, and the manner of scanning includes, but is not limited to, moving the charged particle beam or moving the sample; the detection module 5 is configured to receive the charged particle and detect the signal strength of the charged particle; and the spectral analysis module 6 disposed below the detection module 5 is configured to analyze spectroscopic characteristics of the charged particle. Referring to
(23) In an imaging process of the imaging device, a charged particle beam is emitted by the charged particle source 1 first; the charged particle beam enters the convergence system 2 for convergence; the converged charged particle beam scans the sample 4; the charged particle beam is controlled by the scanning control system 3 to scan the sample 4; a particular area on the sample 4 is irradiated and scanned; the charged particle beam on each scanning point may penetrate or partly penetrate the sample 4 in the process of scanning; the charged particle beams penetrating the sample 4 enter the detection module 5; some of the charged particle beams are received by the detection module 5, and the other charged particle beams pass through the hole 8 on the detection module 5 and enter the spectral analysis module 6; the charged particle beams received by the detection module 5 can be detected by the detection module so as to give the signal strength in a plurality of spatial positions within a scanning range of the sample at a time; and the charged particle beams entering the spectral analysis module 6 are used to obtain spectral data, energy loss spectra, or the like by using the spectral analysis module.
(24) The device of this example obtains diffraction patterns by using a detection module having a hole, and performs spectral analysis by using a charged particle beam passing through the hole, so as to obtain diffraction patterns and spectral signals simultaneously by one scanning, which may improve the efficiency of acquiring data.
Example 2
(25) Based on Example 1, referring to
Example 3
(26) An imaging method of this example includes a method for acquiring at least one diffraction pattern and a method for performing ptychography on the acquired at least one diffraction pattern by using a hollow ptychography method.
(27) The method for acquiring at least one diffraction pattern is based on a set of imaging devices. Referring to
(28) Steps of the method are as follows: converging, by the convergence system 2, a charged particle beam emitted by the charged particle source 1 onto the sample 4; controlling, by the scanning control system 3, the charged particle beam to scan the sample 4; and the charged particle beam penetrating the sample to arrive at the detection module, detecting the signal strength of a charged particle in a corresponding scanning position by the pixelated detector unit 7 in the detection module 5, and acquiring a diffraction pattern in the corresponding scanning position by the detection module 5 provided with the hole 8. After the charged particle beam is controlled by the scanning control system 3 to scan the sample 4, the convergence system 2 and the scanning control system 3 can precisely determine an area range irradiated by the charged particle beam on the sample, the size of the area range, and its relative position. It can be clear that diffraction pattern obtained by the detection module 5 every time the charged particle beam scans the sample is created when the charged particle beam penetrates a particular position and area on the sample. An irradiation range of the charged particle beam is defined as R (a set of coordinates of all points within an irradiation area relative to an origin), and the obtained diffraction pattern is defined as D (D is a set of signal sizes (light intensities) obtained by each detector unit). The imaging device obtains data information of (R, D) simultaneously in each scanning in the scanning process. The diffraction pattern is based on the strength of the charged particle obtained by the detector unit in the detection module 5.
(29) The charged particle beam scans the sample 4 and a set of diffraction pattern information of the sample is obtained. The information includes scanning position information and diffraction pattern information, such as {(R.sub.1, D.sub.1), (R.sub.2, D.sub.2) . . . (R.sub.N, D.sub.N)}. There is a non-empty set R.sub.overlap between a scanning area R.sub.i of the charged particle beam on the sample 4 and one or more other scanning areas R.sub.j, R.sub.overlap=R.sub.iR.sub.j (iN, jN) and N is the total number of scanning areas of the charged particle beam on the sample 4. That is, a scanning area in which each diffraction pattern is generated is required to overlap with one or more other scanning areas in which at least one diffraction pattern is generated.
Example 4
(30) Based on Example 3, an imaging method of this example relates to obtaining an image by processing the diffraction pattern obtained by the detection module 5 based on a hollow ptychography algorithm. With the imaging method, a phase contrast sample image may be obtained with the at least one diffraction pattern of the charged particle. Based on initial data of the at least one diffraction pattern and an initially speculated iterative process of an exit wave, amplitude and phase information of the exit wave is reconstructed.
(31) Relationships between a phase, an amplitude, and imaging for the reconstruction are as follows:
(32) A final result of the reconstruction is a function O(r), an independent variable of the function is a position coordinate, and the value of the function may be understood as a change amount of the amplitude and the phase of the charged particle beam when penetrating the sample in particular position coordinates. It may be agreed that an relative value of the change amount of the amplitude and the phase of the charged particle beam is converted into a different gray scale value, and a gray scale picture is obtained by using different amplitude and phase change amounts in different spatial coordinates, which can be understood as a reconstructed image. An image obtained with an amount of amplitude change in O(r) is referred to as an amplitude contrast image, and an image obtained with an amount of phase change is referred to as a phase contrast image.
(33) Referring to
(34) setting P(r) as a probe function, where the probe function is an incident wave function before the charged particle beam arrives at the sample, and r is a spatial coordinate;
(35) setting O(r) as a complex amplitude distribution function of an object, where the complex amplitude distribution function of the object can reflect the structure and characteristics of the object sufficiently, the value of the complex amplitude distribution function of the object represents the effect of a characteristic position of the sample on a charged particle beam that passes through the sample (specifically embodied as changes in amplitude and phase), and O(r) is a target function and complex function; reconstructing O(r) through a plurality of iterative calculations by the method of this example; and using O(r), which is obtained by a last iterative calculation, as the complex amplitude distribution function of the object, where r is a space coordinate, O.sub.n(r) represents a target function in the n.sup.th iteration, the value of O.sub.n(r) also varies over time throughout the process of iteration, and a finally reconstructed image is obtained by plotting the amplitudes and the phases of O.sub.n(r);
(36) setting .sub.n,m as a function of an exit wave penetrating the object, defining the function .sub.n,m of the emergent wave penetrating the object as a product of the probe function P(r) and the complex amplitude distribution function O(r) of the object:
.sub.n,m(r)=P(r).Math.O.sub.n(r+R.sub.m)Formula (1), where
(37) n represents the n.sup.th iteration of O(r), m represents the m.sup.th scanning position of the charged particle beam on the sample, and R.sub.m represents a relative coordinate vector of the charged particle beam in the m.sup.th scanning position on the sample relative to a first scanning position;
(38) obtaining amplitude and phase distributions of the exit wave function .sub.n,m in a far field by performing Fourier transform on the function .sub.n,m of the exit wave penetrating the object, to obtain
.sub.n,m(r)=FFT{.sub.n,m(r)}=|A.sub.n,m|exp(i.sub.n,m)Formula (2), where
(39) |A.sub.n,m| represents an amplitude of the exit wave function .sub.n,m in a far field in the n.sup.th iteration, .sub.n,m represents a phase of the emergent wave function .sub.n,m in the far field in the n.sup.th iteration, and i is an imaginary unit; and
(40) the exit wave function is usually expressed in a complex form, properties of the charged particle beam may be described by a wave function, which includes a real part and an imaginary part that may be expressed by a phase and an amplitude of the wave function, so that |(r)|.sup.2 corresponds to the strength of a charged particle beam in a position (r) in space, which may be measured actually, and a far-field light intensity of the charged particle beam in the m.sup.th scanning position on the sample is collected through an experimental device and is recorded as I.sub.m;
(41) setting a constraint function M, where the function M is related to a shape of the detection module in the above imaging system. The constraint function M is a real function, the same as the diffraction pattern (D) in space size, and is also a function of the spatial coordinate. The value of the function is used to control weights of signals of different spatial coordinates on the diffraction pattern (D) in the process of iteration. Specifically, in an experiment, the value of function M is related to a specific structure and shape of the detection module;
(42) substituting {square root over (I.sub.m)} for the amplitude |A.sub.n,m| of the emergent wave function .sub.n,m in the far field and substituting into the constraint function M so as to obtain Formula (3):
.sub.n,m,new(r)={square root over (I.sub.m)}exp(i.sub.n,m)M+|A.sub.n,m|exp(i.sub.n,m)(1M)Formula (3)
(43) obtaining a new exit wave function .sub.n,m,new by performing inverse fast Fourier transform on .sub.n,m,new(r), which is shown by Formula (4):
.sub.n,m,new(r)=FFT.sup.1{.sub.n,m,new(r)}Formula (4)
(44) obtaining, through calculation, a new complex amplitude distribution function of the object according to the new exit wave function .sub.n,m,new(r), which is shown by Formula (5):
(45)
where
(46) and are adjustable parameters, is used to ensure that a denominator is not 0, and is used to control the strength fed back; and
(47) after the new complex amplitude distribution function of the object is obtained through calculation via Formula (1)-Formula (5), re-substituting the new complex amplitude distribution function O.sub.n+1(r+R.sub.m) of the object into the Formula (1) to start another iterative calculation, and using a complex amplitude distribution function O.sub.z(r+R.sub.m) of the object, which is obtained by a final iterative calculation, as the basis of reconstructing an image, so that the reconstructed image is obtained by plotting amplitudes and phases of O.sub.n+1(r+R.sub.m).
Example 5
(48) Based on Example 4, in an imaging method of this example, the constraint function M is related to the structure of the detection module 5.
(49) In discretized conditions, the constraint function M is represented by a matrix function, each element value in the matrix function corresponds to a dependent variable, a function value of the dependent variable is 1 or 0, and an independent variable is a corresponding two-dimensional position coordinate.
(50) In addition, in calculations of a simulation program, the constraint function M is represented by a matrix function directly, the matrix function is related to the structure of the detection module 5, position coordinates in the matrix function correspond to position coordinates of the detection module 5, and position coordinates in the matrix function with a dependent variable function value being 1 correspond to position coordinates of the hole 8 on the detection module 5.
(51) In the simulation program, the matrix function corresponds to an image, position coordinates in the matrix function with a dependent variable function value being 1 are all displayed as white in the image, and position coordinates in the matrix function with a dependent variable function value being 0 are all displayed as black in the image, so that an area displayed in white in the image corresponding to the matrix function M corresponds to the position of the hole on the detection module 5.
Example 6
(52) Based on Example 5, in an imaging method of this example, in the first iteration of O(r), an initial complex amplitude distribution function O.sub.0(r+R.sub.m) of the object has a random distribution. A product of the initial complex amplitude distribution function O.sub.0(r+R.sub.m) of the object and a probe function P(r) is used as the function .sub.n,m of the exit wave penetrating the object: .sub.n,m(r)=P(r).Math.O.sub.0(r+R.sub.m).
Example 7
(53) Based on Example 5, in an imaging method of this example, in the first iteration of O(r), when there are other priori conditions, the initial complex amplitude distribution) function O.sub.0(r+R.sub.m) of the object may be used to obtain a low-resolution image of the sample by other means, and it is expected to obtain a high-resolution image based on the low-resolution image. In this case, the low-resolution image is used as the initial complex amplitude distribution function O.sub.0(r+R.sub.m) of O(r) directly.
Example 8
(54) Based on Example 5, in an imaging method of this example, the charged particle beams converge onto the sample. After sample scanning, most of the charged particle beams arrive at the detection module, but there are still charged particle beams passing through the hole 8 of the detection module. The signal strength of the charged particle beams passing through the hole 8 of the detection module is not detected by the detection module, resulting in the absence of a corresponding diffraction pattern. As a compensation, the radian of the hole 8 disposed on the detection module 5, that is, a collection angle for collecting diffraction patterns, is 5 mrad-22 mrad. In this case, the charged particle beams may scan the sample continuously, each scanning area may overlap with a plurality of other areas to some extent, and an absent diffraction pattern may be obtained again in a subsequent scanning position. The middle of the hole 8 is sufficiently small, and its boundary is sufficiently large. With such conditions satisfied, a complete reconstruction result can be obtained by using the detection module having the hole without degrading imaging quality.
Example 9
(55) Based on Example 8, in an imaging method of the example, the feasibility of the algorithm is verified by using
(56) A computer-simulated detector obtains the resolution of the diffraction pattern, 512*512, in each scanning point. Adjustable parameters and are used to control the magnitude of change of the target function for the number of times of iteration, are parameters that can be set freely, and has typical values of 0.1-0.01. In this example, the parameters are selected as =0.01 and =0.01.
(57) The function P(r) is a two-dimensional complex function in which a position on a plane is taken as a variable, and its form is not unique. In the ptychography algorithm, the function P(r) remains unchanged in iterations, and this example is simulated by a computer without changing P(r). Images of the function P(r) used in this example are shown in
(58) In an actual experiment, function M depends on the structure and shape of the detection module, and reconstruction may be performed with different functions M in a computer simulation manner. The function M is a two-dimensional (planar) real function, and usually, its size (pixel resolution) on the plane is the same as the actual physical (pixel) resolution of the detection module. In this example, the pixel resolution of function M is 512*512. The function M in this example is characterized in that its value is 1 in a circular area with a central radius of 91 pixels, which is represented by white, and its value is 0 in other areas, which is represented by black. A hole disposed on a corresponding detection module is of a circular shape, and a collection angle for acquiring a diffraction pattern is 22 mrad. That is, the value of the function is 1 in an area in which a divergence angle of a charged particle beam along an optical axis is 22 mrad, and the value of the function is 0 in the remaining areas. An image corresponding to function M (matrix function) used is shown in
(59) In this example, the number of cycles of running an iteration is 10. An amplitude image of a finally reconstructed image obtained through computer simulation is shown in
Example 10
(60) Based on Example 9, in this example, except that the number of cycles of running iterations is 50, other parameter conditions are the same as those in Example 9 and are used to experiment with image reconstruction. Results of the image reconstruction are shown in
Example 11
(61) Based on Example 9, in this example, the number of cycles of running iterations is 50. The function M is characterized in that its value is 1 in an area with a central inner radius of 20 pixels and an outer radius of 90 pixels, which is represented by white, and its value is 0 in the remaining areas, which represented by black. Referring to
(62) Other parameter conditions are the same as those in Example 6 and are used to experiment with image reconstruction. Results of the image reconstruction are shown in
Example 12
(63) Based on Example 9, in this example, the number of cycles of running iterations is 50. The function M is characterized by being of 1 in a central square area with a side length of 100 pixels, which is represented by white, and being of 0 in the remaining areas, which is represented by black. Referring to
Example 13
(64) An imaging system is provided. The system includes an imaging device and an imaging method. The imaging method uses a hollow ptychography algorithm, and the imaging device uses an imaging device provided with a hole. At least one diffraction pattern is acquired first by using the imaging device provided with the hole, and then, the at least one diffraction pattern is processed by using the hollow ptychography method, so that a ptychography image is obtained.
(65) The foregoing descriptions are merely preferred implementations of the present invention. It should be noted that various improvements and refinements can be made without departing from the principle of the present invention for a person skilled in the art, and those improvements and refinements shall also fall within the protection scope of the present invention.