METHOD AND APPARATUS FOR RECONSTRUCTING ATOMIC SPATIAL DISTRIBUTION AND ELECTRON BEAM FUNCTION
20230317409 · 2023-10-05
Inventors
Cpc classification
H01J37/244
ELECTRICITY
International classification
Abstract
The present disclosure discloses a method, which includes: obtaining, by controlling to move an electron beam to scan a sample, a diffraction intensity of the sample at each scanning position; initializing a sample transmission function and an electron beam function, establishing, based on the diffraction intensity, the sample transmission function, and the electron beam function, a forward propagation model containing to-be-optimized parameters, and calculating a value of a loss function; solving a derivative of the loss function with respect to the to-be-optimized parameters, to obtain gradients of the to-be-optimized parameters in the sample transmission function and the electron beam function, optimizing the to-be-optimized parameters based on the gradients, and updating the value of the loss function; and repeating an iteration process until an iteration termination condition is satisfied, and outputting an optimized sample transmission function and an optimized electron beam function.
Claims
1. A method for reconstructing an atomic spatial distribution and an electron beam function, comprising: S101, obtaining, by controlling to move an electron beam to scan a sample, a diffraction intensity of the sample at each scanning position; S102, describing a sample transmission function using local functions for the atomic spatial distribution, describing a electron beam function using aberration functions, establishing, based on the diffraction intensity, the sample transmission function, and the electron beam function, a forward propagation model containing to-be-optimized parameters, and calculating a value of a loss function; S103, solving a derivative of the loss function with respect to the to-be-optimized parameters, to obtain gradients of the to-be-optimized parameters in the sample transmission function and the electron beam function, optimizing the to-be-optimized parameters based on the gradients, and updating the value of the loss function; and S104, determining whether a current iteration satisfies an iteration termination condition, performing S103 in response to the current iteration failing to satisfy the iteration termination condition, and outputting, in response to the current iteration satisfying the iteration termination condition, an optimized sample transmission function and an optimized electron beam function.
2. The method according to claim 1, further comprising, prior to said describing the sample transmission function using the local functions for the atomic spatial distribution, and describing the electron beam function using the aberration functions: initializing the to-be-optimized parameters in the sample transmission function and the electron beam function, wherein the to-be-optimized parameters in the electron beam function comprises aberration coefficients, and wherein the to-be-optimized parameters in the sample transmission function comprises atom positions and parameters describing the atomic spatial distribution.
3. The method according to claim 1, wherein: the loss function is:
4. The method according to claim 1, wherein the iteration termination condition comprises: a number of iterations reaching a predetermined threshold; and/or the loss function converging to a predetermined value.
5. An apparatus for reconstructing an atomic spatial distribution and an electron beam function, comprising: an obtaining module configured to obtain, by controlling to move an electron beam to scan a sample, a diffraction intensity of the sample at each scanning position; a construction module configured to describe a sample transmission function using local functions for the atomic spatial distribution, describe a electron beam function using aberration functions, establish, based on the diffraction intensity, the sample transmission function, and the electron beam function, a forward propagation model containing to-be-optimized parameters, and calculate a value of a loss function; and an optimization module configured to solve a derivative of the loss function with respect to the to-be-optimized parameters, to obtain gradients of the to-be-optimized parameters in the sample transmission function and the electron beam function, optimize the to-be-optimized parameters based on the gradients, update the value of the loss function, repeat an iteration process until an iteration termination condition is satisfied, and output an optimized sample transmission function and an optimized electron beam function.
6. The apparatus according to claim 5, further comprising: an initialization module configured to, prior to describing the sample transmission function using the local functions for the atomic spatial distribution, and describing the electron beam function using the aberration functions, initialize the to-be-optimized parameters in the sample transmission function and the electron beam function, wherein the to-be-optimized parameters in the electron beam function comprises aberration coefficients, and wherein the to-be-optimized parameters in the sample transmission function comprises atom positions and parameters describing the atomic spatial distribution.
7. The apparatus according to claim 5, wherein: the loss function is:
8. The apparatus according to claim 5, wherein the iteration termination condition comprises: a number of iterations reaching a predetermined threshold; and/or the loss function converging to a predetermined value.
9. An electronic device, comprising a memory; a processor; and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements: S101, obtaining, by controlling to move an electron beam to scan a sample, a diffraction intensity of the sample at each scanning position; S102, describing a sample transmission function using local functions for the atomic spatial distribution, describing a electron beam function using aberration functions, based on the diffraction intensity, the sample transmission function, and the electron beam function, a forward propagation model containing a to-be-optimized parameter, and calculating a value of a loss function; S103, solving a derivative of the loss function with respect to the to-be-optimized parameters, to obtain gradients of the to-be-optimized parameters in the sample transmission function and the electron beam function, optimizing the to-be-optimized parameters based on the gradients, and updating the value of the loss function; and S104, determining whether a current iteration satisfies an iteration termination condition, performing S103 in response to the current iteration failing to satisfy the iteration termination condition, and outputting, in response to the current iteration satisfying the iteration termination condition, an optimized sample transmission function and an optimized electron beam function.
10. The electronic device according to claim 12, wherein the processor, when executing the computer program, further implements, prior to said describing the sample transmission function using the local functions for the atomic spatial distribution, and describing the electron beam function using the aberration functions: initializing the to-be-optimized parameters in the sample transmission function and the electron beam function, wherein the to-be-optimized parameters in the electron beam function comprises aberration coefficients, and wherein the to-be-optimized parameters in the sample transmission function comprises atom positions and parameters describing the atomic spatial distribution.
11. The electronic device according to claim 9, wherein: the loss function is:
12. The electronic device according to claim 9, wherein the iteration termination condition comprises: a number of iterations reaching a predetermined threshold; and/or the loss function converging to a predetermined value.
13. A computer-readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method for reconstructing the atomic spatial distribution and the electron beam function according to claim 1.
14. The computer-readable storage medium according to claim 13, wherein the method further comprises, prior to said describing the sample transmission function using the local functions for the atomic spatial distribution, and describing the electron beam function using the aberration functions: initializing the to-be-optimized parameters in the sample transmission function and the electron beam function, wherein the to-be-optimized parameters in the electron beam function comprise aberration coefficients, and wherein the to-be-optimized parameters in the sample transmission function comprise atom positions and parameters describing the atomic spatial distribution.
15. The computer-readable storage medium according to claim 13, wherein: the loss function is:
16. The computer-readable storage medium according to claim 13, wherein the iteration termination condition comprises: a number of iterations reaching a predetermined threshold; and/or the loss function converging to a predetermined value.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0025] The above and/or additional aspects and advantages of the present disclosure will become more apparent and more understandable from the following description of embodiments taken in conjunction with the accompanying drawings.
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
DETAILED DESCRIPTION
[0042] The embodiments of the present disclosure will be described in detail below with reference to examples thereof as illustrated in the accompanying drawings, throughout which same or similar elements, or elements having same or similar functions, are denoted by same or similar reference numerals. The embodiments described below with reference to the drawings are illustrative only, and are intended to explain, rather than limiting, the present disclosure.
[0043] A method and apparatus for reconstructing an atomic spatial distribution and an electron beam function, an electronic device, and a storage medium according to embodiments of the present disclosure will be described below with reference to the accompanying drawings. For problems mentioned above in BACKGROUND of an inability to parametrically represent atom positions, orbital occupation, aberration coefficients, etc., the present disclosure provides a method for reconstructing an atomic spatial distribution and an electron beam function. In the method, an electron beam function is represented by, but not limited to, aberration functions corresponding to aberration coefficients, and a transmission function is represented by, but not limited to, a parametrical form of local functions of an atomic spatial distribution, allowing resolution with sub-pixel precision to be achieved. In addition, the information on atom positions and the atomic spatial distribution is represented parametrically while advantages of conventional ptychographic imaging are retained. Therefore, a problem in the related art that only two-dimensional image of a sample can be obtained but parameterized representations of atom positions, orbital occupation, aberration coefficients, etc., are impossible is solved.
[0044]
[0045] As illustrated in
[0046] At block S101, a diffraction intensity of a sample at each scanning position is obtained by controlling to move an electron beam to scan the sample.
[0047] In a further embodiment, the sample is scanned periodically or aperiodicity by moving the electron beam. Diffraction intensity data generated when the electron beam is located at each scanning position is collected. A diffraction intensity is obtained from the diffraction intensity data.
[0048] At block S102, a sample transmission function and an electron beam function are constructed, a forward propagation model containing to-be-optimized parameters is established based on the diffraction intensity, the sample transmission function, and the electron beam function, and a value of a loss function is calculated.
[0049] In embodiments of the present disclosure, the sample transmission function is described using a function including, but not limited to, local functions for the atomic spatial distribution, and the electron beam function is described using a function including, but not limited to, aberration functions. The loss function is obtained based on a constructed sample transmission function and a constructed electron beam function, in such a manner that a ptychographic reconstruction problem is changed into an optimization problem.
[0050] Optionally, in an embodiment of the present disclosure, the method further includes, prior to the action of constructing the sample transmission function and the electron beam function: initializing the to-be-optimized parameters in the sample transmission function and the electron beam function. The to-be-optimized parameters in the electron beam function includes the aberration coefficients. The to-be-optimized parameters in the sample transmission function include atom positions and parameters describing the atomic spatial distribution.
[0051] Before construction of the sample transmission function and the electron beam function, parameters in the sample transmission function and the electron beam function are initialized. Initialized parameters include aberration coefficients, atom positions, an s-orbital peak width, an s-orbital peak height, an amplitude peak width, an amplitude peak height, and other parameters describing the atomic spatial distribution. The electron beam function is obtained based on the aberration coefficients. The transmission function is obtained based on parameters such as the atom positions, the s-orbital peak width, the s-orbital peak height, the amplitude peak width, the amplitude peak height, and other parameters describing the atomic spatial distribution. A loss function L is then calculated.
[0052] Optionally, in an embodiment of the present disclosure, the loss function is expressed as a function with respect to the sample transmission function, the electron beam function, etc. The loss function includes, but is not limited to, a form of:
where j represents an ordinal number of the scanning position, u, v represents coordinates in real space, |.square-solid.| represents calculating a modulus of each element in a matrix,
represents calculating a two-dimensional Fourier transform of a matrix, I.sub.j represents the diffraction intensity, and Ψ.sub.exit represents an exit wave function.
[0053] In an embodiment of the present disclosure, the exit wave function Ψ.sub.exit is a function related to the sample transmission function and the electron beam function. The exit wave function Ψ.sub.exit is in a form of:
[0054] The electron beam function obtained based on the aberration coefficients is shown below:
where P(r - r.sub.j) represents the electron beam scanning to a j-th position. P(r - r.sub.j) can be obtained by a variety of methods including, but not limited to, the following method: using a diaphragm function A(k) and an aberration function χ(k) corresponding to a given aberration coefficient C.sub.n,m. The aberration function χ(k) is obtained through the following equation:
where R{.Math.} represents taking a real part of a matrix in {.Math.}, the matrix in {.Math.} represents other aberration coefficients, aberration ω = k.sub.x + i * k.sub.y, k.sub.x and k.sub.y are coordinates in reciprocal space, respectively, and ω̅ is the complex conjugate matrix of ω.
[0055] The transmission function O.sub.l(r) of the l-th slice obtained based on the parameters such as the atom positions, the s-orbital peak width, the s-orbital peak height, the amplitude peak width, the amplitude peak height, and other parameters describing the atomic spatial distribution is shown below:
where V.sub.l(r) and Amp.sub.l(r) represent a projection potential and an amplitude of the transmission function, respectively. V.sub.l(r) and Amp.sub.l(r) may be described by expressions including but not limited to:
where s(r) represents an s-orbital spatial distribution of electrons in the l-th slice, p(r) represents a p-orbital spatial distribution of electrons in the l-th slice, and so on. A further description is made by an example of reconstructing the s-orbital spatial distribution of the electrons. It is clear that the example of the transmission function described in terms of reconstructing the s-orbital spatial distribution of the electrons is only part of the present disclosure. s.sub.l(r) may be described, but is not limited to being described, by a local function of a Gaussian function:
[0056] The transmission function of each slice may be assumed to have a same thickness.
represents a Fresnel diffraction or other actions. p(k;dz) represents a Fresnel diffraction propagator or other propagators. The Fresnel diffraction may be expressed as:
where dz represents a thickness of each slice of the sample.
[0057] At block S 103, a derivative of the loss function with respect to the to-be-optimized parameters is solved to obtain gradients of the to-be-optimized parameters in the sample transmission function and the electron beam function, the to-be-optimized parameters are optimized based on the gradients, and the value of the loss function is updated.
[0058] At block S104, whether a current iteration satisfies an iteration termination condition is determined, S103 is performed in response to the current iteration failing to satisfy the iteration termination condition, and an optimized sample transmission function and an optimized electron beam function are outputted in response to the current iteration satisfying the iteration termination condition.
[0059] After the loss function has been constructed by the above processes, parameters in the loss function are considered as to-be-optimized parameters. Gradients of the to-be-optimized parameters are obtained by deriving the loss function to iteratively optimize corresponding parameters.
[0060] It should be understood that gradients of the loss function
with respect to the aberration coefficients, the atom positions, the s-orbital peak width, the s-orbital peak height,the amplitude peak width, the amplitude peak height, other parameters describing the atomic spatial distribution, etc., are solved. Corresponding parameters are updated using the calculated gradients.
[0061] In a further embodiment, (M.sub.l,i, N.sub.l,i, A1.sub.l,i, B1.sub.l,i, A2.sub.l,i, B1.sub.1,i, C.sub.n,m, D.sub.l) are considered as to-be-optimized parameters. Gradients of the loss function
with respect to parameters such as ( M.sub.l,i, N.sub.l,i, A.sub.l,i, B 1.sub.l,i, A2.sub.l,i, B1.sub.l,i, C.sub.n,m, D.sub.l ) are solved to iteratively optimize corresponding parameters.
[0062] The gradients may be obtained from the following analytical expressions (an example is given by solving partial derivatives of L with respect to the atomic spatial distribution and the amplitude of the transmission function of a single slice):
may be obtained from the following analytical expression:
where V(r) and Amp(r) are even functions. Amp(r) is a real function. Partial derivatives of V(r) and Amp(r) with respect to different parameters are:
[0063] The obtained partial derivatives of V(r) and Amp(r) with respect to different parameters are substituted into the expression to obtain the partial derivative of with respect to each parameter.
[0064] Further, after the gradient of each to-be-optimized parameter is obtained through the loss function, the to-be-optimized parameter is updated based on the gradient. Each to-be-optimized parameter is updated by:
where α.sub.M
[0065] After optimization of each to-be-optimized parameter, the loss function is recalculated based on optimized parameters. An iteration is performed until the iteration termination condition is satisfied.
[0066] In an embodiment of the present disclosure, the iteration termination condition includes: a number of iterations reaching a predetermined threshold; and/or the loss function converging to a predetermined value.
[0067] Through the above iteration processes, the optimized sample transmission function and the optimized electron beam function are finally obtained. A plurality of sample-related parameters is obtained based on the optimized sample transmission function and the optimized electron beam function, including, but not limited to, e.g., the aberration coefficients, the atom positions, and the parameters describing the atomic spatial distribution. In this way, not only the two-dimensional image of the sample is obtained, but also the parameterized representation of information on the atom positions is realized.
[0068] The method for reconstructing the atomic spatial distribution and the electron beam function of the present disclosure is described in detail below with reference to the accompanying drawings and embodiments.
[0069] In an embodiment, it is a projection of strontium titanate along the direction [110] that needs to be observed, a structure of which is illustrated in
[0070] The electron beam scans over the sample. Scanning points may be referred to
[0071] Each aberration coefficient was randomly initialized. The electron beam function was initialized using an equation
An amplitude of the initialized electron beam function is illustrated in
[0072] The loss function
is calculated. The gradients of the loss function L with respect to the to-be-optimized parameters are solved. Target parameters are iteratively updated using the following equations:
where α.sub.Ml,i, α.sub.Nl,i, α.sub.A1l,i, α.sub.B1l,i, α.sub.A2l,i, α.sub.B2l,i, α.sub.DL and α.sub.cn,m are learning rates of the parameters. An update process may be optimized using an Adam algorithm or other algorithms.
[0073] An amplitude image of a reconstructed electron beam function finally obtained is as illustrated in
[0074] With the method for reconstructing the atomic spatial distribution and the electron beam function according to the embodiments of the present disclosure, a series of diffraction patterns obtained by the electron beam scanning over the sample are used as data. The transmission function of atoms in the sample is described in terms of a function including, but not limited to, the local functions of the atomic spatial distribution. The electron beam function is described in terms of a function including, but not limited to, the aberration functions corresponding to the aberration coefficients. In an iterative optimization algorithm of the ptychographic imaging, the parameters of the transmission function are updated by using the gradients of the loss function with respect to the parameters of the transmission function, and the parameters of the electron beam function are updated by using the gradients of the loss function with respect to the parameters of the electron beam function. Finally, the transmission function and the electron beam function are obtained. The present disclosure can directly obtain information such as coordinates of atoms in the sample and the atomic spatial distribution, and greatly reduce the number of to-be-optimized parameters in an optimization algorithm for the ptychographic imaging.
[0075] An apparatus for reconstructing an atomic spatial distribution and an electron beam function according to embodiments of the present disclosure is described with reference to the accompanying drawings.
[0076]
[0077] As illustrated in
[0078] The obtaining module 100 is configured to obtain, by controlling to move an electron beam to scan a sample, a diffraction intensity of the sample at each scanning position. The construction module 200 is configured to construct a sample transmission function and an electron beam function, establish, based on the diffraction intensity, the sample transmission function, and the electron beam function, a forward propagation model containing to-be-optimized parameters, and calculate a value of a loss function. The optimization module 300 is configured to solve a derivative of the loss function with respect to the to-be-optimized parameters, to obtain gradients of the to-be-optimized parameters in the sample transmission function and the electron beam function, optimize the to-be-optimized parameters based on the gradients, update the value of the loss function, repeat an iteration process until an iteration termination condition is satisfied, and output an optimized sample transmission function and an optimized electron beam function.
[0079] Optionally, in an embodiment of the present disclosure, the action of constructing the sample transmission function and the electron beam function includes: describing the sample transmission function using local functions for the atomic spatial distribution; and describing the electron beam function using aberration functions.
[0080] Optionally, in an embodiment of the present disclosure, the apparatus further includes: an initialization module configured to, prior to constructing the sample transmission function and the electron beam function, initialize the to-be-optimized parameters in the sample transmission function and the electron beam function. The to-be-optimized parameters in the electron beam function includes aberration coefficients. The to-be-optimized parameters in the sample transmission function include atom positions and parameters describing the atomic spatial distribution.
[0081] Optionally, in an embodiment of the present disclosure, the loss function is:
where j represents an ordinal number of the scanning position, u, v represents coordinates in real space, |-| represents calculating a modulus of each element in a matrix, 1F{-} represents calculating a two-dimensional Fourier transform of a matrix, l.sub.j represents the diffraction intensity, and Ψ.sub.exit represents an exit wave function; [0082] the exit wave function Ψ.sub.exit is: where P(r) represents the electron beam function, P(r - r.sub.j) represents the electron beam scanning to a j-th position, P.sub.dz{.Math.} represents a Fresnel diffraction propagator, and O.sub.1(r) represents the sample transmission function of the 1-th slice; [0083] the sample transmission function O.sub.l(r) is: where V.sub.l (r) represents a projection potential of the transmission function, Amp.sub.l(r) represents an amplitude of the transmission function, where s(r) represents an s-orbital spatial distribution of electrons in the l-th slice, p(r) represents a p-orbital spatial distribution of electrons in the l-th slice, and s.sub.l(r) is represented by a local function of a Gaussian function as: [0084] the electron beam function P(r) is: where A(k) represents a diaphragm function, C.sub.n,m represents a aberration coefficient, .sub.χ(k) represents an aberration function, R{.} represents taking a real part of a matrix in {.Math.}, aberration ω = k.sub.x + i .sub.* k.sub.y, k.sub.x and k.sub.y are coordinates in reciprocal space, respectively, and ω̅ is the complex conjugate matrix of ω.
[0085] Optionally, in an embodiment of the present disclosure, the iteration termination condition includes: a number of iterations reaching a predetermined threshold; and/or the loss function converging to a predetermined value.
[0086] It should be noted that the above explanation of the embodiments of the method for reconstructing the atomic spatial distribution and the electron beam function is also applicable to the apparatus for reconstructing the atomic spatial distribution and the electron beam function according to this embodiment, and thus details thereof will be omitted here.
[0087] With the apparatus for reconstructing the atomic spatial distribution and the electron beam function according to this embodiment, the electron beam function is not limited to being represented by aberration functions corresponding to aberration coefficients, and the transmission function is not limited to being represented in the parametrical form of the local functions of the atomic spatial distribution, allowing resolution with sub-pixel precision to be achieved. In addition, the information on the atom positions and the atomic spatial distribution is represented parametrically while advantages of conventional ptychographic imaging are retained, allowing a further analysis to be facilitated.
[0088]
[0089] Further, the electronic device includes: a communication interface 1603 configured to communicate between the memory 1601 and the processor 1602; and the memory 1601 storing a computer program executable on the processor 1602. The memory 1601 may include a high-speed Random Access Memory (RAM), and may also include a non-volatile memory, such as at least one disk memory.
[0090] When the memory 1601, the processor 1602, and the communication interface 1603 are implemented independently, the communication interface 1603, the memory 1601, and the processor 1602 may be interconnected and communicate with each other via a bus. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The buses may be divided into an address bus, a data bus, a control bus, etc. For the convenience of description, only one thick line is used in
[0091] Optionally, in a specific implementation, when the memory 1601, the processor 1602, and the communication interface 1603 are integrated on a single chip for an implementation, the memory 1601, the processor 1602, and the communication interface 1603 may communicate with each other through an internal interface.
[0092] The processor 1602 may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement an embodiment of the present disclosure.
[0093] A computer-readable storage medium is further provided according to an embodiment. The computer-readable storage medium stores a computer program. The computer program, when executed by a processor, implements the method for reconstructing the atomic spatial distribution and the electron beam function as described above.
[0094] In the description of this specification, descriptions with reference to the terms “an embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” etc., mean that specific features, structure, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.
[0095] In addition, the terms “first” and “second” are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present disclosure, “N” means at least two, such as two, three, etc., unless otherwise specifically defined.
[0096] Any process or method described in a flowchart or described herein in other ways may be understood to include one or N modules, segments, or portions of codes of executable instructions for achieving specific logical functions or steps in the process. The scope of a preferred embodiment of the present disclosure includes other implementations. A function may be performed not in a sequence shown or discussed, including a substantially simultaneous manner or a reverse sequence based on the function involved, which should be understood by those skilled in the art to which the embodiments of the present disclosure belong.
[0097] It should be understood that each part of the present disclosure may be realized by hardware, software, firmware, or a combination thereof. In the above embodiments, N steps or methods may be realized by software or firmware stored in the memory and executed by an appropriate instruction execution system. For example, when it is realized by the hardware, likewise in another embodiment, the steps or methods may be realized by one or a combination of the following techniques known in the art: a discrete logic circuit having a logic gate circuit for realizing a logic function of a data signal, an application-specific integrated circuit having an appropriate combination logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), etc.
[0098] It should be understood by those skilled in the art that all or a part of the steps carried by the method in the above-described embodiments may be completed by relevant hardware instructed by a program. The program may be stored in a computer-readable storage medium. When the program is executed, one or a combination of the steps of the method in the above-described embodiments may be included.