Method of determining a changing spatial distribution of particles at multiple points in time
09733267 · 2017-08-15
Assignee
Inventors
Cpc classification
G06T7/246
PHYSICS
International classification
G01P5/00
PHYSICS
Abstract
For determining a changing spatial distribution of particles at each of multiple points in time, real two-dimensional images of the particles are recorded with different mapping functions. An estimated spatial distribution of the particles is provided. Virtual two-dimensional images of the estimated spatial distribution are calculated applying the different mapping functions. Differences between the virtual and the real two-dimensional images are determined; and the estimated spatial distribution of the particles are varied for reducing the differences to obtain a spatial distribution approximated to the actual spatial distribution of the particles. The estimated spatial distribution of the particles is provided in that the locations of the individual particles in a spatial distribution approximated for one other point in time are shifted dependently on how the locations of the individual particles have changed between at least two spatial distributions approximated for at least two other points in time.
Claims
1. A method of determining a changing spatial distribution of particles at multiple points in time following to each other at intervals, the method comprising the following steps for each of the points in time: recording real two-dimensional images of the particles with different mapping functions at the respective one of the points in time; providing an estimated spatial distribution of the particles; calculating virtual two-dimensional images of the estimated spatial distribution applying the different mapping functions; determining differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions; and varying the estimated spatial distribution of the particles for reducing the differences to obtain an approximated spatial distribution which is approximated to the actual spatial distribution of the particles at the respective one of the points in time; wherein the estimated spatial distribution of the particles for at least one of the points in time is provided in that the locations of the individual particles in an approximated spatial distribution obtained for one other of the points in time are shifted dependently on how the locations of the individual particles have changed between at least two approximated spatial distributions obtained for at least two others of the points in time.
2. The method of claim 1, wherein the approximated spatial distribution obtained for the one other of the points in time is the spatial distribution which has been obtained for the last one of the points in time prior to the at least one of the points in time or for the next one of the points in time after the at least one of the points in time.
3. The method of claim 1, wherein the approximated spatial distributions obtained for the at least two others of the points time include the spatial distributions obtained for the last one of the points in time and the next to last one of the points in time prior to the at least one of the points in time, or the next one of the points in time and the next to next one of the points in time after the at least one of the points in time.
4. The method of claim 1, wherein the estimated spatial distribution of the particles is provided for at least one of the points in time in that trajectories of the individual particles are determined from the approximated spatial distributions obtained for the at least two others of the points in time and in that these trajectories are extrapolated for the at least one of the points in time.
5. The method of claim 4, wherein the trajectories are determined from the approximated spatial distributions obtained for more than two others of the points in time.
6. The method of claim 5, wherein particles with discontinuous trajectories are identified and eliminated from the estimated spatial distributions.
7. The method of claim 5, wherein particles with trajectories which deviate from Navier-Stokes solutions for a flow of a fluid seeded with the particles by more than a preset limit value are identified and eliminated from the approximated spatial distributions.
8. The method of claim 5, wherein, if a particle whose trajectory has been followed over a plurality of previous ones of the points in time is missing in the real images recorded for the at least one of the points in time but reappears in the real images recorded for later ones of the points in time on a continuation of the same trajectory, a location of the particle on the continuous trajectory is added to the spatial distribution determined for the at least one of the points in time.
9. The method of claim 1, wherein, if particles are missing in the real images when determining the differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions, these particles missing in the real images are eliminated from the approximated spatial distribution.
10. The method of claim 1, wherein, if additional particles appear in the real images when determining the differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions, these additional particles appearing in the real images are added to the approximated spatial distribution.
11. The method of claim 1, wherein the spatial distributions of the particles for those of the points in time between a first one of the points in time and a much later second one of the points in time are once determined starting from the first one of the points in time for succeeding points in time and once starting from the second one of the points in time for preceding points in time.
12. The method of claim 11, wherein particles which are only included in one of the two approximated spatial distributions obtained for any one of the points in time between the first one of the points in time and the second one of the points in time are added to the other spatial distribution for the respective one of the points in time.
13. The method of claim 1, wherein, in varying the estimated spatial distribution of the particles for reducing the differences, spatial locations of particles which are closely neighboring in the estimated spatial distributions are varied in a coordinated way.
14. A method of determining a changing spatial distribution of particles at multiple points in time following to each other at intervals, the method comprising the following steps for each of the points in time: recording real two-dimensional images of the particles with different mapping functions at the respective one of the points in time; providing an estimated spatial distribution of the particles; calculating virtual two-dimensional images of the estimated spatial distribution applying the different mapping functions; determining differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions; and varying the estimated spatial distribution of the particles for reducing the differences to obtain an approximated spatial distribution which is approximated to the actual spatial distribution of the particles at the respective one of the points in time; wherein the estimated spatial distribution of the particles for at least one of the points in time is provided in that the locations of the individual particles in an approximated spatial distribution obtained for one other of the points in time are shifted dependently on how the locations of the individual particles have changed between at least two approximated spatial distributions obtained for at least two others of the points in time; wherein the estimated spatial distribution of the particles is provided for at least one of the points in time in that trajectories of the individual particles are determined from the approximated spatial distributions obtained for the at least two others of the points in time and in that these trajectories are extrapolated for the at least one of the points in time; wherein the trajectories are determined from the approximated spatial distributions obtained for more than two others of the points in time; and wherein particles with trajectories which deviate from Navier-Stokes solutions for a flow of a fluid seeded with the particles by more than a preset limit value are identified and eliminated from the approximated spatial distributions.
15. A method of determining a changing spatial distribution of particles at multiple points in time following to each other at intervals, the method comprising the following steps for each of the points in time: recording real two-dimensional images of the particles with different mapping functions at the respective one of the points in time; providing an estimated spatial distribution of the particles; calculating virtual two-dimensional images of the estimated spatial distribution applying the different mapping functions; determining differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions; and varying the estimated spatial distribution of the particles for reducing the differences to obtain an approximated spatial distribution which is approximated to the actual spatial distribution of the particles at the respective one of the points in time; wherein the estimated spatial distribution of the particles for at least one of the points in time is provided in that the locations of the individual particles in an approximated spatial distribution obtained for one other of the points in time are shifted dependently on how the locations of the individual particles have changed between at least two approximated spatial distributions obtained for at least two others of the points in time; and wherein the spatial distributions of the particles for those of the points in time between a first one of the points in time and a much later second one of the points in time are once determined starting from the first one of the points in time for succeeding points in time and once starting from the second one of the points in time for preceding points in time.
16. The method of claim 15, wherein particles which are only included in one of the two approximated spatial distributions obtained for any one of the points in time between the first one of the points in time and the second one of the points in time are added to the other spatial distribution for the respective one of the points in time.
17. The method of claim 15, wherein the approximated spatial distribution obtained for the one other of the points in time is the spatial distribution which has been obtained for the last one of the points in time prior to the at least one of the points in time or for the next one of the points in time after the at least one of the points in time, and wherein the approximated spatial distributions obtained for the at least two others of the points time include the spatial distributions obtained for the last one of the points in time and the next to last one of the points in time prior to the at least one of the points in time, or the next one of the points in time and the next to next one of the points in time after the at least one of the points in time.
18. The method of claim 15, wherein the estimated spatial distribution of the particles is provided for at least one of the points in time in that trajectories of the individual particles are determined from the approximated spatial distributions obtained for the at least two others of the points in time and in that these trajectories are extrapolated for the at least one of the points in time, and wherein the trajectories are determined from the approximated spatial distributions obtained for more than two others of the points in time.
19. The method of claim 18, wherein particles selected from particles with discontinuous trajectories and particles with trajectories which deviate from Navier-Stokes solutions for a flow of a fluid seeded with the particles by more than a preset limit value are identified and eliminated from the approximated spatial distributions.
20. The method of claim 18, wherein, if a particle whose trajectory has been followed over a plurality of previous ones of the points in time is missing in the real images recorded for the at least one of the points in time but reappears in the real images recorded for later ones of the points in time on a continuation of the same trajectory, a location of the particle on the continuous trajectory is added to the spatial distribution determined for the at least one of the points in time.
21. The method of claim 15, wherein, if particles are missing in the real images when determining the differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions, these particles missing in the real images are eliminated from the approximated spatial distribution, and wherein, if additional particles appear in the real images when determining the differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions, these additional particles appearing in the real images are added to the approximated spatial distribution.
22. The method of claim 15, wherein, in varying the estimated spatial distribution of the particles for reducing the differences, spatial locations of particles which are closely neighboring in the estimated spatial distributions are varied in a coordinated way.
Description
SHORT DESCRIPTION OF THE DRAWINGS
(1) The invention can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. In the drawings, like reference numerals designate corresponding parts throughout the several views.
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) According to the invention, a method of determining a changing spatial distribution of particles at a plurality of points in time following to each other at intervals comprises the following steps for each point in time: (i) recording real two-dimensional images of the particles with different effective mapping functions at the respective point in time; (ii) providing an estimated spatial distribution of the particles; (iii) calculating virtual two-dimensional images of the estimated spatial distribution applying the different mapping functions; (iv) for each of the mapping functions, determining differences between the respective virtual two-dimensional image and the respective real two-dimensional image; and (v) varying the estimated spatial distribution of the particles for reducing the differences to obtain an approximated spatial distribution approximated to the actual spatial distribution of the particles at the respective point in time. For at least one point in time, the estimated spatial distribution of the particles is provided in that the spatial positions or locations of the individual particles in an approximated spatial distribution obtained for one other point in time are shifted dependently on how their locations have changed between approximated spatial distributions obtained for at least two other points in time.
(8) With regard to this combination of features of the method according to the invention, the following notes are indicated. The fact that the steps (i) to (v) are executed for each of several points in time following to each other at intervals does not exclude that, with regard to further points in time at which no approximated spatial distributions are available, the estimated spatial distribution of the particles may be provided in another way, like for example based on evaluating the different real images by means of triangulation. This particularly applies to prior points in time at which no approximated spatial distribution are available for even prior points in time.
(9) The different effective image transfer functions or mapping functions at which the real two-dimensional images of the particles are recorded at the respective point in time should remain unchanged over the multiple points in time, or occurring variations of the mapping functions have to be compensated. The different mapping functions particularly include different imaging directions or mapping directions. At least, two different mapping functions with different mapping directions are applied. A number of cameras used for recording the images of the particles and, thus, the number of different mapping directions may, however, be even clearly higher than two.
(10) Both determining the differences between the virtual and real two-dimensional images of the same mapping functions and varying the estimated spatial distribution of the particles for reducing the differences may particularly relate to the positions of the particles in the two-dimensional images and the locations of the particles in the spatial distribution. Generally, however, other parameters as described in DE 10 2009 009 551 B4, corresponding to U.S. Pat. No. 8,542,882 B2 which is incorporated herein by reference, may also be considered here.
(11) In the method according to the invention, the steps (iii) to (v) may be iteratively repeated two or more times to adapt the approximated spatial distribution step by step to the actual spatial distribution until, for example, a preset maximum error or limit value with regard to the differences of the positions of the individual particles in the real and virtual two-dimensional images is no longer exceeded. Also in this regard, further details of the method according to the present invention may be taken from DE 10 2009 009 551 B4, corresponding to US patent U.S. Pat. No. 8,542,882 B2 incorporated herein by reference.
(12) The spatial distributions approximated for the one point in time of the other points in time and the at least two points in time of the other points in time may be spatial distributions approximated for points in time preceding or succeeding the at least one point in time. This applies, even if in the following only preceding or prior points in time are mentioned. All the following statements are to be understood as correspondingly also applying to succeeding or later points in time following to the at least one point in time for which the actual spatial distribution of the particles is approximated. Often, the spatial distributions approximated for the one other point in time and the at least two other points in time, which are considered in providing the estimated spatial distribution for the at least one point in time, are, however, either all obtained for prior points in time or all obtained for later points in time.
(13) In the method according to the present invention, locations of the individual particles in an approximated spatial distribution obtained for one prior point in time, on the one hand, and changes in location of the individual particles between approximated spatial distributions obtained for at least two prior points in time, on the other hand, are used for providing the estimated spatial distribution of the particles. Providing the estimated spatial distribution of the particles is thus based on the assumption that the particles at least essentially continue their prior trajectories. If they even exactly continue their prior trajectories, and if these trajectories have been completely determined by means of the spatial distributions approximated for the prior points in time, there will be no differences between the virtual two-dimensional images calculated for the provided estimated spatial distribution and the real two-dimensional images recorded for the respective point in time. In other words, differences only occur, if the trajectories of the particles do not continue as they did previously, and any variation of the estimated spatial distribution of the particles necessary for reducing the differences between the virtual and the real two-dimensional images only has to map these variations of the trajectories. Correspondingly, as a rule, the estimated spatial distribution is very close to the actual spatial distribution, and only very few iteration steps are necessary to map still existing differences. Thus, the method according to the invention requires little computing time and is very quick.
(14) It is also to be considered that the method according to the present invention typically is a PTV method in which the shifts of the locations of the particles between the spatial distributions determined for the individual points in time are determined anyway as this is the information of interest in PTV. Thus, the entire information required for providing the estimated spatial distribution of the particles for the next point in time is already existing. Consequently, three-dimensional reconstructions of the spatial distribution from the real two-dimensional images based on triangulation, for example, are often only used in advance of the method according to the invention until the first estimated spatial distribution may be provided on the basis of previously determined spatial distributions.
(15) The method according to the invention is the first PTV method in which the spatial distribution of the particles at at least one point in time is determined based on the distributions of the particles determined for prior points in time in such a way that not even a coarse determination of the spatial locations of the particles at the at least one point in time by means of triangulation or any other three-dimensional reconstruction of the spatial distribution from the real images recorded at the at least one point in time is needed. This is the basis for determining the spatial distribution of the particles at the at least one point in time at a high speed. Nevertheless, a high accuracy in determining the spatial positions or locations of the individual particles is achieved by the method of the present invention.
(16) In the method according to the invention the approximated spatial distribution obtained for a prior point in time which is used for providing the estimated spatial distribution of the particles may be that spatial distribution which has been obtained for the last point in time preceding the at least one point in time. This spatial distribution tends to be that one of the previous spatial distributions which comes closest to the spatial distribution at the at least one point in time. Thus, under suitable circumstances, it may even itself be used as the estimated spatial distribution for the directly following at least one point in time, for example, if it is the only available spatial distribution and if there are no other spatial distributions from which changes of the locations of the individual particles could be determined.
(17) With regard to the changes of the locations of the particles between the spatial distributions approximated for at least two prior points in time, it is preferred if these spatial distributions at least include one of the spatial distributions which have been obtained for the last point in time and the point in time next to the last point in time prior to the at least one point in time. From these two spatial distributions, current information on the velocities of the particles in the interval between the next to last point in time and the last point in time prior to the at least one point in time may be derived. These velocities will only vary to a limited extent between the last point in time and the at least one point in time. Thus, besides the last spatial distribution of the particles, these velocities are the most important information for providing the estimated spatial distribution of the particles for the at least one point in time for which the method according to the invention is currently executed and which, for reasons of simplicity, is also designated as the “current” point in time, here.
(18) In the method according to the invention, the previous trajectories of the particles may also be determined more exactly in that more approximated spatial distributions than those at the last and the next to last point in time prior to the current point in time are considered. Thus, the estimated spatial distribution of the particles for the at least one point in time may be provided in that trajectories of the individual particles are determined from approximated spatial distributions of the particles obtained for at least three prior points in time, and in that these trajectories are extrapolated up to the current point in time.
(19) As the particles continuously continue their previous trajectories when following the flows in a fluid, particles with discontinuous trajectories may be identified and eliminated from the approximated spatial distributions.
(20) Further, the requirement can be placed on the trajectories of the particles that they do not deviate from a Navier-Stokes solution for a flow of a fluid seeded with the particles by more than a given measure. Thus, a Navier-Stokes regularization of the trajectories may be made.
(21) If a particle whose trajectory has been followed over a plurality of previous points in time is missing in real images recorded at one point in time but reappears in the images recorded at later points in time on a continuation of the same trajectory, its location in the spatial distribution determined for the one point in time may be added on the continued trajectory.
(22) Generally, however, particles missing in the real images, when determining the differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping function, may be eliminated from the approximated spatial distribution. If the particles missing in the real images are particles at the border of the estimated spatial distribution, for example, it may be assumed that they have left the respective measurement volume.
(23) Vice versa, additional particles appearing in the real images, when determining the differences between the virtual two-dimensional images and the real two-dimensional images of the same mapping functions, may be added to the estimated spatial distribution, particularly if the additional particles are present at the border of the measurement volume. In this case, it may be assumed that these particles newly got into the measurement volume. The spatial positions or locations of these new particles may be determined from the real two-dimensional images by three-dimensional reconstruction, the effort to be spent for this being limited due to the small number of new particles.
(24) In a particular embodiment of the method according to the invention, the spatial distributions of the particles, for points in time between a first point in time and a much later second point in time, are once determined starting from the first point in time for succeeding points in time and once starting from the second point in time for preceding points in time. In an ideal case, two identical distributions of the particles result for each point in time. For example, with a high density of the particles, this procedure, however, sometimes enables to resolve particles when proceeding in the one temporal direction which are not resolved when proceeding in the other temporal direction. If particles which are only included in one of the two spatial distributions determined for one of the points in time between the first point in time and the second point in time are added to the respective other spatial distribution for this point in time, the other distribution includes all locations of all resolved particles.
(25) If, in the method according to the invention, particles disappear out of the determined spatial distribution, and if afterwards new particles appear in the spatial distribution, they may in fact be the same particles whose trajectories could temporarily not be followed. This particularly applies if the particles do not reappear at the border of the observed volume but, for example, disappear and reappear in a spatial area in which lines of sight of the particles are very close to each other in several images of different mapping functions so that the particles partially or even completely overlap within these images. For checking whether these reappearing particles are in fact the same particles, the presumptive trajectories of the disappearing particles may be extrapolated beyond the point in time of their disappearance by fitting a spline, for example. Then it may be checked whether a particle newly appearing the distribution is located on or close to one of these extrapolated trajectories, and whether its trajectory runs parallel or at least nearly parallel to the extrapolated trajectory. This procedure may also be executed in a reversed temporal direction directed into the past for each newly appearing particle. If the extrapolated and the real trajectories differ by less than a preset threshold value, it may be assumed that the newly appearing particle is in fact the particle which previously disappeared from the distribution. By means of the extrapolated trajectories, the trajectory of such a particle may be completed for those points in time at which the particle was not included in the distribution.
(26) In the method according to the invention, varying the estimated spatial distribution of the particles for reducing the differences between the real and virtual two-dimensional images may include a coordinated variation of the locations particularly of such particles which are closely neighboring to each other in the estimated spatial distribution. Closely neighboring particles in the estimated spatial distribution are also close to each other in the real and virtual two-dimensional images. In case of varying the locations of these particles in the estimated spatial distribution in a non-coordinated way to reduce the differences between the real and virtual images, there is the danger that the location of a particle is varied in such a way that it is consistent with the real images of an in fact different particle. Then, other particles may also no longer be associated correctly. Each mixing up of particles means an error in determining the actual trajectories of the particles. By varying the locations of all particles located in a dense area in a coordinated way, the most probable correct variation of the location of all particles may be more easily acknowledged. Here, various boundary conditions like a minimum mean acceleration of the particles, a minimum mean square deviation from a Navier-Stokes solution for the area and so on may also be set.
(27) Generally, varying the estimated spatial distribution of the particles for reducing the differences between the real and virtual two-dimensional images may include the coordinated variation of the locations of all particles which are included in the estimated spatial distribution of the particles. Then, however, the effort to be spent for the method according to the invention is quite high. Thus, it is suitable to execute the coordinated variation of the estimated spatial distribution of the particles for those particles, only, whose images, due to same or closely neighboring lines of sight completely or at least partially overlap in one, several, nearly all, or even all of the two-dimensional images of the particles. The danger of a relevant overlap of the images of the particles in the images of the different mapping functions particularly exists if only few cameras are used for recording the real images of the particles.
(28) Now referring in greater detail to the drawings,
(29)
(30) The method according to the invention illustrated in
(31) For a following point in time t.sub.3, in a step 10, the spatial distribution of the particles is also determined starting from an estimated spatial distribution as generally known from DE 10 2009 009 551 B4. As the estimated spatial distribution, however, not only the last spatial distribution determined for the point in time t.sub.2 is used, but the estimated spatial distribution for the point in time t.sub.3, in addition to the distribution determined for the point in time t.sub.2 also considers changes of the locations of the individual particles between the spatial distributions at the points in time t.sub.1 and t.sub.2 in that it assumes same changes or shifts also between the points in time t.sub.2 and t.sub.3. For an individual particle, this step 10 corresponds to the procedure which has been illustrated in
(32) The method according to the invention illustrated in
(33) Many variations and modifications may be made to the preferred embodiments of the invention without departing substantially from the spirit and principles of the invention. All such modifications and variations are intended to be included herein within the scope of the present invention, as defined by the following claims.