ATTITUDE ESTIMATION METHOD AND SYSTEM FOR ON-ORBIT THREE-DIMENSIONAL SPACE OBJECT UNDER MODEL RESTRAINT
20170008650 ยท 2017-01-12
Inventors
- Tianxu ZHANG (Wuhan, Hubei, CN)
- Liangliang WANG (Wuhan, Hubei, CN)
- Gang ZHOU (Wuhan, Hubei, CN)
- Ming Li (Wuhan, Hubei, CN)
- Weidong YANG (Wuhan, Hubei, CN)
- Kuan LIU (Wuhan, Hubei, CN)
- Yayun ZHENG (Wuhan, Hubei, CN)
Cpc classification
B64G1/245
PERFORMING OPERATIONS; TRANSPORTING
G06V10/751
PHYSICS
G06V10/44
PHYSICS
B64G3/00
PERFORMING OPERATIONS; TRANSPORTING
International classification
B64G3/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
An attitude estimation method for an on-orbit three-dimensional space object comprises an offline feature library construction step and an online attitude estimation step. The offline feature library construction step comprises: according to a space object three-dimensional model, acquiring multi-viewpoint characteristic views of the object, and extracting geometrical features therefrom to form a geometrical feature library, where the geometrical features comprise an object main body height-width ratio, an object longitudinal symmetry, an object horizontal symmetry, and an object main-axis inclination angle. The online attitude estimation step comprises: preprocessing an on-orbit object image to be tested and extracting features, and matching the extracted features in the geometrical feature library, where an object attitude characterized by a characteristic view corresponding to a matching result is an attitude estimation result. A dimension scale and position relationship between various components of an object are accurately acquired in a three-dimensional modeling stage, thereby ensuring subsequent relatively high matching precision. An attitude estimation system for an on-orbit three-dimensional space object is also provided.
Claims
1. An attitude estimation method for an on-orbit three-dimensional space object, comprising an offline feature library construction step and an online attitude estimation step, wherein the offline feature library construction step specifically comprises: (A1) acquiring, according to a space object three-dimensional model, multi-viewpoint characteristic views of the object for characterizing various attitudes of the space object; and (A2) extracting geometrical features from each space object multi-viewpoint characteristic view to form a geometrical feature library, wherein the geometrical features comprise an object main body height-width ratio T.sub.i,1, an object longitudinal symmetry T.sub.i,2, an object horizontal symmetry, T.sub.i,3, and an object main-axis inclination angle T.sub.i,4, wherein the object main body height-width ratio T.sub.i,1 refers to a height-width ratio of an minimum bounding rectangle of the object; the object longitudinal symmetry T.sub.i,2 refers to a ratio of an area of the upper-half portion of the object to an area of the lower-half portion of the object within a rectangular region enclosed by the minimum bounding rectangle of the object; the object horizontal symmetry T.sub.i,3 refers to a ratio of an area of the left-half portion of the object to an area of the right-half portion of the object within the rectangular region enclosed by the minimum bounding rectangle of the object; and the object main-axis inclination angle T.sub.i,4 refers to an included angle between an object cylinder-body main axis and a view horizontal direction of a characteristic view; and the online attitude estimation step specifically comprises: (B1) preprocessing an on-orbit space object image to be tested; (B2) extracting features from the image to be tested after preprocessing, wherein the features are the same as the features extracted in Step (A2); and (B3) matching the features extracted from the image to be tested in the geometrical feature library, wherein a space object attitude characterized by a characteristic view corresponding to a matching result is an object attitude in the image to be tested.
2. The attitude estimation method for an on-orbit three-dimensional space object according to claim 1, wherein a manner of extracting the feature, the object main body height-width ratio T.sub.i,1 comprises: (A2.1.1) obtaining a threshold T, by using a threshold criterion of a maximum between-cluster variance for a characteristic view F.sub.i, setting a pixel gray value f.sub.i(x, y) greater than the threshold T.sub.i in the characteristic view F.sub.i as 255, and setting a pixel gray value f.sub.i(x, y) less than or equal to the threshold T.sub.i as zero, thereby obtaining a binary image G.sub.i, wherein G.sub.i is a pixel matrix whose width is n and height is m, and g.sub.i(x, y) is a pixel gray value at a point (x,y) in G.sub.i; (A2.1.2) scanning the binary image G.sub.i in an order from top to bottom and from left to right, if a current point pixel value g.sub.i(x, y) is equal to 255, recording a current pixel horizontal coordinate x=Topj, and a vertical coordinate y=Topi, and stopping scanning; (A2.1.3) scanning the binary image G.sub.i in an order from bottom to top and from left to right, if a current point pixel value g.sub.i(x, y) is equal to 255, recording a current pixel horizontal coordinate x=Bntj, and a vertical coordinate y=Bnti, and stopping scanning; (A2.1.4) scanning the binary image G.sub.i in an order from left to right and from top to bottom, if a current point pixel value g.sub.i(x, y) is equal to 255, recording a current pixel horizontal coordinate x=Leftj, and a vertical coordinate y=Lefti, and stopping scanning; (A2.1.5) scanning the binary image G.sub.i in an order from right to left and from top to bottom, if a current point pixel value g.sub.i(x, y) is equal to 255, recording a current pixel horizontal coordinate x=Rightj, and a vertical coordinate y=Righti, and stopping scanning; and (A2.1.6) defining the object main body height-width ratio of the characteristic view F.sub.i as
3. The attitude estimation method for an on-orbit three-dimensional space object according to claim 2, wherein a manner of extracting the feature, the object longitudinal symmetry T.sub.i,2 comprises: (A2.2.1) calculating a horizontal coordinate C.sub.ix=(Leftj+Rightj)/2 and a vertical coordinate C.sub.i=(Topi+Bnti)/2 of a central point of the characteristic view F.sub.i, wherein the symbol V represents taking an integral part for the variable V; (A2.2.2) counting the number of pixel points whose gray value is 255 within a region where 1horizontal coordinate xn and 1vertical coordinate yC.sub.iy in the binary image G.sub.i, that is, the area ST.sub.i of the upper-half portion of the object of the characteristic view F.sub.i; (A2.2.3) counting the number of pixel points whose gray value is 255 within a region where 1horizontal coordinate xn and C.sub.iy+1vertical coordinate ym in the binary image G.sub.i, that is, the area SD.sub.i of the lower-half portion of the object of the characteristic view F.sub.i; and (A2.2.4) calculating the object longitudinal symmetry
4. The attitude estimation method for an on-orbit three-dimensional space object according to claim 3, wherein a manner of extracting the feature, the object horizontal symmetry T.sub.i,3 comprises: (A2.3.1) counting the number of pixel points whose gray value is 255 within a region where 1horizontal coordinate xC.sub.ix and 1vertical coordinate ym in the binary image G.sub.i, that is, the area SL.sub.i of the left-half portion of the object of the characteristic view F.sub.i; (A2.3.2) counting the number of pixel points whose gray value is 255 within a region where C.sub.ix+1horizontal coordinate xn and 1vertical coordinate ym in the binary image G.sub.i, that is, the area SR.sub.i of the right-half portion of the object of the characteristic view F.sub.i; and (A2.3.3) calculating the object horizontal symmetry
5. The attitude estimation method for an on-orbit three-dimensional space object according to claim 4, wherein a manner of extracting the feature, the object main-axis inclination angle T.sub.i,4 comprises: (A2.4.1) calculating a horizontal coordinate x.sub.i0 and a vertical coordinate y.sub.i0 of a gravity center of the binary image G.sub.i corresponding to the characteristic view F.sub.i:
6. The attitude estimation method for an on-orbit three-dimensional space object according to claim 1, further comprising: performing normalization processing on the geometrical feature library constructed in Step (A2), and performing normalization processing on the features extracted from the image to be tested in Step (B2).
7. The attitude estimation method for an on-orbit three-dimensional space object according to claim 1, a specific implementation manner of the acquiring, according to a space object three-dimensional model, multi-viewpoint characteristic views of the object for characterizing various attitudes of the object in Step (A1) comprises: dividing a Gaussian observation sphere into K two-dimensional planes at an angle interval of for pitching angle and at an interval of for yaw angle , wherein =180 to 0, =180 to 180, and K=360*180/.sub.2; and placing the space object three-dimensional model O.sub.T at the spherical center of the Gaussian observation sphere, and performing orthographic projection of the three-dimensional model O.sub.T from the spherical center respectively onto the K two-dimensional planes, to obtain multi-viewpoint characteristic views F.sub.i of K three-dimensional template objects in total, wherein each characteristic view F.sub.i is a pixel matrix whose width is n and height is m, f.sub.i(x,y) is a pixel gray value at a point (x,y) in F.sub.i, 1horizontal coordinate xn, 1vertical coordinate ym, and i=1, 2, . . . , and K.
8. The attitude estimation method for an on-orbit three-dimensional space object according to claim 1, wherein in Step (B1), noise suppression is first performed on the image to be tested by using non-local means filtering first, and then deblurring is performed by using a maximum likelihood estimation algorithm.
9. The attitude estimation method for an on-orbit three-dimensional space object according to claim 1, a specific implementation manner of (B3) comprises: (B3.1) traversing the entire geometrical feature library SMF, and calculating Euclidean distances, represented as D.sub.1, . . . , and D.sub.K, between four geometrical features {SG.sub.1,SG.sub.2,SG.sub.3,SG.sub.4} of the image to be tested and each row of vectors in the geometrical feature library SMF, wherein K is a quantity of the multi-viewpoint characteristic views of the object; and (B3.2) choosing four minimum values D.sub.S, D.sub.t, D.sub.u, and D.sub.v from the Euclidean distances D.sub.1, . . . , and D.sub.K, and calculating an arithmetic mean of four object attitudes corresponding to the four minimum values, wherein the arithmetic mean is an object attitude in the image to be tested.
10. An attitude estimation system for an on-orbit three-dimensional space object, comprising an offline feature library construction module and an online attitude estimation module, wherein the offline feature library construction module specifically comprises: a first sub-module, configured to acquire, according to a space object three-dimensional model, multi-viewpoint characteristic views of the object for characterizing various attitudes of the space object; and a second sub-module, configured to extract geometrical features from each space object multi-viewpoint characteristic view to form a geometrical feature library, wherein the geometrical features comprise an object main body height-width ratio T.sub.i,1, an object longitudinal symmetry T.sub.i,2, an object horizontal symmetry T.sub.i,3, and an object main-axis inclination angle T.sub.i,4, wherein the object main body height-width ratio T.sub.i,1 refers to a height-width ratio of an minimum bounding rectangle of the object; the object longitudinal symmetry T.sub.i,2 refers to a ratio of an area of the upper-half portion of the object to an area of the lower-half portion of the object within a rectangular region enclosed by the minimum bounding rectangle of the object; the object horizontal symmetry T.sub.i,3 refers to a ratio of an area of the left-half portion of the object to an area of the right-half portion of the object within the rectangular region enclosed by the minimum bounding rectangle of the object; and the object main-axis inclination angle T.sub.i,4 refers to an included angle between an object cylinder-body main axis and a view horizontal direction of a characteristic view; and the online attitude estimation module specifically comprises: a third sub-module, configured to preprocess an on-orbit space object image to be tested; a fourth sub-module, configured to extract features from the image to be tested after preprocessing, wherein the features are the same as the features extracted by the second sub-module; and a fifth sub-module, configured to match the features extracted from the image to be tested in the geometrical feature library, wherein a space object attitude characterized by a characteristic view corresponding to a matching result is an object attitude in the image to be tested.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
DETAILED DESCRIPTION
[0076] To make the objectives, technical solutions, and advantages of the present invention clearer and more comprehensible, the present invention is further described below in detail with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described here are merely used to explain the present invention rather than to limit the present invention. In addition, the technical features involved in the implementation manners of the present invention described below can be combined with each other as long as the technical features do not conflict with each other.
[0077] In the present invention, an on-orbit three-dimensional space object is an on-orbit Hubble telescope, and the structure of a satellite platform of the Hubble telescope is a cylinder. Two rectangular solar panels are mainly carried on the satellite platform, and an object attitude that needs to be estimated refers to an attitude of the satellite platform in the three-dimensional object coordinate system.
[0078] The present invention is further described below in detail by using the structure of an object shown in
[0079] A procedure of the present invention is shown in
[0080] (A1) Step of acquiring multi-viewpoint characteristic views of a template object includes the following sub-steps:
[0081] (A1.1) Step of establishing a template object three-dimensional model:
[0082] For a cooperative space object, for example, a satellite object, detailed three-dimensional structures and relative position relationships such as a satellite platform, a load carried by a satellite, and relative position relationships among components of the satellite can be precisely obtained. For an uncooperative space object, approximate geometrical structures and relative position relationships of various components of the object are deduced from multi-viewpoint projection images of the object. By using a priori knowledge that when an object satellite moves on an orbit, a connecting line between the center of mass of a satellite platform and the center of the earth is perpendicular to the satellite platform, that a solar panel of the object satellite always points to an incident direction of sunlight, and the like, spatial position relationships among various components of the satellite are further determined. A three-dimensional modeling tool Multigen Creator is used to establish a three-dimensional model of an object satellite.
[0083] (A1.2) Step of acquiring multi-viewpoint characteristic views of the template object:
[0084] As shown in
[0085] In the present invention, a Hubble telescope simulated satellite is used as the template object. As shown in
[0086] (A2) Step of establishing a geometrical feature library of the template object includes the following sub-steps:
[0087] This example is described by using i=1886 frames of 2592 frame characteristic views as an example:
[0088] (A2.1) Calculate an object main body height-width ratio T.sub.i,1 of each characteristic view F.sub.i:
[0089] (A2.1.1) Obtain a threshold T.sub.i=95 by using a threshold criterion of a maximum between-cluster variance for the input characteristic view F.sub.i shown in
[0090] (A2.1.2) Scan the binary image G.sub.i in an order from top to bottom and from left to right, if a current point pixel value g.sub.i(x, y) is equal to 255, record a current pixel horizontal coordinate x=Topj, and a vertical coordinate y=Topi, and stop scanning, where in this example, Topj=272, and Topi=87.
[0091] (A2.1.3) Scan the binary image G.sub.i in an order from bottom to top and from left to right, if a current point pixel value g.sub.i(x, y) is equal to 255, record a current pixel horizontal coordinate x=Bntj, and a vertical coordinate y=Bnti, and stop scanning, where in this example, Bntj=330, and Bnti=315.
[0092] (A2.1.4) Scan the binary image G.sub.i in an order from left to right and from top to bottom, if a current point pixel value g.sub.i(x, y) is equal to 255, record a current pixel horizontal coordinate x=Leftj, and a vertical coordinate y=Lefti, and stop scanning, where in this example, Leftj=152, and Lefti=139.
[0093] (A2.1.5) Scan the binary image G.sub.i in an order from right to left and from top to bottom, if a current point pixel value g.sub.i(x, y) is equal to 255, record a current pixel horizontal coordinate x=Rightj, and a vertical coordinate y=Righti, and stop scanning, where in this example, Rightj=361, and Righti=282.
[0094] (A2.1.6) Define the object main body height-width ratio of the characteristic view F.sub.i as a ratio
of an object height H.sub.i to an object width W.sub.i, where H.sub.i=|TopiBnti|, W.sub.i=|LeftjRightj|, and the symbol |V| represents an absolute value of the variable V. As shown in
[0095] (A2.2) Calculate an object longitudinal symmetry T.sub.i,2 of each characteristic view F.sub.i:
[0096] (A2.2.1) Calculate a horizontal coordinate C.sub.ix=(Leftj+Rightj)/2 and a vertical coordinate C.sub.iy=(Topi+Bnti)/2 of a central point of the characteristic view F.sub.i, where the symbol V represents taking an integral part for the variable V, where in this example, C.sub.ix=256, and C.sub.iy=201.
[0097] (A2.2.2) Count the number of pixel points whose gray value g.sub.i(x, y) is 255 within a region where 1horizontal coordinate x500 and 1vertical coordinate y201 in the binary image G.sub.i, that is, the area ST.sub.i of the upper-half portion of the object of the characteristic view F.sub.i. In this example, an area of a region enclosed by a rectangular box abcd in
[0098] (A2.2.3) Count the number of pixel points whose gray value g.sub.i(x, y) is 255 within a region where 1horizontal coordinate x500 and 202<vertical coordinate y411 in the binary image G.sub.i, that is, the area SD.sub.i of the lower-half portion of the object of the characteristic view F.sub.i. In this example, an area of a region enclosed by a rectangular box cdef in
[0099] (A2.2.4) Calculate the object longitudinal symmetry
of the characteristic view F.sub.i.
[0100] The object longitudinal symmetry of the characteristic view F.sub.i is defined as a ratio of an area ST.sub.i of the upper-half portion of the object to an area SD.sub.i of the lower-half portion within a rectangular region enclosed by an minimum bounding rectangle of the object, where in this example, T.sub.i,2=1.0873.
[0101] (A2.3) Calculate an object horizontal symmetry T.sub.i,3 of each characteristic view F.sub.i:
[0102] (A2.3.1) Count the number of pixel points whose gray value g.sub.i(x, y) is 255 within a region where 1horizontal coordinate xC.sub.ix and 1vertical coordinate ym in the binary image G.sub.i, that is, the area SL.sub.i of the left-half portion of the object of the characteristic view F.sub.i. In this example, an area of a region enclosed by a rectangular box hukv in
[0103] (A2.3.2) Count the number of pixel points whose gray value g.sub.i(x, y) is 255 within a region where C.sub.ix+1horizontal coordinate xn and 1vertical coordinate ym in the binary image G.sub.i, that is, the area SR.sub.i of the right-half portion of the object of the characteristic view F.sub.i. In this example, an area of a region enclosed by a rectangular box ujvl in
[0104] (A2.3.3) Calculate the object horizontal symmetry
of the characteristic view F.sub.i.
[0105] The object horizontal symmetry of the characteristic view F.sub.i is defined as a ratio of an area SL.sub.i of the left-half portion of the object to an area SR.sub.i of the right-half portion within a rectangular region enclosed by a minimum bounding rectangle of the object, where in this example, T.sub.i,3=0.9909.
[0106] (A2.4) Calculate an object main-axis inclination angle T.sub.i,4 of the characteristic view F.sub.i:
[0107] The object main-axis inclination angle is defined as an included angle between an object cylinder-body axis of the characteristic view F.sub.i and an image horizontal direction. The feature represents an attitude feature of an object most distinctively, has a value range of 0 to 180, and is represented by using a one-dimensional floating-point number.
[0108]
[0109] (A2.4.1) Calculate a horizontal coordinate X.sub.i0 and a vertical coordinate y.sub.i0 of a gravity center of the binary image G.sub.i corresponding to each characteristic view F.sub.i, where in this example, x.sub.i0=252, and y.sub.i0=212.
[0110] (A2.4.2) Calculate a p+q.sup.th central moment .sub.i(p, q) of the binary image G.sub.i corresponding to the characteristic view F.sub.i.
[0111] (A2.4.3) Construct a real symmetrical matrix
and calculate feature values V.sub.1 and V.sub.2 of the matrix Mat and feature vectors
corresponding to the feature vectors, where in this example,
the feature values are V.sub.1=6.295510.sup.9 and V.sub.2=2.345510.sup.10, and the feature vectors are
[0112] (A2.4.4) Calculate the object main-axis inclination angle T.sub.i4 shown in
where
[0113] in the formula, the symbol represents a ratio of the circumference of a circle to the diameter thereof, and the symbol a tan 2 represents an arctangent function.
[0114] In this example, the object main-axis inclination angle T.sub.i4=50.005.
[0115] (A2.5) Construct a geometrical feature library MF of the multi-viewpoint characteristic views F.sub.i of the template object:
[0116] where
[0117] in the formula, the i.sup.th row {T.sub.i,1,T.sub.i,2,T.sub.i,3,T.sub.i,4} represents a geometrical feature of the characteristic view F.sub.i of the i.sup.th frame, where in this example, as shown in
[0118] (A2.6) Normalization processing step:
[0119] Perform normalization processing on the geometrical feature library MF of the multi-viewpoint characteristic views F.sub.i of the template object, to obtain a normalized geometrical feature library SMF of the template object:
[0120] where in the formula,
Vec.sub.j=max{T.sub.1,j,T.sub.2,j, . . . , T.sub.i,j, . . . , T.sub.K,j} i=1, 2, . . . , and K, j=1, 2, 3, and 4; and the symbol Max{V} represents taking a maximum value in a set V.
[0121] An online attitude estimation step specifically includes:
[0122] (B1) Step of calculating geometrical features of the image to be tested, including the following sub-steps:
[0123] (B1.1) Step of preprocessing the image to be tested
[0124] Imaging data of a space object has much noise and a low signal-to-noise ratio, and blurring is obvious. Therefore, before subsequent processing is performed on the imaging data, it is necessary to perform preprocessing on the imaging data first. That is, denoising is performed on the imaging data first, and then, for characteristics of the imaging data, an effective calibration algorithm is used to perform image restoration processing on an image of the space object. In this example, non-local means filtering (the following parameters are chosen: the size of a similarity window is 55, the size of a search window is 1515, and an attenuation parameter is 15) is chosen to first perform noise suppression on the image to be tested.
[0125] (B2) Step of extracting geometrical features from the image to be tested
[0126] Replace f.sub.i(x, y) with the image g(x, y) after preprocessing, perform sub-step (2.1) to sub-step (2.4), to obtain geometrical features {G.sub.1,G.sub.2,G.sub.3,G.sub.4} of the image to be tested, and perform normalization processing on the geometrical features {G.sub.1,G.sub.2,G.sub.3,G.sub.4}, to obtain normalized geometrical features {SG.sub.1,SG.sub.2,SG.sub.3,SG.sub.4} of the image to be tested, where
SG.sub.j=G.sub.j/Vec.sub.j, and j=1,2,3,4.
[0127] (B3) Object attitude estimation step, including the following sub-steps:
[0128] (B3.1) Traverse the entire geometrical feature library SMF of the template object, and calculate Euclidean distances D.sub.1, . . . , and D.sub.K between geometrical features {SG.sub.1,SG.sub.2,SG.sub.3,SG.sub.4} of the image to be tested and each row of vectors in SMF; and
[0129] (B3.2) Choose four minimum values D.sub.S, D.sub.t, D.sub.u, and D.sub.v from the Euclidean distances D.sub.1, . . . , and D.sub.K, where an attitude of the image to be tested is set as an arithmetic mean of pattern attitudes represented by D.sub.S, D.sub.t, D.sub.u, and D.sub.v.
[0130] The results show that a precision error of an estimation result of the pitching angle is zero degree, and a precision error of an estimation result of the yaw angle is within 10 degrees.
[0131] A person skilled in the art easily understands that the foregoing merely provides preferred embodiments of the present invention, which are not used to limit the present invention. Any modifications, equivalent replacements, and improvements made within the spirit and principle of the present invention shall all fall within the protection scope of the present invention.