AUDIOVISUAL DISPLAY MODES FOR SENSE-AND-AVOID SYSTEM FOR AERIAL VEHICLES

Abstract

The invention provides six different display modes illustrating interaction and relative locations of two or more aerial vehicles (AVs), with at least one of the AVs being controllable by a ground-based or airborne-based controller of an unmanned aerial vehicle (UAV) or a pilot of a standard manned aircraft. Some display modes also indicate a predicted distance of closest approach of two AVs, the possibility of conflict or collision, and a remaining time, measured relative to the present time, before this conflict occurs. An audio and/or visual indicator advises the AV controller if this conflict event is likely to occur and recommends an acceleration or deceleration increment that may avoid such conflict.

Claims

1. A method for displaying present and predicted future locations, velocities and accelerations of each of at least first and second aerial vehicles (AVs), the method comprising providing a computer that is programmed: to receive or otherwise provide estimates of present locations rj (t0) of a selected number J of AVs, numbered j=1, . . . , J (J2), for a present time, t=t0, where the locations rj(t0) are determined with reference to a Cartesian coordinate system (x,y,z) having unit length vectors i, j and k oriented parallel to x-, y- and z-coordinate axes, with initial vector location values rj(t0)=(xj0,yj0,zj0); to provide estimates of at least one of present velocity vectors vj (t0) and present acceleration vectors aj(t0) for the J AVs, for the present time, t=t0; to provide an estimate of location vectors rj(t), velocity vectors vj(t) and acceleration vectors aj(t) for at least two spaced apart times t that are greater than t0; to provide an estimate of a time, t=t(min)t0, for which a square of a distance separation value d(t;1,2).sup.2=|r12(t)|.sup.2=|r1(t)r2(t)|.sup.2 attains a locally minimum value for the AVs j=1 and j=2, and to estimate the locations rj(t=t(min)) for j=1 and j=2; to choose said value t=t(min) to be a value of time that is greater than said value t=t0 and that satisfies $\left(\text{/}.Math..Math.t\right).Math.{d\left(t=t\left(\min \right);1;2\right)}^2=2.Math.\left(r.Math..Math.10-r.Math..Math.20\right).Math.\left(v.Math..Math.10-v.Math..Math.20\right)+2.Math.\left\{{\left\{v.Math..Math.10-v.Math..Math.20\right\}}^2+2.Math.\left\{r.Math..Math.10-r.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\right\}.Math.\left(t\left(\min \right)-t.Math..Math.0\right)+6.Math.\left\{v.Math..Math.10-v.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\}.Math.{\left(t\left(\min \right)-t.Math..Math.0\right)}^2+4.Math.{\left\{a.Math..Math.10-a.Math..Math.20\right\}}^2-{\left(t\left(\min \right)-t.Math..Math.0\right)}^3=0,$ where d(t;1;2).sup.2=|r12(t)|2=|r1(t)r2(t)|.sup.2 is a distance of separation squared between the locations r1(t) and r2(t); to provide a unit length normal vector n={v10a10}/|v10a10|, of a display plane for the J AVs, where v10 and a10 are not approximately parallel to each other, and to choose an anchor point AP for the display plane to be at least one of the locations r10 and r20; to visually represent, on a display screen, a display plane defined by the normal vector n and passing through at least one display plane anchor point AP; to visually represent, on the display screen, the locations r1(t0) and r2(t0) on or adjacent to the display plane , determined with reference to the normal vector n. to determine whether the separation value d(t(min);1,2) satisfies d(t(min);1,2)r(thr0), where r(thr0) is a selected positive conflict radius; and when d(t(min);1,2)r(thr0), to estimate a first value, t=t1, in time that satisfies t0t1t(min) and d(t1;1,2)=r(thr0), to estimate and to display a remaining time t(rem)=t1-t0 as at least one of a visually perceptible signal and an audibly perceptible signal, and to estimate a predicted location r1(t=t1), to display a circle on the display plane , centered at the location r1(t=t1) and having a circle radius r(thr0); and to display a location r1(t) for at least two values of time t in a range t0tt1; and

2. The method of claim 1, wherein said computer is further programmed to provide a recommended acceleration increment a1, to be added to said acceleration vector a10, that may allow said AV1 and said AV2 to avoid a condition d(t;1,2)r(thr0) for any value of time t in the range t0t<t(min).

3. The method of claim 2, wherein said computer is further programmed: to determine a normal vector n2 for an approach plane by a relation n2={v20a20}/|v20a20|, where v20 and a20 are not approximately parallel to each other; and to recommend said acceleration increment a2 for said AV1 to be approximately parallel or approximately anti-parallel to the approach plane normal vector n2.

4. The method of claim 2, wherein said computer is further programmed: to recommend, as said acceleration increment a1 for said AV1, a reduction of a magnitude of said velocity v10, while maintaining a direction of said velocity v10 approximately unchanged.

5. The method of claim 1, wherein said computer is further programmed: to estimate said time t=t1 at which said separation distance satisfies d(t=t1;1,2)=r(thr0), according to a real valued solution, t1-t0, of an equation $.Math..Math..Math.r.Math..Math.12.Math.{\left(t=t.Math..Math.1\right)}^2={\left(r.Math..Math.10-r.Math..Math.20\right)}^2+2.Math.\left(r.Math..Math.10-r.Math..Math.20\right).Math.\left(v.Math..Math.10-v.Math..Math.20\right).Math.\left(t.Math..Math.1-t.Math..Math.0\right)+\left\{{\left(v.Math..Math.10-v.Math..Math.20\right\}}^2+2.Math.\left(r.Math..Math.10-r.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\right\}.Math.{\left(t.Math..Math.1-t.Math..Math.0\right)}^2+2.Math.\left\{v.Math..Math.10-v.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\}.Math.{\left(t.Math..Math.1-t.Math..Math.0\right)}^3+{\left\{a.Math..Math.10-a.Math..Math.20\right\}}^2.Math.{\left(t.Math..Math.1-t.Math..Math.0\right)}^4={r\left(\mathrm{thr}.Math..Math.0\right)}^2.$

6. The method of claim 1, wherein said computer is programmed to execute said operations in claim 1 only when a present separation distance d(t0;1,2) is less than a selected positive first potential conflict radius r(thr1) that is greater than said radius r(thr0).

7. The method of claim 1, wherein said computer is further programmed to execute said operations in claim 1 only when an estimated future separation distance, defined by d(1,2;t0+test).sup.2=|r10-r20+{t(/t) (r1(t)r2(t))(t=t0)}|.sup.2, is less than a selected second potential conflict radius r(thr2) that is greater than said radius r(thr0), where t is a selected positive time value.

8. The method of claim 1, further comprising: when at least one time value, t=t1, in a range t0tt(min) exists for which d(t1;1,2)r(th0), providing at least one of an audio indication and a visual indication that advises said controller that said first and second AVs are predicted to move within a separation distance r(thr0) of each other.

Description

BRIEF DESCRIPTION OF THE FIGURES

[0020] FIGS. 1 and 2 illustrate orientation of the planes (EW) and (NS) and (), for the first and second display modes.

[0021] FIGS. 3A and 3B illustrate a nadir view presented in a third display mode.

[0022] FIG. 4 illustrates a minimum separation display determined in a fourth display mode.

[0023] FIGS. 5A and 5B illustrate two alternatives situations in which display mode 4 can be presented.

[0024] FIGS. 6 and 7 illustrate display configurations used in the fifth and sixth display modes.

[0025] FIGS. 8 and 9 illustrate some geometric determinations used in various embodiments.

[0026] FIG. 10 illustrates a procedure for determination of an acceleration increment to avoid conflict of collision.

[0027] FIGS. 11 and 12 and 13 illustrate alternative screen displays, including a primary mode and one or more secondary modes, according to the invention.

DESCRIPTION OF BEST MODES OF THE INVENTION

[0028] The invention provides several different screen display modes for a ground-based or airborne controller (collectively referred to as a controller) of an aerial vehicle (AV). Two or more (or all) modes can be displayed simultaneously, or the controller can switch from one display mode to another depending upon the circumstances and upon which mode(s) are more relevant, as illustrated in FIGS. 11 and 12 and 13. Each of the Figures has an associated Cartesian coordinate system (x,y,z), with corresponding unit length vectors (i, j, k), in which the z-axis corresponds to a local vertical direction. Each of the following display modes displays a portion of one or more display planes, as this plane would appear on a screen observed by a controller. The x-axis and y-axes define a locally horizontal plane, and are orthogonal to each other and to the z-axis.

[0029] In a first display mode, illustrated in FIG. 1, the present location of each of two or more AVs is projected onto, and displayed on, (1) a first, vertically oriented display plane (EW), which is defined by a local z-axis (vertical) direction and by an local x-axis, orthogonal to the z-axis and extending in an east-west direction; and/or (2) a second, vertically oriented display plane (NS), which is defined by the local z-axis direction and by a local y-axis, orthogonal to the z-axis and extending in a north-south direction. The planes (EW) and (NS) intersect at right angles, and the first AV present location r10=r1(t0) is on a line segment of intersection of these planes, corresponding to the altitude, z=z10, of the present location of the first AV. The second AV present location r20=r21(t0) will usually be located at a point off one or both of the planes, (EW) and (NS). Preferably, these two planes are viewed together in a perspective view, relative to the respective planes (EW) and (NS), as illustrated in FIG. 1. The present location r20 of the second AV is projected, parallel to the y-axis and parallel to the x-axis onto the planes (EW) and (NS), respectively, using a formalism developed in Appendix A The projections of the present location r20 of the second AV on the planes (EW) and (NS) will vary with the changing location r20 of the second AV relative to the location r10 of the first AV.

[0030] The vertically oriented plane (EW) is a plane parallel to the x-axis and parallel to the z-axis and is defined by a coordinate relation

y=y10(constant), (1A)

with a corresponding unit length normal vector

n=j. (1B)

[0031] The vertically oriented plane (NS), parallel to the y-axis and to the z-axis, is similarly defined by a coordinate relation

x=x10(constant). (2A)

with a corresponding unit length normal vector

n=i. (2B)

r10=(x10,y10,z10) (3)

[0032] An anchor point for an intersection of the vertical planes, (EW) and (NS), has the coordinates r10=(x10,y10,z10), where z10 is the z coordinate of the first AV, and r20 is projected perpendicular onto each of the planes (EW) and (NS), as illustrated in FIGS. 1 and 9. The planes (EW) and (NS) can be used individually as display planes, with one or both of the present locations r10 and/or r20 being projected onto the display plane, computed as follows:

r(proj)=r{(rr(i)).Math.n}n. (r=r10 or r20). (4)

where r(i) is a vector, partly coinciding with the vector r, that points to the intersection of R with a display plane that is defined by n.

[0033] Preferably, the planes (EW) and (NS) are shown together at a non-horizontal, perspective viewing direction, as illustrated in FIG. 1, with the present location r10 being on an intersection line of (EW) and (NS), and the location r20 being projected perpendicularly onto (EW) and onto (NS), as shown in FIG. 1.

[0034] In a second display mode, a third, vertically oriented display plane (2)=(;1,2), illustrated in FIG. 2, is defined by a local z-axis direction and by an local azimuthal axis, orthogonal to the z-axis and oriented at an azimuthal angle relative to the local x-axis, as illustrated in FIG. 2 An anchor point for the display plane 2=(;1,2) and the azimuthal angle are chosen so that this plane passes through the present locations, r10 and r20, of both AV1 and AV2. The plane (;1,2), is uniquely defined unless the present locations, r1(t0) and r2(t0), coincide with each other or with the z-axis.

[0035] Optionally, first and second arrows extend from the present first and second AV locations, r10 and r20, where the two arrows (1) point toward each other when a closing rate value CRV=(/t) Irl (t)|r1<0, and (2) the two arrows point away from each other when a closing rate value CRV=(/t)|r1(t)r2(t)|>0. A single arrow, rather than two such arrows, can be used here. Where N AVs are present, numbered n=1, 2, . . . , N (N3), the plane (;n1,n2) can be determined and displayed separately for each two AVs (n1 and n2) of interest. Optionally, a plane (;n1,n2) can be displayed for two AVs containing the locations rn1(t0) and rn2(t0), for which |rn1(t0)rn2(t0)| is the smallest for the present time, t=t0.

[0036] The vertically oriented plane (;1,2) of the second mode, illustrated in FIG. 2, is defined by a relation

(xx0)sin (yy0)cos =0, (5A)

with corresponding unit length normal vector

n=i sin +j cos , (5B)

where is the selected azimuthal angle (0<2) and an anchor point, (x=x0,y=y0, z=z0), is unspecified. An anchor point for the plane (;1,2), is a location (x0 ,y0 ,z0) in three dimensions through which the plane (;1,2) passes, A (three dimensional) anchor point and an azimuthal angle for the plane () are chosen so that this plane (;1,2) includes each of the AV present locations r10=(x10,y10,z10) and r20=(x20,y20,z20). This requires that

tan =(y20y10)/(x20x10) (x20x100), (6)

(x10x0)sin (y1y0)cos =0, (7A)

(_i x2x0)sin (y2y0)cos =0, (7B)

and is satisfied, for example, by the choice

(x0,y0)=((x10+x20)/2, (y10+y20)12). (8)

[0037] In this display mode, the distance |r10-r20|, measured in the plane (), is precisely the present separation distance for the first and second AVs.

[0038] Optionally, the present velocity vectors v10=(vx10,vy10,vz10) and v20=(vx20,vy20,vz20) can be shown anchored at the respective locations, r10 and r20. Generally, these present velocity vectors will not lie in the plane () unless vy1/vx1=tan and/or vy2/vx2=tan .

[0039] A third display mode, illustrated in FIGS. 3A and 3B, provides a nadir (overhead) view of the first and second AVs. The anchor point for this horizontal display plane (3), with unit length normal vector n=k, preferably passes through the present location r10 of the first AV (z=z10), or through the present location r20 of the second AV (z=z20), or through a location intermediate between the present vertical heights of the first and second AVs (z=z120=fz10+(1f).Math.z20, with 0f1 (for example, f=0.5). The present locations, r10 and r20, of the first and second AVs are projected vertically onto the plane (3), using Eq. (3) with n=k, with arrows that point that toward each other if CRV<0 and that point away from each other if CRV>0. This is preferably shown in a perspective view.

[0040] In a fourth display mode, an initial separation vector r12(t0)=r1(t0)r2(t0) and a separation distance squared, d(t;1,2).sup.2=|r12(t)|.sup.2 are determined for first and second AVs, using observed or estimated vector values for the present location rj(t0) (j=1, 2), the present velocity vector vj0=vj(t0) and the present acceleration vector aj0=aj(t0) for each AV. A prediction of a future separation vector is estimated, using r10-r20, v10-v20, and a10-a20, and an analysis disclosed in a preceding patent application, U.S. Ser. No. 11/888,070 (incorporated by reference herein), and one or more times, t=t(min), are determined for which d(t;1,2).sup.2=|r12(t)|.sup.2 is minimized. One or three real solutions, t=t(min) can be found, and interest centers on a first real solution for which t(min)t0.

[0041] A unit length normal n(4)=(v10a10)/|v10a10| is determined, and a display plane (4) is identified, with normal vector n(4) and anchor point given by the location r10. Where the vectors v10 and a10 are substantially parallel, a vertically oriented plane (4), generated by the vectors k and v10, becomes the replaces the plane (4), with corresponding normal vector n(4)={kv10}/|kv10|. The location r20 of the second AV is shown relative to the display plane (4), or is projected onto (4), using the projection formalism disclosed in Appendix A or an equivalent formalism. A predicted AV trajectory r1(t) (t0(fixed)tt(min)) for the first AV lies in, and does not deviate from, the display plane (4), and one or more intermediate locations r1(t) for the first AV trajectory are shown on the display plane (4). The system optionally indicates the minimum separation distance d(t=t(min);1,2) and determines whether this minimum separation distance satisfies d(t=t(min);1,2)r(thr0). Here, r(thr0) is a selected conflict radius of a sphere Sph(4), centered at the location r1(t), and the separation vector r12(t) should avoid the sphere interior. The interior of Sph(4) may be a region where a collision of AV1 and AV2 may occur, or where these two AVs may experience a near miss, for example, r(thr0)=100-1320 feet.

[0042] Where d(t=t(min);1,2)>r(thr0), the separation distance d(t;1,2) for the predicted trajectories of AVs number 1 and 2 will always be greater than r(thr0). In this situation, no further graphics are required for the fourth display mode. Where d(t(min);1,2)r(thr0), the system (1) estimates a first time, t=t1, that satisfies t0t1t(min) and d(t=t1;1,2)=r(thr0), (2) determines a location r1(t1), (3) displays a circle Cir(4) in the display plane (4), centered at r1(t1), of radius r(thr0) (representing a predicted conflict sphere), (4) determines a remaining time, t(rem)=t1-t0, before conflict will occur, and (5) provides a visually perceptible and/or audibly perceptible signal indicating that a conflict will occur and the remaining time t(rem). This situation is illustrated in FIG. 4. Optionally, the system recommends an acceleration increment, a1(t0) that AV1 should execute in order to avoid the predicted conflict.

[0043] In the fourth display mode, a predicted separation vector r12(t;1,2) is determined by the relation

r12(t)=r10r20+{v10v20}(tt0)+(){a10a20}(tt0).sup.2 (tt0), (9A)

rj0=rj(t0) (j=1, 2), (9B)

vj0=vj(t0) (j=1, 2), (9C)

aj0=aj(t0) (j=1, 2). (9D)

[0044] This minimum value is a real solution, t=t(min), of a cubic equation

[00001]$\begin{array}{cc}\left(\text{/}.Math.t\right).Math.{d\left(t;1;2\right)}^2=2.Math.\left(r.Math..Math.10-r.Math..Math.20\right).Math.\left(v.Math..Math.10-v.Math..Math.20\right)+2.Math.\left\{{\left\{v.Math..Math.10-v.Math..Math.20\right\}}^2+2.Math.\left\{r.Math..Math.10-r.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\right\}.Math.\left(t\left(\min \right)-t.Math..Math.0\right)+6.Math.\left\{v.Math..Math.10-v.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\}.Math.{\left(t\left(\min \right)-t.Math..Math.0\right)}^2+4.Math.{\left\{a.Math..Math.10-a.Math..Math.20\right\}}^2.Math.(t\left(\min \right)-{t\left(0\right)}^3=0.& \left(10\right)\end{array}$

[0045] Eq. (10) has one or three real solutions. If no real solution, t=t(min), exists for which t(min)>t0, the time point, t=t(min), of closest approach for the two AVs has already passed (i.e., t(min)<t0), and no subsequent action can be taken that will affect the minimum separation distance.

[0046] A sequence of two or more locations for each of the first and second AVs, r1(t) and r2(t), beginning at t=t0, is optionally displayed in this fourth mode, representing separate trajectories for each of the AVs. Assuming that t(min)>t0 in this fourth display mode, the distance squared of closest approach d(t(min);1;2).sup.2 will occur at some time in the future (t=t(min)>t0), and the system determines whether

d(t(min);1,2)r(thr0), (11)

where r(thr0) is the conflict radius. Optionally, the first conflict time, t=t1(t0t1t(min))), at which the separation distance |r12(t)|r(thr0), is determined by

[00002]$\begin{array}{cc}{.Math..Math..Math.r.Math..Math.12.Math.\left(t=t.Math..Math.1\right).Math.}^2={\left(r.Math..Math.10-r.Math..Math.20\right)}^2+2.Math.\left(r.Math..Math.10-r.Math..Math.20\right).Math.\left(v.Math..Math.10-v.Math..Math.20\right)+\left\{{\left(v.Math..Math.10-v.Math..Math.20\right\}}^2+2.Math.\left(r.Math..Math.10-r.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\right\}.Math.{\left(t.Math..Math.1-t.Math..Math.0\right)}^2+2.Math.\left\{v.Math..Math.10-v.Math..Math.20\right\}.Math.\left\{a.Math..Math.10-a.Math..Math.20\right\}\}.Math.{\left(t.Math..Math.1-t.Math..Math.0\right)}^3+{\left\{a.Math..Math.10-a.Math..Math.20\right\}}^2.Math.{\left(t.Math..Math.1-t.Math..Math.0\right)}^4={r\left(\mathrm{thr}.Math..Math.0\right)}^2,& \left(12\right)\end{array}$

and the controller is made visually aware and/or audibly aware of how close in time, t=t1-t0, is the (first) conflict point. An acceleration increment, a1 or a2, is recommended, visually and/or audibly, for avoiding the conflict.

[0047] Optionally, the fourth display mode is presented whenever either of two situations occurs, illustrated in FIG. 5A and FIG. 5B, using a vertically-oriented cylinder or some other suitable geometric region representing a user-defined volume of airspace. In a first situation for the fourth display mode, illustrated in FIG. 5A, the system determines that the present separation distance |r12(t0)| satisfies

|r12(t0)|=|r10r20|r(thr1), (13)

where r(thr1) is a first threshold radius, greater than r(thr0), for potential conflict. In this first situation, the fourth display mode is presented if the present separation distance |r12(t0)| is no greater than a first selected positive potential conflict radius r(thr1) (>t(thr0)),

[0048] In a second situation for the fourth display mode, illustrated in FIG. 5B, the system determines that an estimated future separation distance |r12(t0+t;est)|, defined by

|r12(t0+t;est)|.sup.2=|r10r20+{t(/t) (r1(t)r2(t)).sub.t=t0}|.sup.2r(thr2).sup.2, (14)

is no greater than a second selected positive potential conflict radius r(thr2) (>r(thr0)), where t is a selected positive time value (e.g., t=15-60 sec). In this second alternative, the fourth display mode is presented if the estimated future separation distance, for a selected future time t=t0+t, is no greater than r(thr2) that is greater than the conflict radius r(thr0). Optionally, in the first alternative and/or the second alternative, the locations of AVs 1 and 2 can be displayed within a chosen geometric shape, such as a cylinder CR of suitable height and diameter. Optionally, the fourth display mode can also be presented where neither the first situation nor the second situation occurs. A sphere of radius r(thr0) or r(thr1) or r(thr2) is somewhat analogous to a tau area in TCAS.

[0049] In a fifth display mode, illustrated in FIG. 6, a display plane (5) is defined by the present velocity vectors, v10 and v20, of the first and second AVs, with unit length normal vector n(5) for this plane having the components

n(5)=(v10v20}/|v10v20|. (15)

[0050] This assumes that v10 and v20 are not substantially parallel. The display plane (5) contains the present location r10, and contains a projection of the second AV r20, parallel to the normal vector n(5), onto the plane (5), computed in Appendix A according to

r20(proj)=r20{(r20r20).Math.n(5)}n(5) (16)

The display plane (5) is defined by the normal vector n(5) in Eq. (15), and an anchor point r10 that is the present location of the first AV. The second AV present location r20 is projected onto the display plane (5) as indicated in Eq. (16). The magnitude of the projected distance

r12(proj)=r10r20(proj), (17)

measured in the plane (5), is an visual estimate or lower bound of the present separation distance d(t0;1,2)=|r10r20|.

[0051] As indicated in Appendix A, the unit length normal vector n(5) is expressible in terms of direction cosines,

n(5)=(cos 1, cos 2, cos 3), (18)

cos.sup.21+cos.sup.22+cos.sup.23=1, (19)

the plane (5) may be expressed in coordinates as

(xx0)cos 1+(yy0)cos 2+(zz0)cos 3=0, (20)

where (x0, y0, z0) are the coordinates of an anchor point, for example,

(x0, y0, z0)=r1(t0) or r2(t0). (21)

[0052] In a sixth display mode, illustrated in FIG. 7, the display plane (6) is defined by the present vectors, v10 and a10, with unit length normal vector

n(6)=(v10a10}/|v10a10|, (22)

and contains the present location r10, as an anchor point. This assumes that v10 and a10 are not substantially parallel. The equation for the display plane is determined as in Appendix A, Eq. (A3), using the direction cosine values determined for the normal vector n(6) and the anchor point coordinates for the present location r10:

r10=(x10,y10,z10)=(x0,y0,z0). (23)

[0053] The present location r20 of the second AV is projected parallel to the normal vector n(6) onto the plane (6) and displayed as r2(t0;proj), as in Eq. (16). Where v10 and a10 are substantially parallel, a vertically oriented plane, generated by the vectors k and v10, becomes a plane (6), replacing the plane (6), with corresponding normal vector n(6)={kv10}/|kv10| Trajectories, r1(t) and r2(t) are shown for the first and second AVs from the present time value, t=t0, to a time, t=t(min), corresponding to closest approach for the AVs, which will generally not lie on the plane (6).

[0054] Each of the display screens in each of the display modes (1-6) optionally includes a supplemental first scale S1 that graphically provides (1) a visually perceptible first length L1 that is linearly proportional to a present separation distance |r10-r20| of the first and second AVs and optionally provides a supplemental second scale S2 that graphically provides a second length L2 that is linearly proportional to a closing rate value, CRV=(/t)|r1(t)r2(t)| at a chosen value of time t, such as the present time, t=t0 and indicate with two opposed arrows whether the CRV>0 (arrows point away from each other) or CRV<0 (arrows point toward each other).

[0055] Each of the first, second, third, fourth, fifth and sixth display modes is referenced to a display plane, where the normal vector defining this plane is, or is proportional to, one of the vectors

n=i, j, k, i si +j cos , (v10v20)/|v10v20|, or (v10a10)/|v10a10|, (24)

[0056] The anchor point(s), if any, is one of the locations

AP=r10, r20, f z10+(1f) z20, r1(t(min)), or r2(t(min)). (25)

[0057] A projection r(proj) of a vector r onto a display plane having a unit length normal vector n is determined as

r(proj)=r{(r.Math.r(i)).Math.n}n, (26)

where r(i) is the location of an intersection of the vector r with the display plane.

[0058] The preceding development has illustrated six different display modes for two or more AVs and has considered the possibility of conflict, according to which the distance of closest approach for these AVs becomes no greater than a conflict radius r(thr0). One or more of these AVs may be an unmanned aerial vehicle that is remotely controlled by a ground-based or airborne-based UAV controller, with one or more display modes being presented to the controller at a sequence of spaced apart times (e.g., with spacing t=2-15 seconds, or longer). Several or all of these display modes may be presented simultaneously, or sequentially, to a remotely located controller of a UAV or to a cockpit-based pilot of a manned aircraft. In a first alternative, each of the AVs may be capable of independent flight. In a second alternative, the recommendations associated with the display modes may be transferred to an autopilot system archive.

[0059] The display modes disclosed here are preferably implemented by a computer that is programmed to receive and store: (i) the present location components, r1(t0) and r2(t0); (ii) the present velocity vector components, v1(t0) and v2(t0); (iii) the present acceleration vector components, a1(t0) and a2(t0); (iv) the conflict radius and potential conflict radii, r(thr0), r(thr 1) and r(thr2); and (v) to compute other scalars and vector components as needed.

[0060] The different display modes are not intended to replace the screen views presented to an air traffic controller. The different display modes of this invention are intended to be used by any AV pilot including UAV controllers. The different display modes represent a specific AV's flight safety situation symbolically in two dimensions, with each display mode having its characteristic strengths and deficits. It is likely that a given UAV controller or AV pilot will develop a human factors driven preference for one, two or three of these modes. Therefore, each of the display modes is made available to suit the preferences of a given UAV controller or AV pilot.

[0061] Optionally, the UAV controller or AV pilot has a larger or centralized primary screen to display a chosen mode and one, two or more secondary screens to display modes that may complement information shown on the primary screen. In FIGS. 11, and 12 and 13, modes 1 and 2 and 4 are displayed as primary, respectively, and other modes are displayed as secondary, respectively. This treatment can be extended to provision of many screens, one being primary and all others being secondary. The controller presses one or more of a group of M buttons to bring up a specified display mode as primary, and may further specify one or more of the M-1 other display modes as secondary.

[0062] The information presented by the audiovisual display modes might be equated with an Air Traffic Control perspective; however, this is not the case. The fundamental difference is that the computations and algorithms of the sense-and-avoid display system focus only on potential airborne conflicts involving a selected AV (e.g., the UAV being operated by a ground-based controller). The system processes 3D data from a data source, such as ground-based radar, and then evaluates, identifies, prioritizes, and declares action for potential conflicts with other AVs in a timely manner. In this AV-centric framework, the system provides the UAV controller with a flight safety capability of maintaining a safe separation distance from other AVs during UAV flights that extend beyond the visual range of ground-based observers and airborne observers in chase planes.

[0063] When compared with the forward-looking perspective of pilots in manned aircraft, the difference is that the sense-and-avoid display system is capable of providing UAV controllers with information from a 360 3D volume of airspace surrounding their respective UAV. This capability is made possible using 3D data sources. An example of such a 3D data source is the Sentinel radar manufactured by Thales Raytheon Systems that has been integrated with the herein described sense-and-avoid display system. The Sentinel radar detects the x,y,z positions of cooperative AVs equipped with an identification device (e.g., a transponder) as well as noncooperative AVs not equipped with an identification device.

[0064] In the operational framework of flight safety, the invention described herein applies to an Unmanned Aircraft System (UAS) defined as including an Unmanned Aerial Vehicle (UAV), a ground control station, a UAV controller, and any associated equipment, software and communication links that support UAV flight operations.

Appendix A. Display Plane Geometry.

[0065] Simple analytical geometry techniques can be used to relate a unit length normal vector components of a display plane and coordinates of an anchor point on the plane to components of an equation defining that plane. If the unit length normal vector n for the plane is expressible in terms of direction cosines,

n(5)=(cos 1, cos 2, cos 3), (A1)

cos.sup.21+cos.sup.22+cos.sup.23=1, (A2)

the plane may be expressed in coordinates as

(xx0)cos 1+(yy0)cos 2+(zz0)cos 3=0, A3)

where (x0, y0, z0) are the coordinates of an anchor point, as illustrated in FIG. 8. In the context presented here, the anchor point usually coincides with the present location (vector) of the first or second AV:

(x0, y0, z0)=r1(t0) or r2(t0). (A4)

[0066] A projection of a vector, such as r, onto a plane that is defined by a unit length normal vector n can be expressed in vector notation as

r(proj)=r{(r.Math.r(i)).Math.n}n. (A5)

as illustrated in FIG. 9, where r(i) is an intersect vector, drawn to the location where r intersects the plane . The intersect location r(i) is determined as follows. Express the vector r in parametric form as

xx1=e.Math.s, yy1=f.Math., zz1=g.Math.s, (0s|r|) (A6)

e.sup.2+f.sup.2+g.sup.2=1, (A7)

where s=0 corresponds to the origin of r and s=|r| corresponds to the other end of the vector r, the location r. In this configuration, x1=y1=z1=0. The unit length normal vector n has components n=(a,b,c) with a.sup.2+b.sup.2+c.sup.2=1, and a plane with the normal vector n can be expressed parametrically as

a(xx0)+b(yy0)+c(zz0)=0, (A8)

where (x0, y0, z0) is an anchor point of this plane. The intersect vector r(i) corresponds to a location on the plane for which

[00003]$\begin{array}{cc}a\left(s_I^{*}.Math.e-x.Math..Math.0\right)+b\left(s_I^{*}.Math.f-y.Math..Math.0\right)-c\left(s_I^{*}.Math.g-z.Math..Math.0\right)=0,& \left(\mathrm{A9}\right)\\ \begin{array}{c}s=s_I=.Math.\left\{a.Math..Math.x.Math..Math.0+\mathrm{by}.Math..Math.0+\mathrm{cz}.Math..Math.0\right\}.Math.\text{/}.Math.\left\{a.Math.e+b.Math.f+c.Math.g\right\}\\ =.Math.\left\{\mathrm{ax}.Math..Math.0+\mathrm{by}.Math..Math.0+\mathrm{cz}.Math..Math.0\right\}.Math.\text{/}.Math.\left(n.Math.r^{.Math.}\right),\end{array}& \left(\mathrm{A10}\right)\\ r^{.Math.}=r/.Math.r.Math.,& \left(\mathrm{A11}\right)\\ r=r^{.Math.}.Math.s_I,& \left(\mathrm{A12}\right)\end{array}$

where the line parameter s.sub.I may have any positive or negative or zero value. The location r(i) is the intersection with the plane of a line segment LL (of undetermined length), aligned with the vector r. These geometric quantities are illustrated in FIG. 9.

Appendix B. Determination of Acceleration Increment to Avoid Conflict.

[0067] Assume AV2 is approaching AV1 with a velocity vector v2(t) and acceleration vector a2(t), as determined and made available to the first AV controller, where a2(t) is assumed to be substantially constant, as illustrated in FIG. 10. Assuming that v2(t) and a2(t) are not substantially parallel, the cross product, v2(t)a2(t) characterizes a unit length normal vector

n2={v2(t)a2(t)}/|v2(t)a2(t)|(B1)

that is perpendicular to an instantaneous approach plane that contains v2(t) and a2(t) and has the location r2(t) as an anchor point. Note that n2 need not be entirely vertical or entirely horizontal. One optimal maneuver for AV1 is to move perpendicular to the plane , away from this plane. The approach plane may be defined by coordinates (x,y,z) satisfying

n2.Math.rL=0, (B2)

r=(x,y,z), (B3)

where L is a perpendicular distance from the origin to the plane . The acceleration increment a1 is preferably chosen to be parallel (or anti-parallel) to the normal vector n2, which is defined by the present vectors v20 and a20 of AV2. Identification of the normal n2 for the approach plane with sufficient accuracy will often require use of a directional antenna with very good angular resolution, in order to accurately determine or estimate the vectors v20 and a20.

[0068] In an alternative response to potentially entering a conflict volume, AV1 can execute a substantial deceleration a1 in its present heading (reduced magnitude, same direction), chosen so that AV1 will reach and pass through its location r1(t1) long after AV2 has reached and passed through its corresponding location r2(t1), to ensure that the separation distance d(t;1,2) is always greater than r(thr0). This assumes that AV2 does not significantly alter its own velocity, acceleration or deceleration vectors.