DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND STORAGE MEDIUM STORING DISPLAY CONTROL PROGRAM
20250118215 ยท 2025-04-10
Assignee
Inventors
Cpc classification
G08G5/23
PHYSICS
International classification
Abstract
A display control device includes processing circuitry to estimate a second mobile object as a mobile object having an abnormal approach period out of a plurality of relevant mobile objects, to make a display device display a two-dimensional coordinate system formed by a first coordinate axis representing positions from a start point to an end point of a first predicted trajectory by distances and a second coordinate axis representing a time, a line indicating the first predicted trajectory, and an abnormal approach region indicating ranges of the position and the time of the second mobile object, and to make the display device display a display component, and upon receiving input information for moving the display component, to correct the first predicted trajectory so that the line indicating the first predicted trajectory does not overlap with the abnormal approach region.
Claims
1. A display control device in a control system that transmits commands to a plurality of mobile objects traveling on a plurality of tracks, the display control device comprising processing circuitry to acquire track structure data indicating structure of the plurality of tracks; to acquire control information from a management device that manages the control information including positions and operation schedules of the plurality of mobile objects; to estimate a plurality of predicted trajectories indicating movement routes of the plurality of mobile objects based on the track structure data and the control information; to acquire a first predicted trajectory indicating the movement route of a first mobile object as a mobile object selected as a monitoring target from among the plurality of mobile objects and a plurality of relevant predicted trajectories indicating the movement routes of a plurality of relevant mobile objects being mobile objects other than the first mobile object from the plurality of predicted trajectories; to estimate a second mobile object as a mobile object having an abnormal approach period in which a distance from the first mobile object is less than or equal to a predetermined reference value out of the plurality of relevant mobile objects based on the track structure data, the first predicted trajectory and the plurality of relevant predicted trajectories; to make a display device display a two-dimensional coordinate system formed by a first coordinate axis representing positions from a start point to an end point of the first predicted trajectory by distances from the start point or the end point and a second coordinate axis representing a time, a line indicating the first predicted trajectory in the two-dimensional coordinate system, and an abnormal approach region indicating ranges of the position and the time of the second mobile object in the abnormal approach period; and to make the display device display a display component for updating the first predicted trajectory, and upon receiving input information for moving the display component, to correct the first predicted trajectory so that the line indicating the first predicted trajectory does not overlap with the abnormal approach region.
2. The display control device according to claim 1, wherein the display component is a dot-like component overlapping with the line indicating the first predicted trajectory displayed on the display device and not overlapping with the abnormal approach region.
3. The display control device according to claim 1, wherein the display component is displayed at a position of a time temporally earlier than the time range of the abnormal approach region.
4. The display control device according to claim 1, wherein when there occurs a user input operation for moving the display component displayed on the display device in a direction of the second coordinate axis, the processing circuitry generates an updated predicted trajectory by moving part of the line indicating the first predicted trajectory temporally after the display component in the direction of the movement of the display component.
5. The display control device according to claim 4, wherein a line indicating the updated predicted trajectory includes: a first part as a line segment in a range temporally before the display component; a third part as a line segment in a range temporally after the display component; and a second part as a line segment connecting the first part and the third part.
6. The display control device according to claim 1, wherein the abnormal approach occurs at an intersection of a first track and a second track intersecting with each other among the plurality of tracks between the first mobile object traveling on the first track and the second mobile object traveling on the second track.
7. The display control device according to claim 1, wherein the abnormal approach occurs on one track among the plurality of tracks between the first mobile object and the second mobile object traveling in a same direction as each other.
8. The display control device according to claim 1, wherein the abnormal approach occurs on one track among the plurality of tracks between the first mobile object and the second mobile object traveling in directions of approaching each other and being opposite to each other.
9. The display control device according to claim 1, wherein the processing circuitry changes the reference value based on one or more items of information out of information regarding a visibility range in atmospheric air at the plurality of tracks acquired from the management device, information regarding a wind direction and wind speed at the plurality of tracks acquired from the management device, and information regarding size of the first mobile object acquired from the management device.
10. The display control device according to claim 1, further comprising a storage device to store the track structure data.
11. The display control device according to claim 1, further comprising an input device to be operated by a user for inputting the input information for moving the display component.
12. The display control device according to claim 1, wherein the plurality of mobile objects include an aircraft, a vehicle, or both of an aircraft and a vehicle, and the plurality of tracks include a taxiway and a runway in an airport.
13. A display control method to be executed by a display control device in a control system that transmits commands to a plurality of mobile objects traveling on a plurality of tracks, the display control method comprising: acquiring track structure data indicating structure of the plurality of tracks; acquiring control information from a management device that manages the control information including positions and operation schedules of the plurality of mobile objects; estimating a plurality of predicted trajectories indicating movement routes of the plurality of mobile objects based on the track structure data and the control information; acquiring a first predicted trajectory indicating the movement route of a first mobile object as a mobile object selected as a monitoring target from among the plurality of mobile objects and a plurality of relevant predicted trajectories indicating the movement routes of a plurality of relevant mobile objects being mobile objects other than the first mobile object from the plurality of predicted trajectories; estimating a second mobile object as a mobile object having an abnormal approach period in which a distance from the first mobile object is less than or equal to a predetermined reference value out of the plurality of relevant mobile objects based on the track structure data, the first predicted trajectory and the plurality of relevant predicted trajectories; making a display device display a two-dimensional coordinate system formed by a first coordinate axis representing positions from a start point to an end point of the first predicted trajectory by distances from the start point or the end point and a second coordinate axis representing a time, a line indicating the first predicted trajectory in the two-dimensional coordinate system, and an abnormal approach region indicating ranges of the position and the time of the second mobile object in the abnormal approach period; and making the display device display a display component for updating the first predicted trajectory, and upon receiving input information for moving the display component, correcting the first predicted trajectory so that the line indicating the first predicted trajectory does not overlap with the abnormal approach region.
14. A non-transitory computer-readable storage medium for storing a display control program that causes a display control device in a control system that transmits commands to a plurality of mobile objects traveling on a plurality of tracks to execute processes of acquiring track structure data indicating structure of the plurality of tracks; acquiring control information from a management device that manages the control information including positions and operation schedules of the plurality of mobile objects; estimating a plurality of predicted trajectories indicating movement routes of the plurality of mobile objects based on the track structure data and the control information; acquiring a first predicted trajectory indicating the movement route of a first mobile object as a mobile object selected as a monitoring target from among the plurality of mobile objects and a plurality of relevant predicted trajectories indicating the movement routes of a plurality of relevant mobile objects being mobile objects other than the first mobile object from the plurality of predicted trajectories; estimating a second mobile object as a mobile object having an abnormal approach period in which a distance from the first mobile object is less than or equal to a predetermined reference value out of the plurality of relevant mobile objects based on the track structure data, the first predicted trajectory and the plurality of relevant predicted trajectories; making a display device display a two-dimensional coordinate system formed by a first coordinate axis representing positions from a start point to an end point of the first predicted trajectory by distances from the start point or the end point and a second coordinate axis representing a time, a line indicating the first predicted trajectory in the two-dimensional coordinate system, and an abnormal approach region indicating ranges of the position and the time of the second mobile object in the abnormal approach period; and making the display device display a display component for updating the first predicted trajectory, and upon receiving input information for moving the display component, correcting the first predicted trajectory so that the line indicating the first predicted trajectory does not overlap with the abnormal approach region.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The present invention will become more fully understood from the detailed description given hereinbelow and the accompanying drawings which are given by way of illustration only, and thus are not limitative of the present invention, and wherein:
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
DETAILED DESCRIPTION OF THE INVENTION
[0033] A display control device, a display control method and a display control program according to an embodiment will be described below with reference to the drawings. The following embodiments are just examples and it is possible to appropriately combine embodiments and appropriately modify each embodiment.
[0034]
[0035] The display control device 10 is part of a control system (i.e., air traffic control system) 1 that transmits commands to a plurality of mobile objects traveling on a plurality of tracks on the ground. The control system 1 includes a control information management device 30 as a management device and a display device 40 such as a liquid crystal monitor that displays images. The control system 1 is, for example, an airport traffic control system that transmits commands to a plurality of aircrafts as a plurality of mobile objects. The plurality of tracks are runways and taxiways in an airport, for example. In general, the control system of the airport handles flying aircraft and taxiing aircraft as targets of the air traffic control. However, the mobile objects to which the control system 1 in the present disclosure transmits commands are mobile objects traveling on the ground (including aircraft with the wheels not in contact with a runway and flying immediately above the runway at the time of landing or takeoff). The mobile object is not limited to an aircraft but can also be a vehicle such as an automobile. Further, the mobile objects may include both of an aircraft and a vehicle.
[0036] The control information management device 30 includes a mobile object tracking-identification unit 31, an operation management unit 32 and a sensor information acquisition unit 33. The mobile object tracking-identification unit 31 keeps track of the positions of the plurality of mobile objects and identifies each of the plurality of mobile objects. The operation management unit 32 manages operation management information including operation times of the plurality of mobile objects and an operation route of each of the plurality of mobile objects from a movement starting point (i.e., start point) to a destination (i.e., end point). The sensor information acquisition unit 33 receives sensing information regarding a mobile object from a sensor sensing the mobile object.
[0037] The display control device 10 includes a track structure data acquisition unit 12, a control information acquisition unit 13, a predicted trajectory estimation unit 14, a predicted trajectory acquisition unit 15, an abnormal approach estimation unit 16, a display control unit 17, an input device 18 and a trajectory correction unit 19.
[0038] The track structure data acquisition unit 12 acquires track structure data indicating the structure of the plurality of tracks from a storage device 11. The track structure data is, for example, map data of the tracks. Specifically, the track structure data acquisition unit 12 reads out the structure of the tracks (e.g., length of each taxiway and the like) stored in the storage device 11 such as a nonvolatile memory and gives the structure to the abnormal approach estimation unit 16. While the storage device 11 is shown as part of the display control device 10 in
[0039] The control information acquisition unit 13 acquires control information (e.g., air traffic control information) from the control information management device 30 that manages the control information including the positions and operation schedules of the plurality of mobile objects. Specifically, the control information acquisition unit 13 acquires present positions of the mobile objects, the operation management information, and so forth managed by the control information management device 30.
[0040] The predicted trajectory estimation unit 14 estimates predicted trajectories (e.g., scheduled loci of mobile objects traveling on the ground) indicating movement routes of the plurality of mobile objects based on the track structure data and the control information. Specifically, the predicted trajectory estimation unit 14 estimates the predicted trajectories and the present positions of the mobile objects based on the present positions of the mobile objects and the operation management information acquired from the control information acquisition unit 13. The predicted trajectories also include loci of aircraft with the wheels not in contact with the runway and flying immediately above the runway at the time of landing or takeoff.
[0041] The predicted trajectory acquisition unit 15 acquires a first predicted trajectory indicating the movement route of a mobile object selected as a monitoring target (referred to also as a selected mobile object or a first mobile object) among the plurality of mobile objects and a plurality of second predicted trajectories indicating the movement routes of a plurality of relevant mobile objects being mobile objects other than the selected mobile object from the estimated predicted trajectories. Specifically, the predicted trajectory acquisition unit 15 reads out the predicted trajectories (predicted loci) of the mobile objects calculated by the predicted trajectory estimation unit 14 and gives the predicted trajectories to the abnormal approach estimation unit 16.
[0042] The abnormal approach estimation unit 16 estimates an abnormal approach mobile object as a mobile object having a period in which the distance from the selected mobile object is less than or equal to a predetermined reference value (i.e., threshold value) out of the plurality of relevant mobile objects and estimates the position of the mobile object (referred to also as the abnormal approach mobile object or a second mobile object) in the abnormal approach period based on the track structure data, the first predicted trajectory and the plurality of second predicted trajectories. Specifically, the abnormal approach estimation unit 16 refers to the selected mobile object acquired from the input device 18 and estimates an abnormal approach region (e.g., near collision region) of the mobile object. The estimated abnormal approach region is given to the display control unit 17 and thereby displayed as an enhanced display component in superimposition on a diagram. The abnormal approach region is calculated based on the structure of the track of the mobile object (e.g., the length of the taxiway or the like) acquired from the track structure data acquisition unit 12 and the predicted trajectory of the mobile object acquired from the predicted trajectory acquisition unit 15.
[0043] The abnormal approach estimation unit 16 may acquire information regarding a visibility range in atmospheric air (maximum distance at which the shape of a target can be recognized with the naked eye) at a plurality of tracks (e.g., measurement values of visibility meters) from the control information management device 30 and modify the predetermined reference value based on the acquired visibility range.
For example, the reference value can be adjusted properly by increasing the reference value with the decrease in the visibility range due to the atmospheric air condition such as fog, rain and snow. Further, the abnormal approach estimation unit 16 may acquire information regarding a wind direction and wind speed at a plurality of tracks (e.g., measurement values of anemoscopes and anemometers) from the control information management device 30 and modify the predetermined reference value based on the wind direction and the wind speed. For example, the reference value can be adjusted properly by increasing the reference value when the wind direction is a following wind direction with the increase in the wind speed. Furthermore, the abnormal approach estimation unit 16 may acquire information regarding the size of the selected mobile object and the size of the abnormal approach mobile object (e.g., data regarding the aircraft, mobile object size information and inter-mobile object distance information obtained by analysis of camera images, and so forth) from the control information management device 30 and modify the predetermined reference value based on the size of the selected mobile object and the size of the abnormal approach mobile object. For example, a braking distance as the distance necessary for stopping increases with the increase in the size (i.e., with the increase in the weight) of the selected mobile object and with the increase in the size of the abnormal approach mobile object, and thus the reference value can be adjusted properly by increasing the reference value with the increase in the size of the selected mobile object and with the increase in the size of the abnormal approach mobile object. This is because a larger mobile object has greater weight and its braking distance as the distance necessary for stopping is longer.
[0044] The display control unit 17 makes the display device 40 display a two-dimensional coordinate system, formed by a first coordinate axis representing positions from a start point to an end point of the first predicted trajectory by distances from the start point (the unit is [m], for example, and the distance can also be the distance from the end point) and a second coordinate axis representing the time (e.g., elapsed time since a reference time to, the unit is [s], for example), and a line indicating the first predicted trajectory in the two-dimensional coordinate system. Specifically, in this embodiment, the display control unit 17 makes the display device 40 display the two-dimensional coordinate system formed by the first coordinate axis representing the positions from the start point to the end point of the first predicted trajectory by distances from the start point or the end point and the second coordinate axis representing the time, the line indicating the first predicted trajectory in the two-dimensional coordinate system, and the abnormal approach region indicating ranges of the time and the position of the second mobile object in the abnormal approach period. The two-dimensional coordinate system and the line indicating the predicted trajectory are referred to also as a diagram. The diagram is displayed by referring to selection information from the air traffic controller (i.e., user of the system) inputted through the input device 18. Further, the display control unit 17 makes the display device 40 display the enhanced display component indicating the position of the abnormal approach mobile object in the abnormal approach period in the two-dimensional coordinate system. The enhanced display component is displayed in superimposition on the diagram. Specifically, the display control unit 17 makes the display device 40 display figures representing the mobile objects, a map, the enhanced display component, and so forth. The enhanced display component is, for example, a display component obtained by filling in a predetermined figure (e.g., circle, quadrangle, star or the like) with a predetermined color (e.g., yellow, orange, red or the like). The enhanced display component can also be a display component using variation in the luminance by blinking, variation in the color, variation in the shape, or a combination of two or more of these variations.
[0045] The input device 18 is an operation input unit that receives inputs from the air traffic controller. The input device 18 is, for example, a keyboard, a mouse, a touch panel, a microphone for audio input, or the like. The input from the air traffic controller is, for example, an operation of selecting the trajectory of a mobile object to be displayed or the like. The input device 18 gives the input from the air traffic controller to the display control unit 17 as input data.
[0046] The trajectory correction unit 19 makes the display device 40 display a display component for updating the first predicted trajectory, and upon receiving input information for moving the display component, corrects the first predicted trajectory so that the line indicating the first predicted trajectory does not overlap with the abnormal approach region. Here, the display component is, for example, a dot-like component overlapping with the line indicating the first predicted trajectory displayed on the display device 40 and not overlapping with the abnormal approach region. The dot-like component is shown in
[0047]
[0048] Functions of the display control device 10 are implemented by processing circuitry, for example. The processing circuitry can be either dedicated hardware or the processor 101 executing a program stored in the memory 102. The processor 101 can be any one of a processing device, an arithmetic device, a microprocessor, a microcomputer and a DSP (Digital Signal Processor). The memory 102 may be a storage device such as a non-transitory computer-readable storage medium (i.e., record medium) storing the program.
[0049] In the case where the processing circuitry is dedicated hardware, the processing circuitry is, for example, a single circuit, a combined circuit, a programmed processor, a parallelly programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or a combination of some of these circuits.
[0050] In the case where the processing circuitry is the processor 101, the display control program to be executed by the display control device 10 is implemented by software, firmware or a combination of software and firmware. The display control program is installed in the display control device 10 via a network or from a record medium. The software and the firmware are described as programs and stored in the memory 102. The processor 101 is capable of implementing the functions of the units shown in
[0051] It is also possible to implement part of the display control device 10 by dedicated hardware and part of the display control device 10 by software or firmware. As above, the processing circuitry is capable of implementing the above-described functions by hardware, software, firmware or a combination of some of these means.
[0052]
[0053] First, the display control device 10 acquires the track structure data indicating the structure of the plurality of tracks (step S1) and acquires the control information from the control information management device 30 that manages the control information including the positions and the operation schedules of the plurality of mobile objects (step S2). The steps S1 and S2 may also be executed in reverse order or executed in parallel.
[0054] The display control device 10 estimates the predicted trajectories indicating the movement routes of the plurality of mobile objects based on the track structure data and the control information (step S3).
[0055] The display control device 10 acquires the first predicted trajectory indicating the movement route of the mobile object selected as the monitoring target among the plurality of mobile objects and the plurality of second predicted trajectories indicating the movement routes of the plurality of relevant mobile objects being mobile objects other than the selected mobile object from the estimated predicted trajectories (step S4).
[0056] The display control device 10 estimates the abnormal approach mobile object as a mobile object having the period in which the distance from the selected mobile object is less than or equal to the predetermined reference value out of the plurality of relevant mobile objects and estimates the position of the abnormal approach mobile object in the abnormal approach period based on the track structure data, the first predicted trajectory and the plurality of second predicted trajectories (step S5).
[0057] When there is an abnormal approach mobile object (YES in step S6), the display control device 10 makes the display device 40 display the two-dimensional coordinate system, formed by the first coordinate axis representing the positions from the start point to the end point of the first predicted trajectory by distances from the start point (e.g., horizontal axis) and the second coordinate axis representing the time (e.g., vertical axis), and the line (e.g., straight line or curved line) indicating the first predicted trajectory in the two-dimensional coordinate system (step S7), and makes the display device 40 display the enhanced display component indicating the position of the abnormal approach mobile object in the abnormal approach period in the two-dimensional coordinate system (step S8). When there is no abnormal approach mobile object (NO in the step S6), the display control device 10 ends the execution of the display control method according to the embodiment.
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068] The display control device 10 obtains the distance between the selected aircraft and the aircraft relevant to the selected aircraft (step S13) and judges whether or not the obtained distance is less than or equal to a predetermined reference value (i.e., threshold value) (step S14). If the obtained distance is greater than the predetermined threshold value (NO in the step S14), the process returns to the step S11. If the obtained distance is less than or equal to the predetermined threshold value (YES in the step S14), the process advances to step S15.
[0069] In the step S15, the display control device 10 fills in a minute region including the position of the selected aircraft with a color representing the abnormal approach (e.g., danger of collision at an intersection, rear-end collision or head-on collision). The minute region is a region in predetermined size and shape, for example. The size of the minute region is specified by the number of pixels in each of a vertical direction and a horizontal direction, for example. The shape of the minute region is a quadrangular shape, a circular shape, an elliptical shape, a triangular shape or the like, for example. By the processing of the steps S11 to S15, a color, luminance, a pattern, or a combination of two or more out of these for displaying the abnormal approach may be assigned to one minute region regarding one relevant aircraft.
[0070] Subsequently, the display control device 10 estimates an intersection Ia that the selected aircraft passed through immediately before and an intersection Ib that the selected aircraft will pass through next (step S16). Subsequently, the display control device 10 estimates an intersection Ic that the aircraft relevant to the selected aircraft passed through immediately before and an intersection Id that the aircraft relevant to the selected aircraft will pass through next (step S17). The display control device 10 judges whether or not Ia=Id and Ib=Ic hold (step S18).
[0071] If the condition Ia=Id and Ib=Ic is not satisfied (NO in the step S18), the process returns to the step S16. If the condition Ia=Id and Ib=Ic is satisfied (YES in the step S18), the process advances to step S19. In the step S19, the display control device 10 judges that the head-on approach has occurred between the selected aircraft and the aircraft relevant to the selected aircraft and fills in the head-on region with a predetermined color.
[0072] The processing of the steps S11 to S19 is executed for all of the relevant aircraft. Further, this process is executed for all positions in the diagram. In other words, one minute region including the position of the abnormal approach is filled in with color by the processing of the steps S11 to S15 in
[0073] In this embodiment, the occurrence of the abnormal approach between the selected mobile object and a mobile object relevant to the selected mobile object is displayed by using the predicted trajectory, the enhanced display component 221 and the head-on region 223 (when the head-on approach occurs) in the two-dimensional coordinate system. When the two-dimensional display is used as above, the air traffic controller is facilitated to grasp the occurrence of the abnormal approach, the position of the abnormal approach, and the type (intersection, rear-end or head-on) of the abnormal approach.
[0074] Further, by simultaneously displaying the presence/absence of the abnormal approach between the selected mobile object and a plurality of relevant mobile objects, it is possible to simultaneously grasp whether the trajectory set for each mobile object is safe or not.
[0075] Next, a description will be given of the correction of the trajectory by using diagram screens.
[0076]
[0077]
[0078]
[0079]
[0080] When the predicted trajectory is not corrected by use of the knob 304, the aircraft DEP001 as the mobile object moving according to the line 301 travels through the abnormal approach region 302 where the abnormal approach (that can include collision) with another aircraft occurs as shown in
[0081]
[0082] In the next step S22, when dragging of the cursor 303 is started and the knob 304 is moved in the time axis direction, the trajectory correction unit 19 shifts part of the trajectory temporally after the knob 304 (i.e., the third part 301c) accompanying the movement of the knob 304 as shown in
[0083] In the next step S23, when the dragging of the cursor 303 ends, the trajectory correction unit 19 records a stoppage position and the time at that time and fixes the trajectory as shown in
[0084] In the next step S24, the trajectory correction unit 19 provides the corrected trajectory to the predicted trajectory acquisition unit 15.
[0085]
[0086]
[0087]
[0088] As described above, according to this embodiment, the stoppage position and the stoppage time of the mobile object can be set by operating the knob for correcting the trajectory (display component) displayed on the diagram screen by using a mouse, a touch panel or the like. That is, in this embodiment, the operation for avoiding the abnormal approach (that can include collision) of mobile objects can be carried out on the diagram screen of the two-dimensional coordinate system, and thus the route setting for avoiding the abnormal approach region can be made by the intuitive method of setting the stoppage time and the stoppage position so that the line indicating the trajectory does not overlap with the dangerous region.
[0089] Further, according to this embodiment, the stoppage position and the stoppage time of the mobile object can be set by automatically operating the knob for correcting the trajectory (display component) displayed on the diagram screen, such as by use of AI (Artificial Intelligence) operating by using a learning model generated by a learning device.
DESCRIPTION OF REFERENCE CHARACTERS
[0090] 1: control system, 10: display control device, 11: storage device, 12: track structure data acquisition unit, 13: control information acquisition unit, 14: predicted trajectory estimation unit, 15: predicted trajectory acquisition unit, 16: abnormal approach estimation unit, 17: display control unit, 18: input device, 19: trajectory correction unit, 30: control information management device (management device), 40: display device, 201-203: runway (track), 204: taxiway (track), 221: enhanced display component, 302: abnormal approach region, 223: head-on region (enhanced region), 301: line indicating trajectory (predicted trajectory), 303: cursor, 304, 304a-304c: knob (display component), 401, 402: mobile object.