A method, includes saving in-flight data from an aircraft during a simulated training exercise, wherein the in-flight data includes geospatial locations of the aircraft, positional attitudes of the aircraft, and head positions of a pilot operating the aircraft, saving simulation data relating to a simulated virtual object presented to the pilot as augmented reality content in-flight, wherein the virtual object was programmed to interact with the aircraft during the simulated training exercise and representing the in-flight data from the aircraft and the simulation data relating to the simulated virtual object as a replay of the simulated training exercise.

Systems and methods include providing a virtual reality (“VR”) flight emulator system that simulates control, operation, and response of a vehicle. The flight emulator includes a control interface and a head-mounted display worn by a user. Motion, orientation, and/or forces experienced by the simulated vehicle are imparted to a user through a motion-control seat. Multiple flight emulators can be connected to a communication network, and a master flight emulator may teleport into a slave flight emulator in order to observe, overtake, override, and/or assume control of the slave flight emulator. Inputs made via the control interface of the master flight emulator or during playback of a pre-recorded training exercise or flight mission are translated into the control interface, head-mounted display, and motion-control seat of the slave flight emulator to provide real-time feedback to the user of the slave flight emulator.

Systems and methods for providing immersive avionics training include controlling a virtual or augmented reality device to present, to a user, a virtual or augmented reality simulation of a user interface of an avionics system including a simulation of a display of the avionics system. The method further includes detecting a user action based on a point of gaze and touch inputs of the user indicative of a user command to use a functionality of the avionics system. The user action is a physical interaction with a control panel apparatus representing an input device of the user interface of the avionics system. The method also includes simulating the use of the functionality in accordance with the user command to generate output data and controlling the virtual or augmented reality device to simulate display of the output data in the simulation of the display of the avionics system.

An aircraft VR training system includes: training terminals that generates simulation images for performing simulation training in common VR space and provides the simulation images to trainees individually associated with the training terminals; and a setting terminal including setting information necessary for generating the simulation images. The setting terminal transmits the setting information to the training terminals. The training terminals set the setting information received from the setting terminal, and transmit setting completion notification of the setting information to the setting terminal. After the setting terminal receives the completion notification from all the training terminals, the setting terminal causes the training terminals to start simulation training.

A VR training system includes: a training terminal that generates a simulation image for simulation training in VR space and includes an avatar of a trainee linked to action of the trainee in real space and a controller with which the trainee performs an omission action. When an omission action is performed with the controller in a series of actions in the simulation training, the training terminal omits a predetermined action of the avatar and updates the simulation image from a state before the predetermined action to a state after the predetermined action.

A method and system for simulating pilot controls in a cockpit simulator by controlling one or more arms on which is/are mounted a control grip, pedal or the like, to locate the grip at different positions and allow movement of the grip in a plurality of movement directions and trajectories while allowing varying force feedback.

A VR training system includes: training terminals that generates simulation images for simulation training in common VR space and provides the simulation images to trainees individually associated with the training terminals; and a tracking sensor that detects motion of the trainees in real space. Each of the training terminals calculates a position and a posture of a self avatar in VR space based on a detection result of the tracking sensor, acquires position information on a position and a posture of another avatar in the VR space from another training terminal, and generates the another avatar in the VR space based on the acquired position information.

Systems and methods are disclosed for virtual reality (VR) aircraft test and training environments that simultaneously leverage a high quality immersive environment engine and an operational flight program (OFP) running on a virtual flight management computer (FMC) by using a communication channels that couples the immersive VR environment engine with the virtual FMC. Existing investment in flight simulators, test environment core components, and any of navigation simulation, data link simulation, air traffic control simulation, and flight visualization modules can be advantageously employed to provide high-quality, realistic testing and training capability.

A display system comprises a projector combined with a retro reflective screen and a viewer distance from the projector such that the observation angle is less than approximately 2-3 degrees. The brightness of the image on the screen for the proposed display system is increased by a factor of ˜100-500× as compared to traditional display systems with for an equivalent power/intensity light source.

Systems, methods, and computer products according to the principles of the present inventions may involve a training system for a pilot of an aircraft. The training system may include an aircraft sensor system affixed to the aircraft adapted to provide a location of the aircraft, including an altitude of the aircraft, speed of the aircraft, and directional attitude of the aircraft. It may further include a helmet position sensor system adapted to determine a location of a helmet within a cockpit of the aircraft and a viewing direction of a pilot wearing the helmet. The helmet may include a see-through computer display through which the pilot sees an environment outside of the aircraft with computer content overlaying the environment to create an augmented reality view of the environment for the pilot. A computer content presentation system may be adapted to present computer content to the see-through computer display at a virtual marker, generated by the computer content presentation system, representing a geospatial position of a training asset moving within a visual range of the pilot, such that the pilot sees the computer content from a perspective consistent with the aircraft's position, altitude, attitude, and the pilot's helmet position when the pilot's viewing direction is aligned with the virtual marker.