Patent classifications
G09B9/44
Augmented reality for vehicle operations
A method of training a plurality of pilots, each in a separate real aircraft, includes providing a head mounted see-through computer display (HMD) to each of the plurality of pilots such that each of the plurality of pilots are enabled to view a common virtual environment with computer rendered training content, tracking a location, attitude and speed of each of the separate real aircraft, positioning the computer rendered training content at a geospatial location within a visual range of each of the plurality of pilots and presenting the computer rendered training content to the HMD of each of the plurality of pilots, wherein the presentation in each individual HMD is dependent on an alignment of each respective HMD and the computer rendered content geospatial location.
PILOT EDUCATION SYSTEM
A pilot education system includes a learning stage identifier, a teaching information setter, and a practice method setter. The learning stage identifier is configured to identify a learning stage of a trainee to operate either one of an aircraft simulator and an actual aircraft by measuring and analyzing maneuvering skills of the trainee. The maneuvering skills are related to at least one of a sight line or a maneuvering operation. The teaching information setter is configured to set an amount of teaching information to be presented to the trainee in either one of the aircraft simulator and the actual aircraft according to the learning stage identified by the learning stage identifier. The practice method setter is configured to set a practice method for the trainee according to the learning stage identified by the learning stage identifier.
PILOT EDUCATION SYSTEM
A pilot education system includes a learning stage identifier, a teaching information setter, and a practice method setter. The learning stage identifier is configured to identify a learning stage of a trainee to operate either one of an aircraft simulator and an actual aircraft by measuring and analyzing maneuvering skills of the trainee. The maneuvering skills are related to at least one of a sight line or a maneuvering operation. The teaching information setter is configured to set an amount of teaching information to be presented to the trainee in either one of the aircraft simulator and the actual aircraft according to the learning stage identified by the learning stage identifier. The practice method setter is configured to set a practice method for the trainee according to the learning stage identified by the learning stage identifier.
Augmented reality for vehicle operations
An augmented reality system, includes a first head-mounted see-through optic and a second head-mounted see-through optic each adapted to present digital content viewable by a user and having a transparency that enables the user to see through to the surrounding environment, wherein the first and second optics are separated by a distance such that a user of the first cannot see a user of the second optic, a training simulation system adapted to present digital content to each of the first and second optics, wherein the digital content represents a vehicle operated by the other user, wherein the digital content is presented to the first optic at a geospatial position proximate the first optic and the training simulation system further adapted to move the geospatial position of the digital content to maintain an apparent position relative to the other vehicle based on the other vehicle's movements.
Augmented reality for vehicle operations
An augmented reality system, includes a first head-mounted see-through optic and a second head-mounted see-through optic each adapted to present digital content viewable by a user and having a transparency that enables the user to see through to the surrounding environment, wherein the first and second optics are separated by a distance such that a user of the first cannot see a user of the second optic, a training simulation system adapted to present digital content to each of the first and second optics, wherein the digital content represents a vehicle operated by the other user, wherein the digital content is presented to the first optic at a geospatial position proximate the first optic and the training simulation system further adapted to move the geospatial position of the digital content to maintain an apparent position relative to the other vehicle based on the other vehicle's movements.
Flight simulation
There is provided a method and apparatus for simulating a flight scenario during a live flight of an aircraft. The method comprises: (i) generating (60) images comprising scenes relevant to the simulated flight scenario at a simulated altitude; (ii) calculating, using live flight data received for the aircraft and with reference to a predetermined flight model (65), simulated flight data for the simulated flight scenario at the simulated altitude; and (iii) displaying, on a display system (35) of the aircraft, the calculated simulated flight data while controlling the display of said generated scene images to simulate movement of the aircraft through the displayed scene at a rate and in a direction corresponding to the displayed simulated flight data. The method and apparatus may optionally alter the response of the aircraft to control actions (70) by a pilot to simulate the response expected of the aircraft having the simulated flight characteristics.
Flight simulation
There is provided a method and apparatus for simulating a flight scenario during a live flight of an aircraft. The method comprises: (i) generating (60) images comprising scenes relevant to the simulated flight scenario at a simulated altitude; (ii) calculating, using live flight data received for the aircraft and with reference to a predetermined flight model (65), simulated flight data for the simulated flight scenario at the simulated altitude; and (iii) displaying, on a display system (35) of the aircraft, the calculated simulated flight data while controlling the display of said generated scene images to simulate movement of the aircraft through the displayed scene at a rate and in a direction corresponding to the displayed simulated flight data. The method and apparatus may optionally alter the response of the aircraft to control actions (70) by a pilot to simulate the response expected of the aircraft having the simulated flight characteristics.
AUGMENTED REALITY FOR VEHICLE OPERATIONS
Systems, methods, and computer products according to the principles of the present inventions may involve a training system for a pilot of an aircraft. The training system may include an aircraft sensor system affixed to the aircraft adapted to provide a location of the aircraft, including an altitude of the aircraft, speed of the aircraft, and directional attitude of the aircraft. It may further include a helmet position sensor system adapted to determine a location of a helmet within a cockpit of the aircraft and a viewing direction of a pilot wearing the helmet. The helmet may include a see-through computer display through which the pilot sees an environment outside of the aircraft with computer content overlaying the environment to create an augmented reality view of the environment for the pilot. A computer content presentation system may be adapted to present computer content to the see-through computer display at a virtual marker, generated by the computer content presentation system, representing a geospatial position of a training asset moving within a visual range of the pilot, such that the pilot sees the computer content from a perspective consistent with the aircraft's position, altitude, attitude, and the pilot's helmet position when the pilot's viewing direction is aligned with the virtual marker.
AUGMENTED REALITY FOR VEHICLE OPERATIONS
Systems, methods, and computer products according to the principles of the present inventions may involve a training system for a pilot of an aircraft. The training system may include an aircraft sensor system affixed to the aircraft adapted to provide a location of the aircraft, including an altitude of the aircraft, speed of the aircraft, and directional attitude of the aircraft. It may further include a helmet position sensor system adapted to determine a location of a helmet within a cockpit of the aircraft and a viewing direction of a pilot wearing the helmet. The helmet may include a see-through computer display through which the pilot sees an environment outside of the aircraft with computer content overlaying the environment to create an augmented reality view of the environment for the pilot. A computer content presentation system may be adapted to present computer content to the see-through computer display at a virtual marker, generated by the computer content presentation system, representing a geospatial position of a training asset moving within a visual range of the pilot, such that the pilot sees the computer content from a perspective consistent with the aircraft's position, altitude, attitude, and the pilot's helmet position when the pilot's viewing direction is aligned with the virtual marker.
AUGMENTED REALITY FOR VEHICLE OPERATIONS
Systems, methods, and computer products according to the principles of the present inventions may involve a training system for a pilot of an aircraft. The training system may include an aircraft sensor system affixed to the aircraft adapted to provide a location of the aircraft, including an altitude of the aircraft, speed of the aircraft, and directional attitude of the aircraft. It may further include a helmet position sensor system adapted to determine a location of a helmet within a cockpit of the aircraft and a viewing direction of a pilot wearing the helmet. The helmet may include a see-through computer display through which the pilot sees an environment outside of the aircraft with computer content overlaying the environment to create an augmented reality view of the environment for the pilot. A computer content presentation system may be adapted to present computer content to the see-through computer display at a virtual marker, generated by the computer content presentation system, representing a geospatial position of a training asset moving within a visual range of the pilot, such that the pilot sees the computer content from a perspective consistent with the aircraft's position, altitude, attitude, and the pilot's helmet position when the pilot's viewing direction is aligned with the virtual marker.