VR startup Thrust Vector is developing an in-cockpit training system

Cal Jeffrey

Posts: 2,791   +700
Staff member

A Texas-based firm called Thrust Vector has been using an Oculus Go to develop an aircraft training solution for pilots while they are actually in the air. Trainees would wear the wireless VR headset while flying to simulate different flight scenarios. The company has already performed several successful in-flight tests.

“[We have flown] probably two dozen full approaches in full VR, all the way down to about 50 feet above the runway,” Thrust Vector co-founder John Nagle told UploadVR.

The system uses the Oculus Go because it is cheap and wireless. The software combines data from Mapbox with the Unity world engine to render maps that are accurate to the aircraft’s current location. The Oculus is not only capable of representing the position of the airplane in relation to the ground, but also can very accurately portray the craft’s altitude.

“[Visual rendering is based on] an open source ADS-B sensor called Stratux, which also has an AHRS capability (Attitude and Heading Reference System),” said Nagle. “It uses a WAAS-enhanced GPS for position.”

The system is not intended to be used solo. There is always a “safety pilot” in the co-pilot’s chair in case of trouble. When Nagle is using the headset for a test, his partner and co-founder of the company John Paul Sommer flies shotgun. They constantly convey and verify information throughout the flight as can be seen in the demo video above, where Nagle all but lands a plane while in VR.

“It is still 3DOF, but it is airplane-referenced,” explained Nagle. “In an airplane, the headset rotates in 2 ways; the airplane can turn, and your head can turn also. We do the math to keep head motion airplane-relative. We do plan to use more powerful headsets in future tests, of course.”

The concept is to create a safe way to train pilots in the air how to handle various situations like low visibility, bad weather, equipment failure, and even combat scenarios by simulating these things in a relatively safe VR environment.

So how does the FAA view this radical concept? We don’t know yet. If you’ll pardon the pun, Thrust Vector until now has flown under the radar.

“FAA approval is usually relegated to things which are permanently mounted in the cockpit,” said Nagle. “Nonetheless, we look forward to working with the FAA as we refine the technology to make sure we stay within the boundaries of common sense and the regulations. After all, ultimately the goal is to improve safety, not compromise it.”

Permalink to story.

 

Uncle Al

Posts: 7,985   +6,757
Having had, maintained, and used my pilot's license for over 30 years I can see a number of benefits to this kind of system but at the same time I worry about turning flying into just another "video game" and essential will be how they will handle system failures. I'm talking THEIR system over the aircraft. If a person if flying in horrific conditions, looses his system, has to remove the visor and return to the "real world" it could have dire circumstances. In any case, it is certainly worthy of further research and development ......
 

mattfrompa

Posts: 576   +73
Having had, maintained, and used my pilot's license for over 30 years I can see a number of benefits to this kind of system but at the same time I worry about turning flying into just another "video game" and essential will be how they will handle system failures. I'm talking THEIR system over the aircraft. If a person if flying in horrific conditions, looses his system, has to remove the visor and return to the "real world" it could have dire circumstances. In any case, it is certainly worthy of further research and development ......
A valid point. So you feel the co-pilot is an insufficient safe-guard?
 
Having had, maintained, and used my pilot's license for over 30 years I can see a number of benefits to this kind of system but at the same time I worry about turning flying into just another "video game" and essential will be how they will handle system failures. I'm talking THEIR system over the aircraft. If a person if flying in horrific conditions, looses his system, has to remove the visor and return to the "real world" it could have dire circumstances. In any case, it is certainly worthy of further research and development ......
The article is talking about using it as a training aid. No different than a hood for IFR training, only more high tech and versatile. A great idea. BTW, I'm speaking from the position as an ATP and CFII.
 

Uncle Al

Posts: 7,985   +6,757
A valid point. So you feel the co-pilot is an insufficient safe-guard?
Oh not at all, in fact for the small aircraft that often fly without a co-pilot it would be great. Of course, this is just for training at this point but there is no reason it could not be adapted for real-time operations .... but the cost?!?!?!?!?!