Role: Team lead, Unity developer
Date: Spring 2018-present
ARSIS (the Augmented Reality Space Informatics System) is an augmented reality heads-up display for astronauts developed for the NASA SUITS Challenge. Features include a voice-controlled menu system, spatial navigation aids, and 3D telestration for dynamic communication with Mission Control. I have led the team (~10 members) and been one of the primary developers on the project since it began. In 2018 I traveled as one of five team members to test and present our work at Johnson Space Center. We published our work here as part of the HCI International conference. Current research is focused on object detection, eye tracking for UI navigation, and lunar navigation.
Early 2D Telestration Prototype
Originally, telestration was performed in 2D using pictures sent from the HoloLens.
3D Telestration Split Screen
3D telestration with virtual reality. Mission Control operatives draw/place shapes in the VR space which then appear in the HoloLens.
Desktop Telestration Mockup
Design for desktop portal for 3D telestration
We redesigned our original 3D menus in 2D for a cleaner look.
Outline of how a user would use ARSIS to navigate
Outline of how a user would use ARSIS to complete spacewalk procedures
Geology Sample Flowchart
Outline of how a user would use ARSIS to collect field notes