ATLAS - AR System for NASA Lunar Expedition
An AR system for the Microsoft Hololens, designed to be a tool for astronauts on lunar expeditions.
Role
Product designer, User Researcher
Project Type
AR/MR Design
Team
SEDS@UM, CLAWS@UM
Project Background
NASA SUITS Challenge
Develop an augmented reality (AR) informatics display system to enable interfacing with lunar payloads, support science work, visualize consumables, streamline crew-to-crew communication, bolster Mission Control Center (MCC) interaction methods and navigate terrain.
Opportunity
Understand astronauts' needs during the states of navigation, extravehicular activities (EVA) and geology sampling to bring out a system that supports their missions.
Outcome 🎉
The final design that was presented to NASA representative was very well-received. Astronaut Nick Hague commented that the design was the "first UI that scratches the itch of everything he(I) wanted to see" among all the school presentations. The team was invited to the Houston Space Center to test out the product.
Value Proposition
1
Only provide essential data while keeping the distraction at minimum
2
Module UI applies a foldable design that adapts to the different using scenarios in space, which provides extensive assistance that are situation specific
3
UI modules have clearly differentiated priorities under different situations to ensure astronauts' safety as well as to increase their working efficiency.
Understand
How might we create an AR system that can serve the need of Astronauts' EVA missions?
There are 3 key locations during an EVA, and there are some key needs from each of these locations
Base
⦿ Communication with MCC
⦿ Store sample
⦿ Understand upcoming tasks
⦿ Analyse sample
Rover / On the way
⦿ Navigate to sample site
⦿ Communicate with MCC
⦿ Understand upcoming tasks
⦿ Know status of consumables
Sampling Site
⦿ Collect samples of at the specified location
⦿ Use corresponding tools for collecting samples
⦿ Following tasks list
⦿ Document samples
⦿ Know status of consumables
⦿ Communicate with MCC
Insights based on suit's upgrade need
Navigation
⦿ Map is used for understanding the terrain, relative position of destination, partner and base
⦿ Sampling site locations are usually predetermine
⦿ Danger (no-go) zones need to be marked out pre-trip
⦿ Astronauts need to be aware of the relative direction of the important location and their partners
Consumable
⦿ Any resources that sustain an astronaut during an EVA
⦿ Missions are executed independently. Each mission is strictly limited within certain range from the base.
⦿ Astronauts need to monitor their partner's consumable status
General
⦿ Information shouldn't be overwhelming
⦿ EVA environments are usually high in color contrast
⦿ Color choice should be selected carefully
⦿ UI should only provide necessary information in order to help astronauts handle stressful situations
Sampling
⦿ Astronauts' main EVA mission for the Artemis - collect lunar rock samples
⦿ Note taking needs to be fast, “(it) shouldn’t take longer to take note than to speak about it”
⦿ Graphical documentation of the sample and environment is important
⦿ Each sample bag is individually labeled, sometimes pre-labeled pre-trip
⦿ Task lists would help set goals and provide guidance
⦿ Analysis of notes, photos and samples happens at the base
Communication
⦿ There are two types of communications: crew-to-MCC (Mission Control Center) and crew-to-crew
⦿ Astronauts on extravehicular activity (EVA) were to have “verbal diarrhea”
⦿ Information shouldn't be overwhelming
⦿ Astronauts need to be warned about any emergency
⦿ Voice input would be more efficient than hand-typing in space suits
Core Design Opportunities
Navigation
A unobtrusive location indicator that marks out important units, and can be easily and frequently accessed.
Consumable
Only provides the most important consumable's data, but is able to remind astronauts if emergencies occur.
Communication
A task window for displaying the current task and provide additional prompt and info to support astronauts' task execution.
Exploration
Speed Ideation Session
To help us brainstorm ideas of different parts of the system, we applied speed ideation method to quickly generate ideas. We then review the ideas and pick the preferred one.
Paper Prototyping
After we decided on the general procedure of the sampling process, we made paper prototypes to understand the constraints of our idea.
Evaluation
Voting Workshop
We created digital prototype and kept small nuances between each design. Then we held a voting workshop to select the ones that we all prefer and the ones that we disapprove. We also added comments on the side to explain our thoughts.
Feedback Gathering
After we came to a point where we believe our design is decent enough. We sent out invites for comments on the design to our software team and getting their feedbacks. Afterwards, we evaluated their feedbacks and modified our design based on the good feedbacks we selected.
Different Component Iteration Overview
These are several key components to the AR system that we kept iterating on: voice assistant, bio-stats, mini-map, warning and task list. It took many iterations for the design to evolve to the final state.
Final Design
Based on the the low-fi prototype, I refined them into high fidelity prototypes and created the animation for the key experiences.
Component 1
Task list displays upcoming and finished tasks
Task list displays the task in progress. The last can also be expanded for viewing previous and upcoming tasks.
Component 2
Mini Map provides subjects' location overview
The mini map displays the astronaut, their partner(s), destination, home base and no-go zones. The astronaut is fixed in the center and always facing forward. When they turn, the mini map rotates around them.
Component 3
Drop Waypoint
Astronauts are able to set waypoints at their current location through voice command directly in the Hololens viewport. The voice assistant provides guidance and instructions as the astronaut drops and names its waypoint.
Component 4
Delete Waypoints
To remove waypoints, astronauts would use voice commands to activate the function, select the waypoint to be removed, and confirm the action. An undo function would be available for recovery.
Component 5
Sampling and photo taking
Once the camera is activated, the window will be wrapped in a green ring indicating the area the photo will be taken. After taking the photo, an equivalent to a screenshot, it will briefly stay under the voice assistant before disappearing.
Component 6
Bio Stats and warning status
Since users are worried about the wet nozzles short-circuiting their vehicles, the design features a double-undercut design to protect the nozzles well from the rain.
Component 7
Voice Assistant and response animation
The voice assistance serves as the information center where astronauts can receive warnings, notifications and messages. It is also where they can receive feedback when they are inputting voice commands.
Component 8
Orange Warning
Warnings that won’t immediately affect astronauts’ lives are displayed in orange. Once dismissed, an orange dot is kept above the voice assistant as a notification.
Component 9
Red Warning
The warning message contains both the reasons that led to the problem as well as instructions to resolve the problem. Once dismissed, the messages are kept under the voice assistance to keep the astronauts informed.