Usability Evaluation of a Winter Operations App
Business Case
Making a seasonal use app more intuitive for line operations
Industry
Service Provided
Aviation
Usability
Project Summary
Seasonal app usage presents several challenges for pilots, particularly regarding proficiency and reliability in critical situations. Since applications like the Holdover Time (HOT) App are only used during winter operations, pilots may struggle with reduced familiarity when they need them most, potentially affecting decision-making speed and accuracy.
The lack of regular exposure can lead to slower navigation of app features, increasing cognitive load and the risk of errors in high-pressure environments. Ensuring that such applications are intuitive and user-friendly, particularly those used infrequently, is essential to maintaining operational effectiveness.
The Challenge
Faced with a tight timeline, an airline customer sought to acquire a new HOT App to replace the legacy version used over multiple winter seasons.
Recognizing that differences between the two applications could impact pilot performance, the airline prioritized a comprehensive assessment of the new tool. Their request included identifying key differences between the legacy and proposed apps, uncovering potential usability issues, and providing design recommendations to address any deficiencies. Additionally, they required guidance on effective training strategies to familiarize pilots with the new app, ensuring seamless adoption.
Given the urgency, all assessments and recommendations needed to be delivered within an accelerated two-week time frame.
The Approach
Given the project's urgency and significance, we acted swiftly while maintaining a structured approach. Leveraging our expertise in user testing and FAA usability design guidelines, we conducted an interface evaluation of both the legacy and proposed HOT apps. This process involved mapping app features to design standards to identify potential design issues that could impact pilot performance.
To gain direct user insights, we invited pilots to evaluate the new application through a tabletop exercise, using a customized usability assessment tool to measure ease of use. Additionally, we gathered feedback from pilot participants on the most effective training methods for familiarizing crews with the app’s capabilities.
The collected data was analyzed, and used to develop recommendations for improving usability and optimizing training strategies.
The Outcome
After analyzing pilot feedback and FAA display design guidelines, several usability issues were identified that could impact performance.
Given the app’s seasonal use, addressing these concerns with the developer was essential. As a result, key design improvements were recommended, including mock-ups illustrating enhancements and insights on optimal training methods.
These recommendations were presented in a joint session with the client and the third-party app developer, leading to an immediate Joint Application Development (JAD) session. Most suggested design changes were implemented on the spot, while more complex adjustments were scheduled for a later version—all accomplished within an impressive two-week time frame.
Usability Services at Human In Systems
Human In Systems transforms data into actionable insights, improving system usability and performance. Thanks to our knowledge of human - systems interaction, we deliver tailored solutions that connect user needs with operational goals.