Amazon AWS · September 2023 UX Design · Product Strategy

EMR Learning Center: Empowering customers with on-demand resources

Role
Senior UX Designer
Timeline
3 months (2023)
Team
UX, PM, SA, Dev
Status
Concept validation
01 — Overview

Creating a Learning Center to reduce EMR's steep learning curve

Amazon EMR (Elastic MapReduce) is a managed cluster platform for processing vast amounts of data using open-source frameworks like Apache Spark, Hadoop, and Presto. Despite its power, customers consistently struggled with the service's complexity and steep learning curve.

The proposal: Create a new "Learning Center" page in the EMR console to provide on-the-spot, critical information about the most integral features and workflows of the service to help customers complete their tasks successfully and expediently.

“The learning curve is steep and long, even for long-time EMR users, who use this service for years.”

— EMR Solution Architect

02 — Understanding the Problem

Customer personas and pain points

EMR serves multiple customer personas, each with distinct needs and workflows:

Persona 01

Data Platform Administrator

Initiates and manages EMR clusters, sets up Studios and Serverless applications. Primary interface: EMR Console and Studio.

Persona 02

Developer & Data Engineer

Creates and manages Studios, builds data pipelines, prototypes notebooks. Uses EMR Studio, Serverless, and JupyterLab.

Persona 03

Data Scientist

Builds and runs ML models in interactive environments. Access Serverless application endpoints and JupyterLab.

03 — Research & Discovery

Three critical findings from customer feedback

Through collaboration with the product SA team and analysis of customer feedback, we identified three major pain points:

Finding 01

Knowledge Gap

A lack of user understanding of key product capabilities and potential features within the platform.

Finding 02

Contextual Information

While documentation existed, the UI lacked helpful contextual information that users needed during their daily tasks.

Finding 03

Reduced Focus

Jumping out of the platform to learn about features while performing timely functions distracted customers and reduced product TTV (time-to-value).

What customers told us:

“EMR's documentation is difficult to digest. It has too much technical content, which is hard to understand for certain audiences.”
“There are YouTube videos showing how to use the old interface, but no videos showing how to use the new one.”
“As a student, my course is on previous console interface so I'm switching to it.”

A two-part solution: Asset repository + UI mapping

The Learning Center would serve as both a centralized resource hub and an integrated contextual help system throughout the EMR console.

Part 1: Curated Repository

Behind the scenes, the EMR Learning Center would be a managed collection of expert-generated, subject-matter resources for quick-access insights.

Customers could search by subject and access various asset types:

  • Getting started tutorials: Step-by-step instructions, videos, and diagrams
  • Video clips: Internal and external content on key features
  • Diagrams: Visual illustrations of critical workflows
  • Documentation links: Whitepapers, blogs, eBooks, webinars
  • Integration insights: Key EMR integrations explained
  • Expert recommendations: Tips from SAs and other users

Part 2: Asset Mapping

Throughout the EMR console, at key workflow areas, there would be "Learning Center icon clusters" mapped to relevant Learning Center assets.

UI would feature resource icons in critical workflows such as:

  • Creation flows: Cluster creation, Studio setup
  • Administration: Monitoring and cluster management
  • Data processing: Steps, batch jobs, Spark notebooks

EMR on EC2 cluster creation, for example, can be challenging, so adding helpful insights in critical areas could help customers complete the task successfully and quickly.

04B — Competitive Research

Learning from industry examples

I researched how other data platform companies approached learning resources and in-product education. Two standout examples informed the design direction:

Competitive Analysis Databricks "Learn" Section — Comprehensive Resource Hub
Databricks Learn section
Databricks provides a robust "Learn" section with documentation, events, training & certification, demos, and extensive resources. Their approach includes video content, demo library, and organized learning paths that help users navigate complex data platform capabilities.
Competitive Analysis Starburst Resources — Categorized Learning Materials
Starburst resources section
Starburst organizes resources by type (Data Sheets, Case Studies, Videos, eBooks) with filtering capabilities. Their Data Mesh Resource Center provides curated access to specialized content, demonstrating the value of well-organized learning materials for complex technical products.

These examples validated the approach of creating a dedicated learning hub while also highlighting opportunities to differentiate through contextual help integration directly in workflows.

05 — Design Exploration

Initial wireframes and information architecture

The Learning Center page would feature categorized resources with flexible viewing options and search functionality. I explored information architecture, wireframe layouts, and interaction patterns.

Information Architecture Learning Center Structure and Navigation
Learning Center information architecture
The IA defines how customers navigate from any EMR page to the Learning Center, browse categorized content (tutorials, videos, diagrams, resources, integrations, recommendations), and access detailed resource pages or recommendation pages. Toggle views between thumbnail/list and table formats.
Wireframe Diagram Repository and Modal Interactions
Learning Center wireframe showing diagram repository and modal
The wireframe shows how diagrams are organized in the repository (left) and how they can be expanded in a modal view (right) for sharing and downloading. This provides customers with visual learning resources that can be easily accessed and shared.
Wireframe Tutorial Detail Page — "How to Create an EMR on EC2 Cluster"
Tutorial detail page wireframe
Tutorial detail pages provide overview, prerequisites, expected outcomes, notable reviews, and suggested steps with share and download options. Users can also play/download tutorial audio files for learning on-the-go (walking, driving, flights).
06 — Contextual Help Integration

Mapping resources to workflow touchpoints

Once EMR built a repository of resources, the proposal was to integrate Learning Center assets with existing workflows by mapping them to task-critical points throughout the UI.

Concept Resource Mapping Strategy
Resource mapping concept
The UI would feature resource icon clusters (video tutorials, diagrams, tips) at key workflow positions such as creation flows, administration and monitoring, and data processing tasks. For example, EMR on EC2 cluster creation can be challenging, so adding helpful insights in critical areas could help customers complete the task successfully and quickly.
UI Integration Knowledge Cluster Icons — EMR Studio Creation Flow
Resource mapping in UI with knowledge cluster icons
Resource icon clusters appear at key workflow positions where specific knowledge gaps may exist. In the EMR Studio creation flow, icons provide access to diagrams that open in modals, offering visual explanations of complex workflows at the exact moment customers need them.
07 — Process Design

Learning Center asset management workflow

A critical component of the proposal was defining how assets would be created, reviewed, and integrated into the Learning Center. The process includes eight key steps:

Process Flow 8-Step Asset Management Process
Asset management workflow diagram
The workflow starts with identifying knowledge gaps from customer feedback, deciding on asset type (video, diagram, audio, etc.), collaborating with experts to create resources, reviewing and finalizing content, entering into the repository, implementing in the UI, mapping to relevant locations, and finally tagging and monitoring for effectiveness.

8-Step Asset Management Process:

Implementation From Creation to Implementation — 3-Step Integration
Three-step implementation flow
Once created, resources follow a three-step path: (1) entered into EMR repository, (2) added to Learning Center UI with proper categorization, and (3) mapped to relevant UI locations via reference icons to provide on-the-spot contextual help throughout customer workflows.

Benefits for customers and AWS

The Learning Center initiative aimed to deliver value across multiple dimensions:

Customer Benefits

  • Enhanced knowledge: Improve product capability understanding
  • Reduced time-to-value: Complete tasks more quickly with contextual help
  • Increased satisfaction: Empowered to figure out functions independently
  • Better comprehension: Access to key information when needed
  • Improved discoverability: Find features and capabilities more easily

Business Benefits

  • Reduced support calls: Self-service resources decrease support burden
  • Enhanced product quality: Contextual, in-console resources improve experience
  • Increased adoption & retention: Relevant feature information drives engagement
  • Console value-add: Incentive to use console vs. CLI/SDK
  • Cross-service consumption: Potential for business in affiliated AWS services
09 — Validation & Feedback

Continuous advocacy and iteration

Throughout the concept development, we conducted multiple deep-dive presentations with partners, an org-level UXDD (UX Design Discussion), and specific meetings with solution architects to present and discuss the initiative.

Key feedback themes:

“Centralize Learning Center insights into categories. Include cross-service insights.”
“Include a robust LC insight search engine — Gen AI.”
“Diagrams and images — Start with animated gifs. Audio files — Learn on the go (walking the dog, driving to work, flights, road trips).”
“Customers are giving up on search — Go to Google, ChatGPT. Simplified gen AI experience.”

Next steps defined:

10 — Reflection

Design as advocacy

The EMR Learning Center project exemplified the role of design in advocating for customer needs within a large organization. While the concept faced challenges around desirability, feasibility, and viability, the process of research, design, and continuous stakeholder engagement helped surface critical customer pain points and propose tangible solutions.

Key learnings from this project included the importance of starting with an MVP approach, building cross-functional alignment through workshops and presentations, and using customer quotes and feedback as powerful advocacy tools. The wireframes and process documentation served not just as design artifacts, but as conversation starters that helped the broader team visualize possibilities and discuss tradeoffs.

This project reinforced my belief that great design work isn't just about the final deliverable — it's about facilitating important conversations, challenging assumptions, and relentlessly advocating for the customer experience.

Return to portfolio →