Amazon EFS Deep Dive

Understanding Elastic File System in AWS

What is Amazon EFS?

Definition

Amazon EFS is a fully managed, scalable, cloud-native NFS file system for use with AWS Cloud services and on-premises resources.

Key Characteristics

  • Fully managed service
  • Elastic scaling
  • Multi-AZ availability
  • NFSv4 protocol support

Common Use Cases

Application Scenarios

  • Big data analytics
  • Content management systems
  • Web serving
  • Container storage

Enterprise Use

  • Shared file systems
  • Development environments
  • Database backups
  • Media processing workflows

Storage Classes

Standard

  • Default storage class
  • Low latency access
  • Higher cost
  • Best for active workloads

One Zone

  • Single AZ storage
  • Lower cost (47% savings)
  • Same features as Standard
  • Good for development

Infrequent Access (IA)

  • Lower storage cost
  • Higher retrieval cost
  • Lifecycle management
  • Good for backups

Performance Modes

General Purpose

  • Default mode
  • Low latency
  • Higher IOPS
  • Most workloads

Max I/O

  • Higher latency
  • Unlimited throughput
  • Parallel access
  • Big data/analytics

EFS Architecture

Flow Explanation

  1. EC2 instances in multiple AZs connect to EFS via mount targets
  2. Each AZ has its own mount target for high availability
  3. Mount targets use security groups to control access
  4. Data is automatically replicated across AZs
  5. Applications can access the same data concurrently

Key Components

Mount Targets

  • One per AZ
  • IP address based
  • High availability
  • VPC integration

File System

  • Regional resource
  • Elastic capacity
  • Shared access
  • POSIX compliant

Security Groups

  • Network control
  • Port 2049 (NFS)
  • VPC security
  • Access control

Netflix

Use Case

Netflix uses EFS for content delivery and media processing workflows, enabling:

  • Shared access to media files across multiple processing servers
  • High-throughput media transcoding operations
  • Scalable content distribution system
  • Concurrent access from multiple availability zones

Prime Video

Use Case

Prime Video leverages EFS for video processing and content management:

  • Large-scale video processing pipelines
  • Content metadata management
  • Multi-region content distribution
  • Automated transcoding workflows

Audible

Use Case

Audible utilizes EFS for audiobook processing and delivery:

  • Audio file processing and format conversion
  • Metadata management for audiobooks
  • Shared storage for content delivery
  • Backup and archival of audio content

Amazon Shopping

Use Case

Amazon.com uses EFS for various e-commerce operations:

  • Product image and media storage
  • Shared configuration management
  • Log aggregation and analysis
  • Content delivery optimization

Throughput Modes

Bursting

  • Scales with storage size
  • Burst credits system
  • Default mode
  • Good for varying workloads

Provisioned

  • Fixed throughput rate
  • Independent of size
  • Predictable performance
  • Higher cost

Optimization Tips

Best Practices

  • Use latest NFS client
  • Optimize read-ahead size
  • Use appropriate mount options
  • Monitor CloudWatch metrics

Common Issues

  • Network latency
  • Throughput limits
  • Mount target issues
  • Permission problems

Access Control

IAM

  • API-level control
  • Resource policies
  • Role-based access
  • Fine-grained permissions

Network Security

  • VPC security groups
  • Mount target control
  • NFS-level security
  • Transit encryption

Encryption

At Rest

  • KMS integration
  • Automatic encryption
  • No performance impact
  • Cannot be disabled

In Transit

  • TLS encryption
  • Optional feature
  • Mount option required
  • Slight performance impact

Test Your Knowledge

1. What is the main advantage of EFS over EBS?

2. Which storage class offers the lowest cost in EFS?

3. What protocol does EFS use?

4. Which performance mode is best for big data applications?

5. What is true about EFS encryption at rest?