Setting the file. One moment.
Subchapter 43.10
references/s3-general-purpose-knowledge.mdMarkdown7 KBView on GitHub
This reference captures information addressing common gotchas and frequently asked questions for Amazon S3 general purpose buckets to support accurate model responses. It is not a complete specification. The authoritative source for current specifications, limits, quotas, and API behavior is the , , , and . Retrieve current specifications, limits, and quotas from those pages before citing specifics; cite figures only from those pages.
What it is: Amazon S3 General Purpose is virtually unlimited object storage accessed over a REST and HTTP API, storing objects redundantly across a minimum of three Availability Zones in a Region for high durability and availability by default. It offers multiple storage classes and Lifecycle Management that optimize cost across access frequencies without application changes.
Well-suited for: the default starting point and system of record for unstructured data, such as data lakes and analytics, backups and archive targets, ML training data, media storage and content distribution, log and event data, static website and application assets, and regulatory and compliance archives.
You MUST retrieve information from the linked documentation in the below table before answering any user question on the related topic.
| Topic | Example service characteristics, features, and actions | Documentation |
|---|---|---|
| Access and protocols | REST and HTTP API; strong read-after-write consistency | Access control in Amazon S3 (opens in a new tab); Accessing an Amazon S3 general purpose bucket (opens in a new tab) |
| Deployment and availability | Multi-AZ redundancy; durability vs backup | Data protection in Amazon S3 (opens in a new tab) |
| Storage classes | S3 Standard; S3 Standard-Infrequent Access (S3 Standard-IA); S3 One Zone-IA; S3 Intelligent-Tiering; S3 Express One Zone; S3 Glacier storage classes (S3 Glacier Instant Retrieval, S3 Glacier Flexible Retrieval, S3 Glacier Deep Archive); Lifecycle transitions | Understanding and managing Amazon S3 storage classes (opens in a new tab) |
| Data protection and management | Versioning; Object Lock; Replication; Batch Replication; Replication Time Control; Batch Operations | Data protection in Amazon S3 (opens in a new tab); Working with objects in Amazon S3 (opens in a new tab); Retaining multiple versions of objects with S3 Versioning (opens in a new tab) |
| Performance | prefix partitioning; 503 SlowDown; request-rate pre-warming | Best practices design patterns: optimizing Amazon S3 performance (opens in a new tab) |
| Security | SSE-S3; SSE-KMS; IAM and bucket policies; Block Public Access; ACLs disabled / bucket-owner-enforced; condition keys; explicit deny; checksums; account regional namespace; bucket owner condition; encryption in transit | Security in Amazon S3 (opens in a new tab); S3 Security Best Practices (opens in a new tab) |
| Health and monitoring | CloudWatch metrics; alarms; CloudTrail; Storage Lens | Logging and monitoring in Amazon S3 (opens in a new tab) |
| Pricing | storage by class; requests; retrieval; data transfer; Intelligent-Tiering monitoring; lifecycle transitions; Inventory and Analytics; replication (not exhaustive, review pricing page for the full list of pricing dimensions) | Amazon S3 pricing (opens in a new tab) |
| Mountpoint for Amazon S3 | local file-system mount; read-heavy sequential workloads | Mountpoint (opens in a new tab) |
| S3 Metadata | queryable object-metadata tables; discovery and governance | Discovering your data with S3 Metadata tables (opens in a new tab) |
| S3 Tables | managed Apache Iceberg tables; automatic compaction, snapshot management, and unreferenced-file removal | Working with Amazon S3 Tables and table buckets (opens in a new tab) |
| S3 Vectors | storing and querying vector embeddings | Working with S3 Vectors and vector buckets (opens in a new tab) |
You MUST retrieve information from the linked documentation in the below table before providing the user with any guidance on the related area.
| Example area | Example errors | Example fixes | Documentation |
|---|---|---|---|
| Cost and billing | bill spikes; incomplete multipart uploads; lifecycle transition costs | isolate with Storage Lens and Cost Explorer; abort incomplete uploads | Understanding your S3 bill (opens in a new tab), S3 Storage Lens (opens in a new tab), Aborting incomplete multipart uploads (opens in a new tab) |
| Data protection and recovery | delete markers on versioned buckets; archive restore expiry; replication gaps | use versioning or Object Lock and Batch Replication; budget minimum durations | Locking objects with Object Lock (opens in a new tab), Replicating existing objects with Batch Replication (opens in a new tab), Restoring an archived object (opens in a new tab), Troubleshooting replication (opens in a new tab), Troubleshooting versioning (opens in a new tab) |
| Access and permissions | cross-account AccessDenied; KMS key mismatch | evaluate the full policy chain; explicit deny overrides allows | Access denied (403) (opens in a new tab), Bucket policy examples using condition keys (opens in a new tab) |
| Performance | 503 SlowDown on hot prefixes | spread across prefixes; back off with jitter | Performance design patterns for Amazon S3 (opens in a new tab) |