Buckets and objects are not enough
Summary
The author argues that while S3 is a powerful storage surface, it lacks a first-class dataset abstraction, which hampers governance, cost management, and data discovery. Without a dataset layer, managing lifecycle and understanding ownership becomes brittle; the piece advocates for a durable layer that derives datasets from storage structures and metadata, with examples from industry players and a personal note about building a solution.