AWS technical article on running Apache Kafka without local disk storage by mounting S3 as an NFS file system. Includes architecture patterns for multi-region Kafka deployments, performance benchmarks, and practical implementation guidance. Useful for teams managing storage constraints and wanting to leverage cloud object storage for event streaming infrastructure.
Apache Kafka usually stores its logs on local disk, which fills up and forces teams to offload data and maintain custom tooling. With Amazon S3 Files, you can mount an S3 bucket as an NFS file system and point Kafka's log directories to it, running diskless Kafka. This post shows how, with a multi-Region setup and performance benchmarks.