Manticore Search's backup tool now supports direct streaming uploads to S3-compatible storage, eliminating the need for intermediate local files. The feature uses automatic multipart uploads, optional zstd compression, SSE-S3 encryption by default, and a manifest-based restore that doesn't require s3:ListBucket permissions. Supported providers include AWS S3, MinIO, and Cloudflare R2. Usage requires only changing the --backup-dir flag to an s3:// path. The post covers CLI usage, required IAM permissions, Kubernetes CronJob integration, disaster recovery patterns, and the underlying streaming architecture built on a new StorageInterface abstraction.
Table of contents
The Problem with Traditional BackupsStreamable S3 Backup: How It WorksUsagePerformance ConsiderationsRestore from S3Use CasesTechnical DetailsMigration from Local BackupsConclusionSort: