S3 Streamable Backup: Direct-to-Cloud Backups for Manticore Search
Since we introduced the backup tool in Manticore Search 6, backing up your data has become significantly easier. But we kept hearing the same question: "What about cloud storage?" Today, we're exci...

Source: DEV Community
Since we introduced the backup tool in Manticore Search 6, backing up your data has become significantly easier. But we kept hearing the same question: "What about cloud storage?" Today, we're excited to announce that manticore-backup now supports S3-compatible storage with streaming uploads — no intermediate files, no local disk space headaches, just direct-to-cloud backups. The Problem with Traditional Backups When you're running Manticore Search in production, your datasets can grow quickly. Backing up to local storage has its limitations: Disk space constraints: You need free space equal to your backup size on the same machine Manual transfer steps: Backup locally, then upload to cloud storage Time overhead: The copy-then-upload dance doubles your backup window Complexity: Scripting reliable uploads with resume capability, encryption, and error handling Streamable S3 Backup: How It Works The new S3 storage support streams your backup data directly to S3-compatible storage. Here's w