WAL-G 3.0.10 introduces wal-send for streaming replication from object storage
The new wal-send feature allows PostgreSQL standbys to read WAL directly from object storage using the streaming replication protocol.
Summary
The WAL-G team has released version 3.0.10 of their open-source backup and recovery tool. While supporting multiple databases like MySQL, MariaDB, and MongoDB, this update focuses heavily on enhancing PostgreSQL capabilities through improved Write-Ahead Log (WAL) management.
Key improvements include the introduction of the wal-send utility and optimizations for continuous archival in daemon mode. The release also updates S3 storage support to use AWS SDK v2 and introduces several safety mechanisms to prevent data corruption or name collisions during backup operations.
Technical improvements in WAL-G 3.0.10
- Streaming Replication: The new wal-send utility serves archived WAL via the PostgreSQL streaming replication protocol, enabling pg_receivewal and standby servers to pull segments directly from object storage.
- Archival Optimizations: Continuous WAL archival in daemon mode now maintains an active pipeline between requests and utilizes retained lookahead to minimize directory scanning overhead.
- S3 Storage Enhancements: S3 support has migrated to AWS SDK v2, adding configurable request timeouts, checksum settings, and retryable error codes, alongside support for server-side S3 copying and configurable transfer concurrency.
- Data Integrity and Safety: New features include backup-name reservation to prevent concurrent reuse, a --wait-for-archive flag to ensure all required WAL segments reach storage before a backup is marked complete, and improved file handling for WAL prefetch and upload failures.
- Distributed Database Support: Greenplum and Cloudberry updates include per-backup accounting for shared AO/AOCS/PAX storage and fixes for segment-level backup and restore operations.
Why it matters
This release significantly simplifies high-availability architectures by allowing standby nodes to leverage cloud object storage as a direct source for WAL segments. For database administrators, the improved S3 integration and enhanced safety checks reduce the risk of incomplete backups and improve the reliability of large-scale data recovery workflows.
Original reference: www.postgresql.org →