Remix.run Logo
joshmn 7 hours ago

I have a moderately sized 2TB production database I have enjoyed using pgBackRest on, and was—this week—going to set it up on another 8TB database we have.

What's the next-closest thing? wal-g? barman? databasus? I only get to cosplay as a DBA.

infinet 5 minutes ago | parent | next [-]

[delayed]

sgarland 6 hours ago | parent | prev | next [-]

I've used barman on somewhat large-ish DBs (30+ TB), and had no complaints with it. I am a DBRE, if that holds any weight.

briffle 2 hours ago | parent | next [-]

We recently moved from Barman to pgBackrest. Our main complaints with barman were that incremental backups utilized hardlinks. Which was great, we could have our 7TB database backed up, and the next day, only 20GB in changes. But, when replicating that data to cloud storage, there is no concept of hardlinks, so now we had to push 14TB to cloud storage. Also, at least last time we looked a while back, file compression was only the WAL files, unless you used the newer barman-cloud-backup tool, which we did not.

Also, pgBackrest lets you do the majority of the backup from a physical standby, which is VERY nice for removing the load off production.

None of these seemed like issues, until we looked at pgBarman, and suddenly realized how nice that would be.

joshmn 5 hours ago | parent | prev [-]

barman seems to cover "Natural disaster" in their docs. Seems good.

I'll take a look. Thanks!

3manuek 2 hours ago | parent | prev | next [-]

The "closest" would be using Barman with hook scripts (https://docs.pgbarman.org/release/3.18.0/user_guide/hook_scr...) if you rely on cloud storage for storing backups.

https://github.com/aiven-open/pghoard seems like a good option too, but I haven’t tested it yet to have a solid opinion.

ramraj07 5 hours ago | parent | prev | next [-]

Backing up multi terabyte production postgres databases is not merely cos playing ha ha

drcongo 7 hours ago | parent | prev | next [-]

I can beat you on the timing - I'd never used pgBackRest before, but started setting it up on a project about 2 hours ago, by the time I'd finished the README had been updated.

hosteur 6 hours ago | parent | prev | next [-]

databasus does not do PITR.

zigzag312 5 hours ago | parent [-]

Is that info up-to-date? Their readme states:

  **Backup types**
  
  - **Logical** — Native dump of the database in its engine-specific binary format. Compressed and streamed directly to storage with no intermediate files
  - **Physical** — File-level copy of the entire database cluster. Faster backup and restore for large datasets compared to logical dumps
  - **Incremental** — Physical base backup combined with continuous WAL segment archiving. **Enables Point-in-time recovery (PITR)** — restore to any second between backups. Designed for disaster recovery and near-zero data loss requirements
EDIT: It seem PITR has been added this March (for PostgreSQL)

https://github.com/databasus/databasus/issues/411

zigzag312 5 hours ago | parent | prev [-]

pg_probackup seems to be another one.