How We Solved a Storage Problem in PostgreSQL Without Adding a Single Byte of Storage

Originally published at hakibenita.com on December 22, 2018.

A while back we started getting alerts in the middle of the night on low disk space. A quick investigation led us to one of our ETL tasks.

The ETL task was working on a table that stored binary records we refer to as “dumps”. Every night the task was fired to eliminate duplicate dumps, and free up some space.