Re: PostgreSQL as advanced job queuing system
Thiemo Kellner <thiemo@gelassene-pferde.biz>
From: Thiemo Kellner <thiemo@gelassene-pferde.biz>
To: pgsql-general@lists.postgresql.org
Date: 2024-03-22T16:17:10Z
Lists: pgsql-general
Am 22.03.2024 um 14:15 schrieb Fred Habash: > We developed a home-grown queue system using Postgres, but its > performance was largely hindered by que tables bloating and the need to > continuously vacuum them. It did not scale whatsoever. With some > workarounds, we ended up designing three sets of queue tables, switching > between them based on some queue stats, vacuum the inactive set, and repeat. > We kept this queue system for low SLA app components. For others, we > switched to Kafka. Investing in learning and implementing purpose built > queue systems pays off for the long term. I wonder whether one should https://youtu.be/VEWXmdjzIpQ&t=543 not to scale either.