Thread

Re: Improving tracking/processing of buildfarm test failures

Alexander Lakhin <exclusion@gmail.com> — 2025-10-01T19:00:00Z

Hello hackers,

Please take a look at the September report on buildfarm failures:
# SELECT br, COUNT(*) FROM failures WHERE dt >= '2025-09-01' AND
  dt < '2025-10-01' GROUP BY br;
REL_13_STABLE: 7
REL_14_STABLE: 3
REL_15_STABLE: 5
REL_16_STABLE: 7
REL_17_STABLE: 15
REL_18_STABLE: 27
master: 83
-- Total: 147
(Counting test failures only, excluding indent-check, Configure, Build
errors.)

# SELECT COUNT(*) FROM (SELECT DISTINCT issue_link FROM failures WHERE
  dt >= '2025-09-01' AND dt < '2025-10-01');
15

# SELECT issue_link, COUNT(*) FROM failures WHERE dt >= '2025-09-01' AND
  dt < '2025-10-01' GROUP BY issue_link ORDER BY 2 DESC LIMIT 6;

https://www.postgresql.org/message-id/443709.1757876535@sss.pgh.pa.us : 36
-- Fixed

https://www.postgresql.org/message-id/2874644f-6431-41f4-abe2-99e5ab052606%40gmail.com : 19
-- Hurd

https://www.postgresql.org/message-id/aMoejB3iTWy1SxfF%40paquier.xyz : 17
-- Fixed

https://www.postgresql.org/message-id/CA+hUKGL0bikWSC2XW-zUgFWNVEpD_gEWXndi2PE5tWqmApkpZQ@mail.gmail.com : 11


https://www.postgresql.org/message-id/CAHGQGwFcjccSYX+Ap8meEbCccUei-B4tmYsBFu4wMEixKi90fQ@mail.gmail.com : 9


https://www.postgresql.org/message-id/E1uxCW0-000Q4A-2d%40gemulon.postgresql.org : 8
-- Fixed

# SELECT COUNT(*) FROM failures WHERE dt >= '2025-09-01' AND
  dt < '2025-10-01' AND issue_link IS NULL; -- Unsorted/unhelpful failures
23

Short-lived failures: 71


Best regards,
Alexander