Thread

Re: Improving tracking/processing of buildfarm test failures

Alexander Lakhin <exclusion@gmail.com> — 2026-05-05T19:00:00Z

Hello hackers,

Please take a look at the April report on buildfarm failures:
# SELECT br, COUNT(*) FROM failures WHERE dt >= '2026-04-01' AND
  dt < '2026-05-01' GROUP BY br;
REL_14_STABLE: 7
REL_15_STABLE: 3
REL_16_STABLE: 6
REL_17_STABLE: 4
REL_18_STABLE: 15
master: 144
-- Total: 180
(Counting test failures only, excluding indent-check, Configure, Build
errors, also excluding failures from fruitcrow (2).)

# SELECT COUNT(*) FROM (SELECT DISTINCT issue_link FROM failures WHERE
  dt >= '2026-04-01' AND dt < '2026-05-01');
31

# SELECT issue_link, COUNT(*) FROM failures WHERE dt >= '2026-04-01' AND
  dt < '2026-05-01' GROUP BY issue_link ORDER BY 2 DESC LIMIT 6;

https://www.postgresql.org/message-id/1CB288C9-564B-4664-B096-C2F4377D17AB%40yesql.se : 35
-- Fixed

https://www.postgresql.org/message-id/ptyiexyhmtxf4lm524s7o7w64r26ra237uusv4tjav4yhpmeoo@vfwwllz7tivb : 14
-- Fixed

https://www.postgresql.org/message-id/OS3PR01MB8889505E2F3E443CCA4BD72EEA45A%40OS3PR01MB8889.jpnprd01.prod.outlook.com : 11
-- Fixed

https://www.postgresql.org/message-id/E1wI7MQ-003Ldn-2V%40gemulon.postgresql.org : 10
-- Fixed

https://www.postgresql.org/message-id/1997398.1776263852%40sss.pgh.pa.us : 10
-- Fixed

https://www.postgresql.org/message-id/CA+hUKGL0bikWSC2XW-zUgFWNVEpD_gEWXndi2PE5tWqmApkpZQ@mail.gmail.com : 8

# SELECT COUNT(*) FROM failures WHERE dt >= '2026-04-01' AND
  dt < '2026-05-01' AND issue_link IS NULL; -- Unsorted/unhelpful failures
33

Short-lived failures: 122

Best regards,
Alexander