Thread

Re: Improving tracking/processing of buildfarm test failures

Alexander Lakhin <exclusion@gmail.com> — 2025-09-01T19:00:00Z

Hello hackers,

Please take a look at the August report on buildfarm failures:
# SELECT br, COUNT(*) FROM failures WHERE dt >= '2025-08-01' AND
  dt < '2025-09-01' GROUP BY br;
REL_13_STABLE: 9
REL_14_STABLE: 8
REL_15_STABLE: 6
REL_16_STABLE: 12
REL_17_STABLE: 13
REL_18_STABLE: 16
master: 38
-- Total: 102
(Counting test failures only, excluding indent-check, Configure, Build
errors.)

# SELECT COUNT(*) FROM (SELECT DISTINCT issue_link FROM failures WHERE
  dt >= '2025-08-01' AND dt < '2025-09-01');
14

# SELECT issue_link, COUNT(*) FROM failures WHERE dt >= '2025-08-01' AND
  dt < '2025-09-01' GROUP BY issue_link ORDER BY 2 DESC LIMIT 6;
https://www.postgresql.org/message-id/20250823144505.88.nmisch@google.com : 9
-- Fixed

https://www.postgresql.org/message-id/CA+hUKGL0bikWSC2XW-zUgFWNVEpD_gEWXndi2PE5tWqmApkpZQ@mail.gmail.com : 6

https://www.postgresql.org/message-id/CAOYmi%2BnCkoh3zB%2BGkZad44%3DFNskwUg6F1kmuxqQZzng7Zgj5tw%40mail.gmail.com : 6
-- Fixed

https://www.postgresql.org/message-id/CANhcyEX4hH9POyTM3vh%3D58newEF0%3DqgK46xF5i-RDir2zAZ4og%40mail.gmail.com : 5

https://www.postgresql.org/message-id/0b07ead5-a5da-445e-9698-a7d340708bdf%40gmail.com : 4

https://git.postgresql.org/gitweb/?p=postgresql.git;a=commit;h=97ca67377 : 4
-- Fixed

# SELECT COUNT(*) FROM failures WHERE dt >= '2025-08-01' AND
  dt < '2025-09-01' AND issue_link IS NULL; -- Unsorted/unhelpful failures
56

Short-lived failures: 21

Best regards,
Alexander