Re: reduce size of logs stored by buildfarm

On 2025-Nov-25, Jacob Champion wrote:

> On Tue, Nov 25, 2025 at 5:30 AM Álvaro Herrera <alvherre@kurilemu.de> wrote:
> > I also noticed that an oauth test file contains a couple MBs of a
> > gigantic string of just 'x'.  I suppose that will compress well (with
> > gzip at least, the 2 MB file becomes 8 kB).  Still, it's kinda
> > ridiculous and useless to bloat a 67 kB file to 2 MB that way.
> 
> Sorry about that.

No need!

> > 0003 does that by simply cutting the string short at 10k, which reduces
> > the size of the log from 2 MB to some 86 kB.  Maybe there are better
> > ways to deal with this?  Jacob?
> 
> Only thing I don't like about this is that the JSON you need for
> debugging might be after the useless padding. Attached is a patch that
> does things more surgically, tested against Python 3.6, and I'm
> running it through the CI now.

Brilliant, thanks.

-- 
Álvaro Herrera        Breisgau, Deutschland  —  https://www.EnterpriseDB.com/
"You're _really_ hosed if the person doing the hiring doesn't understand
relational systems: you end up with a whole raft of programmers, none of
whom has had a Date with the clue stick."              (Andrew Sullivan)
https://postgr.es/m/20050809113420.GD2768@phlogiston.dyndns.org