Re: Need a builtin way to run all tests faster manner

Jim Nasby <jim.nasby@openscg.com>

From: Jim Nasby <jim.nasby@openscg.com>
To: Peter Eisentraut <peter.eisentraut@2ndquadrant.com>, Magnus Hagander <magnus@hagander.net>, Andrew Dunstan <andrew.dunstan@2ndquadrant.com>
Cc: Simon Riggs <simon@2ndquadrant.com>, Alvaro Herrera <alvherre@2ndquadrant.com>, Andres Freund <andres@anarazel.de>, Tom Lane <tgl@sss.pgh.pa.us>, Stephen Frost <sfrost@snowman.net>, PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2017-03-10T19:53:12Z
Lists: pgsql-hackers
On 3/10/17 1:09 PM, Peter Eisentraut wrote:
> On 3/10/17 03:27, Jim Nasby wrote:
>> Perhaps https://travis-ci.org/ or something similar could be used for
>> this. That avoids any issues about random code.
>
> That doesn't achieve any platform coverage, which is the main point here.

I don't think platform coverage is the first thing to worry about with 
patches, nor with ongoing development.

The biggest win we'd get from something like Travis would be if the 
commitfest monitored for new patch files coming in for monitored threads 
and it created a new branch, applied the patches, and if they applied 
without error commit the branch and push to let Travis do it's thing. We 
wouldn't want that running in the main git repo, but it should be fine 
in a fork that's dedicated to that purpose.

If the travis build failed, commitfest could notify the author.

It could also rebase master into each branch on a daily basis so authors 
would know very quickly if something got committed that broke their patch.

Obviously that doesn't remove the need for manual testing or the 
buildfarm, but it would at least let everyone know that the patch passed 
a smoke test.
-- 
Jim Nasby, Chief Data Architect, OpenSCG
http://OpenSCG.com


Commits

  1. Improve isolation tests infrastructure.