Testbot proposal

Testbot proposal

[Jan Kratochvil]

Hi,

as an acting testbot I would prefer to run a software as the testbot instead.

It should be public so therefore asking here for suggestions, extensions are
welcome for:
	http://sourceware.org/gdb/wiki/BuildBot
It is expected to deploy some existing testbot framework.

Why the testbot is needed:
People do not always run all the possible configuration options combinations:
	http://sourceware.org/ml/gdb-patches/2011-02/msg00556.html
	http://sourceware.org/ml/gdb-patches/2011-03/msg00602.html
People do not have all the tooling pre-requisites for full testing available:
	http://sourceware.org/ml/gdb-patches/2011-03/msg00609.html
etc.

Unfortunately I do not know what is deployed for GCC.  Contrary to GCC the
project GDB is more dependent primarily on GCC but also even on kernel ptrace,
glibc, fpc (Free Pascal Compiler) etc.

Where to run it?  There is http://gcc.gnu.org/wiki/CompileFarm so maybe it is
sufficient for runs against various GCCs.  One cannot do there various OS
virtualizations but I do not expect and find OK this public testbot would
cover all the specific regression test runs I do specifically for Fedora.


Thanks,
Jan

Re: Testbot proposal

[Tom Tromey]

>>>>> "Jan" == Jan Kratochvil <jan.kratochvil@redhat.com> writes:

Jan> Unfortunately I do not know what is deployed for GCC.

Nothing formal.

Jan> Where to run it?  There is http://gcc.gnu.org/wiki/CompileFarm so
Jan> maybe it is sufficient for runs against various GCCs.  One cannot
Jan> do there various OS virtualizations but I do not expect and find OK
Jan> this public testbot would cover all the specific regression test
Jan> runs I do specifically for Fedora.

I believe that if we use buildbot, we can set it up so that
organizations can supply new buildslaves.  That way we could get more
coverage.

Also, if we need to, maybe we could get the compile farm to run some
virtual systems for us.  Also we could consider installing different
versions of GCC for different buildslaves.

We don't have to do this stuff in the first step, though; we just have
to make sure that whatever regression testing platform we pick is
capable enough to let us grow.

Tom

Re: Testbot proposal

[Jan Kratochvil]

On Thu, 10 Mar 2011 16:00:12 +0100, Tom Tromey wrote:
> Also we could consider installing different versions of GCC for different
> buildslaves.

There should be nightly/per-commit or so built GCCs.  I was running it nightly
GCCs with my `hammock' tests before but currently I do not.  Currently the GCC
debug/ regressions I find only after Jakub rebases Fedora GDBs which is
(a) too late and (b) someone has to find the GCC commit etc. afterwards, an
automatable task again.


Thanks,
Jan