From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 17875 invoked by alias); 5 Jun 2004 00:17:08 -0000 Mailing-List: contact gdb-help@sources.redhat.com; run by ezmlm Precedence: bulk List-Subscribe: List-Archive: List-Post: List-Help: , Sender: gdb-owner@sources.redhat.com Received: (qmail 17868 invoked from network); 5 Jun 2004 00:17:07 -0000 Received: from unknown (HELO baradas.org) (66.166.225.55) by sourceware.org with SMTP; 5 Jun 2004 00:17:07 -0000 Received: by baradas.org (Postfix, from userid 500) id EB1B898C8A; Fri, 4 Jun 2004 20:17:06 -0400 (EDT) From: Peter Barada To: me@cgf.cx Cc: gdb@sources.redhat.com In-reply-to: <20040604235736.GA3283@coe.casa.cgf.cx> (message from Christopher Faylor on Fri, 4 Jun 2004 19:57:36 -0400) Subject: Re: [maint] [maint] Michael Chastain for testsuite References: <20040604233726.4FA074B104@berman.michael-chastain.com> <20040604235736.GA3283@coe.casa.cgf.cx> Message-Id: <20040605001706.EB1B898C8A@baradas.org> Date: Sat, 05 Jun 2004 00:17:00 -0000 X-SW-Source: 2004-06/txt/msg00032.txt.bz2 >>(2) Testing submissions -- I mean to require that every patch says >> how it was tested (or not tested). I don't think it's useful >> to formalize or standardize how a patch is tested beyond that. > >Does that translate into every bug reported eventually gets a test? >Would it make sense to add the test for a reported bug before a patch to >fix it is submitted? I'd like to see a testcase being *required* to be added that shows a current failure *before* a patch for its fix is accepted. This would expand the regession capability quite immensely. Then we'd have a much more palatable problem of having too many testcases that stress various areas of the code, a problem that I'd much rather see :) Of course testcases may overlap so a failure for one problem may be fixed by a different patch, but the submitted testcase adds to the arsenal we could use for regressions, and if we're smart enough, we could link the testcases together. In fact, I'd like to also require for each testcase information in the testcase about what PR it is submitted for so if a regression occurs an automates tester can point it out as a way to stat to figure out *why* it failed. -- Peter Barada peter@the-baradas.com