From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 4848 invoked by alias); 6 Apr 2009 19:18:12 -0000 Received: (qmail 4840 invoked by uid 22791); 6 Apr 2009 19:18:11 -0000 X-SWARE-Spam-Status: No, hits=-2.6 required=5.0 tests=AWL,BAYES_00,SPF_PASS X-Spam-Check-By: sourceware.org Received: from e24smtp03.br.ibm.com (HELO e24smtp03.br.ibm.com) (32.104.18.24) by sourceware.org (qpsmtpd/0.43rc1) with ESMTP; Mon, 06 Apr 2009 19:18:05 +0000 Received: from mailhub3.br.ibm.com (mailhub3.br.ibm.com [9.18.232.110]) by e24smtp03.br.ibm.com (8.13.1/8.13.1) with ESMTP id n36JDTBc026658 for ; Mon, 6 Apr 2009 16:13:29 -0300 Received: from d24av02.br.ibm.com (d24av02.br.ibm.com [9.18.232.47]) by mailhub3.br.ibm.com (8.13.8/8.13.8/NCO v9.2) with ESMTP id n36JIMLj1982570 for ; Mon, 6 Apr 2009 16:18:22 -0300 Received: from d24av02.br.ibm.com (loopback [127.0.0.1]) by d24av02.br.ibm.com (8.12.11.20060308/8.13.3) with ESMTP id n36JI1IT016955 for ; Mon, 6 Apr 2009 16:18:01 -0300 Received: from [9.18.238.219] (dyn532062.br.ibm.com [9.18.238.219]) by d24av02.br.ibm.com (8.12.11.20060308/8.12.11) with ESMTP id n36JI1jZ016943; Mon, 6 Apr 2009 16:18:01 -0300 Subject: relying on testsuite results From: Thiago Jung Bauermann To: Paul Pluzhnikov Cc: gdb-patches@sourceware.org In-Reply-To: <8ac60eac0904061159v4deb9d48n1cf791463e587e54@mail.gmail.com> References: <200901121846.51709.pedro@codesourcery.com> <200902062335.17737.pedro@codesourcery.com> <8ac60eac0902082223q2192830cu8b75f6424fca6c68@mail.gmail.com> <200902092216.54762.pedro@codesourcery.com> <8ac60eac0904061159v4deb9d48n1cf791463e587e54@mail.gmail.com> Content-Type: text/plain; charset=UTF-8 Date: Mon, 06 Apr 2009 19:18:00 -0000 Message-Id: <1239045480.8871.11.camel@localhost.localdomain> Mime-Version: 1.0 Content-Transfer-Encoding: 8bit X-IsSubscribed: yes Mailing-List: contact gdb-patches-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: gdb-patches-owner@sourceware.org X-SW-Source: 2009-04/txt/msg00106.txt.bz2 Hi Paul, [ Hijacking thread, changing subject. ] El lun, 06-04-2009 a las 11:59 -0700, Paul Pluzhnikov escribió: > On Mon, Feb 9, 2009 at 3:16 PM, Pedro Alves wrote: > > > I'm not 100% sure if we want to fix this, or if we want to > > adjust the testsuite instead, and making clear in the docs > > that the variable can be empty. > > Meanwhile the test continues to fail :-( I'm sincerely curious about why this bothers you to the point of remembering this discussion from one month ago and fixing it. I'd love to rely on testsuite results like this, but unfortunately there are too many "non-deterministic testcases" (as I call them) and they add a great deal of noise. So the most use I get from the testsuite is to run regression tests on each patch I submit, and tediously eyeball the diff looking to see if any of the PASS<->FAIL flips actuallly mean something. Do you have a way out of this except going through each of the unreliable tests and staring at them long enough to see why they flip (and that can be tricky)? -- []'s Thiago Jung Bauermann IBM Linux Technology Center