From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 17075 invoked by alias); 5 Aug 2011 03:53:18 -0000 Received: (qmail 17066 invoked by uid 22791); 5 Aug 2011 03:53:18 -0000 X-SWARE-Spam-Status: No, hits=-6.8 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI,RP_MATCHES_RCVD,SPF_HELO_PASS X-Spam-Check-By: sourceware.org Received: from mx1.redhat.com (HELO mx1.redhat.com) (209.132.183.28) by sourceware.org (qpsmtpd/0.43rc1) with ESMTP; Fri, 05 Aug 2011 03:52:45 +0000 Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p753qhcL007950 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Thu, 4 Aug 2011 23:52:43 -0400 Received: from psique ([10.3.112.5]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id p753qbe2014950; Thu, 4 Aug 2011 23:52:40 -0400 From: Sergio Durigan Junior To: Tom Tromey Cc: Marc Khouzam , "'gdb\@sourceware.org'" Subject: Re: How to properly check for regressions? References: Date: Fri, 05 Aug 2011 03:53:00 -0000 In-Reply-To: (Tom Tromey's message of "Thu, 04 Aug 2011 14:51:10 -0600") Message-ID: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-IsSubscribed: yes Mailing-List: contact gdb-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: gdb-owner@sourceware.org X-SW-Source: 2011-08/txt/msg00021.txt.bz2 Tom Tromey writes: >>>>>> "Marc" == Marc Khouzam writes: > > Marc> And how do I deal with tests that sometimes pass and sometimes fail. > > The most common approach is to learn what they are and ignore them. > This isn't totally satisfactory; fixing them or removing them would be > nicer. At IBM I remember they had a list of "non-deterministic tests" in a wiki page. Maybe Thiago can confirm if this list still exists? It would probably be useful if we could create a similar list in our wiki?