From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from simark.ca by simark.ca with LMTP id eYqjGOhHBmpgzjoAWB0awg (envelope-from ) for ; Thu, 14 May 2026 18:08:40 -0400 Authentication-Results: simark.ca; dkim=pass (2048-bit key; unprotected) header.d=linaro.org header.i=@linaro.org header.a=rsa-sha256 header.s=google header.b=ExCc1klI; dkim-atps=neutral Received: by simark.ca (Postfix, from userid 112) id 609811E067; Thu, 14 May 2026 18:08:40 -0400 (EDT) X-Spam-Checker-Version: SpamAssassin 4.0.1 (2024-03-25) on simark.ca X-Spam-Level: X-Spam-Status: No, score=-1.2 required=5.0 tests=ARC_SIGNED,ARC_VALID,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI, NORMAL_HTTP_TO_IP,NUMERIC_HTTP_ADDR,RCVD_IN_DNSWL_MED, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED,RCVD_IN_VALIDITY_RPBL_BLOCKED, RCVD_IN_VALIDITY_SAFE_BLOCKED,WEIRD_PORT autolearn=ham autolearn_force=no version=4.0.1 Received: from vm01.sourceware.org (vm01.sourceware.org [38.145.34.32]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by simark.ca (Postfix) with ESMTPS id B691C1E067 for ; Thu, 14 May 2026 18:08:39 -0400 (EDT) Received: from vm01.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 21E1C4C31893 for ; Thu, 14 May 2026 22:08:38 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 21E1C4C31893 Authentication-Results: sourceware.org; dkim=pass (2048-bit key, unprotected) header.d=linaro.org header.i=@linaro.org header.a=rsa-sha256 header.s=google header.b=ExCc1klI Received: from mail-dy1-x1334.google.com (mail-dy1-x1334.google.com [IPv6:2607:f8b0:4864:20::1334]) by sourceware.org (Postfix) with ESMTPS id B13BB4BB58DF for ; Thu, 14 May 2026 22:07:48 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org B13BB4BB58DF Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=linaro.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=linaro.org ARC-Filter: OpenARC Filter v1.0.0 sourceware.org B13BB4BB58DF Authentication-Results: sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::1334 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1778796468; cv=none; b=StrzY8zDhmLLFYEX+rNAgWthnbjLbf52DWJqEjsU/tSBa7va8VgR+Vn2xFP4QFmOLRmyDdf78SMuiROWC5naXqR6XyUuuUcyQ5uDypcziRRd4VxjDT3Wo5o7ybO1rBd00cKOI2sxVM8+ZjSGsqRsFUp7T2sx4fioa5o2el6ZhXk= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1778796468; c=relaxed/simple; bh=MOSx4fFscs/iUcNzzvNyYv5yPi/qTsAUoMGXAUUUYB4=; h=DKIM-Signature:From:To:Subject:Date:Message-ID:MIME-Version; b=vEvRnaBJdbLu1HMcZ09F7r70m6VETU4ciG0AQGCiYlJlcoTDa8N8MnW+QBxdTqyEo86eAY0VmIb0BPjEtSOSHEbIsDgLV2GafEfPwQvGvMe3PWuFuQA+EEnoeWoXMlx+3ysfU8UtY+0B563unhow7CAocoTMhAgEQkQ6dEDfFnI= ARC-Authentication-Results: i=1; sourceware.org; dkim=pass (2048-bit key, unprotected) header.d=linaro.org header.i=@linaro.org header.a=rsa-sha256 header.s=google header.b=ExCc1klI DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org B13BB4BB58DF Received: by mail-dy1-x1334.google.com with SMTP id 5a478bee46e88-2f7020a928eso12032825eec.1 for ; Thu, 14 May 2026 15:07:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1778796468; x=1779401268; darn=sourceware.org; h=content-transfer-encoding:mime-version:message-id:date:user-agent :references:in-reply-to:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=XwQuaxYnrAb7iXvY5kgIu1bKOC6RFbr/x3kyTaAPSI0=; b=ExCc1klI+JeI2yMOYJ7lpk0tGm6u70ZsNvERqQ2+8kS7ypnDP4Uk4D9AjxojuVx4/N 55h/un5QBU9xhkwTCDLu22Bi7oEDc5Z6Idkv9Hr4FPloeUser5WkeZ73qzP8P5ja2vsY G/Zf9/HKi/mhXk0YPTesqwoW8I0b9/wRpsFdUIQTp681d4wZleLTHrwJUikLmPBaJ8Tu r2LHloo6SNc2XIA0W5fSrVHF86w+/1k1gxpA7KOQreCwjjMCJoeRIJCe3oo/O4cJGvp5 c1I9TNvHqH/P2pWj78njsG3p1fFduqT600Qy8YN8XTprbXqP82R5PVP171+pfIa6QrZF KT2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1778796468; x=1779401268; h=content-transfer-encoding:mime-version:message-id:date:user-agent :references:in-reply-to:subject:cc:to:from:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=XwQuaxYnrAb7iXvY5kgIu1bKOC6RFbr/x3kyTaAPSI0=; b=XuWpJSk/N5uPFFDHtUP1oLcrjN/3RtQ884k0acrCCa9Jm2jHP938sbj45g0gJ962pA T3oOznyhM1Uvt+oTlE6Q4pdHsNJiUz5dNF5OEtEfEHvcJ9wiXXDNLdc0kNBiKcIZHsbM 2NyZrqiFOOyQ0vdNtF4juQXTpVmVFbwFNPxYvbQNGwdgFnzSSoZIn7pObWlL4Y49JEG1 Kkp3V7EiWINlHjngSzdW0/j350oFvxgwx9oV8ID0r/VhMQDAyfl86cE/en74N4wKOGT2 0m8hzdgf+E7goSaIQ754046DjuXUvSgAszVtQNrj5x37Xdy95i5V8AJ1MZY7vnPOAwiH 4XvQ== X-Forwarded-Encrypted: i=1; AFNElJ9TuO7KwPeCV2D4lU/+OV1zCVd2bckFRNFj5fRU3BMLj7fhiibInXyPQb0bjH6mjuodb03B2gkRGECguQ==@sourceware.org X-Gm-Message-State: AOJu0YzDiEgkBHAVOXuQ7mIYYljjpRFl2RRndpJK2UWWsTWCDgyPJQf3 l3kmZoh14KVTPDTE+ghQwZVkSAX4zmSt116r/YFTqWeU7m9JqFemKeDxDvZ1qAlqu72nPNzAAPL 2h1a9 X-Gm-Gg: Acq92OFYn8zUuG5dvKRQLDpzSj/lT2OkErrfqRNsH4a5Oo9qLk+Oc2ISRrw/oacci/l A60NyHO3LfHySOT1muPPIu/Y9gYfnNYCMCcjtbv2Ay2PvdmqejLjnpDtfNLedMvK7TESZC4gmhs 0Z05/xbxODcQ2ChezSX12+lFvDb5v9nPBcLVifrzR+QMeDtST0ggSl35FJ6UblQRvwkdviBwZrc +BotLg6tdCGaaICwTE6GL5Hc0Uqn8K7yld9f4em9AFXWVmJUy5gqNt5SLLjoDZmS0eNs+puuJVo 5yLOXUOTovWKhZWF7MJsFn0IdxoPooi/jJ3NvSEuvqLyfXq4oWaS/VLe29ir4OxBIMffcsVHS4M 35NfhfrOY+H3buP2TtaX7oZ/iKHxJCbqs+J4gYkpkp1sALEoIm2WNCS3j5nGtB/C3czgW+J+FQo G1KfdZ/2yJLbC7z9h3M+sWzs2jvCCat7hFuw== X-Received: by 2002:a05:7301:3d1a:b0:2da:1a81:588 with SMTP id 5a478bee46e88-303983c6515mr696435eec.14.1778796467530; Thu, 14 May 2026 15:07:47 -0700 (PDT) Received: from localhost ([2804:14d:7e39:8083:f04c:42e3:5943:38f6]) by smtp.gmail.com with ESMTPSA id 5a478bee46e88-30293e2e6a9sm4671440eec.2.2026.05.14.15.07.46 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 14 May 2026 15:07:47 -0700 (PDT) From: Thiago Jung Bauermann To: "Metzger, Markus T" Cc: Simon Marchi , "gdb-patches@sourceware.org" Subject: Re: [PATCH] gdb: fix an issue with thread list corruption In-Reply-To: (Markus T. Metzger's message of "Mon, 11 May 2026 07:25:41 +0000") References: <20260504071636.1571615-1-markus.t.metzger@intel.com> <20260504071636.1571615-2-markus.t.metzger@intel.com> <6ff2ff67-e93c-41b0-b55a-2ec6462e6061@simark.ca> <81a1a827-5c22-4f24-852a-1c85d09c30cc@simark.ca> <5b5e0342-ff7e-44f4-803b-aa96075229af@simark.ca> User-Agent: mu4e 1.14.1; emacs 30.2 Date: Thu, 14 May 2026 19:07:45 -0300 Message-ID: <87se7tejbi.fsf@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: gdb-patches@sourceware.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Gdb-patches mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: gdb-patches-bounces~public-inbox=simark.ca@sourceware.org "Metzger, Markus T" writes: > And what am I supposed to do about such sporadically failing tests when > I want to test a patch series to ensure that I'm not introducing regressi= ons? > > I created two empty patches and tested upstream master (of a few days ago) > and my two empty patches, then diff'ed the corresponding gdb.sum files > against the respective parent commit [1]. > > The noise caused by sporadically failing tests makes it difficult to judge > whether a given patch is OK. Even if a patch would trigger a new fail in= a > test that sporadically passes, it would not be noticed in all that noise. Ideally over time we'll fix the tests that fail sporadically for no good reason. In addition to that, there's suspicion of a kernel bug which causes Expect to miss some bytes in the pty: https://sourceware.org/bugzilla/show_bug.cgi?id=3D28561 A GCC engineer also noticed that sometimes GCC tests spuriously fail because the output seen by Expect is missing a \n that by all accounts should have been there (I don't have a bugzilla link for that one though). I recently wrote=C2=B9 a suggestion about how to deal with the flaky tests while these things aren't sorted out. I'll reproduce it here for convenience: The Linaro CI keeps an "expected failures" file containing the baseline failures and automatically detected flaky failures. For example: http://54.172.246.49:9090/jobs/tcwg_gdb_check--master-aarch64-build/builds/= 10102/archive/artifacts/sumfiles/xfails.xfail (We're currently doing some server migration so the URL above is likely to change at some point. CI notification emails will have the current one.) You can use it with GCC's contrib/testsuite-management/validate_failures.py script to filter the noise: $ validate_failures.py --manifest=3Dxfails.xfail --results=3Dgdb.sum > fail= ures.txt Note that strictly speaking, the baseline failures are specific of the machine the CI jobs run on. If you want to be precise you can replace the "known failures" section of the file with the failures from your testsuite run of the patch's base commit. --=20 Thiago =C2=B9 https://inbox.sourceware.org/gdb-patches/87zf2sc47o.fsf@linaro.org/