From: Joel Brobecker <brobecker@adacore.com>
To: Tom de Vries <tdevries@suse.de>
Cc: Tom Tromey <tom@tromey.com>,
gdb-patches@sourceware.org,
Joel Brobecker <brobecker@adacore.com>
Subject: Re: [PATCH][gdb/testsuite] Handle unrecognized command line option in gdb_compile_test
Date: Wed, 8 Sep 2021 07:12:44 -0700 [thread overview]
Message-ID: <20210908141244.GF9184@adacore.com> (raw)
In-Reply-To: <cb31b1f3-7f94-6de0-0a5b-4c7ffb2b5270@suse.de>
> [ To reiterate my earlier point, it's counter-pattern to generate a FAIL
> for something that's not a problem in the tool-under-test. So much
> counter-pattern that I had to resist the reflex to commit this as obvious. ]
>
> Indeed, there could be an error in the testcase. Also, there could be
> no error in the test-case.
>
> In the former case, having a FAIL instead of UNSUPPORTED could increase
> the change of noticing this, agreed. In the latter case, having a FAIL
> instead of UNSUPPORTED when testing an older compiler, is an annoyance
> which drowns out FAILs that do need attention.
>
> So, I'm not saying that noticing test-case errors causing compilation
> problem is not worthwhile. But I'm saying that turning the compilation
> errors into FAILs is the wrong solution.
I see what you mean. I don't really have a strong opinion on this.
Speaking for myself, I tend to blindly accept UNSUPPORTED results,
so I am unlikely to notice incorrect ones, which suggests that, for me
at least, using UNSUPPORTED is no better. But then again, the way
I have being doing testing in the past is by "diff-ing" the testsuite
report before and after my change -- so it's not like I would notice
a FAIL better ;-). So it's also be no worse (again, just speaking for
myself, as YMMV in this case).
--
Joel
next prev parent reply other threads:[~2021-09-08 14:13 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-09-08 11:20 Tom de Vries via Gdb-patches
2021-09-08 12:22 ` Joel Brobecker
2021-09-08 13:45 ` Tom de Vries via Gdb-patches
2021-09-08 14:12 ` Joel Brobecker [this message]
2021-09-10 16:38 ` Tom de Vries via Gdb-patches
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210908141244.GF9184@adacore.com \
--to=brobecker@adacore.com \
--cc=gdb-patches@sourceware.org \
--cc=tdevries@suse.de \
--cc=tom@tromey.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox