Mirror of the gdb-patches mailing list
 help / color / mirror / Atom feed
From: Michael Elizabeth Chastain <mec@shout.net>
To: carlton@kealia.com
Cc: gdb-patches@sources.redhat.com
Subject: Re: [testsuite] add gdb.cp/gdb1355.exp
Date: Thu, 18 Sep 2003 21:22:00 -0000	[thread overview]
Message-ID: <200309182122.h8ILMDTq000427@duracef.shout.net> (raw)

David C writes:

  1) The bug is completely undiagnosed.
  2) The bug is diagnosed but known not to be fixed.
  3) The bug was diagnosed, thought to be fixed, but not actually fixed.

  We have three states here, and only two bug labels.
  
I agree with this state list.  The problem is that the difference
between the states exists only in our minds.

  (gdb) print 2+2
  5

dc> That's the static way of looking at the situation; another is a
dc> dynamic way, namely how will the output of the tests change between
dc> runs.  In both of our proposals, if a regression pops up, we'll see a
dc> state transition: either PASS=>FAIL or PASS=>KFAIL.

I agree.  To me, that's the important part.  People should be looking
for transitions (comparing two gdb.sum's) rather than looking at
levels (looking at a single gdb.sum ... and then they ignore the
ERROR, WARNING, KFAIL, XFAIL, UNRESOLVED, UNTESTED, UNSUPPORTED
results too!)

dc> But my proposal also guarantees that there will always be a state
dc> transition after a bug is (thought to be) fixed: either KFAIL=>PASS or
dc> KFAIL=>FAIL.  In your proposal, the latter scenario won't lead to a
dc> state transition: it will remain KFAIL.

Ah, I'm really starting to see where you're coming from, with the
idea that someone should change the test script after someone
fixes the bug.

I guess it's not so bad.  I'm starting to come around.

Michael C


             reply	other threads:[~2003-09-18 21:22 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2003-09-18 21:22 Michael Elizabeth Chastain [this message]
  -- strict thread matches above, loose matches on Subject: below --
2003-09-20 22:03 Michael Elizabeth Chastain
2003-09-20 21:59 Michael Elizabeth Chastain
2003-09-18 21:27 Michael Elizabeth Chastain
2003-09-20 21:46 ` Andrew Cagney
2003-09-20 22:31   ` Daniel Jacobowitz
2003-09-21  0:51     ` Andrew Cagney
2003-09-18 15:33 Michael Elizabeth Chastain
2003-09-20 21:40 ` Andrew Cagney
2003-09-18  2:01 Michael Elizabeth Chastain
2003-09-18 14:27 ` Andrew Cagney
2003-09-18 16:05   ` David Carlton
2003-09-18 15:38 ` David Carlton
2003-09-18  0:54 Michael Elizabeth Chastain
2003-09-18  0:56 ` Daniel Jacobowitz
2003-09-18  1:20   ` David Carlton
2003-09-18  1:27     ` David Carlton
2003-09-18  0:00 Michael Elizabeth Chastain
2003-09-18  0:48 ` David Carlton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=200309182122.h8ILMDTq000427@duracef.shout.net \
    --to=mec@shout.net \
    --cc=carlton@kealia.com \
    --cc=gdb-patches@sources.redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox