Re: [RFC] Framework for selectively omitting individual testsuite tests or directories for local use only

Daniel Jacobowitz
2004-02-03T00:23:54Z

On Mon, Feb 02, 2004 at 05:13:43PM -0700, Fred Fish wrote:
> Very often when I'm working with a gdb that has very poor testsuite
> results, I want to set things up so that I can selectively omit
> individual troublesome tests or even entire directories of tests.
>
> That way the I can get a completely clean gdb testsuite run, and then
> start tackling the troublesome tests one a time, without having to
> filter out the hundreds of other failures I haven't yet gotten around
> to fixing. Also, a clean testsuite runs *MUCH* faster than one that
> has hundreds of timeouts or other such issues. For example, the
> current sh-elf gdb seems to hang forever if you don't avoid running
> the gdbtk tests.
>
> Dejagnu supports "ignoretests" and "ignoredirs" lists of specific
> individual tests or directories to ignore. Below is a patch that I
> frequently apply locally to any gdb tree I'm working on.
>
> I'd like to propose that we add it, or something like it, to the
> testsuite strictly for use as a debugging aid. It's not intended to
> become a permanent way for various configurations to hide their more
> problematic test cases, just a framework for developers to use
> locally.
>
> Comments?

To be honest, I don't see the point of adding this. Take a look at
what your change does:

> *************** site.exp: ./config.status Makefile
> *** 111,116 ****
> --- 114,121 ----
> @echo "set build_triplet ${build_canonical}" >> ./tmp0
> @echo "set srcdir ${srcdir}" >> ./tmp0
> @echo "set tool gdb" >> ./tmp0
> + @echo "lappend ignoredirs ${ignoredirs}" >>./tmp0
> + @echo "lappend ignoretests ${ignoretests}" >>./tmp0
> @echo "## All variables above are generated by configure. Do Not Edit ##" >> ./tmp0
> @cat ./tmp0 > site.exp
> @cat site.bak | sed \

OK... there is a much easier way.

drow@nevyn:~% echo $DEJAGNU
/home/drow/.dejagnu/site.exp
drow@nevyn:~% cat >> $DEJAGNU <<EOF
if { "$tool" == "gdb" } {
lappend ignoredirs gdb.cp
}
EOF

$target_alias is there too. Even $srcdir should be available by this
point, giving you great freedom.

--
Daniel Jacobowitz
MontaVista Software Debian GNU/Linux Developer