Re: [RFC] Framework for selectively omitting individual testsuite tests or directories for local use only

[Daniel Jacobowitz <drow@mvista.com>]

On Mon, Feb 02, 2004 at 05:13:43PM -0700, Fred Fish wrote:
> Very often when I'm working with a gdb that has very poor testsuite
> results, I want to set things up so that I can selectively omit
> individual troublesome tests or even entire directories of tests.
> 
> That way the I can get a completely clean gdb testsuite run, and then
> start tackling the troublesome tests one a time, without having to
> filter out the hundreds of other failures I haven't yet gotten around
> to fixing.  Also, a clean testsuite runs *MUCH* faster than one that
> has hundreds of timeouts or other such issues.  For example, the
> current sh-elf gdb seems to hang forever if you don't avoid running
> the gdbtk tests.
> 
> Dejagnu supports "ignoretests" and "ignoredirs" lists of specific
> individual tests or directories to ignore.  Below is a patch that I
> frequently apply locally to any gdb tree I'm working on.
> 
> I'd like to propose that we add it, or something like it, to the
> testsuite strictly for use as a debugging aid.  It's not intended to
> become a permanent way for various configurations to hide their more
> problematic test cases, just a framework for developers to use
> locally.
> 
> Comments?

To be honest, I don't see the point of adding this.  Take a look at
what your change does:

> *************** site.exp: ./config.status Makefile
> *** 111,116 ****
> --- 114,121 ----
>   	@echo "set build_triplet ${build_canonical}" >> ./tmp0
>   	@echo "set srcdir ${srcdir}" >> ./tmp0
>   	@echo "set tool gdb" >> ./tmp0
> + 	@echo "lappend ignoredirs ${ignoredirs}" >>./tmp0
> + 	@echo "lappend ignoretests ${ignoretests}" >>./tmp0
>   	@echo "## All variables above are generated by configure. Do Not Edit ##" >> ./tmp0
>   		@cat ./tmp0 > site.exp
>   	@cat site.bak | sed \

OK... there is a much easier way.

drow@nevyn:~% echo $DEJAGNU
/home/drow/.dejagnu/site.exp
drow@nevyn:~% cat >> $DEJAGNU <<EOF
if { "$tool" == "gdb" } {
  lappend ignoredirs gdb.cp
}
EOF

$target_alias is there too.  Even $srcdir should be available by this
point, giving you great freedom.

-- 
Daniel Jacobowitz
MontaVista Software                         Debian GNU/Linux Developer