* [patch] Try to use python-config to get python include and lib parameters.
@ 2010-05-20 23:08 Doug Evans
2010-05-21 5:36 ` Doug Evans
0 siblings, 1 reply; 4+ messages in thread
From: Doug Evans @ 2010-05-20 23:08 UTC (permalink / raw)
To: gdb-patches
Hi.
Building with a private copy of python, or even the system copy,
sometimes requires linking with extra libraries.
These libraries are listed with `python-config --ldflags'.
[or --libs, but --ldflags also includes any needed -L's]
I will check this in in a few days if there are no objections.
2010-05-20 Doug Evans <dje@google.com>
* configure.ac: Try to use python-config to get python include and lib
parameters.
* configure: Regenerate.
Index: configure.ac
===================================================================
RCS file: /cvs/src/src/gdb/configure.ac,v
retrieving revision 1.117
diff -u -p -r1.117 configure.ac
--- configure.ac 23 Apr 2010 18:07:26 -0000 1.117
+++ configure.ac 20 May 2010 23:03:09 -0000
@@ -619,13 +619,28 @@ if test "${with_python}" = no; then
else
case "${with_python}" in
yes | auto)
- # Leave as empty, use defaults.
- python_includes=
- python_libs=
+ AC_PATH_PROG(python_config_path, python-config, missing)
+ if test "${python_config_path}" = missing; then
+ # Perhaps this should be an error, but 7.0 and 7.1 shipped without
+ # checking for python-config so in the interests of not breaking
+ # anything, we follow their behaviour here.
+ python_includes=
+ python_libs=
+ else
+ python_includes=`${python_config_path} --includes`
+ python_libs=`${python_config_path} --ldflags`
+ fi
;;
/*)
- python_includes="-I${with_python}/include"
- python_libs="-L${with_python}/lib"
+ AC_PATH_PROG(python_config_path, python-config, missing,
+ [PATH = ${with_python}/bin])
+ if test "${python_config_path}" = missing; then
+ # If an explicit path was provided, and we can't find python-config
+ # at that location, flag an error.
+ AC_ERROR(python-config missing from ${with_python}/bin)
+ fi
+ python_includes=`${python_config_path} --includes`
+ python_libs=`${python_config_path} --ldflags`
;;
*)
AC_ERROR(invalid value for --with-python)
^ permalink raw reply [flat|nested] 4+ messages in thread* Re: [patch] Try to use python-config to get python include and lib parameters. 2010-05-20 23:08 [patch] Try to use python-config to get python include and lib parameters Doug Evans @ 2010-05-21 5:36 ` Doug Evans 2010-05-21 16:51 ` Tom Tromey 0 siblings, 1 reply; 4+ messages in thread From: Doug Evans @ 2010-05-21 5:36 UTC (permalink / raw) To: gdb-patches [-- Attachment #1: Type: text/plain, Size: 1077 bytes --] On Thu, May 20, 2010 at 4:04 PM, Doug Evans <dje@google.com> wrote: > Hi. > > Building with a private copy of python, or even the system copy, > sometimes requires linking with extra libraries. > These libraries are listed with `python-config --ldflags'. > [or --libs, but --ldflags also includes any needed -L's] > > I will check this in in a few days if there are no objections. > > 2010-05-20 Doug Evans <dje@google.com> > > * configure.ac: Try to use python-config to get python include and lib > parameters. > * configure: Regenerate. python-config is a python script so it won't work when build != host. 2010-05-20 Doug Evans <dje@google.com> * configure.ac: For non-canadian-cross builds (build == host), try to use python-config to get python include and lib parameters. * configure: Regenerate. Tested with build=host=target=amd64-linux [with/without python] build=host=amd64-linux target=arm-eabi [with/without python] build=amd64-linux host=i386-linux target=arm-eabi [without python] [-- Attachment #2: gdb-100520-python-config-2.patch.txt --] [-- Type: text/plain, Size: 7066 bytes --] 2010-05-20 Doug Evans <dje@google.com> * configure.ac: For non-canadian-cross builds (build == host), try to use python-config to get python include and lib parameters. * configure: Regenerate. Index: configure.ac =================================================================== RCS file: /cvs/src/src/gdb/configure.ac,v retrieving revision 1.117 diff -u -p -r1.117 configure.ac --- configure.ac 23 Apr 2010 18:07:26 -0000 1.117 +++ configure.ac 21 May 2010 05:12:25 -0000 @@ -589,22 +589,31 @@ else fi dnl Utility to simplify finding libpython. +dnl $1 = pythonX.Y +dnl $2 = the shell variable to assign the result to +dnl If libpython is found we store $version here. +dnl $3 = additional flags to add to CPPFLAGS +dnl $4 = additional flags to add to LIBS + AC_DEFUN([AC_TRY_LIBPYTHON], [ version=$1 define([have_libpython_var],$2) - define([VERSION],[translit([$1],[abcdefghijklmnopqrstuvwxyz./-], - [ABCDEFGHIJKLMNOPQRSTUVWXYZ___])]) - [HAVE_LIB]VERSION=no + new_CPPFLAGS=$3 + new_LIBS=$4 AC_MSG_CHECKING([for ${version}]) + save_CPPFLAGS=$CPPFLAGS save_LIBS=$LIBS - LIBS="$LIBS -l${version}" + CPPFLAGS="$CPPFLAGS $new_CPPFLAGS" + LIBS="$LIBS $new_LIBS" + found_usable_python=no AC_LINK_IFELSE(AC_LANG_PROGRAM([[#include "${version}/Python.h"]], [[Py_Initialize ();]]), - [[HAVE_LIB]VERSION=yes - have_libpython_var=yes], - [LIBS=$save_LIBS]) - AC_MSG_RESULT([$[HAVE_LIB]VERSION]) + [have_libpython_var=${version} + found_usable_python=yes], + [CPPFLAGS=$save_CPPFLAGS + LIBS=$save_LIBS]) + AC_MSG_RESULT([${found_usable_python}]) ]) AC_ARG_WITH(python, @@ -617,45 +626,96 @@ if test "${with_python}" = no; then AC_MSG_WARN([python support disabled; some features may be unavailable.]) have_libpython=no else + have_python_config=no case "${with_python}" in yes | auto) - # Leave as empty, use defaults. - python_includes= - python_libs= + # We can't use python-config in the non-native case, it's a python script. + if test ${build} = ${host}; then + AC_PATH_PROG(python_config_path, python-config, missing) + if test "${python_config_path}" = missing; then + # Perhaps this should be an error, but 7.0 and 7.1 shipped without + # checking for python-config so in the interests of not breaking + # anything, we follow their behaviour here. + python_includes= + python_libs= + else + python_includes=`${python_config_path} --includes` + python_libs=`${python_config_path} --ldflags` + have_python_config=yes + fi + else + python_includes= + python_libs= + fi ;; /*) - python_includes="-I${with_python}/include" - python_libs="-L${with_python}/lib" + if test ${build} = ${host}; then + AC_PATH_PROG(python_config_path, python-config, missing, + [PATH = ${with_python}/bin]) + if test "${python_config_path}" = missing; then + # If an explicit path was provided, and we can't find python-config + # at that location, flag an error. + AC_ERROR(python-config missing from ${with_python}/bin) + fi + python_includes=`${python_config_path} --includes` + python_libs=`${python_config_path} --ldflags` + have_python_config=yes + else + python_includes="-I${with_python}/include" + python_libs="-L${with_python}/lib" + fi ;; *) AC_ERROR(invalid value for --with-python) ;; esac - save_CPPFLAGS=$CPPFLAGS - CPPFLAGS="$CPPFLAGS ${python_includes}" - save_LIBS=$LIBS - LIBS="$LIBS ${python_libs}" + # Having "/pythonX.Y" in the include path is awkward. + # All those python headers get bubbled up to the top inviting lots + # of random collisions. GDB originally didn't use python-config to + # find the compilation parameters and includes "pythonX.Y/" in the + # path of the, umm, include file. So strip away this part of the + # output of python-config --includes. + python_includes=`echo "${python_includes} " \ + | sed -e 's,/python[[0-9]]*[[.]][[0-9]]* , ,g'` + + # If we have python-config, only try the configuration it provides. + # Otherwise fallback on the old way of trying different versions of + # python in turn. + have_libpython=no - if test "${have_libpython}" = no; then - AC_TRY_LIBPYTHON(python2.6, have_libpython) - if test "${HAVE_LIBPYTHON2_6}" = yes; then - AC_DEFINE(HAVE_LIBPYTHON2_6, 1, [Define if Python 2.6 is being used.]) + if test "${have_python_config}" = yes; then + python_version=`echo " ${python_libs} " \ + | sed -e 's,^.* -l\(python[[0-9]]*[[.]][[0-9]]*\) .*$,\1,'` + if test "${python_version}" != ""; then + AC_TRY_LIBPYTHON(${python_version}, have_libpython, + ${python_includes}, ${python_libs}) + else + AC_MSG_ERROR([unable to determine python version from ${python_libs}]) fi - fi - if test ${have_libpython} = no; then - AC_TRY_LIBPYTHON(python2.5, have_libpython) - if test "${HAVE_LIBPYTHON2_5}" = yes; then - AC_DEFINE(HAVE_LIBPYTHON2_5, 1, [Define if Python 2.5 is being used.]) + else + if test "${have_libpython}" = no; then + AC_TRY_LIBPYTHON(python2.6, have_libpython, + ${python_includes}, "${python_libs} -lpython2.6") fi - fi - if test ${have_libpython} = no; then - AC_TRY_LIBPYTHON(python2.4, have_libpython) - if test "${HAVE_LIBPYTHON2_4}" = yes; then - AC_DEFINE(HAVE_LIBPYTHON2_4, 1, [Define if Python 2.4 is being used.]) + if test ${have_libpython} = no; then + AC_TRY_LIBPYTHON(python2.5, have_libpython, + ${python_includes}, "${python_libs} -lpython2.5") fi + if test ${have_libpython} = no; then + AC_TRY_LIBPYTHON(python2.4, have_libpython, + ${python_includes}, "${python_libs} -lpython2.4") + fi + fi + if test "${have_libpython}" = python2.6; then + AC_DEFINE(HAVE_LIBPYTHON2_6, 1, [Define if Python 2.6 is being used.]) + elif test "${have_libpython}" = python2.5; then + AC_DEFINE(HAVE_LIBPYTHON2_5, 1, [Define if Python 2.5 is being used.]) + elif test "${have_libpython}" = python2.4; then + AC_DEFINE(HAVE_LIBPYTHON2_4, 1, [Define if Python 2.4 is being used.]) fi - if test ${have_libpython} = no; then + + if test "${have_libpython}" = no; then case "${with_python}" in yes) AC_MSG_ERROR([python is missing or unusable]) @@ -667,12 +727,10 @@ else AC_MSG_ERROR([no usable python found at ${with_python}]) ;; esac - CPPFLAGS=$save_CPPFLAGS - LIBS=$save_LIBS fi fi -if test "${have_libpython}" = yes; then +if test "${have_libpython}" != no; then AC_DEFINE(HAVE_PYTHON, 1, [Define if Python interpreter is being linked in.]) CONFIG_OBS="$CONFIG_OBS \$(SUBDIR_PYTHON_OBS)" CONFIG_DEPS="$CONFIG_DEPS \$(SUBDIR_PYTHON_DEPS)" ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [patch] Try to use python-config to get python include and lib parameters. 2010-05-21 5:36 ` Doug Evans @ 2010-05-21 16:51 ` Tom Tromey 2010-05-24 23:07 ` Doug Evans 0 siblings, 1 reply; 4+ messages in thread From: Tom Tromey @ 2010-05-21 16:51 UTC (permalink / raw) To: Doug Evans; +Cc: gdb-patches >>>>> "Doug" == Doug Evans <dje@google.com> writes: Doug> 2010-05-20 Doug Evans <dje@google.com> Doug> * configure.ac: For non-canadian-cross builds (build == host), Doug> try to use python-config to get python include and lib parameters. Doug> * configure: Regenerate. It seems reasonable to me. Tom ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [patch] Try to use python-config to get python include and lib parameters. 2010-05-21 16:51 ` Tom Tromey @ 2010-05-24 23:07 ` Doug Evans 0 siblings, 0 replies; 4+ messages in thread From: Doug Evans @ 2010-05-24 23:07 UTC (permalink / raw) To: tromey; +Cc: gdb-patches [-- Attachment #1: Type: text/plain, Size: 1429 bytes --] On Fri, May 21, 2010 at 9:25 AM, Tom Tromey <tromey@redhat.com> wrote: >>>>>> "Doug" == Doug Evans <dje@google.com> writes: > > Doug> 2010-05-20 Doug Evans <dje@google.com> > Doug> * configure.ac: For non-canadian-cross builds (build == host), > Doug> try to use python-config to get python include and lib parameters. > Doug> * configure: Regenerate. > > It seems reasonable to me. I've learned that "python-config", which is a python script, can be pretty much used with any recent python version. I've also learned that it's not always spelled "python-config" when installed. This version of the patch provides our own copy in python/python-config.py. [NOTE: I didn't name it py-config.py on purpose. It doesn't violate the 8.3 file name rule, and since there already is python-internal.h spelled the way it is, I wanted to keep the spelling close to the public name.] This version runs python-config.py with the specified copy of python. Note that it can also work in a cross-compilation environment if the user provides his/her own script that mimics what `python python-config.py --includes|--ldflags' does. I will let it soak until tomorrow. 2010-05-24 Doug Evans <dje@google.com> * configure.ac: Try to use python's distutils to fetch compilation parameters. * configure: Regenerate. * python/python-config.py: New file. [-- Attachment #2: gdb-100524-python-config-3.patch.txt --] [-- Type: text/plain, Size: 9942 bytes --] 2010-05-24 Doug Evans <dje@google.com> * configure.ac: Try to use python's distutils to fetch compilation parameters. * configure: Regenerate. * python/python-config.py: New file. Index: configure.ac =================================================================== RCS file: /cvs/src/src/gdb/configure.ac,v retrieving revision 1.117 diff -u -p -r1.117 configure.ac --- configure.ac 23 Apr 2010 18:07:26 -0000 1.117 +++ configure.ac 24 May 2010 22:43:44 -0000 @@ -589,22 +589,31 @@ else fi dnl Utility to simplify finding libpython. +dnl $1 = pythonX.Y +dnl $2 = the shell variable to assign the result to +dnl If libpython is found we store $version here. +dnl $3 = additional flags to add to CPPFLAGS +dnl $4 = additional flags to add to LIBS + AC_DEFUN([AC_TRY_LIBPYTHON], [ version=$1 define([have_libpython_var],$2) - define([VERSION],[translit([$1],[abcdefghijklmnopqrstuvwxyz./-], - [ABCDEFGHIJKLMNOPQRSTUVWXYZ___])]) - [HAVE_LIB]VERSION=no + new_CPPFLAGS=$3 + new_LIBS=$4 AC_MSG_CHECKING([for ${version}]) + save_CPPFLAGS=$CPPFLAGS save_LIBS=$LIBS - LIBS="$LIBS -l${version}" + CPPFLAGS="$CPPFLAGS $new_CPPFLAGS" + LIBS="$LIBS $new_LIBS" + found_usable_python=no AC_LINK_IFELSE(AC_LANG_PROGRAM([[#include "${version}/Python.h"]], [[Py_Initialize ();]]), - [[HAVE_LIB]VERSION=yes - have_libpython_var=yes], - [LIBS=$save_LIBS]) - AC_MSG_RESULT([$[HAVE_LIB]VERSION]) + [have_libpython_var=${version} + found_usable_python=yes], + [CPPFLAGS=$save_CPPFLAGS + LIBS=$save_LIBS]) + AC_MSG_RESULT([${found_usable_python}]) ]) AC_ARG_WITH(python, @@ -617,45 +626,130 @@ if test "${with_python}" = no; then AC_MSG_WARN([python support disabled; some features may be unavailable.]) have_libpython=no else + have_python_config=no case "${with_python}" in - yes | auto) - # Leave as empty, use defaults. - python_includes= - python_libs= - ;; /*) - python_includes="-I${with_python}/include" - python_libs="-L${with_python}/lib" + if test -d ${with_python}; then + # Assume the python binary is ${with_python}/bin/python. + python_prefix=${with_python} + python_prog="${with_python}/bin/python" + if test ! -x ${python_prog}; then + # Fall back to gdb 7.0/7.1 behaviour. + python_prog=missing + fi + elif test -x ${with_python}; then + # While we can't run python compiled for $host (unless host == build), + # the user could write a script that provides the needed information, + # so we support that. + python_prefix= + python_prog=${with_python} + else + AC_ERROR(invalid value for --with-python) + fi ;; - *) + */*) + # Disallow --with-python=foo/bar. AC_ERROR(invalid value for --with-python) ;; + *) + # The user has either specified auto, yes, or the name of the python + # program assumed to be in $PATH. + python_prefix= + case "${with_python}" in + yes | auto) + if test ${build} = ${host}; then + AC_PATH_PROG(python_prog_path, python, missing) + if test "${python_prog_path}" = missing; then + python_prog=missing + else + python_prog=${python_prog_path} + fi + else + # Not much we can do except assume the cross-compiler will find the + # right files. + python_prog=missing + fi + ;; + *) + # While we can't run python compiled for $host (unless host == build), + # the user could write a script that provides the needed information, + # so we support that. + python_prog="${with_python}" + AC_PATH_PROG(python_prog_path, ${python_prog}, missing) + if test "${python_prog_path}" = missing; then + AC_ERROR(unable to find python program ${python_prog}) + fi + ;; + esac esac - save_CPPFLAGS=$CPPFLAGS - CPPFLAGS="$CPPFLAGS ${python_includes}" - save_LIBS=$LIBS - LIBS="$LIBS ${python_libs}" - have_libpython=no - if test "${have_libpython}" = no; then - AC_TRY_LIBPYTHON(python2.6, have_libpython) - if test "${HAVE_LIBPYTHON2_6}" = yes; then - AC_DEFINE(HAVE_LIBPYTHON2_6, 1, [Define if Python 2.6 is being used.]) + if test "${python_prog}" != missing; then + python_includes=`${python_prog} ${srcdir}/python/python-config.py --includes` + if test $? != 0; then + AC_ERROR(failure running python-config --includes) fi - fi - if test ${have_libpython} = no; then - AC_TRY_LIBPYTHON(python2.5, have_libpython) - if test "${HAVE_LIBPYTHON2_5}" = yes; then - AC_DEFINE(HAVE_LIBPYTHON2_5, 1, [Define if Python 2.5 is being used.]) + python_libs=`${python_prog} ${srcdir}/python/python-config.py --ldflags` + if test $? != 0; then + AC_ERROR(failure running python-config --ldflags) + fi + have_python_config=yes + else + # Fall back to gdb 7.0/7.1 behaviour. + if test -z ${python_prefix}; then + python_includes= + python_libs= + else + python_includes="-I${python_prefix}/include" + python_libs="-L${python_prefix}/lib" fi fi - if test ${have_libpython} = no; then - AC_TRY_LIBPYTHON(python2.4, have_libpython) - if test "${HAVE_LIBPYTHON2_4}" = yes; then - AC_DEFINE(HAVE_LIBPYTHON2_4, 1, [Define if Python 2.4 is being used.]) + + # Having "/pythonX.Y" in the include path is awkward. + # All those python headers get bubbled up to the top inviting lots + # of random collisions. GDB originally didn't use python-config to + # find the compilation parameters and includes "pythonX.Y/" in the + # path of the, umm, include file. So strip away this part of the + # output of python-config --includes. + python_includes=`echo "${python_includes} " \ + | sed -e 's,/python[[0-9]]*[[.]][[0-9]]* , ,g'` + + # If we have python-config, only try the configuration it provides. + # Otherwise fallback on the old way of trying different versions of + # python in turn. + + have_libpython=no + if test "${have_python_config}" = yes; then + python_version=`echo " ${python_libs} " \ + | sed -e 's,^.* -l\(python[[0-9]]*[[.]][[0-9]]*\) .*$,\1,'` + if test "${python_version}" != ""; then + AC_TRY_LIBPYTHON(${python_version}, have_libpython, + ${python_includes}, ${python_libs}) + else + AC_MSG_ERROR([unable to determine python version from ${python_libs}]) + fi + else + if test "${have_libpython}" = no; then + AC_TRY_LIBPYTHON(python2.6, have_libpython, + ${python_includes}, "${python_libs} -lpython2.6") + fi + if test ${have_libpython} = no; then + AC_TRY_LIBPYTHON(python2.5, have_libpython, + ${python_includes}, "${python_libs} -lpython2.5") fi + if test ${have_libpython} = no; then + AC_TRY_LIBPYTHON(python2.4, have_libpython, + ${python_includes}, "${python_libs} -lpython2.4") + fi + fi + if test "${have_libpython}" = python2.6; then + AC_DEFINE(HAVE_LIBPYTHON2_6, 1, [Define if Python 2.6 is being used.]) + elif test "${have_libpython}" = python2.5; then + AC_DEFINE(HAVE_LIBPYTHON2_5, 1, [Define if Python 2.5 is being used.]) + elif test "${have_libpython}" = python2.4; then + AC_DEFINE(HAVE_LIBPYTHON2_4, 1, [Define if Python 2.4 is being used.]) fi - if test ${have_libpython} = no; then + + if test "${have_libpython}" = no; then case "${with_python}" in yes) AC_MSG_ERROR([python is missing or unusable]) @@ -667,12 +761,10 @@ else AC_MSG_ERROR([no usable python found at ${with_python}]) ;; esac - CPPFLAGS=$save_CPPFLAGS - LIBS=$save_LIBS fi fi -if test "${have_libpython}" = yes; then +if test "${have_libpython}" != no; then AC_DEFINE(HAVE_PYTHON, 1, [Define if Python interpreter is being linked in.]) CONFIG_OBS="$CONFIG_OBS \$(SUBDIR_PYTHON_OBS)" CONFIG_DEPS="$CONFIG_DEPS \$(SUBDIR_PYTHON_DEPS)" Index: python/python-config.py =================================================================== RCS file: python/python-config.py diff -N python/python-config.py --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ python/python-config.py 24 May 2010 22:43:44 -0000 @@ -0,0 +1,54 @@ +# Program to fetch python compilation parameters. +# Copied from python-config of the 2.6.5 release. + +import sys +import os +import getopt +from distutils import sysconfig + +valid_opts = ['prefix', 'exec-prefix', 'includes', 'libs', 'cflags', + 'ldflags', 'help'] + +def exit_with_usage(code=1): + print >>sys.stderr, "Usage: %s [%s]" % (sys.argv[0], + '|'.join('--'+opt for opt in valid_opts)) + sys.exit(code) + +try: + opts, args = getopt.getopt(sys.argv[1:], '', valid_opts) +except getopt.error: + exit_with_usage() + +if not opts: + exit_with_usage() + +opt = opts[0][0] + +pyver = sysconfig.get_config_var('VERSION') +getvar = sysconfig.get_config_var + +if opt == '--help': + exit_with_usage(0) + +elif opt == '--prefix': + print sysconfig.PREFIX + +elif opt == '--exec-prefix': + print sysconfig.EXEC_PREFIX + +elif opt in ('--includes', '--cflags'): + flags = ['-I' + sysconfig.get_python_inc(), + '-I' + sysconfig.get_python_inc(plat_specific=True)] + if opt == '--cflags': + flags.extend(getvar('CFLAGS').split()) + print ' '.join(flags) + +elif opt in ('--libs', '--ldflags'): + libs = getvar('LIBS').split() + getvar('SYSLIBS').split() + libs.append('-lpython'+pyver) + # add the prefix/lib/pythonX.Y/config dir, but only if there is no + # shared library in prefix/lib/. + if opt == '--ldflags' and not getvar('Py_ENABLE_SHARED'): + libs.insert(0, '-L' + getvar('LIBPL')) + print ' '.join(libs) + ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2010-05-24 22:58 UTC | newest] Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2010-05-20 23:08 [patch] Try to use python-config to get python include and lib parameters Doug Evans 2010-05-21 5:36 ` Doug Evans 2010-05-21 16:51 ` Tom Tromey 2010-05-24 23:07 ` Doug Evans
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox