From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from simark.ca by simark.ca with LMTP id fcb/F7KI2mVUkSsAWB0awg (envelope-from ) for ; Sat, 24 Feb 2024 19:24:18 -0500 Authentication-Results: simark.ca; dkim=pass (1024-bit key; secure) header.d=sourceware.org header.i=@sourceware.org header.a=rsa-sha256 header.s=default header.b=l1jwQufE; dkim-atps=neutral Received: by simark.ca (Postfix, from userid 112) id 4CA881E0D2; Sat, 24 Feb 2024 19:24:18 -0500 (EST) Received: from server2.sourceware.org (server2.sourceware.org [8.43.85.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by simark.ca (Postfix) with ESMTPS id 3477C1E030 for ; Sat, 24 Feb 2024 19:24:16 -0500 (EST) Received: from server2.sourceware.org (localhost [IPv6:::1]) by sourceware.org (Postfix) with ESMTP id 216F33858296 for ; Sun, 25 Feb 2024 00:24:15 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 216F33858296 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1708820655; bh=xpD/mWNWhgsLWE3NZ7VArHdKdl1ulM76JFDHVk8Mtw8=; h=References:In-Reply-To:Date:Subject:To:Cc:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe: From:Reply-To:From; b=l1jwQufEbQxxvBA9xZo7cfMEUO2fHRtOQEmKllvlA8gTE6e6JiKLpr+VumbJxhreL 2Y5S8SUWgIxa79lvwVggF4/qfHOwJ+6wnY1dWvm6ZWa6xjg4FDG7PCuM44YYu/ENUG XVq7az5QLe4TZF9XGksAdg01LsI6+QspsNGXR9B0= Received: from mail-io1-xd36.google.com (mail-io1-xd36.google.com [IPv6:2607:f8b0:4864:20::d36]) by sourceware.org (Postfix) with ESMTPS id EBC92385842B for ; Sun, 25 Feb 2024 00:23:25 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org EBC92385842B ARC-Filter: OpenARC Filter v1.0.0 sourceware.org EBC92385842B ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1708820609; cv=none; b=KeP+pScWFPmlOHHCbJ3AJmnSC/i4OiOgdBGgyLDMZoRCi/6ADPHSeJpYMRE1hvLMo69D4haeCkV7M+LhoienSXTQAJXZE7p7xhxYHGRobuImtUjzYceXOQZmAXgdTh+9mLLDBimMjMWJNwpp6025ozHpuzUsEa1ASBpdVXwYfbg= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1708820609; c=relaxed/simple; bh=dinGyDTo1Jh0roj1BV8sbwHXDqF9O7CoIhu/boSWe4w=; h=DKIM-Signature:MIME-Version:From:Date:Message-ID:Subject:To; b=icmvY3FcBDawAiupt0SIR6OXl4pGiFzS3f/tdUKHIn8QIKwM6/oFo4ZEs9oSs4+Zzt9cZlnLSwvqX0nqWWAQw/36eiKwaoCmFa0WSWqwokbkjhXAEQoeCIZM8G3VQk0toDWHL853PALCs4ZTCxPXSQHjec9g3m/9NZFXiueiUmw= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-io1-xd36.google.com with SMTP id ca18e2360f4ac-7c7701f95b6so41510439f.1 for ; Sat, 24 Feb 2024 16:23:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708820605; x=1709425405; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=kCeslxEg/33/oXg3lFuAIGvJtS+ffsVd9bKhoQsaj+w=; b=GIJEwVKSBZJt3HUESa/U1S09f4fC1Gt7enhnoR1Q0d3Wyf97qR/+zBWQYEMmme15Lk 243fuMX5Me3pJPS0N1oTRRcFNecXv0LQG4WcT03hk+ZzCeGRouAbzvNwiG+jI1TQvAKs BN8K6zCz2uWAZAQmmZidqwUXWKheJ7SfnkYYzj/OLM8CkEDTzhrgJJMKFxuEq9O92rEc H7paJdU9zIrXzRU8FoQsEBTfgRAAR+luYNT+p5zuxwnHiLGxpAmF29ImnUY7XAMNxxAp u8MVKEu5pZjTExPVe6sSQ9rbJhdBcXMfjPHFxrN7zvcI3gwiR9zp1ZesWf/dZHgMrnEh Sl9A== X-Forwarded-Encrypted: i=1; AJvYcCUCClcsBh07+uQrHN7vqI04oBhIL/6u4LeT2FPXrH+k5sdXewawswDHXT4IFqNaUgGBoXKPaLUC9c21ioc3Vv9O5NU= X-Gm-Message-State: AOJu0YyLQYctifBw+i5MNlh1vT9joknmOL9200CLsbQGx7OBiNGtqbE9 71iJa8wUGdP2+8FerSm9cWDzaD1r2FWmSBx4INwCyBqc9rE9w9N1S/bIUwQEXA4uv/RYavIPOgD 3c+4byZuKdVys712Deky0YmtOyBBemSMqP1M= X-Google-Smtp-Source: AGHT+IEtzsPryRqDNnt+afVQBIi8fLackMSgvsakhsF5HmBRKYHgYR0E0SkUrm/qpkJ/h9X0Zl4ML/1nrBFTesMAVpQ= X-Received: by 2002:a92:cd89:0:b0:365:2399:2446 with SMTP id r9-20020a92cd89000000b0036523992446mr3220483ilb.1.1708820604679; Sat, 24 Feb 2024 16:23:24 -0800 (PST) MIME-Version: 1.0 References: <87v86d6byg.fsf@gentoo.org> <87o7c56ale.fsf@gentoo.org> <20240224193114.GF1353@gnu.wildebeest.org> In-Reply-To: <20240224193114.GF1353@gnu.wildebeest.org> Date: Sun, 25 Feb 2024 00:22:49 +0000 Message-ID: Subject: Re: gdb and ancient GNU autotools To: Mark Wielaard Cc: Sam James , gdb@sourceware.org X-Spam-Status: No, score=-0.7 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, HTML_MESSAGE, KAM_SHORT, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP, T_KAM_HTML_FONT_INVALID, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.30 X-BeenThere: gdb@sourceware.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Gdb mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: =?utf-8?q?Tomasz_K=C5=82oczko_via_Gdb?= Reply-To: =?UTF-8?Q?Tomasz_K=C5=82oczko?= Errors-To: gdb-bounces+public-inbox=simark.ca@sourceware.org Sender: "Gdb" On Sat, 24 Feb 2024 at 19:31, Mark Wielaard wrote: [..] > How exactly are you downloading the patches? You really should not > download them through the gitweb interface. Please just use git, > either over https or git. In both cases content is served by http server. Or if you really want to use a web interface > please use the cgit interface at https://sourceware.org/cgit/ which is > much faster than the gitweb interface. If you do have trouble doing > checkouts for your automated builds and are worried that your > connection is trapped in a fail2ban jail please reach out so we can > investigate. https://sourceware.org/mission.html#organization That cgit interface content is served by the same web server which is throttling the rate of the requests. OK I'll give you the full picture ..to show how deep that rabbit hole is. FYI: I'm doin that because in rpm spec file is possible to specify something like below: Name: mate-utils Version: 1.28.0 Release: 2%{?dist} License: GPL-3.0-or-later ( https://spdx.org/licenses/GPL-3.0-or-later.htm), LGPL-2.0-or-later ( https://spdx.org/licenses/LGPL-2.0-or-later.html) URL: https://mate-desktop.org/ VCS: https://github.com/mate-desktop/mate-utils/ Source: https://pub.mate-desktop.org/releases/%(v=3D%{version}; ech= o ${v%.*})/%{name}-%{version}.tar.xz Patch: %{VCS}/pull/363.patch#/%{name}-build-mate-dictionary-loadable-module-as-no= t-versioned-DSO.patch Or other example: Name: gsettings-desktop-schemas Version: 46.beta Release: 3%{?dist} License: LGPL-2.1-or-later ( https://spdx.org/licenses/LGPL-2.1-or-later.html) URL: https://gitlab.gnome.org/GNOME/gsettings-desktop-schemas/ VCS: https://gitlab.gnome.org/GNOME/gsettings-desktop-schemas/ Source: https://download.gnome.org/sources/gsettings-desktop-schemas/%(v=3D%{versio= n}; echo ${v/.*/})/%{name}-%{version}.tar.xz Patch: %{VCS}/commit/3537f5ab.patch#/%{name}-Update-Georgian-translation.patch Patch: %{VCS}/commit/ea06d947.patch#/%{name}-Update-Turkish-translation.patch Patch: %{VCS}/commit/b3ebfbc4.patch#/%{name}-Update-Ukrainian-translation.patch Patch: %{VCS}/commit/9c7a53ed.patch#/%{name}-Update-Czech-translation.patch Patch: %{VCS}/commit/cb370919.patch#/%{name}-Update-Hebrew-translation.patch Patch: %{VCS}/commit/7c7a2136.patch#/%{name}-Update-Norwegian-Bokm-l-translation.= patch Patch: %{VCS}/commit/63869de8.patch#/%{name}-Update-Turkish-translation-1.patch Patch: %{VCS}/commit/7e238e6c.patch#/%{name}-Update-Slovenian-translation.patch Patch: %{VCS}/commit/aa2d88f0.patch#/%{name}-Change-default-clock-format-back-to-= 24h-for-non-US-l.patch Patch: %{VCS}/commit/9c9d4c89.patch#/%{name}-Update-Persian-translation.patch Patch: %{VCS}/commit/5e674865.patch#/%{name}-Update-Persian-translation-1.patch Patch: %{VCS}/commit/10aa69e8.patch#/%{name}-Update-Ukrainian-translation-1.patch Patch: %{VCS}/commit/57282960.patch#/%{name}-Update-Hebrew-translation=3D1.patch Patch: %{VCS}/commit/dd6b6341.patch#/%{name}-Update-Indonesian-translation-1.patc= h Patch: %{VCS}/commit/63264176.patch#/%{name}-Update-Slovenian-translation-1.patch Patch: %{VCS}/commit/f36769de.patch#/%{name}-Update-Turkish-translation-2.patch Patch: %{VCS}/commit/0ddb6985.patch#/%{name}-Update-Galician-translation.patch Patch: %{VCS}/commit/4d67a8a5.patch#/%{name}-Update-Basque-translation.patch Patch: %{VCS}/commit/04ffad13.patch#/%{name}-Update-Occitan-translation.patch Which allows me easy integrate patches taken from commits added after release %{version} directly over VCS REST interface. For example elfutils or dwz quite often after release in some commits are fixing some important issues and maintainers are not willing to release new version ASP. Simple 'rpmbuild -bs -D "_disable_source_fetch 0" gsettings-desktop-schemas.spec --clean --rmsource --rmspec --nodeps' allows quickly form src.rpm on the system which has access to the public network which in next step is sent to the prod build env spawned only to build single package which is cut off from access to the public network. If that list of patches downloaded over VCS URLs is long enough it exceeds the throttled rate and .. some patches are not downloaded. Web server serving web content of the https://sourceware.org/git/ is ONLY known to me such a server which has such throttling. Literally NONE of other places with VCS REST interfaces are using such fascist settings .. IIRC that throttling is something like 25-30 per MINUTE which is b*dy easy to exceed. Some samples of use such technique from my packages: [tkloczko@pers-jacek SPECS]$ grep Patch:.*VCS *spec -c | sort -t: -nk 2 | tail -n 5 mdadm.spec:125 groff.spec:129 qt5-qtbase.spec:148 libiscsi.spec:187 libimobiledevice.spec:190 And yet another stat .. [tkloczko@pers-jacek SPECS]$ ls -1 *spec | wc -l; grep Patch:.*VCS *spec| wc -l 4829 5829 In other words: avg it is more than one VCS based patch taken out of some commits *per package* in that +4.8k packages population. As you see I'm using that on a massive scale. With any other VCS REST interfaces there is no ANY problem .. except with https://sourceware.org/git/ and I'm using different VCSess in case of +90% of all my packages [tkloczko@pers-jacek SPECS]$ grep ^VCS: *spec| wc -l 4444 .. and that VCS: field sits in each of those specs files to be instantly used if it is needed. Above technique glued with some one line generator which generates those Patch: lines allows me to save TONS of time to keep updated packages downloading all of what is needed in *seconds* .. Some packages only to test them in advance are using gitlab/github email notifications processed over procmail to test build after EACH commit made by maintainers (+ batch of tests to check that produced packages are still OK and warn me over zabbix that something is wrong). Above gives the best possible VISIBILITY of what has been changed in all those commits as well (you can use for that for example mc to manually check what has been changed in each commit .. offline). Instead of chasing bugs using git bisect it is easier to have an instant signal that after commit something went wrong. If you may be thinking about security aspects of downloading all those patches in the batch mode .. github and gitlab allow you to sign commits or git tags. On downloading patches out of commits it is possible to verify those signatures (it takes one line of POSIX sh script to do that). Percentage of projects especially on github in recent months which are using signet commits started going up. Do I need to mention that cgit from https://sourceware.org/git/ do not offer such additional functionality and will probably never be able to do that?=F0=9F=A4=94 --- Any comments about the main topic?=F0=9F=A4=94 kloczek --=20 Tomasz K=C5=82oczko | LinkedIn: http://lnkd.in/FXPWxH