ports-mgmt/poudriere-devel 3.4.99.20260425

poudriere: switch to portconfig

Make poudriere accept both portconfig and dialog4ports, default
in portconfig

ports-mgmt/poudriere{,-devel}: Drop ca_root_nss dependency.

Since the CERTS option no longer installs certificates, we rename it
to MANIFESTS.

MFH:		2023Q4
Reviewed by:	bdrewery
Differential Revision:	https://reviews.freebsd.org/D42070

Remove WWW entries moved into port Makefiles

Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.

This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.

Approved by:		portmgr (tcberner)

Add WWW entries to port Makefiles

It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.

Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.

There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.

This commit implements such a proposal and moves one of the WWW: entries
of each pkg-descr file into the respective port's Makefile. A heuristic
attempts to identify the most relevant URL in case there is more than
one WWW: entry in some pkg-descr file. URLs that are not moved into the
Makefile are prefixed with "See also:" instead of "WWW:" in the pkg-descr
files in order to preserve them.

There are 1256 ports that had no WWW: entries in pkg-descr files. These
ports will not be touched in this commit.

The portlint port has been adjusted to expect a WWW entry in each port
Makefile, and to flag any remaining "WWW:" lines in pkg-descr files as
deprecated.

Approved by:		portmgr (tcberner)

ports-mgmt/poudriere-devel: Update to 3.3.0-1135-g137c376a8

Changes:
 - Remove obsolete test for vfs.mnt_free_list_batch
 - Package Fetch: Must consider OSVERSION for kld packages

ports-mgmt/poudriere-devel: Update to 3.3.0-1132-gd8590c6e8

Changes:
 - Package fetch: Fix pkg version comparisons with PORTREVISIONS
 - Manpage improvements
 - image: Remove extra '/' in output

ports-mgmt/poudriere-devel: Update to 3.3.0-1120-g060395ad7

Changes:
 - poudriere.conf.sample: fix git example URLs
 - Stop using logfile birthtime for durations.
 - exit_handler: Alert if an unhandled error (set -e) is seen.
 - pkg repo: Be more verbose and catch errors better.
 - append_make: Display computed path rather than real
 - options: Add -o flag to specify PORT_DBDIR name to write to.
 - options: Clarify how to modify the options
 - pkgclean: Add -C to allow deleting only specific packages.
 - pkgclean -C: Delete rdeps of listed with -r
 - Wrong PKGNAME error: Hint that a @FLAVOR could be missing
 - Package Fetch: Must compare remote PREFIX
 - image: Add hybrid ISO image support
 - Allow to disable grepping logs for failure reason with
   DETERMINE_BUILD_FAILURE_REASON=no
 - image_zfs: Fix inverted logic
 - image_zfs: Fix setting boot partition size
 - image_zfs: Allow same-as-host pool names
 - image: Exclude ZFS snapshot artifacts from image
 - jail: download.freebsd.org has no /ftp/ in the path anymore
 - manpage updates
 - bash completion updates

ports-mgmt/poudriere-devel: Update to 3.3.0-1068-g8d0342ef6

Changes:
  - image: Add support for zfs image types, including send streams
  - image: Run the post-build script before the build target
  - Fix cleanup waiting on bad pids
  - Fix logs summary showing in some wrong error contexts
  - Assert we have a bootstrap pkg before acting on packages.
  - Package fetch: Fix pkg bootstrap with fresh repo + version mismatch
  - Package fetch: Never fetch packages if remote pkg is newer than ports
  - Package fetch: always blacklist pkg
  - Package fetch: Fetch before deleting packages for missing bootstrap
  - Package fetch: Give an indication which packages are taken from cache
  - sh: Update from FreeBSD 971677d5fd4cc6e776468
  - bulk: Opportunistically start builders as needed. This also
          makes startup of each more verbose.
  - SIGINFO now goes to stderr
  - SIGINFO: New output format, showing tmpfs usage, and cpu%/mem%(rss) from ps.
  - Add a mechanishm to avoid building rust in tmpfs.
    See poudriere.conf.sample for TMPFS_BLACKLIST and TMPFS_BLACKLIST_TMPDIR
  - colors: Remove the need to evaluate \033 escape.
  - bulk: Trim IGNORED packages in parallel.

*/*: Remove redundant '-[0-9]*' from CONFLICTS_INSTALL

The conflict checks compare the patterns first against the package
names without version (as reported by "pkg query "%n"), then - if
there was no match - agsinst the full package names including the
version (as reported by "pkg query "%n-%v").

Approved by: portmgr (blanket)

ports-mgmt/poudriere-devel: Really fix non-amd64 build

ports-mgmt/poudriere-devel: Update to 3.3.0-1022-g964cf327f

Changes:
 - Fix interactive mode failing on 'pkg update'
 - Fix non-root CCACHE usage to be able to read /root/.ccache

ports-mgmt/poudriere-devel: Update to 3.3.0-1020-g59a87677c

Changes:
 - Fixes va_args build error on non-amd64

ports-mgmt/poudriere-devel: Update to 3.3.0-1019-gef4526594

Changes:
  - Store pool dir in logs/.poudriere.pkg_pool%
  - bulk: Add -NN to avoid committing packages.
  - distclean: Don't delete DISTFILES_CACHE if it is empty
  - distclean: Fix deleting from a corrupted list
  - distclean is known to not properly recurse deps.
  - crashed_build/skipping: Show flavor of packages
  - Package Fetch: Fix handling for remote pkg version check
  - Package Fetch: Handle lost packages failure better for PKG_SUFX transition.
  - bulk: Auto rename *.txz to *.pkg if needed
  - Default DELETE_UNQUEUED_PACKAGES to no and document.
  - image: Fix firmware images
  - zsh: Add bulk -b option description for zsh completion file and remove trailing spaces
  - clock: Fix formatting to be more portable

ports-mgmt/poudriere-devel: Update to 3.3.0-967-g764941e90

Changes:
- bulk: Don't delete unqueueud packages unless -a or -f is given
- options: Support multiple -f

ports-mgmt/poudriere-devel: Update to 3.3.0-961-g039b378dc

Changes:
- Fix random bulk crashes due to sh read bug [1]
- bulk: Don't mention stale txz symlinks for -C-deleted packages

PR:	258347 [1]

ports-mgmt/poudriere-devel: Mark BROKEN

The last update is producing random crashes during bulk.
See https://github.com/freebsd/poudriere/issues/917 for
details.

ports-mgmt/poudriere-devel: Update to 3.3.0-958-g3d248385b

Changes:
 - logclean: Don't show dry-run messages when not in dry mode.
 - bulk [-a] -f: Delete packages unknown/unqueued like pkgclean would.
 - bulk: Link to the build logs at PACKAGES/logs
 - bulk missing pkg: Delete packages before fetching from remote
 - enter_interactive: Allow non-root to write to /wrkdirs
 - Various locking changes
 - Package Fetch: Clarify cached packages may be used.
 - Fix race with distfile fetch saving
 - Show loginfo on error

ports-mgmt/poudriere-devel: Update to 3.3.0-927-gb63d7c829

Changes:
- distclean: Fix reading make.conf
- pkgclean: Fix POUDRIERE_BUILD_TYPE error

ports-mgmt/poudriere-devel: Update to 3.3.0-924-g8de014b5e

Changes:
  - git dirty check: Check for untracked Makefile.local and patch files
  - bulk/testport: Detect *new but disabled* OPTIONS
  - buildlog_start: Revert display back to readable local TZ.
  - testport -c: Fix to use the right port directory
  - Package fetch: Generate logfiles, stats, and show in web
  - PACKAGE_FETCH_WHITELIST: Fix only reading the first pkgname.
  - PACKAGE_FETCH_WHITELIST: Fix so globs in the list work too.
  - Package fetch: Check OSVERSION / ABI
  - Package fetch: Save fetch list and url into logdir.
  - Package fetch: Don't double count ports-mgmt/pkg

ports-mgmt/poudriere-devel: Update to 3.3.0-869-g7a9e09c8f

Changes:
  * misc fixes for pkg-1.17's new PKG_SUFX of .pkg
  * Some PORTBUILD_UID/GID fixes and display changes
  * ports -c: Disallow using - in new trees as it causes parsing issues
  * ALLOW_MAKE_JOBS: Explicitly compare to 'yes'
  * bulk -b: prefetch package fixes
  * bulk -b: prefetch packages are now cached (linked and deleted under normal pkgclean/bulk delete behavior)
  * Add in more notes for built packages.
  * Don't store timestamp+poudriere version git notes if PKG_REPRODUCIBLE is set
  * Change pkg notes naming style From_This to_this
  * Allow zstd in WRKDIR_ARCHIVE_FORMAT
  * misc manpage improvements
  * jail: Automatically set XDEV as needed
  * Rename MUTABLE_BASE to clearer IMMUTABLE_BASE
  * bulk/testport -i: Many improvements and /etc/motd populated with env hints
  * jail -m src: Fix src.conf not being used during install
  * Add PACKAGE_FETCH_BLACKLIST
  * bulk: Rebuild all packages if the pkg bootstrap is missing
  * Disallow /dev/bpf in the jails
  * CCACHE_DIR_NON_ROOT_SAFE: Chmod /root to 755 to allow non-root to access
  * CCACHE + BUILD_AS_NON_ROOT: Give detailed information on proper setup for this.
    See https://github.com/freebsd/poudriere/commit/8c36dfe5cca92
  * bulk: Do not process dependencies of IGNORED ports.
  * misc error handling fixes
  * bulk: Rebuild packages with changed ABI

ports-mgmt/poudriere-devel: Update to 3.3.0-748-g71646de83

Changes:
 - bulk: Fix unqueuing needed deps. (regression from
   3.3.0-744-g0bf7bd31e / 3.3.99.20210714)
 - bulk -vv: Show unqueue operations
 - bulk/testport: Show environment per phase in build log

ports-mgmt/poudriere-devel: Update to 3.3.0-744-g0bf7bd31e

Changes:
 - PACKAGE_FETCH: Don't fetch packages that are not queued.
 - bulk: Store (pkg note) and show top level ports git info as well
 - image: various fixes

ports-mgmt/poudriere-devel: Update to 3.3.0-738-g9839954fb

Changes
      - testport: Show logs info on depend build failures
      - MUTABLE_BASE=schg: Support writing to /boot/firmware for cpu microcode
      - jail -x: This is not limited to src builds
      - bulk: Don't run 'bulk crashed' hook on -f failures
      - Add git hash annotation into built packages.
      - jail -cu: Fix freebsd-update using wrong arch [1]
      - Update log parsing reasons (processonelog.sh)

PR:	256652 [1]

ports-mgmt/poudriere-devel: - Update to 3.3.0-704-g8c78cfb24

Changes:
* testport|bulk -b: New feature to fetch remote packages. See PACKAGE_FETCH options in poudriere.conf.sample.
  This feature has pitfalls like downloading and deleting packages. That may be improved with
  upcoming improved incremental build supoport.
* ports now defaults to using FreeBSD's git repository for checkout when no method is specified.
* jail: Add support for fetching from artifact.ci.freebsd.org
* ports -m git: Remove default --single-branch.
* ports: Support -D to not shallow clone with git
* ports: Properly detect vcs checkout errors
* ports/jail -m git: Properly check for git being installed
* logclean -N <n>: Fix to keep latest <n>.
* bulk -n: Don't remove .building dir unless this ran made it
* bulk -f: Ignore anything after first column.
* Update cpdup to v1.22 68cb3cb4e14d9c
* ports/jail -m git: Support -U /local/path.
* jail: Allow poudriere -v to override -q for git/svn
* jail -cm git: Allow -v to be excluded to default to remote branch
* ports: Fix -B being rejected with git.
* jail -r: Fix this to work again

** Some git handling and the PACKAGE_FETCH support is not yet stable and may change in the future.

- Fix new jail and ports creation.

Brings in freebsd/poudriere@1c9357d08e35f2bb248533ce043b2e61920ebf9e

One more small cleanup, forgotten yesterday. Reported by:	lwhsu

Remove # $FreeBSD$ from Makefiles.

Regular USE_GITHUB cleanup.

Remove DISTNAME, it is always overwritten.
Cleanup GH_TAGNAME and WRKSRC.

- Update to 3.3.0-542-g8bf6e594a

- Don't auto pkgclean with bulk -f. Only do this for bulk -a.

ports-mgmt/poudriere-devel: Update to 3.3.99.20210303

- jail: Really fix check_kernconf function

- Update to 3.3.0-540-g9f9007eb8

* ports: move away from portsnap as default
* zfs rollback: Try harder to rollback snapshots.
* bulk -n: Don't remove .building dir unless this ran made it
* common.sh: use new URL for base system
* jail: Fix git checkout during jail update to operate within SRC_BASE.
* image: Add -w (swap size) and -b (swap position)
* image: Support pre and post build scripts
* image: remove unneeded vfs.root.mountfrom that might cause problems
* image: Fix usb and usb+mfs
* image: Add pkgbase support
* image: Fix loader.efi name for arm and arm64
* image: Don't install pmbr and gptboot on !x86
* image: Enable zfs in rc.conf
* testport: Support overlay
* jail: Support PKG_REPO_SIGNING_KEY/KERNCONF for pkgbase
* bulk|testport -i: Mount ports rw
* jail -u: Fix git not running from the src dir on update
* MOVED: Support from overlays
* bulk: Always build repo even if no packages build
* distclean: Don't delete .hidden files.
* bulk: Delete FORBIDDEN packages during incremental check.
* pkgclean: Delete FORBIDDEN packages.
* bulk: Delete corrupted packages like pkgclean does.
* bulk -af: Delete unqueued packages like pkgclean.
* Many test improvements
* Many fixes for builtin helpers
* A lot more random stuff

Fix bsdgrep support for jail version

- Fix jail creation for 12.2+ seeing sys/param.h error.

MFH:	2020Q4

- Update to 3.3.0-253-g531ee09f6

* queue: Fix unqueueable command error message
 * Fix BASEFS error / first-time setup blockers.
 * bulk: Fix non-existent dependencies claiming to be moved.

- Update to 3.3.0-253-g531ee09f6

* Minor perf improvements for builtins.
 * Fix html with port named "latest".
 * testport / bulk -t: Set DEVELOPER in patch phase.
 * image: Make iso images bootable in UEFI

- Update to 3.3.0-229-gce2011f23

* Pass MAKEWORLDARGS during installworld too
  * bulk/testport: Initial support for ports OVERLAYS
  * testport: Show log info on failure exit
  * jail -d: Don't confirm if the jail doesn't exist
  * jail -c: Fix NO_LIB32 support
  * jail -i: Don't show ports tree info if not requested
  * bulk: Compute queued stats after trimming ignored AND trimming queue.
  * Various fixes and expansion of sh mapfile support
  * Always export `LC_COLLATE=C`

- Update to 3.3.0-164-g122329edc

- distclean: Remove empty directories
 - Fix wrkdir saving with FLAVOR'd ports
 - manpage: Cleanup poudriere-jail and poudriere-bulk
 - image: Warn if MFSROOT is too large
 - bulk: Allow overriding nullfs-mounted paths with NULLFS_PATHS
 - bulk: Add additional cases for kern.securelevel assertion

- Update to 3.3.0-126-g12112ee57

- image: Fix error with non-existent /etc/login.conf.orig

- Update to 3.3.0-125-g0a50192f8

- bulk: Process IGNORE/BLACKLIST before build.
 - Add job status to saving workdir on build failure.
 - ports -u: Add 'ports_update done' hook.

- Update to 3.3.0-90-gd6f021339

- Add DISALLOW_NETWORKING, fixes #689
 - qemu: Add /usr/bin/wc and /usr/bin/head to HLINK_FILES.
 - image: Add zsnapshot imagetype.
 - Fix pkg 1.11 issue with devfs mount.
 - bulk -a: Don't print ports in summary unless -v is used.
 - Show FLAVOR in more places.
 - ports -l: Fix error when no ports trees exist yet.
 - testport -c: Fix make.conf not being respected for `make config`.
 - image: Add sleep, ls, and ping to miniroot.

Fix poudriere image with pkg 1.11

Update to 3.3.0-62-g5abf90c67

- Minor updates to blacklist processing (should be NOP)

- Update to 3.3.0-59-g6e1132813

- poudriere: Only pass MAKEOBJDIRPREFIX to 'jail'
 - Document environment fully for poudriere/-jail/-ports.
 - Revert progress indicator
 - poudriere: Fix all environment to be space/quote safe.
 - jail/ports -l: Avoid printing empty columns/trailing whitespace.
 - jail -c -m null/tar/src: Again require -v if newvers.sh is not readable.
 - Show proper errors for missing jail metadata.
 - poudriere-jail.8: jail -m null does NOT null-mount during build.
 - jail -c: Defer pwd_mkdb until bulk's jail_start() call.
 - jail -cu: Stop modifying /etc/login.conf in the jail.
 - Slightly speedup MOVED parsing

Update to 3.3.0-36-g824cd5d40

* Fix status sed/regex error on 11/head.
 * Fix some bogus 'pwait: No such process' warnings.
 * image -t firmware: Fix installation of /usr/local/etc files (#637).
 * image -f: Fix @flavor support.
 * image: Fix errors calculating IMAGESIZE when not needed (like -t tar).
 * image: Fix cleaning up temporary files properly when USE_TMPFS=all is used.

Update to 3.3.30 release.

No changes.

- Update to 3.2.8-438-ga95f2cbfe

- Fix symlinked POUDRIERE_DATA unmount bug.
 - testport: Fix ports-mgmt/pkg Latest link leaking into real package repository.
 - bulk/status: Display the progress indicator extracted from build logs.

This will be 3.3.0.

- Update to 3.2.8-432-g070fc33be

- Update sh from head r343981
 - Add a builtin for simple string substitutions
 - Fix some invalid memset(3)
 - mapfile fixes and tests
 - Micro-optimize some hash functions to save around 30%
 - Inline some mapfile checks
 - Manpage updates/fixes

- Update to 3.2.8-402-g73eefa2e6

- Replace portsmon links with freshports.
 - Document that hook plugins can provide make.conf, but not with filename patterns.
 - pkgclean: Ensure -j is passed in.
 - Create a dataset for poudriere/data/images during initial setup (#630)
 - image -t zrawdisk: Load the ZFS module at boot, so the filesystem can be
   mounted (#633)
 - image -t zrawdisk: Fix check for IMAGESIZE (#634)
 - image: On failure, don't leave md(4) devices laying around (#635)
 - image: When copying the contents of an overlay, copy symlinks as
   symlinks (#636)
 - Update sh to r338473
 - bulk -cC: Prompt to delete if not in a TTY.
   - Only prompt when ATOMIC_PACKAGE_REPOSITORY is off.
   - Only prompt if there are packages to remove.
 - ATOMIC_PACKAGE_REPOSITORY: Be a bit more verbose about packages directory
   paths.
 - image: Add bytes to bibytes conversion regarding image size (#638)
 - image: Add dump support (#644)
 - Update zsh completion

- Update to 3.2.7-372-g6125e0831

Very minor chase of 3.2.7.

  - HTML: Reset error load counter on successful load

- Update to 3.2.6-369-g91f1ddf5f

- jail -u freebsd-update: Auto confirm prompts
  - bulk tests: Don't let system perl interfere with the partial tree used.
  - compute_deps: Determine all errors before bailing out