CVE and update status of the FreeBSD ports tree3,295 unaddressed CVEs in 670 portsAll times are CET
Port details

dns/py-dns-crawler 1.6.5_1

Crawler for getting info about DNS domains and services

Port info

Maintainer
sunpoet@FreeBSD.org
Packages
latest: 1.6.5_1
Upstream
up to date
Last update
to 1.6.5_1 · aafe9a2135
Quarterly
2026Q4: 1.6.5_1
WWW
https://gitlab.nic.cz/adam/dns-crawler
Links
cgit · VuXML

Install

Package
# pkg install py312-dns-crawler
installs 1.6.5_1 from latest; from quarterly (2026Q4) 1.6.5_1
Port
# cd /usr/ports/dns/py-dns-crawler && make install clean
Size
74 KiB download · 352 KiB installed
Depends on
databases/py-redis 8.1.0, devel/py-asn1crypto 1.5.1_1, devel/py-pyicu 2.16.2, devel/py-python-magic 0.4.27_1, devel/py-rq1 1.16.2, dns/py-dnspython 2.9.0,1, dns/py-idna 3.20, lang/python312 3.12.15, mail/py-checkdmarc 6.0.3, net/py-GeoIP2 5.1.0, security/py-cert-human 1.0.7_2, security/py-cryptography 50.0.1_1,1, security/py-ecdsa 0.19.2, security/py-pyopenssl 26.4.0,1, textproc/py-pyaml 26.7.0, www/py-forcediphttpsadapter 1.1.0_1, www/py-hstspreload 2026.9.1, www/py-requests 2.34.2, www/py-requests-toolbelt 1.0.0_1
License
GPLv3

Packages by version and architecture

latest

FreeBSD versionamd64aarch64i386
FreeBSD 161.6.5_11.6.5_1–
FreeBSD 151.6.5_11.6.5_1–
FreeBSD 141.6.5_11.6.5_11.6.5_1

quarterly (2026Q4)

FreeBSD versionamd64aarch64i386
FreeBSD 151.6.5_11.6.5_1–
FreeBSD 141.6.5_11.6.5_11.6.5_1

version as in the ports tree (latest) or the most common one (quarterly) · different version · ✗ not built · – no packages for this platform. Package sets that have not been rebuilt for 60 days are left out.

Unaddressed and VuXML only (0)

No unaddressed CVE and nothing reported by pkg audit for the packaged version 1.6.5_1.

Fixed (0)

No VuXML entries for this package.

Problem reports (0) · open in Bugzilla, most recently changed first

None.

Commits (18)

Po-Chuan Hsieh (sunpoet) · 1.6.5_1
security/py-pyopenssl: Move security/py-openssl to security/py-pyopenssl

- Update WWW
- Convert to USE_PYTHON=pep517
- Clean up Makefile
- Bump PORTREVISION for package change
- Bump PORTREVISION of dependent ports for dependency change
aafe9a2135
Po-Chuan Hsieh (sunpoet) · 1.6.5
dns/py-dns-crawler: Update to 1.6.5

Changes:	https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.md
6d647cb68a
Kai Knoblich (kai) · 1.6.3_2
*/*: Switch consumers from devel/py-rq to devel/py-rq1

These ports are not compatible with py-rq 2.0.0+ and for some there is
not yet a new version that is ready for py-rq 2.0.0+.

Therefore to avoid regressions, switch the consumers to the newly
created port devel/py-rq1, which uses the 1.16.2 release.

* Bump PORTREVISION due dependency change.

PR:		282649
Approved by:	portmgr (blanket)
952c1b2c08
Po-Chuan Hsieh (sunpoet) · 1.6.3_1
dns/py-dns-crawler: Allow build with py-setuptools-git-versioning 2.0.0+

- Bump PORTREVISION for package change
f8b4b540f2
Po-Chuan Hsieh (sunpoet) · 1.6.3
dns/py-dns-crawler: Update to 1.6.3

Changes:	https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.md
8e0de3997e
Po-Chuan Hsieh (sunpoet) · 1.6.2
dns/py-dns-crawler: Update to 1.6.2

- Convert to USE_PYTHON=pep517

Changes:	https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.md
bab68edeb4
Po-Chuan Hsieh (sunpoet) · 1.5.8
dns/py-dns-crawler: Update to 1.5.8

Changes:	https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.md
e047381479
Po-Chuan Hsieh (sunpoet) · 1.4.9_1
*: Replace USES=pycryptography* with USE_PYTHON=cryptography{,_build,_test}

- Introduce USE_PYTHON=cryptography{,_build,_test}
- Switch all 96 ports from USES=pycryptography to with USE_PYTHON=cryptography{,_build,_test}
- Remove Mk/Uses/pycryptography.mk

PR:		273727
Approved by:	tcberner (portmgr)
Exp-run by:	antoine
3754fc5f19
Po-Chuan Hsieh (sunpoet) · 1.4.9_1
dns/py-dns-crawler: Sort USES
8465fa1062
Tobias C. Berner (tcberner) · 1.4.9_1
framework: convert tree to use USES=pycryptography

A future commit will update to security/py-cryptography will introduce a
rust dependency.

PR:		254853
b28a739884
Rene Ladan (rene) · 1.4.9_1
all: remove explicit versions in USES=python for "3.x+"

The logic in USES=python will automatically convert this to 3.8+ by
itself.

Adjust two ports that only had Python 3.7 mentioned but build fine
on Python 3.8 too.

finance/quickfix: mark BROKEN with PYTHON

libtool: compile:  c++ -DHAVE_CONFIG_H -I. -I../.. -I -I. -I.. -I../.. -I../C++ -DLIBICONV_PLUG -DPYTHON_MAJOR_VERSION=3 -Wno-unused-variable -Wno-maybe-uninitialized -O2 -pipe -DLIBICONV_PLUG -fstack-protector-strong -fno-strict-aliasing -DLIBICONV_PLUG -Wall -ansi -Wno-unused-command-line-argument -Wpointer-arith -Wwrite-strings -Wno-overloaded-virtual -Wno-deprecated-declarations -Wno-deprecated -std=c++0x -MT _quickfix_la-QuickfixPython.lo -MD -MP -MF .deps/_quickfix_la-QuickfixPython.Tpo -c QuickfixPython.cpp  -fPIC -DPIC -o .libs/_quickfix_la-QuickfixPython.o
warning: unknown warning option '-Wno-maybe-uninitialized'; did you mean '-Wno-uninitialized'? [-Wunknown-warning-option]
QuickfixPython.cpp:175:11: fatal error: 'Python.h' file not found
          ^~~~~~~~~~
1 warning and 1 error generated.

Reviewed by:	portmgr, vishwin, yuri
Differential Revision:	<https://reviews.freebsd.org/D40568>
3d9a815d9c
Gerald Pfeifer (gerald) · 1.4.9_1
*: Bump PORTREVISIONs for math/mpc update to 1.3.1
8d3e020ed0
Po-Chuan Hsieh (sunpoet) · 1.4.9
dns/py-dns-crawler: Update version requirement of RUN_DEPENDS
5d485f62c6
Dmitry Marakasov (amdmi3) · 1.4.9
*/*: rename CHEESESHOP to PYPI in MASTER_SITES

PR:			267994
Differential revision:	D37518
Approved by:		bapt
77d68471ad
Stefan Eßer (se) · 1.4.9
Remove WWW entries moved into port Makefiles

Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.

This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.

Approved by:		portmgr (tcberner)
fb16dfecae
Stefan Eßer (se) · 1.4.9
Add WWW entries to port Makefiles

It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.

Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.

There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.

This commit implements such a proposal and moves one of the WWW: entries
of each pkg-descr file into the respective port's Makefile. A heuristic
attempts to identify the most relevant URL in case there is more than
one WWW: entry in some pkg-descr file. URLs that are not moved into the
Makefile are prefixed with "See also:" instead of "WWW:" in the pkg-descr
files in order to preserve them.

There are 1256 ports that had no WWW: entries in pkg-descr files. These
ports will not be touched in this commit.

The portlint port has been adjusted to expect a WWW entry in each port
Makefile, and to flag any remaining "WWW:" lines in pkg-descr files as
deprecated.

Approved by:		portmgr (tcberner)
b7f05445c0
Tobias C. Berner (tcberner) · 1.4.9
dns: remove 'Created by' lines

A big Thank You to the original contributors of these ports:

  *  Aaron Dalton <aaron@FreeBSD.org>
  *  Akinori MUSHA aka knu <knu@idaemons.org>
  *  Alex Samorukov <samm@freebsd.org>
  *  Alexey Dokuchaev <danfe@FreeBSD.org>
  *  Allan Jude <allanjude@freebsd.org>
  *  Amar Takhar <verm@drunkmonk.net>
  *  Anders Nordby <anders@fix.no>
  *  Andrew Greenwood <greenwood.andy@gmail.com>
  *  Anton Berezin <tobez@FreeBSD.org>
  *  Ashish SHUKLA <ashish@FreeBSD.org>
  *  Attila Nagy <bra@fsn.hu>
  *  Bas Kruit <baskruit@bsltwr.dhis.org>
  *  Bruce M. Simpson <bms@FreeBSD.org>
  *  Carlos J Puga Medina <cpm@fbsd.es>
  *  Chris St Denis (<chris@ctgameinfo.com>)
  *  Clement Laforet <clement@FreeBSD.org>
  *  Clement Laforet <sheepkiller@cultdeadsheep.org>
  *  Dan Langille <dvl@FreeBSD.org>
  *  Dan Pelleg <daniel+mdnsd@pelleg.org>
  *  Dan Smith <dan@algenta.com>
  *  David O'Brien (obrien@NUXI.com)
  *  Dean Hollister <dean@odyssey.apana.org.au>
  *  Dirk Froemberg <dirk@FreeBSD.org>
  *  Dmitry Pryadko <d.pryadko@rambler-co.ru>
  *  Dmitry Sivachenko <mitya@yandex-team.ru>
  *  Dominik Brettnacher <domi@saargate.de>
  *  Douglas Thrift <douglas@douglasthrift.net>
  *  Edwin Groothuis (edwin@mavetju.org)
  *  Edwin Groothuis <edwin@mavetju.org>
  *  Emanuel Haupt <ehaupt@FreeBSD.org>
  *  Emanuel Haupt <ehaupt@critical.ch>
  *  Eyal Soha <esoha@attbi.com>
  *  Filip Parag <filip@parag.rs>
  *  Filippo Natali <filippo.natali@gmail.com>
  *  Frank Behrens
  *  Gea-Suan Lin <gslin@gslin.org>
  *  Geoffroy Desvernay <dgeo@centrale-marseille.fr>
  *  George Reid <greid@ukug.uk.freebsd.org>
  *  Goran Mekić <meka@tilda.center>
  *  Hajimu UMEMOTO <ume@FreeBSD.org>
  *  Herve Quiroz <hq@FreeBSD.org>
  *  Hirohisa Yamaguchi <umq@ueo.co.jp>
  *  Hye-Shik Chang <perky@fallin.lv>
  *  Jaap Akkerhuis <jaap@NLnetLabs.nl>
  *  James FitzGibbon <jfitz@FreeBSD.org>
  *  Jase Thew <freebsd@beardz.net>
  *  Jimmy Bergman jimmy@sigint.se
  *  Jin-Shan Tseng <tjs@cdpa.nsysu.edu.tw>
  *  Joe Barbish
  *  Jov <amutu@amutu.com>
  *  Jui-Nan Lin <jnlin@freebsd.cs.nctu.edu.tw>
  *  Karl Dietz (Karl.Dietz@frankfurt.netsurf.de)
  *  Kirill Ponomarew <ponomarew@oberon.net>
  *  Koen Martens <gmc@sonologic.nl>
  *  Konstantin Saurbier <saurbier@math.uni-bielefeld.de>
  *  Kostya Lukin <lukin@okbmei.msk.su>
  *  Kris Kennaway <kris@FreeBSD.org>
  *  Kubilay Kocak <koobs@FreeBSD.org>
  *  Kurt Jaeger <fbsd-ports@opsec.eu>
  *  Leo Vandewoestijne <freebsd@dns-lab.com>
  *  Leo Vandewoestijne <freebsd@dns.company>
  *  MIHIRA Yoshiro <sanpei@jp.FreeBSD.org>
  *  Marcin Gondek <drixter@e-utp.net>
  *  Mario Sergio Fujikawa Ferreira <lioux@FreeBSD.org>
  *  Mark Felder <feld@FreeBSD.org>
  *  Mark Linimon <linimon@lonesome.com>
  *  Mark Pulford <mark@kyne.com.au>
  *  Martin Matuska <mm@FreeBSD.org>
  *  Martin Wilke <miwi@FreeBSD.org>
  *  Matthew Hunt <mph@pobox.com>
  *  Matthew Seaman
  *  Michael Cardell Widerkrantz <mc@hack.org>
  *  Moritz Warning <moritzwarning@web.de>
  *  Natacha Porte <natbsd@instinctive.eu>
  *  Neil Blakey-Milner
  *  Olivier Duchateau
  *  Paul Chvostek <paul@it.ca>
  *  Paul Dlug <paul@aps.org>
  *  Philippe Pepiot <phil@philpep.org>
  *  Piotr Kubaj <pkubaj@FreeBSD.org>
  *  Piotr Kubaj <pkubaj@anongoth.pl>
  *  Po-Chuan Hsieh <sunpoet@FreeBSD.org>
  *  Rafal Lesniak <fbsd@grid.einherjar.de>
  *  Roman Shterenzon <roman@xpert.com>
  *  Rong-En Fan <rafan@FreeBSD.org>
  *  Roy Marples <roy@marples.name>
  *  Ryan Steinmetz <rpsfa@rit.edu>
  *  Ryan Steinmetz <zi@FreeBSD.org>
  *  Sahil Tandon <sahil@tandon.net>
  *  Seamus Venasse <svenasse@polaris.ca>
  *  Sergei Kolobov <sergei@FreeBSD.org>
  *  Sergei Kolobov <sergei@kolobov.com>
  *  Sergey Matveychuk <sem@FreeBSD.org>
  *  Sergey Skvortsov <skv@protey.ru>
  *  Simon Dick <simond@irrelevant.org>
  *  Stefan Esser <se@FreeBSD.org>
  *  Steve Wills <swills@FreeBSD.org>
  *  Steve Wills <swills@freebsd.org>
  *  Steven Honson
  *  Sunpoet Po-Chuan Hsieh <sunpoet@FreeBSD.org>
  *  Sunpoet Po-Chuan Hsieh <sunpoet@sunpoet.net>
  *  Timothy Beyer <beyert@cs.ucr.edu>
  *  Waitman Gobble <waitman@waitman.net>
  *  Wen Heping <wen@FreeBSD.org>
  *  Wen Heping <wenheping@gmail.com>
  *  Zane C, Bowers <vvelox@vvelox.net>
  *  adamw
  *  alexis
  *  andrew@ugh.net.au
  *  bkhl
  *  clsung
  *  clsung@dragon2.net
  *  dglo@ssec.wisc.edu
  *  dnscheckengine-port@academ.com (Stan Barber)
  *  fenner
  *  geniusj@ods.org
  *  ijliao
  *  ismail.yenigul@endersys.com.tr
  *  krion
  *  mark@foster.cc
  *  n@nectar.com
  *  roam@FreeBSD.org
  *  rodrigc@FreeBSD.org
  *  rpsfa@rit.edu
  *  sten@blinkenlights.nl

With hat:	portmgr
66ee090cca
Po-Chuan Hsieh (sunpoet) · 1.4.9
dns/py-dns-crawler: Add py-dns-crawler 1.4.9

Despite the name, the crawler gets info for more services than just DNS:
- DNS:
  - all A/AAAA records (for the 2nd level domain and www.subdomain), annotated
    with GeoIP
  - TXT records (with SPF and DMARC parsed for easier filtering)
  - TLSA (for the 2nd level domain and www.subdomain)
  - MX
  - DNSSEC validation
  - nameservers:
    - each server IP annotated with GeoIP
    - HOSTNAME.BIND, VERSION.BIND, AUTHORS.BIND and fortune (also for all IPs)
  - users can add custom additional RRs in the config file
- E-mail (for every server from MX):
  - SMTP server banners (optional, ports are configurable)
  - TLSA records
- Web:
  - HTTP status & headers (inc. parsed cookies) for ports 80 & 443 on each IP
    from A/AAAA records
  - certificate info for HTTPS (optionally with an entire cert chain)
  - webpage content (optional)
  - everything of the above is saved for each step in the redirect history --
    the crawler follows redirects until it gets a non-redirecting status or hits
    a configurable limit

WWW: https://gitlab.nic.cz/adam/dns-crawler
9ff6a0ecc0