security/py-pyopenssl: Move security/py-openssl to security/py-pyopenssl - Update WWW - Convert to USE_PYTHON=pep517 - Clean up Makefile - Bump PORTREVISION for package change - Bump PORTREVISION of dependent ports for dependency changeaafe9a2135
Port details
dns/py-dns-crawler 1.6.5_1
Crawler for getting info about DNS domains and services
Port info
- Maintainer
- sunpoet@FreeBSD.org
- Packages
- latest: 1.6.5_1
- Upstream
- up to date
- Last update
- to 1.6.5_1 · aafe9a2135
- Quarterly
- 2026Q4: 1.6.5_1
- WWW
- https://gitlab.nic.cz/adam/dns-crawler
- Links
- cgit · VuXML
Install
- Package
# pkg install py312-dns-crawlerinstalls 1.6.5_1 fromlatest; fromquarterly(2026Q4) 1.6.5_1- Port
# cd /usr/ports/dns/py-dns-crawler && make install clean- Size
- 74 KiB download · 352 KiB installed
- Depends on
- databases/py-redis 8.1.0, devel/py-asn1crypto 1.5.1_1, devel/py-pyicu 2.16.2, devel/py-python-magic 0.4.27_1, devel/py-rq1 1.16.2, dns/py-dnspython 2.9.0,1, dns/py-idna 3.20, lang/python312 3.12.15, mail/py-checkdmarc 6.0.3, net/py-GeoIP2 5.1.0, security/py-cert-human 1.0.7_2, security/py-cryptography 50.0.1_1,1, security/py-ecdsa 0.19.2, security/py-pyopenssl 26.4.0,1, textproc/py-pyaml 26.7.0, www/py-forcediphttpsadapter 1.1.0_1, www/py-hstspreload 2026.9.1, www/py-requests 2.34.2, www/py-requests-toolbelt 1.0.0_1
- License
- GPLv3
Packages by version and architecture
latest
| FreeBSD version | amd64 | aarch64 | i386 |
|---|---|---|---|
| FreeBSD 16 | 1.6.5_1 | 1.6.5_1 | – |
| FreeBSD 15 | 1.6.5_1 | 1.6.5_1 | – |
| FreeBSD 14 | 1.6.5_1 | 1.6.5_1 | 1.6.5_1 |
quarterly (2026Q4)
| FreeBSD version | amd64 | aarch64 | i386 |
|---|---|---|---|
| FreeBSD 15 | 1.6.5_1 | 1.6.5_1 | – |
| FreeBSD 14 | 1.6.5_1 | 1.6.5_1 | 1.6.5_1 |
version as in the ports tree (latest) or the most common one (quarterly) · different version · ✗ not built · – no packages for this platform. Package sets that have not been rebuilt for 60 days are left out.
Unaddressed and VuXML only (0)
No unaddressed CVE and nothing reported by
pkg audit for the packaged version 1.6.5_1.Fixed (0)
No VuXML entries for this package.
Problem reports (0) · open in Bugzilla, most recently changed first
None.
Commits (18)
dns/py-dns-crawler: Update to 1.6.5 Changes: https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.md6d647cb68a
*/*: Switch consumers from devel/py-rq to devel/py-rq1 These ports are not compatible with py-rq 2.0.0+ and for some there is not yet a new version that is ready for py-rq 2.0.0+. Therefore to avoid regressions, switch the consumers to the newly created port devel/py-rq1, which uses the 1.16.2 release. * Bump PORTREVISION due dependency change. PR: 282649 Approved by: portmgr (blanket)952c1b2c08
dns/py-dns-crawler: Allow build with py-setuptools-git-versioning 2.0.0+ - Bump PORTREVISION for package changef8b4b540f2
dns/py-dns-crawler: Update to 1.6.3 Changes: https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.md8e0de3997e
dns/py-dns-crawler: Update to 1.6.2 - Convert to USE_PYTHON=pep517 Changes: https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.mdbab68edeb4
dns/py-dns-crawler: Update to 1.5.8 Changes: https://gitlab.nic.cz/adam/dns-crawler/-/blob/master/CHANGELOG.mde047381479
*: Replace USES=pycryptography* with USE_PYTHON=cryptography{,_build,_test}
- Introduce USE_PYTHON=cryptography{,_build,_test}
- Switch all 96 ports from USES=pycryptography to with USE_PYTHON=cryptography{,_build,_test}
- Remove Mk/Uses/pycryptography.mk
PR: 273727
Approved by: tcberner (portmgr)
Exp-run by: antoine3754fc5f19dns/py-dns-crawler: Sort USES8465fa1062
framework: convert tree to use USES=pycryptography A future commit will update to security/py-cryptography will introduce a rust dependency. PR: 254853b28a739884
all: remove explicit versions in USES=python for "3.x+"
The logic in USES=python will automatically convert this to 3.8+ by
itself.
Adjust two ports that only had Python 3.7 mentioned but build fine
on Python 3.8 too.
finance/quickfix: mark BROKEN with PYTHON
libtool: compile: c++ -DHAVE_CONFIG_H -I. -I../.. -I -I. -I.. -I../.. -I../C++ -DLIBICONV_PLUG -DPYTHON_MAJOR_VERSION=3 -Wno-unused-variable -Wno-maybe-uninitialized -O2 -pipe -DLIBICONV_PLUG -fstack-protector-strong -fno-strict-aliasing -DLIBICONV_PLUG -Wall -ansi -Wno-unused-command-line-argument -Wpointer-arith -Wwrite-strings -Wno-overloaded-virtual -Wno-deprecated-declarations -Wno-deprecated -std=c++0x -MT _quickfix_la-QuickfixPython.lo -MD -MP -MF .deps/_quickfix_la-QuickfixPython.Tpo -c QuickfixPython.cpp -fPIC -DPIC -o .libs/_quickfix_la-QuickfixPython.o
warning: unknown warning option '-Wno-maybe-uninitialized'; did you mean '-Wno-uninitialized'? [-Wunknown-warning-option]
QuickfixPython.cpp:175:11: fatal error: 'Python.h' file not found
^~~~~~~~~~
1 warning and 1 error generated.
Reviewed by: portmgr, vishwin, yuri
Differential Revision: <https://reviews.freebsd.org/D40568>3d9a815d9c*: Bump PORTREVISIONs for math/mpc update to 1.3.18d3e020ed0
dns/py-dns-crawler: Update version requirement of RUN_DEPENDS5d485f62c6
*/*: rename CHEESESHOP to PYPI in MASTER_SITES PR: 267994 Differential revision: D37518 Approved by: bapt77d68471ad
Remove WWW entries moved into port Makefiles Commit b7f05445c00f has added WWW entries to port Makefiles based on WWW: lines in pkg-descr files. This commit removes the WWW: lines of moved-over URLs from these pkg-descr files. Approved by: portmgr (tcberner)fb16dfecae
Add WWW entries to port Makefiles It has been common practice to have one or more URLs at the end of the ports' pkg-descr files, one per line and prefixed with "WWW:". These URLs should point at a project website or other relevant resources. Access to these URLs required processing of the pkg-descr files, and they have often become stale over time. If more than one such URL was present in a pkg-descr file, only the first one was tarnsfered into the port INDEX, but for many ports only the last line did contain the port specific URL to further information. There have been several proposals to make a project URL available as a macro in the ports' Makefiles, over time. This commit implements such a proposal and moves one of the WWW: entries of each pkg-descr file into the respective port's Makefile. A heuristic attempts to identify the most relevant URL in case there is more than one WWW: entry in some pkg-descr file. URLs that are not moved into the Makefile are prefixed with "See also:" instead of "WWW:" in the pkg-descr files in order to preserve them. There are 1256 ports that had no WWW: entries in pkg-descr files. These ports will not be touched in this commit. The portlint port has been adjusted to expect a WWW entry in each port Makefile, and to flag any remaining "WWW:" lines in pkg-descr files as deprecated. Approved by: portmgr (tcberner)b7f05445c0
dns: remove 'Created by' lines A big Thank You to the original contributors of these ports: * Aaron Dalton <aaron@FreeBSD.org> * Akinori MUSHA aka knu <knu@idaemons.org> * Alex Samorukov <samm@freebsd.org> * Alexey Dokuchaev <danfe@FreeBSD.org> * Allan Jude <allanjude@freebsd.org> * Amar Takhar <verm@drunkmonk.net> * Anders Nordby <anders@fix.no> * Andrew Greenwood <greenwood.andy@gmail.com> * Anton Berezin <tobez@FreeBSD.org> * Ashish SHUKLA <ashish@FreeBSD.org> * Attila Nagy <bra@fsn.hu> * Bas Kruit <baskruit@bsltwr.dhis.org> * Bruce M. Simpson <bms@FreeBSD.org> * Carlos J Puga Medina <cpm@fbsd.es> * Chris St Denis (<chris@ctgameinfo.com>) * Clement Laforet <clement@FreeBSD.org> * Clement Laforet <sheepkiller@cultdeadsheep.org> * Dan Langille <dvl@FreeBSD.org> * Dan Pelleg <daniel+mdnsd@pelleg.org> * Dan Smith <dan@algenta.com> * David O'Brien (obrien@NUXI.com) * Dean Hollister <dean@odyssey.apana.org.au> * Dirk Froemberg <dirk@FreeBSD.org> * Dmitry Pryadko <d.pryadko@rambler-co.ru> * Dmitry Sivachenko <mitya@yandex-team.ru> * Dominik Brettnacher <domi@saargate.de> * Douglas Thrift <douglas@douglasthrift.net> * Edwin Groothuis (edwin@mavetju.org) * Edwin Groothuis <edwin@mavetju.org> * Emanuel Haupt <ehaupt@FreeBSD.org> * Emanuel Haupt <ehaupt@critical.ch> * Eyal Soha <esoha@attbi.com> * Filip Parag <filip@parag.rs> * Filippo Natali <filippo.natali@gmail.com> * Frank Behrens * Gea-Suan Lin <gslin@gslin.org> * Geoffroy Desvernay <dgeo@centrale-marseille.fr> * George Reid <greid@ukug.uk.freebsd.org> * Goran Mekić <meka@tilda.center> * Hajimu UMEMOTO <ume@FreeBSD.org> * Herve Quiroz <hq@FreeBSD.org> * Hirohisa Yamaguchi <umq@ueo.co.jp> * Hye-Shik Chang <perky@fallin.lv> * Jaap Akkerhuis <jaap@NLnetLabs.nl> * James FitzGibbon <jfitz@FreeBSD.org> * Jase Thew <freebsd@beardz.net> * Jimmy Bergman jimmy@sigint.se * Jin-Shan Tseng <tjs@cdpa.nsysu.edu.tw> * Joe Barbish * Jov <amutu@amutu.com> * Jui-Nan Lin <jnlin@freebsd.cs.nctu.edu.tw> * Karl Dietz (Karl.Dietz@frankfurt.netsurf.de) * Kirill Ponomarew <ponomarew@oberon.net> * Koen Martens <gmc@sonologic.nl> * Konstantin Saurbier <saurbier@math.uni-bielefeld.de> * Kostya Lukin <lukin@okbmei.msk.su> * Kris Kennaway <kris@FreeBSD.org> * Kubilay Kocak <koobs@FreeBSD.org> * Kurt Jaeger <fbsd-ports@opsec.eu> * Leo Vandewoestijne <freebsd@dns-lab.com> * Leo Vandewoestijne <freebsd@dns.company> * MIHIRA Yoshiro <sanpei@jp.FreeBSD.org> * Marcin Gondek <drixter@e-utp.net> * Mario Sergio Fujikawa Ferreira <lioux@FreeBSD.org> * Mark Felder <feld@FreeBSD.org> * Mark Linimon <linimon@lonesome.com> * Mark Pulford <mark@kyne.com.au> * Martin Matuska <mm@FreeBSD.org> * Martin Wilke <miwi@FreeBSD.org> * Matthew Hunt <mph@pobox.com> * Matthew Seaman * Michael Cardell Widerkrantz <mc@hack.org> * Moritz Warning <moritzwarning@web.de> * Natacha Porte <natbsd@instinctive.eu> * Neil Blakey-Milner * Olivier Duchateau * Paul Chvostek <paul@it.ca> * Paul Dlug <paul@aps.org> * Philippe Pepiot <phil@philpep.org> * Piotr Kubaj <pkubaj@FreeBSD.org> * Piotr Kubaj <pkubaj@anongoth.pl> * Po-Chuan Hsieh <sunpoet@FreeBSD.org> * Rafal Lesniak <fbsd@grid.einherjar.de> * Roman Shterenzon <roman@xpert.com> * Rong-En Fan <rafan@FreeBSD.org> * Roy Marples <roy@marples.name> * Ryan Steinmetz <rpsfa@rit.edu> * Ryan Steinmetz <zi@FreeBSD.org> * Sahil Tandon <sahil@tandon.net> * Seamus Venasse <svenasse@polaris.ca> * Sergei Kolobov <sergei@FreeBSD.org> * Sergei Kolobov <sergei@kolobov.com> * Sergey Matveychuk <sem@FreeBSD.org> * Sergey Skvortsov <skv@protey.ru> * Simon Dick <simond@irrelevant.org> * Stefan Esser <se@FreeBSD.org> * Steve Wills <swills@FreeBSD.org> * Steve Wills <swills@freebsd.org> * Steven Honson * Sunpoet Po-Chuan Hsieh <sunpoet@FreeBSD.org> * Sunpoet Po-Chuan Hsieh <sunpoet@sunpoet.net> * Timothy Beyer <beyert@cs.ucr.edu> * Waitman Gobble <waitman@waitman.net> * Wen Heping <wen@FreeBSD.org> * Wen Heping <wenheping@gmail.com> * Zane C, Bowers <vvelox@vvelox.net> * adamw * alexis * andrew@ugh.net.au * bkhl * clsung * clsung@dragon2.net * dglo@ssec.wisc.edu * dnscheckengine-port@academ.com (Stan Barber) * fenner * geniusj@ods.org * ijliao * ismail.yenigul@endersys.com.tr * krion * mark@foster.cc * n@nectar.com * roam@FreeBSD.org * rodrigc@FreeBSD.org * rpsfa@rit.edu * sten@blinkenlights.nl With hat: portmgr66ee090cca
dns/py-dns-crawler: Add py-dns-crawler 1.4.9
Despite the name, the crawler gets info for more services than just DNS:
- DNS:
- all A/AAAA records (for the 2nd level domain and www.subdomain), annotated
with GeoIP
- TXT records (with SPF and DMARC parsed for easier filtering)
- TLSA (for the 2nd level domain and www.subdomain)
- MX
- DNSSEC validation
- nameservers:
- each server IP annotated with GeoIP
- HOSTNAME.BIND, VERSION.BIND, AUTHORS.BIND and fortune (also for all IPs)
- users can add custom additional RRs in the config file
- E-mail (for every server from MX):
- SMTP server banners (optional, ports are configurable)
- TLSA records
- Web:
- HTTP status & headers (inc. parsed cookies) for ports 80 & 443 on each IP
from A/AAAA records
- certificate info for HTTPS (optionally with an entire cert chain)
- webpage content (optional)
- everything of the above is saved for each step in the redirect history --
the crawler follows redirects until it gets a non-redirecting status or hits
a configurable limit
WWW: https://gitlab.nic.cz/adam/dns-crawler9ff6a0ecc0