{"added":null,"apiVersion":1,"behindSince":null,"buildDepends":[],"categories":["dns","python"],"comment":"Crawler for getting info about DNS domains and services","compare":null,"dependentCount":null,"description":"Despite the name, the crawler gets info for more services than just DNS:\n- DNS:\n  - all A/AAAA records (for the 2nd level domain and www.subdomain), annotated\n    with GeoIP\n  - TXT records (with SPF and DMARC parsed for easier filtering)\n  - TLSA (for the 2nd level domain and www.subdomain)\n  - MX\n  - DNSSEC validation\n  - nameservers:\n    - each server IP annotated with GeoIP\n    - HOSTNAME.BIND, VERSION.BIND, AUTHORS.BIND and fortune (also for all IPs)\n  - users can add custom additional RRs in the config file\n- E-mail (for every server from MX):\n  - SMTP server banners (optional, ports are configurable)\n  - TLSA records\n- Web:\n  - HTTP status \u0026 headers (inc. parsed cookies) for ports 80 \u0026 443 on each IP\n    from A/AAAA records\n  - certificate info for HTTPS (optionally with an entire cert chain)\n  - webpage content (optional)\n  - everything of the above is saved for each step in the redirect history --\n    the crawler follows redirects until it gets a non-redirecting status or hits\n    a configurable limit","flavors":[],"html":"https://daemonports.org/dragonfly/dns/py-dns-crawler/","kind":"port","lastUpdate":null,"license":["GPLv3"],"maintainer":"sunpoet@FreeBSD.org","name":"py311-dns-crawler","newest":true,"newestVersion":"1.6.5","noVulnData":false,"origin":"dns/py-dns-crawler","otherSystems":[{"maintainer":"sunpoet@FreeBSD.org","newest":true,"origin":"dns/py-dns-crawler","path":"/dns/py-dns-crawler/","system":"FreeBSD","version":"1.6.5_1"},{"maintainer":"sunpoet@FreeBSD.org","newest":true,"noVulnData":true,"origin":"dns/py-dns-crawler","path":"","system":"HardenedBSD","version":"1.6.5_1"},{"maintainer":"sunpoet@FreeBSD.org","newest":true,"noVulnData":true,"origin":"dns/py-dns-crawler","path":"","system":"GhostBSD","version":"1.6.5_1"}],"packages":null,"pkgName":"py311-dns-crawler-1.6.5","related":null,"repository":"DPorts","requiredBy":[],"requiredByCount":0,"runDepends":["databases/py-redis","devel/py-asn1crypto","devel/py-pyicu","devel/py-python-magic","devel/py-rq1","dns/py-dnspython","dns/py-idna","lang/python311","mail/py-checkdmarc","net/py-GeoIP2","security/py-cert-human","security/py-cryptography-legacy","security/py-ecdsa","security/py-openssl","textproc/py-pyaml","www/py-forcediphttpsadapter","www/py-hstspreload","www/py-requests","www/py-requests-toolbelt"],"status":null,"system":"dragonfly","systemLabel":"DragonFly","version":"1.6.5","versions":null,"vulnerabilities":null,"www":"https://gitlab.nic.cz/adam/dns-crawler"}