Who we are
FatHeronLinkBot builds Fat Heron's first-party backlink and referring-host graph used inside Domainers research tools and (later) Fat Heron data products. We are not a third-party SEO SaaS crawler.
User-Agent strings
Live web crawl:
FatHeronLinkBot/1.0 (+https://fatheron.domains/bot/linkbot; research@fatheron.com)
Common Crawl dataset download (separate token):
FatHeronLinkBot-CC/1.0 (+https://fatheron.domains/bot/linkbot; research@fatheron.com)
What we store
- Link edges: referring host → target domain
- Aggregates: backlink count and unique referring-host popularity
- Optional HTTP title / final URL on hot-set fetches
We do not retain long-term HTML page bodies.
robots.txt
We honor User-agent: FatHeronLinkBot and * Disallow rules, including crawl-delay when present.
Opt out / removal
To stop crawls and purge referring edges for a host, email research@fatheron.com or POST to our public opt-out API with the host name.
Contact
Rate limits, allowlisting, or abuse reports: research@fatheron.com