FossickBot

FossickBot is an automated web crawler operated by StackScope (stackscope.dev), a site that records the technologies new websites are built with.

If you found FossickBot in your logs: when a domain first shows up in public certificate and registration records, FossickBot checks whether a real website has gone live there.

What it does

• Requests /robots.txt first, and obeys it (including Crawl-delay).
• Fetches the home page once. Nothing else.
• Does not log in, submit forms, or crawl deeper into the site.
• Identifies as FossickBot and comes from crawler.fossick.bot.
• Records the page title, description, and a short text excerpt — enough to tell a real launch from a parked or placeholder page.

That is all FossickBot does. If a site is genuinely live, StackScope may later catalogue the technologies it uses from a separate visit by its own crawler.

Opt out

Add this to your robots.txt (honoured on the next visit):

User-agent: FossickBot
Disallow: /

Or email abuse@fossick.bot with the domain and it will be excluded by hand.

Operated by StackScope. Contact: abuse@fossick.bot