HireBobbyBot

If you saw HireBobbyBot in your server logs, someone added your website to HireBobby, usually the company that owns it, so Bobby could learn what it does.

What it does

• It fetches your homepage and up to five more pages that describe the business, such as About, Product or Pricing.
• It only runs when someone adds or refreshes a website in HireBobby: there's no ongoing crawl, and no more than a handful of requests at a time.
• It reads page text only. It doesn't run scripts, submit forms, or follow links off your site.
• It honours robots.txt: rules for HireBobbyBot if you have them, otherwise your rules for *.

User agent

HireBobbyBot/0.1 (+https://hirebobby.com/bot)

Blocking it

Add this to your robots.txt to keep HireBobbyBot out of your whole site:

User-agent: HireBobbyBot
Disallow: /

If HireBobbyBot is blocked, people won't be able to add your site to HireBobby. Questions or problems? Email hello@hirebobby.com.