ApprenticeAtlasBot

Every request carries this User-Agent:

ApprenticeAtlasBot/0.1 (+https://apprenticeships.untraceable.dev/bot)

We use no proxies and never disguise the crawler as a browser.

• It reads robots.txt before anything else on a host, caches it for up to 24 hours and never fetches a disallowed path. A robots.txt that answers 4xx is treated as no restrictions; one that answers 429, 5xx or not at all is treated as “disallow everything” until it can be read (RFC 9309).
• At most one request per second to any host, with random jitter, or slower if your robots.txt sets a Crawl-delay.
• It backs off exponentially on 429 and 503 responses and honours Retry-After.
• It sends conditional requests (If-None-Match, If-Modified-Since) so unchanged pages cost you almost nothing.
• It reads public pages only. It never logs in, never accepts click-through terms and never tries to get past a bot check: a block is recorded and the source is left alone.
• Each source is read on a schedule, typically every few hours, not continuously.

Facts about apprenticeship vacancies (title, location, dates, pay, level), a short excerpt of at most 300 characters and the link back to your advert. Never the full description, and never personal data: recruiter names, emails and phone numbers are stripped as each listing is read.

To block it from your whole site:

User-agent: ApprenticeAtlasBot
Disallow: /

Or ask us directly on the takedown page, which also covers corrections. The status page shows every source we read and when we last read it.