Some of our Agent Skills include small Python scripts that read public web pages for the person running them, for example a store owner checking their own product pages. They are not crawlers. They run on that person's computer, only when asked, and only for the pages the job needs.
How they behave
- Each one names itself in its user agent, for example
product-seo-fixer/1.0 (read-only helper run for a user; +https://proskillpacks.github.io). None of them pretends to be a browser. - They read your robots.txt first and follow it the way RFC 9309 describes. If robots.txt can't be read because of a server error or no answer, they treat the whole site as off limits.
- They wait at least one second between requests to the same site.
- They only read. They never submit forms, log in or change anything.
- If a page is blocked, the script stops and asks its user to paste the text in instead.
How to block them
Add a group to your robots.txt with the helper's name, for example:
User-agent: product-seo-fixer
Disallow: /
The names in use today, plus those shipping this week:
agent-ready-store-auditagent-ready-quick-checkproduct-description-rewriterproduct-seo-fixersupport-macro-writerbfcm-campaign-kitshopify-policy-checkerproduct-title-cleanershopify-alt-text-writerlate-payment-chaser-ukphoto-description-writerbrief-to-proposaldiscovery-call-briefProSkillPacks-SiteCheck
ProSkillPacks-SiteCheck is used by our website checks for marketers: on-page fixes, local business details, landing page copy, AI search readiness, competitor comparisons and article refreshes. It reads the pages its user names, robots.txt, and for some checks up to four contact or about pages, /llms.txt and /sitemap.xml. When it is blocked, it tells its user the site asks automated readers to stay out and offers a paste-in version instead.
A store owner can tell the audit to test how AI shopping agents see their own store. Only in that mode, and only for the owner's own store, it also sends requests that use the published user agents of those AI agents, so the owner sees what those agents would see.
Questions or a problem with one of our helpers: open an issue on GitHub.