AI Bot robots.txt & llms.txt Generator
Control which AI search engines and model trainers crawl your site, and build a clean llms.txt guidance manifest for ChatGPT, Claude, Gemini, and Perplexity.
1. AI Crawler Policy Matrix
Toggle Allow or Block per user-agent, or apply a preset.
2. Sitemap, Disallow Rules & Crawl Directives
User-agent: * section. Blocked bots receive Disallow: /.
3. llms.txt Manifest Builder
Curated high-signal URLs & summaries for LLM agents.
Schema.org JSON-LD Builder & Validator
Configure rich result structured data templates with live JSON syntax and Google Schema field validation, or edit raw JSON-LD directly.
LocalBusiness Fields
Fill in structured entity details to generate valid JSON-LD.
Google SERP & OpenGraph Snippet Preview
Measure exact Canvas-rendered title (~580px) and meta description (~920px) pixel widths, preview desktop/mobile search snippets, and inspect OpenGraph & Twitter cards.
1. Search Snippet Metadata
2. OpenGraph & X (Twitter) Card Overrides
Google SERP Preview
OpenGraph & Social Card
Copyable HTML Meta Tags
PageSpeed Insights & HTTP Status Lookup
Run a live Google PageSpeed Insights v5 audit directly from your browser and inspect HTTP/IndexNow status codes & AI crawler troubleshooting playbooks.
1. Google PageSpeed Insights v5 Runner
Queries Google's public PSI v5 endpoint directly from your browser. Optional API key prevents public shared-IP 429 rate limits.
2. HTTP Status & IndexNow Lookup
Interactive diagnostic reference from MabrookTech SEO Ping Pro.
3. Common Crawling & Indexing Playbooks
Proven fixes for retired pings, IndexNow 403s, and invisible AI crawlers.