MabrookTech Tools Ecosystem
AI Discovery & Crawl Governance

AI Bot robots.txt & llms.txt Generator

Control which AI search engines and model trainers crawl your site, and build a clean llms.txt guidance manifest for ChatGPT, Claude, Gemini, and Perplexity.

1. AI Crawler Policy Matrix

Toggle Allow or Block per user-agent, or apply a preset.

2. Sitemap, Disallow Rules & Crawl Directives

Applied to allowed bots and the wildcard User-agent: * section. Blocked bots receive Disallow: /.

3. llms.txt Manifest Builder

Curated high-signal URLs & summaries for LLM agents.

robots.txt 0 lines

                            
Structured Data Engineering

Schema.org JSON-LD Builder & Validator

Configure rich result structured data templates with live JSON syntax and Google Schema field validation, or edit raw JSON-LD directly.

LocalBusiness Fields

Fill in structured entity details to generate valid JSON-LD.

application/ld+json 0 bytes

                            
Search & Social CTR Lab

Google SERP & OpenGraph Snippet Preview

Measure exact Canvas-rendered title (~580px) and meta description (~920px) pixel widths, preview desktop/mobile search snippets, and inspect OpenGraph & Twitter cards.

1. Search Snippet Metadata

0px / 580px • 0 chars
0px / 920px • 0 chars

2. OpenGraph & X (Twitter) Card Overrides

Google SERP Preview

OpenGraph & Social Card

Copyable HTML Meta Tags


                            
Core Web Vitals & Indexing Diagnostics

PageSpeed Insights & HTTP Status Lookup

Run a live Google PageSpeed Insights v5 audit directly from your browser and inspect HTTP/IndexNow status codes & AI crawler troubleshooting playbooks.

1. Google PageSpeed Insights v5 Runner

Queries Google's public PSI v5 endpoint directly from your browser. Optional API key prevents public shared-IP 429 rate limits.

Lighthouse API v5
Categories:

2. HTTP Status & IndexNow Lookup

Interactive diagnostic reference from MabrookTech SEO Ping Pro.

3. Common Crawling & Indexing Playbooks

Proven fixes for retired pings, IndexNow 403s, and invisible AI crawlers.

Pre-Flight Technical SEO Checklist