Lexicon SEO
A read-only audit of the pages search engines and AI answer tools can actually fetch. Technical SEO, plus whether AI crawlers are allowed to read the site.
01
Status codes, redirect chains, HTTP to HTTPS, titles and meta descriptions, headings, canonicals, robots.txt, sitemaps, broken internal links, JSON-LD, Open Graph, image alt text, noindex on important pages, mixed content, and response-time and HTML-size hints.
AI crawler rules in robots.txt, and /llms.txt: whether the file exists, is plain text, and is allowed. Blocking a crawler can be the right choice. The audit makes that choice visible.
Length cutoffs and the performance hints are product heuristics. They are not ranking scores and they are not Core Web Vitals.
02
The crawl accepts one http or https URL. Private hosts and URLs with a username or password are refused before any request.
About one URL per second. It respects robots.txt for its own user agent and stops at the plan’s page cap.
Each finding has a priority (P0, P1, or P2), an evidence URL, and a plain-English fix guide. Paid keys can schedule a re-audit. A model summary runs only when a model key is configured.
03
P0 title_missing
The page HTML has no title text.
Evidence URL: https://example.com/pricing
P1 ai_crawlers_blocked
robots.txt disallows one or more well-known AI crawlers for the whole site.
Evidence URL: https://example.com/robots.txt
P2 llms_txt_missing
/llms.txt returned 404. The file is optional. The finding records that it is absent.
Evidence URL: https://example.com/llms.txt