Index Bloat from Legacy/Hacked Pages Is a Crawl-Budget Black Hole With No Way to Diagnose or Purge It at Scale

Summary

Site owners inherit sites with 1.6M URLs where only 150–200 are real pages (8.86k indexed, 1.58M not indexed) — residue from old builds and a cleaned-up Japanese keyword/doorway hack. They cannot tell which junk URLs still exist, which are still being crawled, or why. Standard remedies fail in practice: 410s 'don't seem to make any difference,' GSC removals are rate-limited and temporary, and robots.txt blocking conflicts with noindex so pages linger. Existing SEO checkers report index counts but do not diagnose the *composition* of index bloat (which URL patterns, which are hack residue, which waste crawl budget) or generate a prioritized purge plan (410 vs noindex vs canonical vs robots) that they can execute and verify. The result is a permanently degraded crawl budget and stalled rankings on the pages that matter — with no tool that closes the loop from audit to verified de-indexing. Highly painful, high-intent, and unsolved by free or paid audit tools.