#Crawling
Crawling is how search engines discover and download the pages of a website. Articles tagged here explain how crawlers find URLs through links and sitemaps and how they decide what to fetch again. They cover crawl budget, crawl traps, server errors and slow responses. Each guide shows how to see your site the way a crawler sees it. You will learn which fixes make crawling faster and cleaner. A page that is never crawled can never be indexed or ranked.
20. 11. 2026 · Čtení: 8 minCancel a Running SEO Check: When and How to Stop It
How to stop a queued or running check in Site SEO AI Audit, where the cancel buttons are, what happens to your allowance and…
20. 11. 2026 · Čtení: 8 minNofollow Internal Links and Empty Anchors: Report Fixes
What “Nofollow on internal links” and “Links without text” mean in Site SEO AI Audit, why the crawler skips nofollow links, and how to…
20. 11. 2026 · Čtení: 8 minContent Needs JavaScript: The AI Visibility Warning
What the “Content needs JavaScript to appear” warning in Site SEO AI Audit means, which pages trigger it, how to test your own pages…
19. 11. 2026 · Čtení: 8 minBroken External Links: Fix Outbound Links From Your Audit
How Site SEO AI Audit lists outbound links that lead to dead pages, why a warning matters for trust, and how to replace, remove…
19. 11. 2026 · Čtení: 8 minrobots.txt Blocks the Whole Website: The Critical Alert
Why Site SEO AI Audit caps your score at 20 when robots.txt blocks the whole website, how a staging setting causes it, and the…
19. 11. 2026 · Čtení: 8 minPages Return 4xx Errors: Clear Dead Ends From Your Report
What the critical “Pages return an error (4xx)” finding in Site SEO AI Audit means, how the crawler finds those pages, and how to…
18. 11. 2026 · Čtení: 8 minSite SEO AI Audit vs Site AI Audit: Which One Do You Need?
How Site SEO AI Audit differs from the Site AI Audit health check: what each checks, where they overlap and which fits your question…
17. 11. 2026 · Čtení: 7 minSitemap Problems: What the Audit Flags and How to Fix
How Site SEO AI Audit checks your XML sitemap: a missing sitemap, broken or noindex addresses, orphan pages and the sitemap column, with a…
16. 11. 2026 · Čtení: 7 minOrphan and Deep Pages: Fixing Weak Structure in Your Report
How Site SEO AI Audit finds orphan pages, pages buried more than three clicks deep and pages with a single internal link, and how…
16. 11. 2026 · Čtení: 8 minRedirect Chains and Links to Redirects: Audit Fixes
How Site SEO AI Audit reports redirect chains and internal links that point to redirects, and how to trace each hop to the final…
15. 11. 2026 · Čtení: 8 minAuditing Large Websites: Up to 10,000 Pages per Check
How to use Site SEO AI Audit on a large website: what up to 10,000 pages per check means, how long a crawl takes…
14. 11. 2026 · Čtení: 8 minThe Page List in Your SEO Report: What Each Column Means
How to read the page list in a Site SEO AI Audit report: status, indexable, depth, links in, words, title length and sitemap, and…