What is Screaming Frog?
Screaming Frog SEO Spider is a desktop website crawler. It follows links and collects server responses, metadata, headings, images, directives and relationships between pages. A finding starts an investigation; it is not automatic proof of an error.
Crawl configuration
We define domains, subdomains, URL parameters, user agent, robots.txt handling and JavaScript rendering. Large sites require speed and memory limits. Authenticated areas and test environments are crawled only with permission and separate configurations.
Status codes and indexing
We examine broken URLs, redirect chains, canonical differences, noindex, crawler blocks and sitemap inconsistencies. We judge each case against the intended role of the page. Redirecting an old product may be correct, while blocking a key service can be critical.
Content and internal links
We compare titles, descriptions, headings, content length, images and anchor text. Click depth and internal link counts reveal structure. Analytics, Search Console and XML sitemap data help identify orphan pages that a link-following crawler cannot discover on its own.
Export and verification
We filter findings for development, editorial and SEO work, then compare crawls after migrations or releases. We order fixes by their effect on indexing, users and the business rather than report size. We manually check samples before bulk changes.
Our approach at PAR HOUSE Agency
We combine crawling with checks of databases, sitemaps, language counterparts and measurement. We verify canonical, hreflang, menus, filters and correct category records. Findings become concrete repairs, followed by verification of the actual outcome.
