Screaming Frog SEO Spider tutorialHow to Set Up Custom Extraction in Screaming Frog
Learn how to set up custom extraction in Screaming Frog, including the settings to confirm before you use the result.
Quick answer
The quick answer
extract structured page data in Screaming Frog with CSS Path, XPath, or regex Start in Configuration > Custom > Extraction, use the settings that match the question you are answering, and validate the result before changing a campaign, report, or website.
Visual guide
The Screaming Frog SEO Spider path
Click through the real product screens used in the steps below.
Step-by-step
How to Set Up Custom Extraction in Screaming Frog
- 01
Open Configuration > Custom > Extraction
Open Configuration > Custom > Extraction and select the project, account, property, or crawl target that owns the data for this task.
- 02
Confirm the scope before changing anything
Check the selected target, date range, location, device, audience, or crawl configuration. Test the extraction expression on representative pages before running a full crawl.
- 03
Configure the task-specific setting
Use the relevant control to set up the task. Keep the configuration focused on one question so the result remains interpretable.
- 04
Review the extraction column and a sample of matched pages
Read the output with the active filters and comparison context in view. Inspect a representative row, page, event, or contact before drawing a conclusion.
- 05
Save the useful view and document the decision
Save the report, segment, configuration, or export when the product supports it. Record what changed and why so the next review has context.
Read the report
What the main metrics mean
URL
The page address discovered during the crawl.
Status code
The server response that helps identify errors, redirects, or successful pages.
Source
The page, sitemap, analytics source, or configuration that revealed the URL.
Crawl configuration
The settings that define which URLs and page resources are included in the crawl.
Before you continue
- Confirm the project, property, account, or crawl target before making changes.
- Use the location, device, date range, or audience that matches the decision you need to make.
- Check the result against the underlying data before reporting it or acting on it.
- Document the change so the next review has useful context.
FAQ
Common questions
What do I need before I start in Screaming Frog SEO Spider?
You need access to the relevant Screaming Frog SEO Spider account and the project, property, audience, or crawl target for this task.
Why does my result look incomplete?
Check the selected target, date range, location, device, permissions, and filters. These settings often explain an unexpected result.
Can I change this setup later?
Most settings can be changed, but changes can affect how future data is collected or displayed. Record the original setting before replacing it.
What should I validate before using the result?
Confirm that the setup matches the real question, then review the source data and a representative example before sharing the result or taking action.
Sources and further reading
This guide was checked against Screaming Frog SEO Spider product documentation:
Reviewed by Filipe Lins DuarteCo-Founder & CEOVast experience talking to customers and users to understand what good software looks like. Background spans commercial and product roles.
Checked by John RiceCo-Founder & CTO15+ years building tech products and web applications. Conducted hundreds of user interviews to know what a good product looks like.
Every Marketraa page follows our editorial standards.