Daily SEO Tips: Exclude Folders on Screaming Frog

Welcome to Casey’s SEO. Today for our daily SEO tip, I’m going to show you guys how to exclude different URLs or folders using Screaming Frog if you need to run a website audit. So we’re going to jump over the computer once you guys go ahead and open up Screaming Frog. Let’s just say you have an ecommerce site that has maybe 30,000 or 40,000 different URLs. You can go ahead and exclude any of those folders or URLs that you know are going to be an issue.

So all you have to do is go to the configuration, scroll down to exclude, and then you can go ahead and put your URL and then anything after that URL to go ahead and exclude those from your search. Really simple. And if you actually need to make sure you include a folder, you’re going to go back to that configuration, you’re going to go include, and then you can type in that URL and folder from there. So that was it for today’s tip. Just remember, if you’re using Screaming Frog and you’re trying to run a website audit on a very large site, you will definitely want to exclude some different folders because you may end up with millions of different URLs, especially if search results are getting pulled into it.

It’s basically just a continuing dynamic URL generating machine and you do not want that. So if you guys have any questions or need any help, please let me know in the comments below. I would love to help you guys out. And until next time, make sure you hit that subscribe button. For more daily SEO tips.