We use cookies
This website (and some of its third-party tools) use cookies. These are important as they allow us to deliver an exceptional experience whilst browsing the site.
By clicking 'Accept', you agree to the use of cookies.
To learn more see our Privacy Statement.
A talk by Sam Gipson
SEO Consultant,
SamGipson.com
Categories covered by this talk
About this talk
The humble robots.txt file (Robots Exclusion Protocol) has been in existence for 25 years and can be hugely influential for SEO. This talk covers an analysis of its current usage by some of the top-ranking sites across key verticals, uncovering some interesting statistics and some of the most common implementation mistakes. It is increasingly important that marketing professionals ensure they are getting theirs right, as Google strives to make robots.txt an internet standard.