Feature Announcements

Robots.txt Change Tracking by ContentKing

  • February 14, 2018
  • Veronika Martosova

Change tracking for robots.txt is here!

We've always been very proud of our change tracking technology. A single click is all it takes to see changed, added, removed and redirect pages.

Today, we bring that same power and intuitiveness to tracking your robots.txt files!

ContentKing - robots.txt change tracking

How it works

ContentKing continuously watchdogs your robots.txt file. As soon as a change is detected, it saves the new version and provides you with a clean and focused overview of exactly what happened.

Why this is so important

The directives in your robots.txt file (opens in a new tab) are like a crawling manual for search engines. It may seem weird, but a single mistake in the robots.txt file can completely remove your website from search engine results!

ContentKing has always tracked the accessibility and indexability of your website's pages, but on top of that it now also tracks every single change in your robots.txt directives so you can quickly and easily determine what changed and whether you need to take action or not.

A time machine for your robots.txt file

In the robots.txt section on the Platform screen, you'll find a new button:

ContentKing - robots.txt

Click that to view the current contents of the robots.txt file, marked up with syntax highlighting to make it easily readable.

ContentKing - robots.txt compare

From there you can click on the Compare button to switch to Change Tracking view.

ContentKing - robots.txt change tracking

Now you can compare any version you want by selecting a snapshot from the dropdowns at the top:

ContentKing - robots.txt date
Veronika Martosova

Veronika is ContentKing's Product Manager. She loves talking to our customers to understand their needs and then work with the development team to come up with the right solutions to them. She enjoys working on the intersection of design, development, marketing and business.