We know that all major search engines below respect the robots.txt file:
- Google (documentation)
- Bing and Yahoo (documentation)
- Yandex (documentation)
- Baidu (documentation)
- DuckDuckGo (documentation)
Keep in mind though, each search engine interprets robots.txt files slightly different!