Why Yandex? - Post ID 223634
Why was Yandex selected as one of the three search engines to submit to? It ignores every robots file and rule you set.
I have them blocked several different ways in my htaccess file and robots.txt file and they STILL ignore all the rules set for them. This is one of the worst bots out there. Am I missing something?
I have them blocked several different ways in my htaccess file and robots.txt file and they STILL ignore all the rules set for them. This is one of the worst bots out there. Am I missing something?
Yandex is a Russian Internet company which operates the largest search engine in Russia with about 60% market share in that country. It also develops a number of Internet-based services and products. Wikipedia
Stock price: YNDX (NASDAQ)$43.14-0.01 (-0.02%)
Headquarters: The Hague
Founded: 2000
http://www.coffeecup.com/forums/sitemapper/why-yandex/
Stock price: YNDX (NASDAQ)$43.14-0.01 (-0.02%)
Headquarters: The Hague
Founded: 2000
http://www.coffeecup.com/forums/sitemapper/why-yandex/
Learn the essentials with these quick tips for Responsive Site Designer, Responsive Email Designer, Foundation Framer, and the new Bootstrap Builder. You'll be making awesome, code-free responsive websites and newsletters like a boss.
I know who they are, Scott. It's their blatant disregard for the robots file that irks me and many other site owners.
China's Baidu spider is just as bad. totally ignores robots file and bashes through forbidden directories unless you outright ban the thing. Both are favored by spammers who like to hit forums and try to sell drugs and counterfeit handbags and shoes
China's Baidu spider is just as bad. totally ignores robots file and bashes through forbidden directories unless you outright ban the thing. Both are favored by spammers who like to hit forums and try to sell drugs and counterfeit handbags and shoes

Twitchin Kitten wrote:
I know who they are, Scott. It's their blatant disregard for the robots file that irks me and many other site owners.
China's Baidu spider is just as bad. totally ignores robots file and bashes through forbidden directories unless you outright ban the thing. Both are favored by spammers who like to hit forums and try to sell drugs and counterfeit handbags and shoes
I know who they are, Scott. It's their blatant disregard for the robots file that irks me and many other site owners.
China's Baidu spider is just as bad. totally ignores robots file and bashes through forbidden directories unless you outright ban the thing. Both are favored by spammers who like to hit forums and try to sell drugs and counterfeit handbags and shoes

I have not had any issues like that. They have always not indexed whatever I setup.
http://help.yandex.com/webmaster/contro … ts-txt.xml
Learn the essentials with these quick tips for Responsive Site Designer, Responsive Email Designer, Foundation Framer, and the new Bootstrap Builder. You'll be making awesome, code-free responsive websites and newsletters like a boss.

Have something to add? We’d love to hear it!
You must have an account to participate. Please Sign In Here, then join the conversation.