A few days ago, I installed the WordPress Global Translator plugin. Since then I've noticed a lot of new spiders/bots coming in, which I suppose is normal.
However, one bot in particular, the Baiduspider bot, is disregarding the robots.txt instructions by going where it should not go. The disallow instructions I placed in the robots.txt file for the bot don't work, either. The bot is also using a number of different IP addresses, so I'm not sure the IP address could be used to deny it access.
I've read that Baiduspider is a search engine from China. One of the translations I set up with the plugin was the Simplified Chinese translation.
I hope Baiduspider is not scraping my site, but it seems to be visiting every nook and cranny, including image folders. My site is a photo blog, so I'm concerned about my blog photos getting swiped on a large scale by this bot.
Every time I check the "Latest Visitors" section of my CPanel, Baiduspider is either currently on my site or has recently been back. It's been coming and going a lot within the last few days.
Can anyone offer some insight on the Baiduspider bot and what, if anything, can or should be done to deny it access to my site? I'd like to think it's a harmless bot. Even is it is harmless, I still don't like the fact that it's disregarding the robots.txt file. Should I be concerned about this bot?
Thanks for any assistance.