Home | SEO

MSN launches new spider

Alex Christie

15 December 2008

Now I know that MSN Live is not everyone’s search engine of choice. Far from it, according to Hitwise data published in E-consultancy’s December Internet Compendium. MSN captured only 3.7% of the overall search market in the UK, dropping from 5.7% a year ago.

In spite of the small market share if you are getting traffic from MSN Live then you may be interested to hear that MSN released their new crawler called msnbot/2.0b last Friday. After a period of testing the new bot is set to replace the current one – charmingly named msnbot/1.1 (+http://search.msn.com/msnbot.htm) – as Live Search’s primary user agent.

The new spider will respect the robots exclusion protocol so no need to update your robots.txt file.

LEAVE A COMMENT

IF YOU LIKED THIS POST, YOU MIGHT ALSO LIKE THESE:

Does Ask.com bring traffic?

Finding accurate traffic statistics about search engines is not an easy task. It all depends on who is...

Spider Pig on Fun Friday

Getting a wee bit nerdy here... Ahead of the release of the Simpsons Movie on DVD we thought we would...

The Big getting Bigger

And the small smaller As has become expected Google has come out as the most used search engine in the...

The impact of a Google penalty

A Hitwise report on Go Compare One thing we are often asked is what would the result be of a penalty...

Google increases market share in US

Google hits 60% for first time Results from Comscore here show that Google has over 60% of the US search...

Grab This Widget