The rollout of Slurp 3.0 officially began Monday and is expected to take several weeks. Among the changes caused by the upgrade would be crawling from a different and much smaller set of IP addresses, but still from the crawl.yahoo.net domain.
Yahoo said the crawlers also would publish a new user-agent, Yahoo Slurp/3.0. Existing robots.txt directives for "Slurp" or "Yahoo Slurp" would still work, but the new crawler would not recognize directives specific to "Slurp/2.0." However, Yahoo said usage of the latter user-agent is "very rare on the Web, so you won't likely be affected."
Yahoo has set up a help page for more details. The changes are expected to affect the main Yahoo Web Search crawlers.
Research from Web analysis firm Hitwise show that users of Yahoo search are often younger and spend less money online than people who prefer Google. Web searchers who use the latter are most likely to have spent more than $500 online, according to Hitwise.
Yahoo is battling a $40-plus billion takeover bid by Microsoft. Yahoo has recently taken actions that make it more difficult for Microsoft to succeed. The software maker, however, has said it is prepared to launch a hostile takeover.
Stay connected and informed by visiting the CA Solutions Center Community!

Become a member today for instant access to free InformationWeek research, expert advice, peer perspectives, and more on the following topics:
- Application Performance Management (APM)
- Security Management
- Mainframe 2.0
- IT Automation
- Service Assurance
Also, visit our Government and Financial Services groups to see how these technologies apply specifically to those industries.
NOTE: Offer valid for U.S., U.S. possessions, & Canada only.