A nice and very comprehensive list of user-agents (Spiders, Robots, Crawler, Browser) for checking on what is happening in the bot and intelligent agent scene on the Internet. Excellent for webmasters checking their logs to see what bot or agent is visiting their site(s). This has been added to Bot Research Subject Tracer*trade; Information Blog.
posted by Marcus Zillman |
4:10 AM
