by Greg
April 27, 2006
Search
When I originally started this blog, I required users to register in order to comment. However, there seemed to be a bug in WordPress that caused the registration function to fail for some people. Rather than track the problem down, I just switched to running everything in pre-mod mode.
Unfortunately, the level of comment spam has [...]
More →
by Greg
April 23, 2006
Search
Just incase you missed it, Matt is back from Boston and has posted an indepth explanation of Google’s new crawl caching proxy. (The system that is responsible for Mediabot fetching pages).
Matt’s diagram pretty much matches what we’ve been seeing, although I still think there might be some issues regarding robots.txt, but we’re still collecting some [...]
More →