Please do not spider search results in an automated fashion. It can generate significant system load.