Spiders actually is a program that visits web pages, goes through information and would add it to a search query.
So let's say someone looks up tips to help with their game crashing, they would get get correlating threads with the same/similar issue. It's pretty simple, but that is what a spider does as far as I can tell
