Thread: Spider Vs. crawler

I just want to know that what is the difference between spider and crawler?


As per my view both are the same thing.

Here Is All You Need

Spider - a browser like program that downloads web pages.

Crawler – a program that automatically follows all of the links on each web page.

Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.