Here's the difference between Spider, Crawler & Robots
Spider - The browsers are like a program and to download the web
page.
Crawler – The program is automatically to follow the links are
web page..
Robots - It had automated computer program can visit websites.
It will guided by search engine algorithms It can combine the tasks of crawler
& spider helpful of the indexing the web pages and through the search
engines.