Crawler and Scooter : Major Shift in Meaning

Shikha Saxena
DataDrivenInvestor
Published in
4 min readFeb 11, 2021

--

Computer Program that crawls on websites to collect, store and index information

Photo by Vidar Nordli-Mathisen on Unsplash

Web Crawler and Scooter are names given to the computer search engine programs which utilize specific algorithms to move or crawl on the data of new and updated web pages, as submitted by owners to read, collect and store data until all pages and links are read; and improve the search engine results by…

--

--

A Technical Writer, an artist and blogger by choice. Passionate about reading , writing and editing, NY.http://www.shikhasaxena.com and https://www.dnabox.co/