Web crawler

Also found in: Encyclopedia, Wikipedia.

Web′ crawl`er

Computers. spider (def. 6).
Random House Kernerman Webster's College Dictionary, © 2010 K Dictionaries Ltd. Copyright 2005, 1997, 1991 by Random House, Inc. All rights reserved.
robot d’indexation
References in periodicals archive ?
A proprietary web crawler, named Lookster Bot, will offer comprehensive website indexing and ranking of web pages providing wide-ranging searches that encompass all corners of the internet.
Discovering the logic and structure of an interface is similar to sitemap discovery with a traditional web crawler, and the discovery is extremely helpful to the content collection logic.
These are: Google, Google scholar, Bing, Yahoo, Blekko, Ask and web crawler. Each of the major search engines, on which the researcher will focus provide some characteristics that enable users get peculiar benefits.
Distributed web crawler is a program which crawls Web resources on the Internet according to some rules and provides the obtained network information to search engine.
Automatically publish Distributed Lists of Sellers (DLS) to subscribers: Ads.txt Plus eliminates the need for programmatic buyers to develop and run a web crawler by using an ads.txt aware smart contract.
Dikaiakos, "Real-time web crawler detection," in Proceedings of the 201118th International Conference on Telecommunications, ICT 2011, pp.
Overall, there is nothing that would stop us from recommending Spider-Man Homecoming to all you fans of the web crawler. In fact, it's a great entertainer even for all those who might not have followed the previous films.
Altavista, web Crawler, Yahoo(1994): it was the first search engine which provids the access to the user to insert and delete the queries with in some given time.
The publication reports that at least one recent draft of the script drops clues that clearly indicates she will be playing one of the most popular love interests of the web crawler. The same role was played by Kirsten Dunst in Sam Raimi's trilogy.
Selamat, "An architecture for a focused trend parallel Web crawler with the application of clickstream analysis," Information Sciences, vol.
These comparisons are done using a code they developed (referred to as Web Crawler), which browses retail sites for indexing.