Web crawler

(redirected from Webcrawlers)

Web′ crawl`er

Computers. spider (def. 6).
Random House Kernerman Webster's College Dictionary, © 2010 K Dictionaries Ltd. Copyright 2005, 1997, 1991 by Random House, Inc. All rights reserved.
robot d’indexation
References in periodicals archive ?
Metasearch engines are also called metacrawlers or webcrawlers. Popular metasearch engines with privacy features include DuckDuckGo and Ixquick as previously discussed.
Later in this article we'll discuss why sometimes it's best to use a webcrawler SE, a specialized SE, an academic SE, or a search portal.
webcrawlers driven by 'relevance' principles, drop-down menus, larger databases, automatic search term/phrase correction feedback, individualised search histories, etc.) that have meant users get the most out of searching without fully comprehending much about the underlying mechanics of WSE's.
(4.) Furthermore, it is increasingly likely that WebCrawlers will be able to harvest enough information from the Internet to automate evaluation and comparison of products, based on their environmental impact, and then link this evaluation to certification standards (Foster, n.d.).
The internet has spawned an entire industry dedicated to the "harvesting" of public information by use of webcrawlers, "scrapers" and other programs.
He added a variety of Webcrawlers on appropriate Web sites, and people started tuning in by logging on.
When we want to detect copyright violations in an image archive or in images posted on the Internet, we can use software agents, such as Webcrawlers, to perform identity checks for as many images as we can locate.
The WEBCRAWLERS and ALTAVISTAS of the world are information herbivores; they graze on Web pages and regurgitate them as searchable indices.
Of primary interest here, description and metadata encompass new and familiar issues: document description by creators, HTML extraction (webcrawlers), library descriptive cataloging, MARC practices and multiple schemes, GILS and TOPNODE, authority files, the mixing of controlled and uncontrolled vocabularies, access to nontextual media, and the complexities of description for aggregate objects and information spaces such as databases and newsgroups.
Petitcolas [6] at Cambridge University's Computer Laboratory (now implemented in the public-domain program 2mosaic) to foil automated Webcrawlers (see Figure 3).