Performance Evaluation of a Regular Expression Crawler and Indexer


ICOMP12, Internet Computing 2012, United States Of America, 01 July 2012, pp.33-39

  • Publication Type: Conference Paper / Full Text
  • Country: United States Of America
  • Page Numbers: pp.33-39


This study aims to find a solution for the optimization of indexer and crawler modules of a search engine if the possible varieties of the search phrases are previously known as a regular expression. A search engine can be considered as an expert in any area if the search domain is narrowed and the crawling and indexing modules are optimized according to this domain. A general expertise of the search engines can be modeled with regular expressions like searching only emails or telephone numbers on the Internet. This paper mainly discusses several alternatives on an expert search engine and evaluates the performance of several varieties.