The nutch search engine should be installed and configured to crawl a list of pre-selected URLs. Admin should be able to add and remove URLs to be crawled in the search engine. An example of a site who has used nutch and the system to crawl the web is mozdex.com.The wedding search engine will only crawl these wedding sites, which have been selected by admin. URLs from the directory submissions should be inserted in queue for admin to approve if they will be crawled too. Sites can be crawled completely or in part.

Спасибо заранее:o)