The leading search engines, for instance Google, Bing and Yahoo!, use crawlers to locate pages for their algorithmic search benefits. Pages which can be connected from other search engine indexed web pages never must be submitted given that they are located mechanically. The Yahoo! Listing and DMOZ, two main directories which closed in 2014 and 201