Posts Tagged ‘web crawler’

Google Digging Deep into “Invisible Web” to Expand Search Results

May 1st, 2008 by Vipul

Did anyne know that we are unable to access billions of pages of information through normal web searches? Now, in a constant bid to improve coverage of the web, Google has started experimenting with a new technology recently to dig deeper into this so-called Invisible Web.

Google is doing something different as always. It has started exploring HTML forms from high quality site and use it to crawl the URLs that correspond to the query. Sounds interesting!

This move is significant as this comprises a huge part of the web that has never been explored by search engines so far (assuming all the search engines follow this). Could this move mean a lot more information being added to the already crowded web? Now, probably users need to do some more exercise to find the desired results or user might see lots of good and quality results. Who knows!

According to offical Google webmaster blog this move doesn’t impact PageRank for other pages of the same site rather it shall only incrase the exposure of a site to Google. This change also does not affect the crawling, ranking, or selection of other web pages in any significant way.

Share/Save/Bookmark

Sphere: Related Content