The Invisible Web Revealed


Is there an invisible web?

Did you ever think how much time and effort was required for a web page to be the first when you perform a certain search? When you need information and you seek for it with search engines such as Google, Yahoo, MSN or whatever other, the results are brought to you through an automatic process of matching your search phrase or keyword with sites containing it. But in order for this to happen, those sites need to be visited by robots and indexed beforehand. In order to help robots correctly indexing a site, I, the webmaster, need to put some info there especially for those programs, so called ‘robots’. If I don’t to it properly, you won’t reach my site, regardless how useful it might be to you in that situation. Or if all my relevant info is published as photos, the search engines won’t find my site for you, because robots can’t read photographs, they know only how to handle text information. Nor robots know how to read pdf files. Nor databases. All info you cannot reach by classic searches is the so called invisible web.


How to see the invisible web?

You might want to ask now: so, if there is an invisible web, how can we reach it, though? Besides portals and directories, invisible or deep web, and specialized search engines, social bookmarking sites must be mentioned here.

Invisible web resources

There are many resources available for deep invisible web exploration. For the curious ones, here there are a few of the best ones:

In the article How to Search the Invisible Web, Lifehacker teaches us the basics of a better targeted deep web search.

If you want to know more on specific topics, you can follow the online courses from free-ed. All courses are free and very easy to subscribe to.

The Berkeley University has a comprehensive guide of invisible web: what it is, how to find it and its inherent ambiguity.

At the Web Lens you can find a lot of invisible web research tools which students and researchers might find useful.

Eric Digests present some interesting facts and references for further reading. The article is rather old, but still good.

A thorough, illustrated description of the web search process can be found at JEP (The Journal of Electronic Publishing published by the University of Michigan Press).

This being said, remember to go for the deep web whenever you get frustrated by the surface web search results.

This entry was posted in Tech & Internet and tagged . Bookmark the permalink. Post a comment or leave a trackback: Trackback URL.

15 Trackbacks

  1. By All Tips and Tricks » I, the Robot… on September 29, 2006 at 10:42 am

    [...] The invisible web revealed [...]

  2. By All Tips and Tricks » Female Photography on October 5, 2006 at 3:42 am

    [...] Other articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Enjoyed? Bookmark this page now to see it laterThese icons link to social bookmarking sites where readers can share and discover new web pages. [...]

  3. By All Tips and Tricks » Auditioning the Internet on October 6, 2006 at 6:42 am

    [...] The invisible web revealed [...]

  4. [...] Other articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP [...]

  5. [...] Other articles: How to buy a new mobile phone The invisible web revealed Stay fit and healthy with summer diets Cholesterol friendly foods 10 car rental tips and tricks [...]

  6. [...] Other articles: How to buy a new mobile phone The invisible web revealed Stay fit and healthy with summer diets Cholesterol friendly foods 10 car rental tips and tricks [...]

  7. [...] Other articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to write faster in MS Word How to use macros in MS Excel [...]

  8. [...] Other articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to write faster in MS Word How to use macros in MS Excel [...]

  9. [...] Other articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to write faster in MS Word How to use macros in MS Excel [...]

  10. [...] Year 2006 is almost gone, and this blog celebrates its first 5 months of existence. It started on blogger, then moved to its own domain after a couple of weeks and some tens of posts. It survived one Fark, three StumbleUpon Buzz entries, and two Netscape front page entries. After the experience of a cheap webhosting, on poor servers, warned every week that it takes too much of the server’s resources, All Tips and Tricks moved from that small, local webhosting company to Dreamhost, a great place to host your sites. Besides, I got a promo code which gave me a good discount. For those of you who are interested in getting a hosting plan with Dreamhost, you can use the code ATT2007 to get a 50$ discount for one year plans, or 20$ discount for monthly plans. [...]

  11. By Two Quick Windows Tricks » All Tips and Tricks on November 2, 2007 at 2:46 pm

    [...] articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to [...]

  12. [...] articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to [...]

  13. By Needs based selling » All Tips and Tricks on November 4, 2007 at 5:44 am

    [...] articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to [...]

  14. By SATBlog Goes Live Online » All Tips and Tricks on November 4, 2007 at 6:32 am

    [...] articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to [...]

  15. By Powerbacks Finally Goes Free » All Tips and Tricks on November 4, 2007 at 6:34 am

    [...] articles: Dr. Jekyll or Mr. Hyde? It depends on perspective The invisible web revealed Data validation in MSExcel The hidden face of MS Excel Get more productivity with Windows XP How to [...]

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Subscribe without commenting


  • Get your FREE tips and tricks:

    Delivered by FeedBurner