How to find additional search sites and directories. There are many websites that serve as launching portals into the unindexed portion of the web. Looking back to http://lowertownstpaulmn.com/2016/08/what-is-the-invisible-web/ where we learned about the invisible web, we found that most of the regular search engines cannot get information from the invisible web. It requires a different approach.
The different approach is to use specialized directories and search engines. Many of the portals into the deep web are through governmental or academic sites. These can provide an opening into the part of the web that is estimated to be 500 times the size of the indexed web. That’s right, 500 times larger.
So if you didn’t find the information you were looking for using Google, Bing or Yahoo, now you know where to go. Dive into the deep web. NOT the dark web, the deep web that is many time larger than that web of the questionable and/or illegal.
Most of the Directories and web sites listed below are indexed by the big 3 search engines. But to go further into the databases you need to engage with the home or index pages of that site. Some are as easy to use as the regular search engines and others have a bit of a learning curve. Most have “Help” pages.
The 11 listed are just a very small sampling of what is available.
Information Please has been providing authoritative answers to all kinds of factual questions since 1938—first as a popular radio quiz show, then starting in 1947 as an annual almanac, and since 1998 on the Internet at www.infoplease.com.
A non-profit free library. The very extensive collections include 10 million texts, 2.6 million movies, 3 million audio items, 140 thousand items of software, 1.2 million images and much more. It’s a real gold mine. Go take a look.
Free and Subscription
Quandl is a Data Platform that brings together over 20 million financial and economic datasets from over 500 publishers on a single comprehensive open data platform. Data on Quandl is divided into databases. Each database covers a different subject. All open databases on Quandl are completely free to use. There also is a pay premium section.
As a national nonprofit organization of the States, SEARCH is the premier resource for collecting, sharing, and analyzing innovative and timely knowledge, information, best practices, services and solutions for justice information sharing.
The Directory of Open Access Journals was launched in 2003 at Lund University, Sweden, with 300 open access journals and today contains ca. 9000 international open access journals covering all areas of science, technology, medicine, social science and humanities.
Subscription search software
Deep Web Technologies provides a single search box to access all of your subscriptions, digital catalog and public resources.
The first place to search for U.S. government data is the portal https://www.usa.gov/ the entry point to the databases of the many agencies and entities of the federal government. A good question and answer format with a search box.
The Library of Congress includes:
https://www.congress.gov/ which holds the information of the legislative branch of the federal government.
http://copyright.gov/ the U.S. Copyright office and
https://catalog.loc.gov/ , the online catalog of the Library of Congress.
Developed by MIT Media Lab and Datawheel, backed by Deloitte. Open government data is important because the more accessible, discoverable, and usable data is, the more impact it can have.
Science.gov searches over 60 databases and over 2200 selected websites from 15 federal agencies, offering 200 million pages of authoritative U.S. government science information including research and development results. Science.gov is governed by the interagency Science.gov Alliance.
Multilingual WorldWideScience.org provides real-time searching and translation of globally-dispersed multilingual scientific literature. The WorldWideScience Alliance, a multilateral partnership, consists of participating member countries and provides the governance structure for WorldWideScience.org.
There are hundreds more directories and search engines on the web. I have listed only the ones that I use and can recommend to you. The sites that I have listed were all operational at the time that this was written. Over the last 2 years several really good predecessors died and no longer exist. I’m sure there will be more resources available to service the growing need to find on-line information.
In doing the research to write this series on web search, I have become more interested in the concerns of our senior citizens. Probably because I am one of them.
The horror stories of fraud and abuse were brought home when the IRS notified me that someone had filed for my Federal tax refund before I did. Going through that mess was something that I don’t want to repeat. Researching that situation has brought me to write my next series on “Fraud against Seniors” Maybe we can work together to help others we know how to avoid even worse experiences. I will post the first of that series on August 30th, 2016.