Do You Have Gray Data?

The Gray Web -- Hidden in Plain Sight

There are many who have commented on the differences between the "visible web" and the "hidden web." The hidden web is commonly defined as "the publicly accessible pages on the World Wide Web that are not indexed by search engines." To these two webs (visible and hidden) we should add a third web -- the Gray Web. By this I mean publicly accessible pages on the web that are not usefully indexed by search engines today. The Gray Web is both dark and visible at the same time. The Gray Web is composed of the structured data and the timely or rapidly changing data not well supported by most of today's search engines.