Firstly, electronic search is a type of electronic communication. A very important type.
The founders of Google couldn't get folk to see the importance of search, so they had to start the Co. themselves. Now we all see it.
How is search evolving?
Initial generation - You index the web, and lay-out the matches. Problem is the web is growing so quickly.
Google's innovation - You use the information on the pages you're indexing to assign order to the results. More a page gets referred to, the higher it ranks: This really made web search a whole lot more usable. But the whole web is no longer simple, plain html pages; often there's a web application using the web page as its interface. So we have problems with information that doesn't get indexed - the dark web.
Challenge 1: Explosion of real-time, highly cross-referenced data.
What else could we do? - How do we deal with the near real-time information being generated on the web? This is today's challenge, and the internet growth continues, and will continue to, explode.
Challenge 2: Incorporating the dark web.
The dark web (the stuff that doesn't come up in today's Google search results) would be great to include. It's a world we can hardly imagine now, but that doesn't mean it isn't possible. Today's searching is too vertical. You want to know the flights from Melbourne to Sydney tomorrow a.m. You can' t get that directly from Google search. It directs you to a vertical search engine of a travel agent, perhaps a few agents, and you search again using their forms. Not great. Want to know the best price on a new VW golf in Melbourne. Again you'll get directed to a specialised site to return those results, not directly from Google.
Guess Google could recognise searches of that type and, with appropriate arrangements with the 3rd-party site, properly designed and configured, use an API to get the results, and display them directly. I don't mind the single-click one needs to do for the best price on a retail item, but navigating travel agent / airline sites is a pain - and I think intentionally so. Also, the 3rd-party wants you to use their sites. This is their currency. If they saw the value of exposing an API instead of their page, great. But they don't. Firstly, they would have to charge for use of the API, and I'm not sure Google is rushing to do that. Secondly they don't get advertising revenue from use of the API. My advise to them is that their best strategy is to have the information available as a single click from the Google search engine, and I'll learn to use their site rather than their competitors.
Challenge 3: New paradigms for search. New domains
Google search is searching for "the internet web page" where you can continue your search/reading. It's domain is the entire (light) web.
Type in to Google "price ipod nano" and you'll get first the Apple web-site. OK, the manufacturer should be first. They'll have the most information, and the most references will be to their site. Next though is the shopbot.com.au site, for me anyway. And that site, one click away, has the prices from the major on-line vendors. Then, Buyer Beware, it helps if you know a little something about the sites.
So we have
- 1. Searching for "the most popular internet web-page".
- 2. Searching for "the price of a retail item".
Here is another, with another domain,
- 3. Searching for "the quantative data" for mathematics, physics, engineering, chemistry, other sciences, economics, etc.
wolframalpha. comes from the author of Mathematica. But it's not just mathematical searching it provides. More quantitative searching. You want to know the statistics of a thing - a stock, a country, a place, it'll give you nicely formatted information. Give it two, and it'll compare them also. Oh yes, and it'll digest just about any math you want to give it also.
I reckon this site could nicely expose an API that could be accessed by Google. Will it. I don't think so. Not unless Google buys it. I hope it does, and it could be a great move for the Co.
The Information a search engine returns
- Google: The popularity of a web-page for a given subject
- WolframApha: The quantative information of a subject
- Shopbot: The prices of a consumer item.
The information available from dedicated application (non-search) pages
- wikipedia: The description of a thing.
- Qantas: The prices and availability of their flights.
Challenge 4: Integration with Vertical Search Engines.
The challenge here is that mentioned in the other article on integration of web services (SOA): Technically it isn't too difficult, but corporately, it has it challenges. Google is earning from advertising revenue now. I reckon they'll stick with integrating with their own Co.s. So if they want better integration with retail pricing web-sites, they'll buy one, and integrate with it. A lot easier.