In-Depth
Research: Tapping into Unstructured Data
Non-traditional data sources provide value and opportunity for increased performance
by Alan See
Organizations today capture volumes of unstructured data—words in the form of customer comments, survey or claim forms, service records, technician notes, e-mail messages, public records, and a variety of other documents. Corporate strategy is all about collecting information from many different sources, evaluating the probabilities of potential outcomes and then making intelligent decisions concerning the direction of the business. Yet many organizations have remained, for the most part, indifferent to their unstructured data sources (considered by many to represent over 85 percent of an organization’s data) that often reflect the true voice and sentiment of their customers, suppliers, and employees.
In the past, little was done to use this data to better understand the business insight it contained because it fell outside of the well-established structured data filters. Recent Aberdeen research shows that organizations are now starting to prioritize the use of unstructured data. The Aberdeen Group conducted an in-depth research survey that has benchmarked companies’ current and planned direction toward integrating unstructured data with traditional structured information. The findings from Aberdeen’s June benchmark report—"The Convergence of Unstructured and Structured Information: Are You Ready for the UnBI?"—show that the top 20 percent of companies that achieve increased performance (the best-in-class or BIC companies) have several characteristics in common. These companies have also found added value from previously untapped information sources.
In fact, 24 percent of those classified as best-in-class companies rated the convergence of unstructured and structured information as one of their top priorities while 56 percent of BIC ranked it as a high priority. To remain competitive, the best-in-class are leveraging their rapidly growing unstructured and untapped data sources. The ability to transform unstructured data into relational data, and to open up information silos through enterprise search technology, enables a 360-degree view of everything pertinent to the business issue at hand.
Best-in-class companies are 55 percent more likely to have text analytics than the industry average and are 33 percent more likely to have federated search technology in place. By incorporating solutions for both search and analysis of unstructured information, the BIC have improved employee productivity and customer insight, as well as reduced risk.
In fact, Aberdeen’s research supports the improvement sited by BIC companies:
- 68 percent reported greater than 10 percent improvement in time spent searching for knowledge objects (employee productivity)
- 94 percent reported greater than 10 percent improvement in response time to customer demands
- 66 percent reported greater than 10 percent improvement in the ability to reduce risk by preventing harmful events before they occur
- 65 percent reported greater than 10 percent improvement in customer insight ("view of the customer")
While e-mail, MSWord and MSExcel have been the initial sources from which the best-in-class have drawn unstructured data, the BIC are also aggressively investigating and planning future sources from which they will pull unstructured data. Web 2.0 sources such as Web logs ("blogs") and wiki pages lead the way with 28 percent currently evaluating, as well as another 28 percent planning to evaluate.
Information is usually considered a good thing. In fact, as a rule, more information leads to better business decisions. However, to be successful, organizations also need well defined strategies and support in place. Aberdeen’s survey results also showed that the organizations enjoying best-in-class performance shared several common characteristics with respect to their efforts to bring structure to unstructured data:
- 54 percent of best-in-class organizations have had a well defined data management strategy in place. The industry average follows with 31 percent and laggards with 23%.
- 48 percent of best-in-class organizations link their BI initiatives to their overall business strategy. The industry average follows with 31 percent and laggards with 10%.
- 42 percent of best-in-class organizations have a BI center of excellence in place. The industry average and laggards follow with 13 percent each.
The term "Business Intelligence," first used in 1989, is going through a redesign. In fact, one could say the intersection of BI, search, and text analytics will help support its new implied potential. The key lesson to appreciate is that valuable information may be found in nontraditional sources.
The report is available for free download but only for a limited time; visit http://www.aberdeen.com/link/sponsor.asp?cid=4114
- - -
Alan See is SVP at AberdeenGroup and also serves as an associate faculty member for the University of Phoenix College of Business and Management. He can be reached at alan.see@aberdeen.com.