News

Microsoft Updates SQL Server 2012, Hadoop Plans

Microsoft inches closer to Hadoop; Denali becomes SQL Server 2012.

• By Kurt Mackie
• 10/12/2011

Microsoft revealed its Hadoop-related plans at the PASS Summit 2011, held in Seattle this week.  The company also announced several changes to product names.

Microsoft's "Denali" product -- its next-generation relational database management system -- will now be known as SQL Server 2012.  The Denali release has been available as a community technology preview (CTP), but the company explained that the solution is now in the "final production stages." SQL Server 2012's released is expected during the first half of next year, Microsoft announced at PASS.

SQL Server 2012 Features

Denali wasn't the only code name dropped.  Microsoft's "Crescent" feature, which simplifies how information workers create data mashups, will not be known as Power View. Microsoft also said it has added a new "touch" capability to Power View that allows users to drill down into data via touch screens.

SQL Server Denali developers who were used to the old "Juneau" code name can now call the integrated development environment SQL Server Data Tools.

Microsoft's new capability for businesses to share data in SQL Server 2012 gets a new code name, "Data Explorer." This feature, which will be available via SQL Azure Labs in November, will leverage the Windows Azure Marketplace, although no details were provided in Microsoft's announcement. Microsoft says Data Explorer provides "capabilities for data curation, collaboration, classification and mashup, opening new capabilities and opportunities around the data that you own or want to work with."

Hadoop Interoperability

Microsoft's ongoing support for the open-source Hadoop technology continues; interoperability is being enabled for Windows Server and Windows Azure. Microsoft is partnering with Apache Hadoop core contributor Hortonworks on the effort. Hortonworks was founded by Yahoo and Benchmark Capital.  SQL Server Certified Microsoft Master Brent Ozar joked in a Twitter feed that "It'd be hilarious if Microsoft ends up buying Yahoo just for the Hadoop expertise."

Hadoop is more than just clustering technology, according to James Kobielus, a senior analyst at Forrester Research.  Kobielus said the technology is "the nucleus of the next-generation enterprise data warehouse in the cloud." He called Hadoop an evolutionary path with . It has storage layer as well as an aggregation and query layer called "Hive." It also has an in-database analytics layer through Map Reduce.

"Hadoop is a petabyte-scalable complex data and analytics staging layer sitting behind an enterprise data warehouse or it can be a standalone data warehouse to some degree," Kobielus said in a phone call. He added that Hadoop is used by early adopters for things like social media analytics. It's used by AOL and Yahoo for ad analytics, for instance.

"Hadoop is an 'in-database analytics' approach, under which complex analytics -- including multivariate statistical analysis, data mining, predictive modeling, sentiment analysis, and content analytics -- are executed in parallel across MPP [massively parallel processing] clusters of distinct processing and storage nodes," Kobielus explained via e-mail. "Hadoop's power enables these functions to be executed with linear scaling across clouds that hold hundreds of petabytes of data and may distribute processing within individual data centers or even wide-area networks."

Kobielus described Microsoft's collaboration with Hortonworks as a key partnership, since that company has been pushing the vision for next-generation Hadoop.

"The Microsoft partnership,…I believe,…is providing professional services and consulting to ISVs and data warehousing companies and others that want to go down the road of Hadoop for big data," Kobielus said. "Hortonworks is very very principled in their commitment to the open source process. All of their development work is contributed back to the Apache open source community. Microsoft has indicated to me that that's a big reason why they're going with Hortonworks."

In the near future, Hadoop distributions will work with Microsoft's PowerPivot business intelligence tools on Windows Server and Windows Azure. Microsoft plans to release a CTP of the Hadoop service for Windows Azure at the end of this year, while the CTP of the Hadoop service for Windows Server is planned for sometime next year. Microsoft will offer code contributions to Hadoop, which is an open source project initiated by the Apache Software Foundation.

Kobielus described the Hadoop work with Windows Server and Windows Server as an "exciting" development.

"Hadoop then becomes the common technology, bridging the parallel data warehouse architecture with the Azure architecture, which are two entirely separate databases for big data," he said. "This is great. I look forward to seeing where they are going in terms of using Hadoop as the catalyzing converge layer between those two Microsoft initiatives."

Microsoft previously released CTPs of Hadoop connectors for SQL Server 2008 R2 and SQL Server Parallel Data Warehouse back in August. The one for SQL Server 2008 R2 has now advanced to "release-to-Web" status and can be downloaded here. Hadoop is typically used to run "big data" business intelligence operations for applications such as supply-chain management, sales analytics, call-center record analysis, Web event analysis, and financial reporting.

Those looking for more information on Hadoop can track Kobielus' work. Yesterday, Forrester published his study, Enterprise Hadoop Best Practices: Concrete Guidelines From Early Adopters In Online Services. Kobielus also is finishing two more studies for publication this month, including one on Yahoo's use of Hadoop and a study on enterprise use of Hadoop for big data applications. Look for a future Forrester Wave study from Kobielus on data warehousing players.

In addition to Microsoft, Hadoop currently is being embraced by Oracle, NoSQL, IBM, Netezza, Teradata, and EMC Greenplum.