Open Source Tool Connects Mainframes to Spark Big Data Analytics

Syncsort open sourced a tool that connects data residing on IBM mainframes to Apache Spark for real-time Big Data analytics.

Using Spark SQL, developers can query IBM z Systems to analyze data without first having to offload the data, according to the "spark-mainframe-connector" page on Spark Packages, a repository of tools maintained by Apache Spark commercial steward Databricks Inc. The connector is available on GitHub.

"Syncsort's open source contribution makes it easy to get real-time insights from mainframe data using Apache Spark's advanced analytics capabilities and Spark SQL interactive queries," said Syncsort exec Tendü Yoğurtçu, in a statement last week. "We believe that Apache Spark will play a critical role in a wide variety of next-generation use cases, including streaming ETL and the Internet of Things. We will continue to contribute to Spark and related Big Data projects to enable a uniform user experience for batch and real-time workloads across all data sources."

About the Author

David Ramel is the editor of Visual Studio Magazine.